-- Logs begin at Sat 2021-12-25 20:01:33 UTC, end at Sat 2021-12-25 22:38:39 UTC. -- Dec 25 20:43:55.095557 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Dec 25 20:43:55.105328 ncdv-master-1 devstack@keystone.service[96725]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 25 20:43:55 2021] *** Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: nodename: ncdv-master-1 Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: machine: x86_64 Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: clock source: unix Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: pcre jit disabled Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: detected number of CPU cores: 4 Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: current working directory: / Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: detected binary path: /usr/bin/uwsgi-core Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: your processes number limit is 47680 Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: your memory page size is 4096 bytes Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: detected max file descriptor number: 2048 Dec 25 20:43:55.106551 ncdv-master-1 devstack@keystone.service[96725]: lock engine: pthread robust mutexes Dec 25 20:43:55.107785 ncdv-master-1 devstack@keystone.service[96725]: thunder lock: enabled Dec 25 20:43:55.107785 ncdv-master-1 devstack@keystone.service[96725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 25 20:43:55.107785 ncdv-master-1 devstack@keystone.service[96725]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 25 20:43:55.154941 ncdv-master-1 devstack@keystone.service[96725]: Python main interpreter initialized at 0x556abf9ce9c0 Dec 25 20:43:55.154941 ncdv-master-1 devstack@keystone.service[96725]: python threads support enabled Dec 25 20:43:55.154941 ncdv-master-1 devstack@keystone.service[96725]: your server socket listen backlog is limited to 100 connections Dec 25 20:43:55.154941 ncdv-master-1 devstack@keystone.service[96725]: your mercy for graceful operations on workers is 90 seconds Dec 25 20:43:55.155266 ncdv-master-1 devstack@keystone.service[96725]: mapped 403077 bytes (393 KB) for 2 cores Dec 25 20:43:55.155350 ncdv-master-1 devstack@keystone.service[96725]: *** Operational MODE: preforking *** Dec 25 20:43:55.155593 ncdv-master-1 devstack@keystone.service[96725]: *** uWSGI is running in multiple interpreter mode *** Dec 25 20:43:55.155593 ncdv-master-1 devstack@keystone.service[96725]: spawned uWSGI master process (pid: 96725) Dec 25 20:43:55.155786 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Dec 25 20:43:55.157159 ncdv-master-1 devstack@keystone.service[96725]: spawned uWSGI worker 1 (pid: 96732, cores: 1) Dec 25 20:43:55.157159 ncdv-master-1 devstack@keystone.service[96725]: spawned uWSGI worker 2 (pid: 96733, cores: 1) Dec 25 20:43:55.157159 ncdv-master-1 devstack@keystone.service[96725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 25 20:44:00.574164 ncdv-master-1 devstack@keystone.service[96733]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:44:00.574164 ncdv-master-1 devstack@keystone.service[96733]: from cryptography.utils import int_from_bytes Dec 25 20:44:00.595386 ncdv-master-1 devstack@keystone.service[96733]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:44:00.595386 ncdv-master-1 devstack@keystone.service[96733]: from cryptography.utils import int_from_bytes Dec 25 20:44:00.595523 ncdv-master-1 devstack@keystone.service[96732]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:44:00.595523 ncdv-master-1 devstack@keystone.service[96732]: from cryptography.utils import int_from_bytes Dec 25 20:44:00.595523 ncdv-master-1 devstack@keystone.service[96732]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:44:00.595523 ncdv-master-1 devstack@keystone.service[96732]: from cryptography.utils import int_from_bytes Dec 25 20:44:00.623159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 25 20:44:00.623350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 25 20:44:00.623538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] command line args: [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 25 20:44:00.623706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 25 20:44:00.623784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 25 20:44:00.623862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 25 20:44:00.623965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ================================================================================ {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 25 20:44:00.624056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] command line args: [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 25 20:44:00.624212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] admin_token = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.624292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 25 20:44:00.624398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ================================================================================ {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 25 20:44:00.624483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] config_dir = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.624622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.624711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] admin_token = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.624789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] config_source = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.624867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] config_dir = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.624995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] debug = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] config_source = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] debug = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.625948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] insecure_debug = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] list_limit = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] log_config_append = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] list_limit = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] log_config_append = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.626935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] log_dir = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] log_file = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] log_dir = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] log_file = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.627965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.628983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.629933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] notification_format = cadf {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.630965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] publish_errors = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.631188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.631333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.631448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.631565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] publish_errors = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.631685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.631810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.631930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] standard_threads = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.632918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] standard_threads = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] strict_password_check = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] use_journal = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] use_json = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] use_stderr = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.633907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] use_eventlog = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.634027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] use_syslog = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.634142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] use_journal = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.634142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] use_json = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.634355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.634476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] use_stderr = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.634592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.634706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] use_syslog = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.634825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.634947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] watch_log_file = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:44:00.635068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.635191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.635319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.635435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.635559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.635681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.635796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.635910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.636148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.636274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.636396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.636523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.636644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.636765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.636906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.637977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.638998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.639953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.640939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.641062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.641177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.641301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.641416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.641605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.641805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.641957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.642923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.643990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.644979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.645942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.646996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.647816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.648900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.649971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.650929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.651887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.652001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.652115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.652228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.652364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.652519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.652707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.enabled = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.653982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.654700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.655975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.656939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.657901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] auth.external = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] auth.external = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] auth.mapped = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.658896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] auth.password = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] auth.password = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] auth.token = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] auth.token = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.659956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] catalog.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.660931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] credential.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] credential.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] credential.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.661919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.662041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.662158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.662285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.662403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.663946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.664929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.665878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.666944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.667900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.668995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.669833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.670976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.671990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.672985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.673951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.674896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.675907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.676849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.password = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.677978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.678208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.678931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.679885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.680971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.681919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.682987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.683914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.684849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.685969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.686901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.687958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] policy.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.688911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] receipt.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.689974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.690907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.691971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] revoke.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] role.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] role.cache_time = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.692933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] role.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] role.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] role.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] role.list_limit = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.693988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.694931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.695986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.696923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.697983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.698098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.698287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.698406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.698528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.698644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.698761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.698879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.699937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.700917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.cache_time = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.provider = fernet {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.701990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.702921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] trust.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.703978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.704929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.connection = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.connection = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.705952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.706892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.707959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.708964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96733) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 25 20:44:00.709784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:44:00.709784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=96732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 25 20:44:00.736174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.736396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.736487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.736618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.736720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.736849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.745795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.746158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.773577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.773807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.774110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.774342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.827053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.827265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.877293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.877523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.878068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.878304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.941795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.942891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.943026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.943241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.943461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.966243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.966413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.966532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.966616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.966710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.966848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.966930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.967067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.967150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.967281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.967373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.967487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.967568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.967696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.981088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.981366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.993587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.993815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.994839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96733) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.995179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.995332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:00.995549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=96732) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 25 20:44:01.011835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.012042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 25 20:44:01.012235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.012371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.012455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 25 20:44:01.012568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 25 20:44:01.012761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.012844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.012996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 25 20:44:01.013103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.013268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.013349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.013524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.013607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.013775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.014024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.024628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.024919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.025185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.025269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.025457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.025538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.025723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.026002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.033290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.033862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.036433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.036809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.037055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.037141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.037366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.037448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.038184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.038290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.038440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.038533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.038705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.038787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.038971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.039054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.039234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.039316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.039498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.039588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.039758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.039840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.040026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.040289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.065220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.065836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.066780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.067051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.067410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.067684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.072142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.072416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.072686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.072785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.073069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.073343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.079739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.079967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.080359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.080638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.084940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.085223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.085495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.085615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.085767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.085900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.086994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.087257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.087520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.105466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.105736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.106305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.106576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.110147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.111006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.113688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.113975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.114572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.114865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.118829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.120122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.122802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.123884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.126318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.126609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.126884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.127158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.127431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.127540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.127698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.127787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.127987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.128266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.128540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.128824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.146122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.146398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.146657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.147430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.147860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.148138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.148399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.148659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.155032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.156279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.156677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.156981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.157961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.158244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.159909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.160184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.160465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.160734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.161037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.161222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.161500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.161787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.162062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.162344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.174506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.174785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.175057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.175327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.175598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.175863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.176014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.176140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.176273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.176556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.176830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.177132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.177404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.177677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.193470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.195140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.196623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.198317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.199813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.201374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.201541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.202946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.203109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.203224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.203504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.204659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.204958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.205246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.211213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.212759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.213001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.214562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.215893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.216177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.216452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.216732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.217697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.217985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.218264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.218550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.228294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.228571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.228847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.229081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.229373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.229652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.236441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96733) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.236713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.237009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.237291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.237375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=96732) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 25 20:44:01.237566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.237650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.237836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.237918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.238973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.239150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.239232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.239411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.239494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.239672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.239754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.239937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.240019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96733) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.240209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.240595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.240893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=96732) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 25 20:44:01.277331 ncdv-master-1 devstack@keystone.service[96733]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556abf9ce9c0 pid: 96733 (default app) Dec 25 20:44:01.278235 ncdv-master-1 devstack@keystone.service[96732]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556abf9ce9c0 pid: 96732 (default app) Dec 25 20:44:01.280624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e801-693e-40c0-8941-ef6e705e8f1f None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:01.280939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e801-693e-40c0-8941-ef6e705e8f1f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:01.281216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47e801-693e-40c0-8941-ef6e705e8f1f None None] PATH_INFO: `/v3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:01.285339 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Sat Dec 25 20:44:01 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:10.429800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433904fb-9c92-4d2c-94e0-76cd0e72b699 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:10.430361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433904fb-9c92-4d2c-94e0-76cd0e72b699 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:10.430361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433904fb-9c92-4d2c-94e0-76cd0e72b699 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:10.435426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:10 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:10.441344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:10.442028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:10.442028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:10.470716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG oslo_db.sqlalchemy.engines [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96733) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:44:10.751649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG passlib.handlers.bcrypt [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96733) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 25 20:44:10.752070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG passlib.handlers.bcrypt [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96733) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 25 20:44:10.806532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:10.808087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:10.933517 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:11.102024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433904fb-9c92-4d2c-94e0-76cd0e72b699 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:11.135032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG oslo_db.sqlalchemy.engines [None req-433904fb-9c92-4d2c-94e0-76cd0e72b699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:44:11.357559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433904fb-9c92-4d2c-94e0-76cd0e72b699 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:11.361869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598444d0-2bd5-41b2-8e25-0be4e871fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:11.371939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598444d0-2bd5-41b2-8e25-0be4e871fa2a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:11.371939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598444d0-2bd5-41b2-8e25-0be4e871fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:11.371939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598444d0-2bd5-41b2-8e25-0be4e871fa2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:11.371939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598444d0-2bd5-41b2-8e25-0be4e871fa2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:11.423017 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.common.rbac_enforcer.enforcer [None req-598444d0-2bd5-41b2-8e25-0be4e871fa2a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 25 20:44:11.423352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598444d0-2bd5-41b2-8e25-0be4e871fa2a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:11.433263 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:11.439702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:11.454298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5d8a-946e-4e83-afe2-bf8919a58978 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:11.463954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487763c2-1c0f-41e5-9b0e-9747f2aac107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:11.463954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487763c2-1c0f-41e5-9b0e-9747f2aac107 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:11.463954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487763c2-1c0f-41e5-9b0e-9747f2aac107 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:11.463954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487763c2-1c0f-41e5-9b0e-9747f2aac107 admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:11.464295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487763c2-1c0f-41e5-9b0e-9747f2aac107 admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:11.513598 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.common.rbac_enforcer.enforcer [None req-487763c2-1c0f-41e5-9b0e-9747f2aac107 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 25 20:44:11.513930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487763c2-1c0f-41e5-9b0e-9747f2aac107 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:11.518510 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:11 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:13.866261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2d88-7770-40d6-821a-7af3acb0070d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:13.866801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2d88-7770-40d6-821a-7af3acb0070d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:13.866801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2d88-7770-40d6-821a-7af3acb0070d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:13.871564 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:13 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:13.877687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766dab7-09e1-4965-afe4-39d8c278964c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:13.878063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766dab7-09e1-4965-afe4-39d8c278964c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:13.878251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766dab7-09e1-4965-afe4-39d8c278964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:13.897103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c766dab7-09e1-4965-afe4-39d8c278964c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:13.898608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c766dab7-09e1-4965-afe4-39d8c278964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:13.906486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:13.930514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2d88-7770-40d6-821a-7af3acb0070d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:13.942553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2d88-7770-40d6-821a-7af3acb0070d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:13.946856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fe786-43c1-4bbf-8449-771a978f6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:13.947518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fe786-43c1-4bbf-8449-771a978f6b3b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:13.947800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fe786-43c1-4bbf-8449-771a978f6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:13.948076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fe786-43c1-4bbf-8449-771a978f6b3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:13.955705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fe786-43c1-4bbf-8449-771a978f6b3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:13.957505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fe786-43c1-4bbf-8449-771a978f6b3b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:13.966688 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:13.972772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766dab7-09e1-4965-afe4-39d8c278964c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:13.982430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766dab7-09e1-4965-afe4-39d8c278964c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:13.986913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c06a5a-21e7-47fe-9354-d041730804df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:13.987765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06a5a-21e7-47fe-9354-d041730804df admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:13.988050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06a5a-21e7-47fe-9354-d041730804df admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:13.988329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06a5a-21e7-47fe-9354-d041730804df admin admin] PATH_INFO: `/v3/users/85e4a70773484059927d734314165968` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:13.989733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c06a5a-21e7-47fe-9354-d041730804df admin admin] RBAC: Authorizing `identity:get_user(user_id=85e4a70773484059927d734314165968)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:13.991621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c06a5a-21e7-47fe-9354-d041730804df admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:13.993206 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:13 2021] GET /identity/v3/users/85e4a70773484059927d734314165968 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:16.487148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a067b4-d98b-4367-887b-199dc7d1a3cd None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.487676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a067b4-d98b-4367-887b-199dc7d1a3cd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.487676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a067b4-d98b-4367-887b-199dc7d1a3cd None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.489304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7a6d-0fc9-4608-a33f-9d19128bc5d4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.489681 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:16.489759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7a6d-0fc9-4608-a33f-9d19128bc5d4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.489877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7a6d-0fc9-4608-a33f-9d19128bc5d4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.492448 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:16.495646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.495929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.496203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.498231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511d04-14f8-4c34-b530-63733debb7d5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.498521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511d04-14f8-4c34-b530-63733debb7d5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.498799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511d04-14f8-4c34-b530-63733debb7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.515997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4a511d04-14f8-4c34-b530-63733debb7d5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:16.517217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4a511d04-14f8-4c34-b530-63733debb7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:16.524770 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 7/12] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:16.537075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG passlib.handlers.bcrypt [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=96732) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 25 20:44:16.538005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG passlib.handlers.bcrypt [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=96732) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 25 20:44:16.550479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a511d04-14f8-4c34-b530-63733debb7d5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:16.559908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a511d04-14f8-4c34-b530-63733debb7d5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:16.564333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:16.565147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.565435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.565712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.578873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:16.584598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:16.585876 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:16.586206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:16.587036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 8/13] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:16.592764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:16.602536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529a4e-fae9-4a22-9d51-891b7d5b07a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:16.606937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:16.607547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.607832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.608115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.608317 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 6/14] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:16.609025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:16.609345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:16.611087 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:16.611087 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:16.611087 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:16.611978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:16.625551 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 9/15] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:16.631305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:16.632110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:16.640969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620f229-a395-45b1-90d4-e73eaf8e2a73 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:16.641189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c203c0-7ba7-4277-8ff2-a0a63da96bdf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:16.645301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:16.645482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:16.646025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.646304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.647024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.647127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.647290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.647570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] PATH_INFO: `/v3/users/85e4a70773484059927d734314165968` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.649189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] RBAC: Authorizing `identity:get_user(user_id=85e4a70773484059927d734314165968)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:16.651047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:16.652615 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 7/16] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:16 2021] GET /identity/v3/users/85e4a70773484059927d734314165968 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:16.654705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:16.656434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:16.658270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:16.665976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 10/17] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:44:16.668029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284736-0d4d-4afc-bb5c-8dd4b03ca576 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:16.671603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:16.672547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:16.673318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.673604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.673881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.675063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:16.676693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:16.678269 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 8/18] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:16.679748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479914-2424-4342-9eae-cdaf6c178fb4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:16.683732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:16.684064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ecb67-1068-4757-929d-0de74b9534d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:16.684792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ecb67-1068-4757-929d-0de74b9534d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.685102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ecb67-1068-4757-929d-0de74b9534d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.685368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ecb67-1068-4757-929d-0de74b9534d8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.686515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ecb67-1068-4757-929d-0de74b9534d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:16.688149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ecb67-1068-4757-929d-0de74b9534d8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:16.689680 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 11/19] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:16.693189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99db17-9ef4-4305-9a3d-fc221401f597 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:16.697702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:16.698375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:16.698659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:16.698935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:16.699804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.domain.id=default, user.id=85e4a70773484059927d734314165968) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:16.700117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:16.701970 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:16.701970 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:44:16.701970 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:44:16.703151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd549756-3e5d-43bd-a148-be07f58b3bc5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:16.714003 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 9/20] 10.222.0.32 () {56 vars in 1343 bytes} [Sat Dec 25 20:44:16 2021] GET /identity/v3/role_assignments?user.id=85e4a70773484059927d734314165968&scope.domain.id=default&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:19.531613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98fe06-0d5a-4c19-b8ae-709d2a1da927 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.539150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98fe06-0d5a-4c19-b8ae-709d2a1da927 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.539150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98fe06-0d5a-4c19-b8ae-709d2a1da927 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.539150 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 12/21] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:19.541305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3789a3-2cb5-4543-9c1b-011eadef0027 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.541732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3789a3-2cb5-4543-9c1b-011eadef0027 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.541915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3789a3-2cb5-4543-9c1b-011eadef0027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.569941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6e3789a3-2cb5-4543-9c1b-011eadef0027 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:19.571164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6e3789a3-2cb5-4543-9c1b-011eadef0027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:19.579284 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 10/22] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:19.626431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98fe06-0d5a-4c19-b8ae-709d2a1da927 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:19.642651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98fe06-0d5a-4c19-b8ae-709d2a1da927 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:19.648264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:19.649348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.649876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.650353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.674508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:19.682392 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:19.684225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 13/23] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:19.690379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af36a-aaea-41a1-9e90-40fd075fe2f7 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.690981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af36a-aaea-41a1-9e90-40fd075fe2f7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.691454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af36a-aaea-41a1-9e90-40fd075fe2f7 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.694125 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 11/24] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:19.695368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:19.711526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5d3e1-0f05-400d-91eb-f39761f64cc5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:19.713030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13aa62-f39f-4744-bbae-9962f4fb90f9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.713530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13aa62-f39f-4744-bbae-9962f4fb90f9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.714007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13aa62-f39f-4744-bbae-9962f4fb90f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.721158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:19.722483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.722483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.722483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.723102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:19.723407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:19.725090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:19.734502 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 14/25] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:19.752016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:19.752201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ef13aa62-f39f-4744-bbae-9962f4fb90f9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:19.753300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ef13aa62-f39f-4744-bbae-9962f4fb90f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:19.763270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27b17-34c0-41db-8aea-a8f0ededbacb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:19.778546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:19.779430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.779711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.779986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] PATH_INFO: `/v3/users/85e4a70773484059927d734314165968` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.780531 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 12/26] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:19.785744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=85e4a70773484059927d734314165968)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:19.788087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:19.789747 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 15/27] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:19 2021] GET /identity/v3/users/85e4a70773484059927d734314165968 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:19.797761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13aa62-f39f-4744-bbae-9962f4fb90f9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:19.811910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13aa62-f39f-4744-bbae-9962f4fb90f9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:19.822413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:19.824465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:19.825465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.825755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.826034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.834586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:19.835914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5dae-d278-45ad-8983-25c18a3a54f3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:19.840892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:19.840892 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 13/28] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:19.849497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:19.852514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ea125-cf71-47c5-80f6-cd3e9fed6fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:19.853532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea125-cf71-47c5-80f6-cd3e9fed6fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.854042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea125-cf71-47c5-80f6-cd3e9fed6fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.854516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea125-cf71-47c5-80f6-cd3e9fed6fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.855519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ea125-cf71-47c5-80f6-cd3e9fed6fb7 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:19.857036 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-924ea125-cf71-47c5-80f6-cd3e9fed6fb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:19.857036 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:19.857036 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:19.858318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ea125-cf71-47c5-80f6-cd3e9fed6fb7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:19.879390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4160610-a6fc-4a74-9ed9-7bec00e7a0c8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:19.884628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437e843-80c8-4131-b0ac-8d873fb2d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:19.885539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e843-80c8-4131-b0ac-8d873fb2d2be admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:19.885821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e843-80c8-4131-b0ac-8d873fb2d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:19.886095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437e843-80c8-4131-b0ac-8d873fb2d2be admin admin] PATH_INFO: `/v3/domains/default/users/85e4a70773484059927d734314165968/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:19.891268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437e843-80c8-4131-b0ac-8d873fb2d2be admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=85e4a70773484059927d734314165968, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:19.892297 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-1437e843-80c8-4131-b0ac-8d873fb2d2be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:19.892297 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:44:19.892297 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:44:19.894275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437e843-80c8-4131-b0ac-8d873fb2d2be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:20.128306 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 16/29] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 20:44:19 2021] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:20.136760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e330a3-fc88-4c35-acc1-ff7c10bc7003 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.137123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e330a3-fc88-4c35-acc1-ff7c10bc7003 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.137414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e330a3-fc88-4c35-acc1-ff7c10bc7003 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.139449 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 17/30] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:20.154048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206ce13-2fe2-4bc1-a16c-823d8793ed2d None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.154392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206ce13-2fe2-4bc1-a16c-823d8793ed2d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.154610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206ce13-2fe2-4bc1-a16c-823d8793ed2d None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.156616 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 18/31] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:20.157707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf289-9eb2-4551-be4a-d3b18d8251f6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.157989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf289-9eb2-4551-be4a-d3b18d8251f6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.158264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf289-9eb2-4551-be4a-d3b18d8251f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.167073 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 14/32] 10.222.0.32 () {58 vars in 1382 bytes} [Sat Dec 25 20:44:19 2021] PUT /identity/v3/domains/default/users/85e4a70773484059927d734314165968/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:20.170926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39c02-cadd-4a47-b782-f45782196af6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.171617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39c02-cadd-4a47-b782-f45782196af6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.172105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39c02-cadd-4a47-b782-f45782196af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.195126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ffebf289-9eb2-4551-be4a-d3b18d8251f6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:20.196744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ffebf289-9eb2-4551-be4a-d3b18d8251f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:20.214965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c2d39c02-cadd-4a47-b782-f45782196af6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:20.217880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c2d39c02-cadd-4a47-b782-f45782196af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:20.346546 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 19/33] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:20.383793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebf289-9eb2-4551-be4a-d3b18d8251f6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:20.391175 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 15/34] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:20.395383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebf289-9eb2-4551-be4a-d3b18d8251f6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:20.410774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:20.411592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.411870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.412693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.428710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d39c02-cadd-4a47-b782-f45782196af6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:20.431530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:20.433889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:20.443770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d39c02-cadd-4a47-b782-f45782196af6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:20.453142 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:44:20.454581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8868cb1-782c-452a-8241-05c5e65e26b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:20.454890 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 20/35] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:20.455999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868cb1-782c-452a-8241-05c5e65e26b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.455999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868cb1-782c-452a-8241-05c5e65e26b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.456272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8868cb1-782c-452a-8241-05c5e65e26b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.460907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8868cb1-782c-452a-8241-05c5e65e26b0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:20.460907 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-d8868cb1-782c-452a-8241-05c5e65e26b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:20.460907 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:44:20.460907 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:44:20.460907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8868cb1-782c-452a-8241-05c5e65e26b0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:20.462439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:20.480402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67b1f6-79da-4adc-ac3d-2e196b144a28 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:20.485836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:20.489289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.489289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.489289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.489289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:20.489289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:20.489738 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:20.489738 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:20.489738 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:20.490788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:20.512053 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 21/36] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:44:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:20.526228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:20.540010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182738-a628-4c18-bfae-4ac41b336f34 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:20.550349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfac28-7e45-458a-8217-739119af350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:20.550349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfac28-7e45-458a-8217-739119af350c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:20.550349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfac28-7e45-458a-8217-739119af350c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:20.550349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfac28-7e45-458a-8217-739119af350c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:20.550678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfac28-7e45-458a-8217-739119af350c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:20.551716 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-14dfac28-7e45-458a-8217-739119af350c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:20.551716 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:20.551716 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:20.553096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfac28-7e45-458a-8217-739119af350c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:20.591762 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 16/37] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 20:44:20 2021] POST /identity/v3/roles => generated 225 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:44:20.718546 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 22/38] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:44:20 2021] POST /identity/v3/projects => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:21.259621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3736e4-f9fa-429d-aa7d-b9c17d518294 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:21.260007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3736e4-f9fa-429d-aa7d-b9c17d518294 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:21.260188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3736e4-f9fa-429d-aa7d-b9c17d518294 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:21.262035 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 17/39] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:21.267698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267490-1d83-4e0a-a0d7-5da578e15f53 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:21.268070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267490-1d83-4e0a-a0d7-5da578e15f53 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:21.268421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267490-1d83-4e0a-a0d7-5da578e15f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:21.286272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7e267490-1d83-4e0a-a0d7-5da578e15f53 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:21.287480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7e267490-1d83-4e0a-a0d7-5da578e15f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:21.344801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 23/40] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:21.355521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6abc-9b79-4ce2-b019-ce32a5c0fb4b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:21.355880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6abc-9b79-4ce2-b019-ce32a5c0fb4b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:21.356230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6abc-9b79-4ce2-b019-ce32a5c0fb4b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:21.358106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 18/41] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:21.363716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bb20-92e7-4a90-80fe-113e12933c4a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:21.364014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bb20-92e7-4a90-80fe-113e12933c4a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:21.364297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bb20-92e7-4a90-80fe-113e12933c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:21.369287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6abc-9b79-4ce2-b019-ce32a5c0fb4b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:21.383890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f4a1bb20-92e7-4a90-80fe-113e12933c4a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:21.384076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6abc-9b79-4ce2-b019-ce32a5c0fb4b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:21.385113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f4a1bb20-92e7-4a90-80fe-113e12933c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:21.388391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5197b7-1de6-4e3c-80db-f58af899110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:21.389113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5197b7-1de6-4e3c-80db-f58af899110a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:21.389493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5197b7-1de6-4e3c-80db-f58af899110a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:21.389814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5197b7-1de6-4e3c-80db-f58af899110a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:21.390678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5197b7-1de6-4e3c-80db-f58af899110a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:21.392282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5197b7-1de6-4e3c-80db-f58af899110a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:21.393052 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 24/42] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:21.418471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1bb20-92e7-4a90-80fe-113e12933c4a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:21.427390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1bb20-92e7-4a90-80fe-113e12933c4a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:21.432280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:21.433068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:21.433350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:21.433625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:21.434929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:21.436749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:21.438517 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 25/43] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:21.444364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:21.453502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f19c3-6d3d-47d7-a2b2-a226c744ab42 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:21.457835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c3c52-efc0-4a64-b80f-6fe811208ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:21.458419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3c52-efc0-4a64-b80f-6fe811208ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:21.458702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3c52-efc0-4a64-b80f-6fe811208ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:21.459006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3c52-efc0-4a64-b80f-6fe811208ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:21.459688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c3c52-efc0-4a64-b80f-6fe811208ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:21.461528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c3c52-efc0-4a64-b80f-6fe811208ee1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:21.557796 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 26/44] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:44:21 2021] POST /identity/v3/projects => generated 312 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:21.580186 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 19/45] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 20:44:21 2021] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:44:22.831828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8879-d54e-4fe7-9b4e-8271d4ff4b7f None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:22.832442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8879-d54e-4fe7-9b4e-8271d4ff4b7f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:22.832442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8879-d54e-4fe7-9b4e-8271d4ff4b7f None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:22.834219 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 27/46] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:22.839794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbaafd-2511-4197-8bc9-f893aa7d59b2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:22.840220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbaafd-2511-4197-8bc9-f893aa7d59b2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:22.840358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbaafd-2511-4197-8bc9-f893aa7d59b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:22.857663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4bfbaafd-2511-4197-8bc9-f893aa7d59b2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:22.858881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4bfbaafd-2511-4197-8bc9-f893aa7d59b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:22.915483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 20/47] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:22.940946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8879-d54e-4fe7-9b4e-8271d4ff4b7f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:22.954117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8879-d54e-4fe7-9b4e-8271d4ff4b7f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:22.959716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:22.959716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:22.959716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:22.959716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:22.970310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:22.977070 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:22.978386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 28/48] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:22.984333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbaafd-2511-4197-8bc9-f893aa7d59b2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:22.993821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbaafd-2511-4197-8bc9-f893aa7d59b2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:22.998512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:22.999173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:22.999457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:22.999796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:23.000567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:23.000906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:23.001919 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:23.001919 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:44:23.001919 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:44:23.002858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:23.017288 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 21/49] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:23.023203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:23.032634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7839-c617-44b1-ab8f-a8b7d9bcabb6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:23.037458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:23.038311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:23.038591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:23.038865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] PATH_INFO: `/v3/users/85e4a70773484059927d734314165968` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:23.040065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=85e4a70773484059927d734314165968)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:23.041892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:23.043440 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 29/50] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:23 2021] GET /identity/v3/users/85e4a70773484059927d734314165968 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:23.049114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:23.059447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d792156-adaf-4ebf-835f-63fd12d10c24 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:23.063896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c558-e9ae-4991-b493-36b3882a4fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:23.064691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c558-e9ae-4991-b493-36b3882a4fed admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:23.065047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c558-e9ae-4991-b493-36b3882a4fed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:23.065366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c558-e9ae-4991-b493-36b3882a4fed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:23.066600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87c558-e9ae-4991-b493-36b3882a4fed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:23.068308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87c558-e9ae-4991-b493-36b3882a4fed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:23.070090 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 22/51] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:23.075833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:23.085451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c34a-2c9c-4219-a29f-bcaf9c4d77e0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:23.089687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:23.090310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:23.090591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:23.090866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:23.091695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.domain.id=default, user.id=85e4a70773484059927d734314165968) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:23.092004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:23.093028 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:23.093028 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:23.093028 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:23.094152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b9cf0-7ad1-47f1-8570-1f940d43f0a6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:23.101488 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 30/52] 10.222.0.32 () {56 vars in 1343 bytes} [Sat Dec 25 20:44:23 2021] GET /identity/v3/role_assignments?user.id=85e4a70773484059927d734314165968&scope.domain.id=default&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:23.987747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b2d85-b6d2-4718-9856-5c993d34ecc4 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:23.988166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b2d85-b6d2-4718-9856-5c993d34ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:23.988371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b2d85-b6d2-4718-9856-5c993d34ecc4 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:23.990211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 23/53] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:23.996125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701319-60e4-45a7-b578-27fe7c3de453 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:23.996538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701319-60e4-45a7-b578-27fe7c3de453 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:23.996685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf701319-60e4-45a7-b578-27fe7c3de453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:24.014658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bf701319-60e4-45a7-b578-27fe7c3de453 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:24.015936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bf701319-60e4-45a7-b578-27fe7c3de453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:24.023961 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 31/54] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:24.048339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b2d85-b6d2-4718-9856-5c993d34ecc4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:24.060258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b2d85-b6d2-4718-9856-5c993d34ecc4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:24.064396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c41e9f-9cc7-4291-81a9-dc27b43c5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:24.065208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c41e9f-9cc7-4291-81a9-dc27b43c5a57 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:24.065524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c41e9f-9cc7-4291-81a9-dc27b43c5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:24.065829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c41e9f-9cc7-4291-81a9-dc27b43c5a57 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:24.067035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c41e9f-9cc7-4291-81a9-dc27b43c5a57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:24.069262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c41e9f-9cc7-4291-81a9-dc27b43c5a57 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:24.070846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 24/55] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:24.076360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf701319-60e4-45a7-b578-27fe7c3de453 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:24.085568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf701319-60e4-45a7-b578-27fe7c3de453 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:24.089845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb088fd5-9fb7-474a-855c-71091b538c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:24.090466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088fd5-9fb7-474a-855c-71091b538c85 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:24.090748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088fd5-9fb7-474a-855c-71091b538c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:24.091023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088fd5-9fb7-474a-855c-71091b538c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:24.091728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb088fd5-9fb7-474a-855c-71091b538c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:24.093650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb088fd5-9fb7-474a-855c-71091b538c85 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:24.173340 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 32/56] 10.222.0.32 () {60 vars in 1161 bytes} [Sat Dec 25 20:44:24 2021] POST /identity/v3/projects => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:26.539597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc52dc-e367-44b1-b103-c6b1b4c6b4b8 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:26.540138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc52dc-e367-44b1-b103-c6b1b4c6b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:26.540221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc52dc-e367-44b1-b103-c6b1b4c6b4b8 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:26.542053 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 25/57] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:26.547679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b88dd0-4518-4617-b342-ffad100b1bed None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:26.548072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b88dd0-4518-4617-b342-ffad100b1bed None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:26.548239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b88dd0-4518-4617-b342-ffad100b1bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:26.565478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-91b88dd0-4518-4617-b342-ffad100b1bed None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:26.566664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91b88dd0-4518-4617-b342-ffad100b1bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:26.621659 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 33/58] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:26.647498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc52dc-e367-44b1-b103-c6b1b4c6b4b8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:26.659358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc52dc-e367-44b1-b103-c6b1b4c6b4b8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:26.664196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327790-f6e5-416e-98cd-edc9c030a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:26.665007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327790-f6e5-416e-98cd-edc9c030a49c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:26.665293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327790-f6e5-416e-98cd-edc9c030a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:26.665570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327790-f6e5-416e-98cd-edc9c030a49c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:26.666746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327790-f6e5-416e-98cd-edc9c030a49c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:26.668437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327790-f6e5-416e-98cd-edc9c030a49c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:26.670076 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 26/59] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:26.675287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b88dd0-4518-4617-b342-ffad100b1bed None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:26.683912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b88dd0-4518-4617-b342-ffad100b1bed None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:26.688241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc69e6-cfdc-4e8f-9efa-086990d59e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:26.688897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc69e6-cfdc-4e8f-9efa-086990d59e45 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:26.689195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc69e6-cfdc-4e8f-9efa-086990d59e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:26.690366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc69e6-cfdc-4e8f-9efa-086990d59e45 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:26.690366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc69e6-cfdc-4e8f-9efa-086990d59e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:26.691192 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-68fc69e6-cfdc-4e8f-9efa-086990d59e45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:26.691192 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:26.691192 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:26.692400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc69e6-cfdc-4e8f-9efa-086990d59e45 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:26.794529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 34/60] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:44:26 2021] POST /identity/v3/users => generated 275 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:44:30.553646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ffd04-5934-4abe-9254-a48471bf7588 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.554155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ffd04-5934-4abe-9254-a48471bf7588 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.554256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ffd04-5934-4abe-9254-a48471bf7588 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.554762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7eba-0c7f-4bae-9bc7-b3367c51ce12 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.555617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7eba-0c7f-4bae-9bc7-b3367c51ce12 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.556117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a7eba-0c7f-4bae-9bc7-b3367c51ce12 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.556376 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 27/61] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:30.558563 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 35/62] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:30.561540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f4ba-348d-452c-9799-03756a875542 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.562088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f4ba-348d-452c-9799-03756a875542 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.562615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f4ba-348d-452c-9799-03756a875542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.564534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a914-2521-4351-9dce-85e4a657b02e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.565047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a914-2521-4351-9dce-85e4a657b02e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.565534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a914-2521-4351-9dce-85e4a657b02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.586769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2103f4ba-348d-452c-9799-03756a875542 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:30.588288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2103f4ba-348d-452c-9799-03756a875542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:30.596755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-42a9a914-2521-4351-9dce-85e4a657b02e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:30.598002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-42a9a914-2521-4351-9dce-85e4a657b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:30.601630 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 28/63] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:30.602960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f3593-5a07-4957-a642-784edc51906f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.603252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f3593-5a07-4957-a642-784edc51906f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.603593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f3593-5a07-4957-a642-784edc51906f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.605617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 29/64] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:30.610050 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 36/65] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:30.626716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24dab9-7b3c-49f1-a3b3-9eed1cdfbed5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.627014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24dab9-7b3c-49f1-a3b3-9eed1cdfbed5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.627297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24dab9-7b3c-49f1-a3b3-9eed1cdfbed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.633013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a914-2521-4351-9dce-85e4a657b02e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.642666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a914-2521-4351-9dce-85e4a657b02e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.647343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.648143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.648429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.648703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.649876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7d24dab9-7b3c-49f1-a3b3-9eed1cdfbed5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:30.651081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7d24dab9-7b3c-49f1-a3b3-9eed1cdfbed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:30.659449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:30.665963 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 30/66] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:30.666806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24dab9-7b3c-49f1-a3b3-9eed1cdfbed5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.667431 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:44:30.676364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24dab9-7b3c-49f1-a3b3-9eed1cdfbed5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.677275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 37/67] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:30.681674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.682460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.682748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.683032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.694892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:30.695056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.702109 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:30.703647 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 31/68] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:30.709387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6b89-15b8-4924-9ad9-671d0ef0a91d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.709708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.713992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.714673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.714961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.715242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.716024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:30.716337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.718254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.721026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8e572-e9fd-462f-ba1a-5194c84ce3f5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.726373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.727202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.727486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.727772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.730190 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 38/69] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:30.736056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.743061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:30.747926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe74d-d8e2-4cb7-b728-3ff58160218a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.750702 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:30.752351 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 32/70] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:30.756942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.757736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.758602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.759034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.759453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.760359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:30.760825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.762606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.763794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26879715-3d13-44e8-8084-1534a9e85b7c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.772840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.773936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.774287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.774439 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 39/71] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.774614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.775521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.790048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef78a3-beac-418d-9a7e-badd5ce1e993 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.794964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d195e61-1865-4d81-9548-e90e03464960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.795385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.795946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d195e61-1865-4d81-9548-e90e03464960 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.796375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d195e61-1865-4d81-9548-e90e03464960 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.796792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d195e61-1865-4d81-9548-e90e03464960 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.797724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d195e61-1865-4d81-9548-e90e03464960 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:30.798106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.798323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d195e61-1865-4d81-9548-e90e03464960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.800053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d195e61-1865-4d81-9548-e90e03464960 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.804963 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 33/72] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.804963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.811175 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 40/73] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.812711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a677b-325c-489a-8681-96034a4b4664 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.813199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a677b-325c-489a-8681-96034a4b4664 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.813640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a677b-325c-489a-8681-96034a4b4664 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.815701 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 41/74] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:30.816653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855eba9a-5cf9-4b2c-827e-2c3d1f004cfb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.816943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a677b-325c-489a-8681-96034a4b4664 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.821702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.822574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.822861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.823140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.824366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.826559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.828949 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 34/75] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.829797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a677b-325c-489a-8681-96034a4b4664 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.830473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.834272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.834897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.835180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.835461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.840842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416de53-d3b3-4eae-bc60-4af6638c1433 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.843455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.845243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.845343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7c5c1-f222-477a-8e26-cb2b4e2abc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.846086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c5c1-f222-477a-8e26-cb2b4e2abc3e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.846372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c5c1-f222-477a-8e26-cb2b4e2abc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.846649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7c5c1-f222-477a-8e26-cb2b4e2abc3e admin admin] PATH_INFO: `/v3/users/85e4a70773484059927d734314165968` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.847858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c5c1-f222-477a-8e26-cb2b4e2abc3e admin admin] RBAC: Authorizing `identity:get_user(user_id=85e4a70773484059927d734314165968)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.850213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7c5c1-f222-477a-8e26-cb2b4e2abc3e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.851955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 35/76] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/users/85e4a70773484059927d734314165968 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.856618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ffe8-6547-4eac-ac38-c026f29456dd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.856618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ffe8-6547-4eac-ac38-c026f29456dd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.856618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ffe8-6547-4eac-ac38-c026f29456dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.856856 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 42/77] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:30.856856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.867379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743340e4-2026-4357-be4d-5e0312fcc843 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.872123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.872753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.873163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.873451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.874478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1ab3ffe8-6547-4eac-ac38-c026f29456dd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:30.875666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ab3ffe8-6547-4eac-ac38-c026f29456dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:30.881198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.882923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.891980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 36/78] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:30.891980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ffe8-6547-4eac-ac38-c026f29456dd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.892164 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 43/79] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:30.892434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.901597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e545-547b-4848-870f-688b4dd72b92 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.902783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ffe8-6547-4eac-ac38-c026f29456dd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.907423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.907891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.908259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.908536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.908680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.908809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.909178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.909576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.910016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.912767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.914587 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 44/80] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.915188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.918589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.920542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.924404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323d87-6754-4e7b-8250-bc5ef082043e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.928849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.929692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.929973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.935467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.935588 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 37/81] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:30.935588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.936532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.938580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.939881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e436eba-469e-4fa7-9c07-d11f155131d3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.945015 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 45/82] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.945015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.949290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.950087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.950374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.950652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.953883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438bb75-f981-41e2-aa32-18ced595ef89 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.961799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:30.962846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.963165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.963453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.963735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.964575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] RBAC: Adding query filter params (role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=43439940dd2449978937f225023600e8, user.id=f99018af6b744d2e8c95aa976fb67d51) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:30.964912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.966765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.968689 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:30.969899 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 38/83] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:30.971783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.972694 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 46/84] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/role_assignments?user.id=f99018af6b744d2e8c95aa976fb67d51&scope.project.id=43439940dd2449978937f225023600e8&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:30.973586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:30.984309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217320a-516c-4644-953a-dfe7216add41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.986012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64be85-55ed-4f99-81c5-ef3b7c8aeae4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:30.989821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.990657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:30.991326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.991604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.991883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.992458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:30.992746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=43439940dd2449978937f225023600e8, user.id=f99018af6b744d2e8c95aa976fb67d51) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:30.993104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.993347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:30.993841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:30.995312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:30.995978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:30.999164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.001711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 39/85] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.002045 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 47/86] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:30 2021] GET /identity/v3/role_assignments?user.id=f99018af6b744d2e8c95aa976fb67d51&scope.project.id=43439940dd2449978937f225023600e8&role.id=cb697f13703f4bc19072e3c59c644481 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.003022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.013113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3cc71-f899-42db-b17f-a3a050cb8beb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.017449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.018130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.018414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.018688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.019291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.019467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:31.019761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.021982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.030816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686bab-06fb-4266-8260-7dcfcd8f16a0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.032420 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 40/87] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.036281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.038058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.038549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.039050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.039151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.040430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=43439940dd2449978937f225023600e8, user.id=85e4a70773484059927d734314165968) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:31.041122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.043257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.050343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde68d6-15f4-436f-84d0-c0783e5482c7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.050711 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 48/88] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:31 2021] GET /identity/v3/role_assignments?user.id=85e4a70773484059927d734314165968&scope.project.id=43439940dd2449978937f225023600e8&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.059422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.060369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.060683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.060993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.062540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.064868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.067090 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 41/89] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:31 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.073380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.085164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f911-d0c0-440d-b089-1cf5ecdb34f7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.090287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a61b9c-e193-425c-a127-c85fe48bd75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.091296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61b9c-e193-425c-a127-c85fe48bd75e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.091786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61b9c-e193-425c-a127-c85fe48bd75e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.092292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a61b9c-e193-425c-a127-c85fe48bd75e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.102874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a61b9c-e193-425c-a127-c85fe48bd75e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.105379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a61b9c-e193-425c-a127-c85fe48bd75e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.116147 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 49/90] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:31.122792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.139586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4895fa-29b2-4232-b7e9-0e38366fb59a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.154851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.155746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.156030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.156306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] PATH_INFO: `/v3/projects/0b8733064bb54350a727ae086ab2735f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.157607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b8733064bb54350a727ae086ab2735f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.159876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.161497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a305ca-b31c-449b-bd7e-37f2afd0cc83 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.161608 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 42/91] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:31 2021] GET /identity/v3/projects/0b8733064bb54350a727ae086ab2735f => generated 312 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.161814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a305ca-b31c-449b-bd7e-37f2afd0cc83 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.162641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a305ca-b31c-449b-bd7e-37f2afd0cc83 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.164746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 50/92] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:31.168781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.170893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237b00-7036-4541-bd33-98db3b6b0fef None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.171190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237b00-7036-4541-bd33-98db3b6b0fef None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.171479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36237b00-7036-4541-bd33-98db3b6b0fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.184016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5a14e-eba1-430a-a12d-d5855de19b35 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.197104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-36237b00-7036-4541-bd33-98db3b6b0fef None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:31.198394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-36237b00-7036-4541-bd33-98db3b6b0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:31.201462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.202143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.202430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.202711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.203573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=0b8733064bb54350a727ae086ab2735f, user.id=f99018af6b744d2e8c95aa976fb67d51) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:31.203895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.205875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.215244 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 43/93] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:31 2021] GET /identity/v3/role_assignments?user.id=f99018af6b744d2e8c95aa976fb67d51&scope.project.id=0b8733064bb54350a727ae086ab2735f&role.id=cb697f13703f4bc19072e3c59c644481 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.232666 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 51/94] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:31.299353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.315760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ae9b-fa43-4f2f-a8bf-f0b70b1ad1da admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.322069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3494e1e-bd95-49ae-b986-4d55364b2ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.322908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494e1e-bd95-49ae-b986-4d55364b2ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.323199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494e1e-bd95-49ae-b986-4d55364b2ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.323481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494e1e-bd95-49ae-b986-4d55364b2ae6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.324896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3494e1e-bd95-49ae-b986-4d55364b2ae6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.326723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3494e1e-bd95-49ae-b986-4d55364b2ae6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.328823 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 44/95] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:31.336231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237b00-7036-4541-bd33-98db3b6b0fef None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:31.354890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36237b00-7036-4541-bd33-98db3b6b0fef None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:31.365400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb676d-e79c-48a3-b4e9-611d8e570418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:31.366120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb676d-e79c-48a3-b4e9-611d8e570418 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:31.366468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb676d-e79c-48a3-b4e9-611d8e570418 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:31.366759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb676d-e79c-48a3-b4e9-611d8e570418 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:31.367526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb676d-e79c-48a3-b4e9-611d8e570418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:31.369888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb676d-e79c-48a3-b4e9-611d8e570418 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:31.499096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 52/96] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:44:31 2021] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:44:33.840804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663587d-6343-4195-a4f3-9206bdd7c7f1 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:33.841855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663587d-6343-4195-a4f3-9206bdd7c7f1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:33.842357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663587d-6343-4195-a4f3-9206bdd7c7f1 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:33.844598 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 45/97] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:33.851479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9df9-9df3-463c-8c71-b4effdb3b27a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:33.851953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9df9-9df3-463c-8c71-b4effdb3b27a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:33.852026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a9df9-9df3-463c-8c71-b4effdb3b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:33.877930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-394a9df9-9df3-463c-8c71-b4effdb3b27a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:33.879139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-394a9df9-9df3-463c-8c71-b4effdb3b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:33.898922 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 53/98] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:33.938857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663587d-6343-4195-a4f3-9206bdd7c7f1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:33.954473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663587d-6343-4195-a4f3-9206bdd7c7f1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:33.959529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:33.960325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:33.960603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:33.960890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:33.981799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:33.988672 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:33.990127 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 46/99] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:33.997023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a9df9-9df3-463c-8c71-b4effdb3b27a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.010184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a9df9-9df3-463c-8c71-b4effdb3b27a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.018671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.019339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.019620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.019891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.020700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:34.021033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.023145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.036532 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 54/100] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.043625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.057852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3f8d6-441a-44ec-b900-bfcffac786cb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.066024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1188e7-5937-449d-a8ce-e694ca9f564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.066898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1188e7-5937-449d-a8ce-e694ca9f564f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.067171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1188e7-5937-449d-a8ce-e694ca9f564f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.067443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1188e7-5937-449d-a8ce-e694ca9f564f admin admin] PATH_INFO: `/v3/users/85e4a70773484059927d734314165968` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.068696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1188e7-5937-449d-a8ce-e694ca9f564f admin admin] RBAC: Authorizing `identity:get_user(user_id=85e4a70773484059927d734314165968)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.070527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1188e7-5937-449d-a8ce-e694ca9f564f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.072342 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 47/101] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/users/85e4a70773484059927d734314165968 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.078441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.089780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061175-dfb2-4146-a198-04e9aba167ba admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.097335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.098136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.098415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.098688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.099979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.102064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.103726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 55/102] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.109264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161dd68-b3f8-4402-9adf-248ab0d3b5f1 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.109553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161dd68-b3f8-4402-9adf-248ab0d3b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.109829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161dd68-b3f8-4402-9adf-248ab0d3b5f1 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.110005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.111577 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 48/103] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:34.124782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b86dc8-dd50-4ffc-a649-3941af075942 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.127910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be707c-f4e1-4367-9623-fb584d025962 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.128197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be707c-f4e1-4367-9623-fb584d025962 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.128477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be707c-f4e1-4367-9623-fb584d025962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.132801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.134050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.134549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.135019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8/users/85e4a70773484059927d734314165968/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.137424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43439940dd2449978937f225023600e8, user_id=85e4a70773484059927d734314165968, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.138672 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:34.138672 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:34.138672 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:34.140995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.165256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e0be707c-f4e1-4367-9623-fb584d025962 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:34.166776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e0be707c-f4e1-4367-9623-fb584d025962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:34.178879 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 49/104] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:34.180511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf04d-036e-486b-a570-ebd1e1cc8797 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.181009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf04d-036e-486b-a570-ebd1e1cc8797 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.181468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baf04d-036e-486b-a570-ebd1e1cc8797 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.183504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 50/105] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:34.188998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a17df-16d6-4c05-881a-c35661b58ba7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.189473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a17df-16d6-4c05-881a-c35661b58ba7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.189926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a17df-16d6-4c05-881a-c35661b58ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.211694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-923a17df-16d6-4c05-881a-c35661b58ba7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:34.213226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-923a17df-16d6-4c05-881a-c35661b58ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:34.221457 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 51/106] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:34.222647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a17df-16d6-4c05-881a-c35661b58ba7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.230335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 56/107] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:34 2021] PUT /identity/v3/projects/43439940dd2449978937f225023600e8/users/85e4a70773484059927d734314165968/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:44:34.246199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a17df-16d6-4c05-881a-c35661b58ba7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.265498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.342696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931a3cb-cdbc-4c6a-8606-ebc5ae3d7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.344630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a3cb-cdbc-4c6a-8606-ebc5ae3d7a40 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.345295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a3cb-cdbc-4c6a-8606-ebc5ae3d7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.346994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a3cb-cdbc-4c6a-8606-ebc5ae3d7a40 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.377181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17b64-a06f-4c2a-801b-50c82b2d8062 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.377376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931a3cb-cdbc-4c6a-8606-ebc5ae3d7a40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:34.384067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9440-d7c5-40c9-8bf8-5454d1f85de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.385164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9440-d7c5-40c9-8bf8-5454d1f85de4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.385623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9440-d7c5-40c9-8bf8-5454d1f85de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.386109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9440-d7c5-40c9-8bf8-5454d1f85de4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.388602 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-3931a3cb-cdbc-4c6a-8606-ebc5ae3d7a40 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:44:34.391868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 52/108] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:34.394450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453f666-4759-4052-8e34-8ff9a169a1aa None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.395409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453f666-4759-4052-8e34-8ff9a169a1aa None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.396216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453f666-4759-4052-8e34-8ff9a169a1aa None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.399823 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 53/109] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:34.403049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453f666-4759-4052-8e34-8ff9a169a1aa None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.409109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9440-d7c5-40c9-8bf8-5454d1f85de4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:34.424019 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-253c9440-d7c5-40c9-8bf8-5454d1f85de4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:34.426152 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 57/110] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:34.429853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453f666-4759-4052-8e34-8ff9a169a1aa None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.432368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591005-6e2e-405e-9873-f15055fb3e46 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.433385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591005-6e2e-405e-9873-f15055fb3e46 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.434425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591005-6e2e-405e-9873-f15055fb3e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.441152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.444980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.445504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.446489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.448446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:34.449708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.453127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.472644 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 54/111] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.474955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.476063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ba591005-6e2e-405e-9873-f15055fb3e46 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:34.478870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba591005-6e2e-405e-9873-f15055fb3e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:34.495668 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 58/112] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:34.496354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f5d09-8ac2-4935-b4ef-b134e36a2458 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.498795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591005-6e2e-405e-9873-f15055fb3e46 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.507306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.508306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.509742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.511524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.512525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:34.514173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.515989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.517716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591005-6e2e-405e-9873-f15055fb3e46 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.525333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.526220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.526760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.527047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.528267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.529418 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 55/113] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.531921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.532821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 59/114] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.535312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.538841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.547959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5981ff-eda8-4a3f-81e1-64a7ede46409 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.550503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cef4c-1902-4ea5-a4ab-9cf3b9c754ca admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.554271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.555809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.556572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.557084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.557258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.558137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.558371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.558649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.559626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.559910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.562066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.562691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.563844 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 60/115] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:34.564627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.565583 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 56/116] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:34.570877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.574841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df3023-1e7b-4bdc-b63e-0640268e2ad5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.580398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.581350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.581635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.581911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.583887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc9b3-0620-413a-98d9-72842e807b83 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.588754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.590018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.590626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.591096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8/users/f99018af6b744d2e8c95aa976fb67d51/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.593749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43439940dd2449978937f225023600e8, user_id=f99018af6b744d2e8c95aa976fb67d51, role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.595112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:34.597265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.603492 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:34.604955 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 61/117] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:34.605518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.616044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54342f6-bf2c-4bca-bf9f-a9a61f71461e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.620668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.621648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.621822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.622063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] PATH_INFO: `/v3/projects/0b8733064bb54350a727ae086ab2735f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.623249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] RBAC: Authorizing `identity:get_project(project_id=0b8733064bb54350a727ae086ab2735f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.625334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.627345 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 62/118] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/projects/0b8733064bb54350a727ae086ab2735f => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.627830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.638183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd69f8a-8196-4210-9639-3b7293a4ba3a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.643026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.643722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.644013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.644294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.645085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:34.645400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.647590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.656418 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 63/119] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.657441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.667412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78168056-65c1-4e08-ad5c-98f581f6e90a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.672077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.672978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.673266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.673544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] PATH_INFO: `/v3/projects/0b8733064bb54350a727ae086ab2735f/users/f99018af6b744d2e8c95aa976fb67d51/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.675675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8733064bb54350a727ae086ab2735f, user_id=f99018af6b744d2e8c95aa976fb67d51, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.678899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.743019 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 57/120] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:34 2021] PUT /identity/v3/projects/43439940dd2449978937f225023600e8/users/f99018af6b744d2e8c95aa976fb67d51/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:34.744416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.800514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 64/121] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:34 2021] PUT /identity/v3/projects/0b8733064bb54350a727ae086ab2735f/users/f99018af6b744d2e8c95aa976fb67d51/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:34.815516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cd24f-f0ae-44f7-8d6c-578adf0b4012 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.880965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.882643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.883124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.883614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.885255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.887745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.890053 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 58/122] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.895821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.915051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ad9b1-a993-446b-bcbe-5ef757b30449 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.930054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0461f-1b60-499e-8413-a358b396071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.930939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0461f-1b60-499e-8413-a358b396071b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.931221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0461f-1b60-499e-8413-a358b396071b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.931531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0461f-1b60-499e-8413-a358b396071b admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.937801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0461f-1b60-499e-8413-a358b396071b admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.939908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0461f-1b60-499e-8413-a358b396071b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:34.941805 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 65/123] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:34 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:34.948148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:34.960311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb81ff-9638-4d27-9c5b-e993f63186fa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:34.970762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6cd34-df08-472f-83e3-3845fa7db558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:34.972092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6cd34-df08-472f-83e3-3845fa7db558 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:34.972684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6cd34-df08-472f-83e3-3845fa7db558 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:34.973190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6cd34-df08-472f-83e3-3845fa7db558 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8/users/f99018af6b744d2e8c95aa976fb67d51/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:34.976306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6cd34-df08-472f-83e3-3845fa7db558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43439940dd2449978937f225023600e8, user_id=f99018af6b744d2e8c95aa976fb67d51, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:34.983990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6cd34-df08-472f-83e3-3845fa7db558 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:35.093695 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 59/124] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:34 2021] PUT /identity/v3/projects/43439940dd2449978937f225023600e8/users/f99018af6b744d2e8c95aa976fb67d51/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:36.216795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac8b15-426b-400e-bf40-9dbc3fb0f7bb None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.217290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac8b15-426b-400e-bf40-9dbc3fb0f7bb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.217290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac8b15-426b-400e-bf40-9dbc3fb0f7bb None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.219370 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 66/125] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:36.225418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009be6d-a0d3-45d0-97d2-2f5df5513852 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.225810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009be6d-a0d3-45d0-97d2-2f5df5513852 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.225993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009be6d-a0d3-45d0-97d2-2f5df5513852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.237981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babd91-82ef-4d4e-9a75-c5327293c17a None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.238256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babd91-82ef-4d4e-9a75-c5327293c17a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.238540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25babd91-82ef-4d4e-9a75-c5327293c17a None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.240837 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 67/126] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:36.246801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dafa1-361b-48dc-9328-927b576156ee None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.247088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dafa1-361b-48dc-9328-927b576156ee None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.247367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dafa1-361b-48dc-9328-927b576156ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.265771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e009be6d-a0d3-45d0-97d2-2f5df5513852 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:36.266954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e009be6d-a0d3-45d0-97d2-2f5df5513852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:36.276508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-939dafa1-361b-48dc-9328-927b576156ee None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:36.277680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-939dafa1-361b-48dc-9328-927b576156ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:36.411465 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 60/127] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:36.414918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 68/128] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:36.460311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009be6d-a0d3-45d0-97d2-2f5df5513852 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.462526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dafa1-361b-48dc-9328-927b576156ee None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.474006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dafa1-361b-48dc-9328-927b576156ee None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.474174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009be6d-a0d3-45d0-97d2-2f5df5513852 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.485189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.486003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.486287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.486567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.489542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.490385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.490673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.490952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.493611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:36.495605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:36.497285 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 61/129] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:36.503427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.513840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:36.517926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1ea8a-15f1-4147-b8a6-cf8f6a211dfa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.520857 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:36.522971 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 69/130] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:36 2021] GET /identity/v3/roles/reader => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:36.528638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.530477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.531153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.531434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.531717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.532445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:36.533485 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:36.533485 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:44:36.533485 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:44:36.534670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:36.545261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b818903-a26e-4555-8fce-d5c81e37cb98 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.566433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.567101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.567383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.567658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.569034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:36.569342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:36.570971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:36.585053 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 70/131] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:36 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:36.591203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.602825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ca16-13ba-420d-8743-e25f0d490bf1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.608770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.609772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.610109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.610393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] PATH_INFO: `/v3/users/e5b21167a5ef4586a94787a4f32233a6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.631974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] RBAC: Authorizing `identity:get_user(user_id=e5b21167a5ef4586a94787a4f32233a6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:36.634175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:36.640452 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 71/132] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:36 2021] GET /identity/v3/users/e5b21167a5ef4586a94787a4f32233a6 => generated 289 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:36.642305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.654014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ce4d-2077-4299-8c43-6d0eb889263b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.661299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.662783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.663381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.663846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.675336 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 62/133] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:44:36 2021] POST /identity/v3/projects => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:36.678252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:36.680289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:36.696225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 72/134] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:44:36.702821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.813820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4bc7d-8d96-4890-acf8-92a6a913e740 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.823442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edfe81-3916-4153-8009-fd16ad14ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.824337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edfe81-3916-4153-8009-fd16ad14ecfa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.824623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edfe81-3916-4153-8009-fd16ad14ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.824924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edfe81-3916-4153-8009-fd16ad14ecfa admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.826186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edfe81-3916-4153-8009-fd16ad14ecfa admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:36.828287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edfe81-3916-4153-8009-fd16ad14ecfa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:36.830021 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 63/135] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:36 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:36.836704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:36.853621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282e348-48eb-4206-ad9c-214966687c80 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:36.863707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502eccd4-9cd6-4be3-811d-b7694fe5ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:36.864735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eccd4-9cd6-4be3-811d-b7694fe5ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:36.865795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eccd4-9cd6-4be3-811d-b7694fe5ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:36.866263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502eccd4-9cd6-4be3-811d-b7694fe5ac19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:36.867335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502eccd4-9cd6-4be3-811d-b7694fe5ac19 admin admin] RBAC: Adding query filter params (role.id=3909633dfd444fa5b26579f3cdd899d3, scope.project.id=43439940dd2449978937f225023600e8, user.id=e5b21167a5ef4586a94787a4f32233a6) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:36.867871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502eccd4-9cd6-4be3-811d-b7694fe5ac19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:36.870240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502eccd4-9cd6-4be3-811d-b7694fe5ac19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:36.881182 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 73/136] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:36 2021] GET /identity/v3/role_assignments?user.id=e5b21167a5ef4586a94787a4f32233a6&scope.project.id=43439940dd2449978937f225023600e8&role.id=3909633dfd444fa5b26579f3cdd899d3 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:37.903366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee9bb-005e-4475-a9be-068d3b58e20d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:37.903932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee9bb-005e-4475-a9be-068d3b58e20d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:37.903932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ee9bb-005e-4475-a9be-068d3b58e20d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:37.905891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 64/137] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:37.911387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cae67-aed3-4709-b3ab-ca5ee793b18c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:37.911823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cae67-aed3-4709-b3ab-ca5ee793b18c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:37.912008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cae67-aed3-4709-b3ab-ca5ee793b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:37.955580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-544cae67-aed3-4709-b3ab-ca5ee793b18c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:37.963210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-544cae67-aed3-4709-b3ab-ca5ee793b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:37.974431 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 74/138] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:38.017658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee9bb-005e-4475-a9be-068d3b58e20d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.040667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ee9bb-005e-4475-a9be-068d3b58e20d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.048319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.049196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.049483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.049768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.074182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:38.081252 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:38.082694 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 65/139] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:38.089104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cae67-aed3-4709-b3ab-ca5ee793b18c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.107570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cae67-aed3-4709-b3ab-ca5ee793b18c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.123068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.123748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.124030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.124308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.125097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:38.125404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.127011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.144288 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 75/140] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.150228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.166473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad11b4-7d8a-484e-8cf4-0b06f0801bb2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.177054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91989482-0070-4240-bd9b-961658f0fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.178483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989482-0070-4240-bd9b-961658f0fe75 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.178763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989482-0070-4240-bd9b-961658f0fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.179034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989482-0070-4240-bd9b-961658f0fe75 admin admin] PATH_INFO: `/v3/users/85e4a70773484059927d734314165968` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.185631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91989482-0070-4240-bd9b-961658f0fe75 admin admin] RBAC: Authorizing `identity:get_user(user_id=85e4a70773484059927d734314165968)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.187485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91989482-0070-4240-bd9b-961658f0fe75 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.189361 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 66/141] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/users/85e4a70773484059927d734314165968 => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.195499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.210071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86255-1599-442b-a312-5f5012b543ac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.220904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.221562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.221854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.222130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.228831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39d95-78f0-4b99-9880-9f5c35ff2560 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.229167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39d95-78f0-4b99-9880-9f5c35ff2560 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.229455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e39d95-78f0-4b99-9880-9f5c35ff2560 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.231367 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 67/142] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:38.236823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37b8e-0d6c-44a6-89f8-d832ec3493e1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.237141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37b8e-0d6c-44a6-89f8-d832ec3493e1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.237427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37b8e-0d6c-44a6-89f8-d832ec3493e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.241096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.242879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.258587 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 76/143] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:38.264344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.273886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6fb37b8e-0d6c-44a6-89f8-d832ec3493e1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:38.275087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6fb37b8e-0d6c-44a6-89f8-d832ec3493e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:38.278056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee53853-fe99-475b-ad78-a79fee43f3c0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.291259 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 68/144] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:38.294878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.295743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.296020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.296290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.301611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.304285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.306113 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 77/145] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:38.312395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37b8e-0d6c-44a6-89f8-d832ec3493e1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.326080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37b8e-0d6c-44a6-89f8-d832ec3493e1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.338512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.339202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.339488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.339765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.340642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=43439940dd2449978937f225023600e8, user.id=85e4a70773484059927d734314165968) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:38.340954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.341653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.342844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.356719 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 69/146] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/role_assignments?user.id=85e4a70773484059927d734314165968&scope.project.id=43439940dd2449978937f225023600e8&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.358795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b61a7-52ce-40c1-af04-4af5305629b3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.375158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.375981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.376259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.376530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.402128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:38.409206 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:38.410642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 78/147] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:38.417652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.435446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726761f0-0bdf-438d-b800-ce4cbf8a4d2f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.446080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072d794-c0fa-4290-a554-b1f94e11135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.446768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072d794-c0fa-4290-a554-b1f94e11135f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.447052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072d794-c0fa-4290-a554-b1f94e11135f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.447331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072d794-c0fa-4290-a554-b1f94e11135f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.448114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072d794-c0fa-4290-a554-b1f94e11135f admin admin] RBAC: Adding query filter params (name=member) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:38.448423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072d794-c0fa-4290-a554-b1f94e11135f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.450064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072d794-c0fa-4290-a554-b1f94e11135f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.468319 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 70/148] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.475378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.493514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862193d-ea87-40c1-99ab-04f850515439 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.493816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862193d-ea87-40c1-99ab-04f850515439 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.494078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862193d-ea87-40c1-99ab-04f850515439 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.496128 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 71/149] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:38.498886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046c66-c531-45c6-be23-b86d01b443da admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.502488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d50e-3183-46e6-b47d-31798ceb7096 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.502769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d50e-3183-46e6-b47d-31798ceb7096 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.503046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d50e-3183-46e6-b47d-31798ceb7096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.513612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.514505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.514781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.515049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.516390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.518574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.520545 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 79/150] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.527230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.538445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8920d50e-3183-46e6-b47d-31798ceb7096 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:38.539650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8920d50e-3183-46e6-b47d-31798ceb7096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:38.542864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ed41-c206-483d-9791-7fdc9f7816cb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.555257 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 72/151] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:38.559113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.559777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.560056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.560330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.576859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.578862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.593669 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 80/152] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:44:38.600989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d50e-3183-46e6-b47d-31798ceb7096 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.605672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.614185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d50e-3183-46e6-b47d-31798ceb7096 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.618221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a961eba-3f9f-418d-acf6-5f4f58a45d13 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.624787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.625793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.626080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.626355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.629632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.630557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.630843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.631120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] PATH_INFO: `/v3/projects/0b8733064bb54350a727ae086ab2735f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.632417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] RBAC: Authorizing `identity:get_project(project_id=0b8733064bb54350a727ae086ab2735f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.634497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.636488 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 73/153] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/projects/0b8733064bb54350a727ae086ab2735f => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.647850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:38.655396 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:44:38.663267 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 81/154] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:38.664632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.664758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.679504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babea33d-67b3-4101-84b6-7835ee0f61bb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.688963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.689354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0914-e07b-41e8-81b2-782cb9cb03bd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.689644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.689926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.690331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.691163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:38.691524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.693291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.709142 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 82/155] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.710033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.710706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.711056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.711333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.712181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=0b8733064bb54350a727ae086ab2735f, user.id=f99018af6b744d2e8c95aa976fb67d51) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:38.712492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.714380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.716908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.728576 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 74/156] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/role_assignments?user.id=f99018af6b744d2e8c95aa976fb67d51&scope.project.id=0b8733064bb54350a727ae086ab2735f&role.id=cb697f13703f4bc19072e3c59c644481 => generated 608 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.735225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d4163-079b-4933-8a2d-75cb203609b3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.741432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.742352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.742692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.742969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.744278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.754402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.757097 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 83/157] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.763630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.778490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175390e-f628-4b93-ad4f-d37122e1ff87 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.795391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2b3f1-64cd-4d18-b59e-1e0417ccc758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.796075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2b3f1-64cd-4d18-b59e-1e0417ccc758 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.796360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2b3f1-64cd-4d18-b59e-1e0417ccc758 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.796639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2b3f1-64cd-4d18-b59e-1e0417ccc758 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.813119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2b3f1-64cd-4d18-b59e-1e0417ccc758 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.814915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2b3f1-64cd-4d18-b59e-1e0417ccc758 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.828213 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 75/158] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:38.834422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.840359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35e1b-d565-4d13-bc92-bd1172ee1c59 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.840648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35e1b-d565-4d13-bc92-bd1172ee1c59 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.840980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35e1b-d565-4d13-bc92-bd1172ee1c59 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.842936 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 76/159] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:38.847302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e85f-abd9-4535-b01d-8ad1a5ac7cd7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.849947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4a4a2-3fda-4789-b0ff-bf3218988970 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.850237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4a4a2-3fda-4789-b0ff-bf3218988970 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.850513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4a4a2-3fda-4789-b0ff-bf3218988970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.855964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.856907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.857199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.857515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.858964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.861310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.863387 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 84/160] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:38.872134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.882443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-66e4a4a2-3fda-4789-b0ff-bf3218988970 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:38.883679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-66e4a4a2-3fda-4789-b0ff-bf3218988970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:38.887869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9765b-6f70-4ab6-9405-eae483710657 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.897915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 77/161] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:38.898417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.899089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.899367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.899639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.900502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] RBAC: Adding query filter params (role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=43439940dd2449978937f225023600e8, user.id=f99018af6b744d2e8c95aa976fb67d51) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:38.900812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:38.902765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:38.914542 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 85/162] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/role_assignments?user.id=f99018af6b744d2e8c95aa976fb67d51&scope.project.id=43439940dd2449978937f225023600e8&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:38.936080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4a4a2-3fda-4789-b0ff-bf3218988970 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:38.954448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4a4a2-3fda-4789-b0ff-bf3218988970 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:38.959838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:38.961013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:38.961514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:38.964907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:38.980074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:38.987212 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:38.988803 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 78/163] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:38.995953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:39.011089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ad425-8223-441c-bda9-750a6af602fd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:39.023842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:39.024961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:39.025465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:39.025945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:39.026941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:39.027456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:39.029342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:39.048326 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 86/164] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:39.055400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:39.065923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae4ba2-89be-432a-8b20-faa37f3ea928 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:39.078020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:39.078930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:39.079211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:39.079486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] PATH_INFO: `/v3/users/f99018af6b744d2e8c95aa976fb67d51` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:39.081552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] RBAC: Authorizing `identity:get_user(user_id=f99018af6b744d2e8c95aa976fb67d51)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:39.083754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:39.085838 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 79/165] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:39 2021] GET /identity/v3/users/f99018af6b744d2e8c95aa976fb67d51 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:39.092103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:39.105945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6813b-cef3-45ca-a68c-39e10822abfb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:39.110976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:39.111959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:39.112469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:39.113028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:39.125827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:39.128102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:39.145145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 87/166] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:39.146662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:39.164183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a7698-e556-4e21-86f8-e57e4be28296 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:39.173507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983d7ad-3c77-4920-8496-7483c55b15cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:39.174452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983d7ad-3c77-4920-8496-7483c55b15cb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:39.174736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983d7ad-3c77-4920-8496-7483c55b15cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:39.175011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983d7ad-3c77-4920-8496-7483c55b15cb admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:39.176731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983d7ad-3c77-4920-8496-7483c55b15cb admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:39.179056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983d7ad-3c77-4920-8496-7483c55b15cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:39.181260 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 80/167] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:39 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:39.187483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:39.197224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e158d54-db5a-47a3-86dd-abd5b1d177b1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:39.204003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d297bf5-d8cd-41af-abd1-e0dc840be054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:39.204929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d297bf5-d8cd-41af-abd1-e0dc840be054 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:39.205353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d297bf5-d8cd-41af-abd1-e0dc840be054 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:39.205766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d297bf5-d8cd-41af-abd1-e0dc840be054 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:39.206787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d297bf5-d8cd-41af-abd1-e0dc840be054 admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=43439940dd2449978937f225023600e8, user.id=f99018af6b744d2e8c95aa976fb67d51) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:39.207259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d297bf5-d8cd-41af-abd1-e0dc840be054 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:39.209860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d297bf5-d8cd-41af-abd1-e0dc840be054 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:39.219433 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 88/168] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:39 2021] GET /identity/v3/role_assignments?user.id=f99018af6b744d2e8c95aa976fb67d51&scope.project.id=43439940dd2449978937f225023600e8&role.id=cb697f13703f4bc19072e3c59c644481 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:40.202121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7eab7-9c98-4f3e-a18e-d83ffbbb943c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.202656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7eab7-9c98-4f3e-a18e-d83ffbbb943c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.202740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7eab7-9c98-4f3e-a18e-d83ffbbb943c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.204452 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 81/169] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:40.210187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf87b59-b07f-4f39-bc28-270df87ffc19 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.210596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf87b59-b07f-4f39-bc28-270df87ffc19 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.210735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf87b59-b07f-4f39-bc28-270df87ffc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.214334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c590d-437b-4d3c-bf22-7c48ad46f68b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.214569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c590d-437b-4d3c-bf22-7c48ad46f68b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.214848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c590d-437b-4d3c-bf22-7c48ad46f68b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.216469 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 82/170] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:40.221678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cabf0-9121-4a1e-a111-632ce1dce24e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.221964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cabf0-9121-4a1e-a111-632ce1dce24e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.222253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cabf0-9121-4a1e-a111-632ce1dce24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.228240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-faf87b59-b07f-4f39-bc28-270df87ffc19 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:40.229468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-faf87b59-b07f-4f39-bc28-270df87ffc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:40.237075 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 89/171] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:40.239102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5c0cabf0-9121-4a1e-a111-632ce1dce24e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:40.240772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5c0cabf0-9121-4a1e-a111-632ce1dce24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:40.248347 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 83/172] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:40.261483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf87b59-b07f-4f39-bc28-270df87ffc19 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:40.270229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf87b59-b07f-4f39-bc28-270df87ffc19 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:40.273886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cabf0-9121-4a1e-a111-632ce1dce24e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:40.274607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:40.275370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.275647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.275916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.282648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cabf0-9121-4a1e-a111-632ce1dce24e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:40.286013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:40.287465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:40.288249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.288531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.288808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.290011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:40.291681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:40.293405 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:40.293755 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 84/173] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:40.294574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 90/174] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:40 2021] GET /identity/v3/roles/reader => generated 84 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:40.299740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:40.300327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:40.309877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f684333-5b8d-46d6-b62b-57f9cc181207 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:40.310241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d121d66-c8b5-43a9-9ee2-70eb6a351064 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:40.314146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747225f-4038-4725-87ce-593d540b276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:40.314427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:40.314783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747225f-4038-4725-87ce-593d540b276a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.315035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.315135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747225f-4038-4725-87ce-593d540b276a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.315310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.315398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747225f-4038-4725-87ce-593d540b276a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.315578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.316025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747225f-4038-4725-87ce-593d540b276a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:40.316310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:40.316608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:40.317044 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-d747225f-4038-4725-87ce-593d540b276a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:40.317044 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:44:40.317044 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:44:40.318191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:40.318292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747225f-4038-4725-87ce-593d540b276a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:40.326894 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 91/175] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:40 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:40.332474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:40.341573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4b62b-f0c7-4a2e-9a37-a70453e75e1f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:40.345779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:40.348824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.348824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.348824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] PATH_INFO: `/v3/users/e5b21167a5ef4586a94787a4f32233a6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.348824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] RBAC: Authorizing `identity:get_user(user_id=e5b21167a5ef4586a94787a4f32233a6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:40.350795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:40.352284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 92/176] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:40 2021] GET /identity/v3/users/e5b21167a5ef4586a94787a4f32233a6 => generated 289 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:40.357473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:40.366863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eeceb-7a78-42b3-ae94-d8e4176bc465 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:40.371270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:40.372038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.372312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.372581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.373779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:40.377616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:40.377616 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 93/177] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:40 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:40.382588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:40.391392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46045-e61c-4869-9aa3-6e8dced3151a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:40.395840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ddd50-9ac3-4042-9ebb-7aec13d71c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:40.400638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ddd50-9ac3-4042-9ebb-7aec13d71c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:40.400638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ddd50-9ac3-4042-9ebb-7aec13d71c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:40.400638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ddd50-9ac3-4042-9ebb-7aec13d71c88 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8/users/e5b21167a5ef4586a94787a4f32233a6/roles/3909633dfd444fa5b26579f3cdd899d3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:40.400638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ddd50-9ac3-4042-9ebb-7aec13d71c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43439940dd2449978937f225023600e8, user_id=e5b21167a5ef4586a94787a4f32233a6, role_id=3909633dfd444fa5b26579f3cdd899d3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:40.401930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ddd50-9ac3-4042-9ebb-7aec13d71c88 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:40.430584 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 85/178] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:44:40 2021] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:40.510377 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 94/179] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:40 2021] PUT /identity/v3/projects/43439940dd2449978937f225023600e8/users/e5b21167a5ef4586a94787a4f32233a6/roles/3909633dfd444fa5b26579f3cdd899d3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:44:42.963263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac842f-7532-4873-8cbd-acc13d606b08 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:42.963669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac842f-7532-4873-8cbd-acc13d606b08 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:42.963834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac842f-7532-4873-8cbd-acc13d606b08 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:42.965640 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 86/180] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:42.971396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d9301-b6ab-4bfa-ae30-2ee1d5e7c8ec None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:42.972132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d9301-b6ab-4bfa-ae30-2ee1d5e7c8ec None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:42.972550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d9301-b6ab-4bfa-ae30-2ee1d5e7c8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:42.976820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b22e-c047-4088-9d1c-28de80353914 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:42.977385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b22e-c047-4088-9d1c-28de80353914 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:42.977925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b22e-c047-4088-9d1c-28de80353914 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:42.981320 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 87/181] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:42.985499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2019d-e339-4da6-b2d4-2e7fa1c2d387 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:42.986018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2019d-e339-4da6-b2d4-2e7fa1c2d387 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:42.986490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2019d-e339-4da6-b2d4-2e7fa1c2d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:42.995192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fc3d9301-b6ab-4bfa-ae30-2ee1d5e7c8ec None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:42.997412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc3d9301-b6ab-4bfa-ae30-2ee1d5e7c8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:43.008208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d8f2019d-e339-4da6-b2d4-2e7fa1c2d387 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:43.010331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d8f2019d-e339-4da6-b2d4-2e7fa1c2d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:43.060643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 95/182] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:43.074418 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 88/183] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:43.087289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d9301-b6ab-4bfa-ae30-2ee1d5e7c8ec None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.096410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d9301-b6ab-4bfa-ae30-2ee1d5e7c8ec None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.100989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d3f42-9dd5-4aa3-98b7-9817b5ca4e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.102267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3f42-9dd5-4aa3-98b7-9817b5ca4e0d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.102696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3f42-9dd5-4aa3-98b7-9817b5ca4e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.103110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3f42-9dd5-4aa3-98b7-9817b5ca4e0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.103218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2019d-e339-4da6-b2d4-2e7fa1c2d387 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.112570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2019d-e339-4da6-b2d4-2e7fa1c2d387 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.115283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d3f42-9dd5-4aa3-98b7-9817b5ca4e0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:43.117866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9267f1-fbdf-486c-a0f8-a056c193312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.118655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9267f1-fbdf-486c-a0f8-a056c193312f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.118930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9267f1-fbdf-486c-a0f8-a056c193312f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.119199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9267f1-fbdf-486c-a0f8-a056c193312f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.122515 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-678d3f42-9dd5-4aa3-98b7-9817b5ca4e0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:43.128821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 96/184] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:43.128821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4649e6-f14b-4cdc-9d9d-2d4252a928b3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.128821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4649e6-f14b-4cdc-9d9d-2d4252a928b3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.128821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4649e6-f14b-4cdc-9d9d-2d4252a928b3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.128821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 97/185] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:43.129786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4649e6-f14b-4cdc-9d9d-2d4252a928b3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.135889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9267f1-fbdf-486c-a0f8-a056c193312f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:43.142916 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9e9267f1-fbdf-486c-a0f8-a056c193312f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:43.144228 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 89/186] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:43.144326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4649e6-f14b-4cdc-9d9d-2d4252a928b3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.145337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95af24-3363-411e-9d50-c741238bce7a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.145626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95af24-3363-411e-9d50-c741238bce7a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.145905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95af24-3363-411e-9d50-c741238bce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.152733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.153418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.153696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.153967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.154717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:43.155019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.156593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.164927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8b95af24-3363-411e-9d50-c741238bce7a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:43.165325 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 98/187] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.166456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.166585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b95af24-3363-411e-9d50-c741238bce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:43.174137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 90/188] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:43.175081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8dc0e-3e5e-4263-8835-f45a194899a6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.175267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a428-fb03-4bc0-9aca-25737514c1d6 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.175550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a428-fb03-4bc0-9aca-25737514c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.175826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a428-fb03-4bc0-9aca-25737514c1d6 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.178165 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 91/189] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:43.178771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a428-fb03-4bc0-9aca-25737514c1d6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.180101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e042b-a560-49e4-b28e-2ae0f9cdf628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.180720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e042b-a560-49e4-b28e-2ae0f9cdf628 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.181020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e042b-a560-49e4-b28e-2ae0f9cdf628 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.181291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e042b-a560-49e4-b28e-2ae0f9cdf628 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.182067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e042b-a560-49e4-b28e-2ae0f9cdf628 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:43.182374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e042b-a560-49e4-b28e-2ae0f9cdf628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.183928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e042b-a560-49e4-b28e-2ae0f9cdf628 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.190954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a428-fb03-4bc0-9aca-25737514c1d6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.192254 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 99/190] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.193939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c5ca3-3b92-4c00-a797-82f92296bf65 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.194359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c5ca3-3b92-4c00-a797-82f92296bf65 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.194752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c5ca3-3b92-4c00-a797-82f92296bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.198552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.199389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.199669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.199944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] PATH_INFO: `/v3/users/75138c18594042d1b46493ac50bf42b0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.213305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d03c5ca3-3b92-4c00-a797-82f92296bf65 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:43.214014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] RBAC: Authorizing `identity:get_user(user_id=75138c18594042d1b46493ac50bf42b0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.214418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d03c5ca3-3b92-4c00-a797-82f92296bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:43.216160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.218036 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 92/191] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/users/75138c18594042d1b46493ac50bf42b0 => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.218748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.225877 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 100/192] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:43.225877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c5ca3-3b92-4c00-a797-82f92296bf65 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.228108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c98fc9-65c0-48a4-9fdf-6d32ebae7e15 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.232205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c5ca3-3b92-4c00-a797-82f92296bf65 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.232965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.233799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.234081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.234353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] PATH_INFO: `/v3/users/e5b21167a5ef4586a94787a4f32233a6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.235523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] RBAC: Authorizing `identity:get_user(user_id=e5b21167a5ef4586a94787a4f32233a6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.236712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.237532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.237740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.237828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.238075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.239449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 93/193] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/users/e5b21167a5ef4586a94787a4f32233a6 => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.245646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.249051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:43.256915 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:44:43.257172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e8f9a-bc6d-45e2-af19-f5ce8bbbb834 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.258096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 101/194] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:43.258096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.263307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.263307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.263307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.263307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.268205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1ed0-a495-48da-b8c4-01c4decfcca5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.270560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.272389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.272623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.273249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.273533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.273808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.281070 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 94/195] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:43.281963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.282870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.283685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.291938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00eea5-fa3c-4f44-9e18-df468743407e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.298495 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 102/196] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:43.298495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.300649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.301501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.301774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.302038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.303674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa914e8b-c3d7-4f09-89f0-9c8f342203dd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.303789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.305411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.306959 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 95/197] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.308184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.309001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.309286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.309558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.310298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:43.310605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.312145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.312297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.320296 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 103/198] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.321085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.321346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144e341-5638-4711-ae26-3c13154586c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.329021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.329835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.330065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3857084-8b8d-4cc6-8b11-e5b3b9c66ad1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.330152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.330373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.331519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.333616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.334551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.335234 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 96/199] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.335366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.335631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.335898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.335986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.337171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.339168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.340764 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 104/200] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.345585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.346008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985e700-397d-4838-bebc-195825f270d8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.350573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.351187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.351464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.351733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.352426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.354407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.355710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527c73e-3baa-41c6-8547-6e2a837ae361 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.359992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.360968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.361132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.361409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] PATH_INFO: `/v3/users/75138c18594042d1b46493ac50bf42b0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.362600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] RBAC: Authorizing `identity:get_user(user_id=75138c18594042d1b46493ac50bf42b0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.364692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.366884 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 105/201] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/users/75138c18594042d1b46493ac50bf42b0 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.367615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.377378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e187e-421f-4d63-b441-0eb72c5c8176 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.381687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.382269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.382550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.382908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.383715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=75138c18594042d1b46493ac50bf42b0) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:43.384028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.385806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.391038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 106/202] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/role_assignments?user.id=75138c18594042d1b46493ac50bf42b0&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.392203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.401382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1291e-da82-4428-939c-1abf08d6c44a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.406010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.406687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.406966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.407240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.408098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] RBAC: Adding query filter params (role.id=3909633dfd444fa5b26579f3cdd899d3, scope.project.id=43439940dd2449978937f225023600e8, user.id=e5b21167a5ef4586a94787a4f32233a6) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:43.408413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.410342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.417782 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 107/203] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/role_assignments?user.id=e5b21167a5ef4586a94787a4f32233a6&scope.project.id=43439940dd2449978937f225023600e8&role.id=3909633dfd444fa5b26579f3cdd899d3 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.417782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.433016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe9e02-de47-4efb-9089-965edba7f34f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.436022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.436789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.437114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.437391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.448983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.450923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.452638 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 97/204] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:44:43 2021] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:44:43.465043 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 108/205] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:43.472566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.496001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4b14-c98a-46b4-96ba-098c8324eca2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.501644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6156c30-aa18-4744-9ada-99dd416cf7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.502937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6156c30-aa18-4744-9ada-99dd416cf7df admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.503404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6156c30-aa18-4744-9ada-99dd416cf7df admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.503870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6156c30-aa18-4744-9ada-99dd416cf7df admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.505629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6156c30-aa18-4744-9ada-99dd416cf7df admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.508058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6156c30-aa18-4744-9ada-99dd416cf7df admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.510693 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 98/206] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:43.517759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:43.528856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56450e-bebd-434d-934b-c6aa0b2f2b03 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:43.534867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66144736-33a3-4eb8-b10e-b5289c742648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:43.536227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66144736-33a3-4eb8-b10e-b5289c742648 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:43.537270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66144736-33a3-4eb8-b10e-b5289c742648 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:43.537771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66144736-33a3-4eb8-b10e-b5289c742648 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:43.538870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66144736-33a3-4eb8-b10e-b5289c742648 admin admin] RBAC: Adding query filter params (role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=75138c18594042d1b46493ac50bf42b0) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:43.539391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66144736-33a3-4eb8-b10e-b5289c742648 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:43.541926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66144736-33a3-4eb8-b10e-b5289c742648 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:43.548863 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 109/207] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:43 2021] GET /identity/v3/role_assignments?user.id=75138c18594042d1b46493ac50bf42b0&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:45.874491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99016e5-7da3-4dd6-9d9e-2364fe0b982e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:45.875036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99016e5-7da3-4dd6-9d9e-2364fe0b982e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:45.875036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99016e5-7da3-4dd6-9d9e-2364fe0b982e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:45.876954 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 99/208] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:45.883476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efce08-24a9-4798-9b51-0ed84ba686b6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:45.883885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efce08-24a9-4798-9b51-0ed84ba686b6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:45.884073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efce08-24a9-4798-9b51-0ed84ba686b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:45.902480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-59efce08-24a9-4798-9b51-0ed84ba686b6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:45.903669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-59efce08-24a9-4798-9b51-0ed84ba686b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:45.911651 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 110/209] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:45.935818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99016e5-7da3-4dd6-9d9e-2364fe0b982e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:45.953540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99016e5-7da3-4dd6-9d9e-2364fe0b982e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:45.962269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ff2f4-85d8-4472-bc53-dfa53f68b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:45.963079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff2f4-85d8-4472-bc53-dfa53f68b105 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:45.963356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff2f4-85d8-4472-bc53-dfa53f68b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:45.963624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff2f4-85d8-4472-bc53-dfa53f68b105 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:45.975028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ff2f4-85d8-4472-bc53-dfa53f68b105 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:45.982053 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4e1ff2f4-85d8-4472-bc53-dfa53f68b105 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:45.983243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 100/210] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:45.989398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efce08-24a9-4798-9b51-0ed84ba686b6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.008721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efce08-24a9-4798-9b51-0ed84ba686b6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.015160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.015843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.016127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.016404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.020932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:46.020932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.021150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9842c-edb3-4695-ac21-9ac000f479da None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.021150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9842c-edb3-4695-ac21-9ac000f479da None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.021150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9842c-edb3-4695-ac21-9ac000f479da None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.021324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.022052 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 101/211] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:46.029219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c36269-00ec-4426-9f4c-2a931d403e01 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.029752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c36269-00ec-4426-9f4c-2a931d403e01 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.030132 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 111/212] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.030627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c36269-00ec-4426-9f4c-2a931d403e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.035790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.046350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2e20-0a92-4bfb-a5b4-00c65f6ff6b6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.051492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.052911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.053202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.053478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] PATH_INFO: `/v3/users/75138c18594042d1b46493ac50bf42b0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.054692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] RBAC: Authorizing `identity:get_user(user_id=75138c18594042d1b46493ac50bf42b0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.054958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-98c36269-00ec-4426-9f4c-2a931d403e01 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:46.056365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-98c36269-00ec-4426-9f4c-2a931d403e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:46.056796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.058578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 112/213] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/users/75138c18594042d1b46493ac50bf42b0 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.063999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.069249 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 102/214] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:46.079856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa645d-9bfa-4d66-af3d-60518d1ebe2e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.084818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.085703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.085984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.086258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.087439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.089567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.091219 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 113/215] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:46.096608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c36269-00ec-4426-9f4c-2a931d403e01 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.097000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.107085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c36269-00ec-4426-9f4c-2a931d403e01 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.107869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce730b7-7875-41b1-a793-30c1febdcc09 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.112227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fea99-f6e2-425d-a972-46ebca462e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.112570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22414dba-e075-4702-8d53-521084e8a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.113120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fea99-f6e2-425d-a972-46ebca462e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.113399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fea99-f6e2-425d-a972-46ebca462e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.113672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fea99-f6e2-425d-a972-46ebca462e78 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/75138c18594042d1b46493ac50bf42b0/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.114272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414dba-e075-4702-8d53-521084e8a6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.114839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414dba-e075-4702-8d53-521084e8a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.115301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22414dba-e075-4702-8d53-521084e8a6c4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.115815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fea99-f6e2-425d-a972-46ebca462e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ad69bd938b400484a11e5ec679eb11, user_id=75138c18594042d1b46493ac50bf42b0, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.118439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fea99-f6e2-425d-a972-46ebca462e78 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.126694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22414dba-e075-4702-8d53-521084e8a6c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:46.133920 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-22414dba-e075-4702-8d53-521084e8a6c4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:44:46.135102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 103/216] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:46.137414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90943ab2-9dc9-4c2f-afa5-6d7607ae6d30 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.137697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90943ab2-9dc9-4c2f-afa5-6d7607ae6d30 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.137969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90943ab2-9dc9-4c2f-afa5-6d7607ae6d30 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.139955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 104/217] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:46.141175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90943ab2-9dc9-4c2f-afa5-6d7607ae6d30 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.153962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90943ab2-9dc9-4c2f-afa5-6d7607ae6d30 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.160043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7a50-023d-4a16-a3fc-657dcc00fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.160043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7a50-023d-4a16-a3fc-657dcc00fe18 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.160043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7a50-023d-4a16-a3fc-657dcc00fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.160043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7a50-023d-4a16-a3fc-657dcc00fe18 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.160351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7a50-023d-4a16-a3fc-657dcc00fe18 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:46.160351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7a50-023d-4a16-a3fc-657dcc00fe18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.162429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7a50-023d-4a16-a3fc-657dcc00fe18 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.170208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 105/218] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.171320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323a70-b86d-4051-8012-a417e7068e18 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.171607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323a70-b86d-4051-8012-a417e7068e18 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.171881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323a70-b86d-4051-8012-a417e7068e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.189571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9a323a70-b86d-4051-8012-a417e7068e18 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:46.190723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9a323a70-b86d-4051-8012-a417e7068e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:46.198209 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 106/219] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:46.199361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed2ab-7a14-4528-8527-c5deb48e434f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.199635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed2ab-7a14-4528-8527-c5deb48e434f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.199900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ed2ab-7a14-4528-8527-c5deb48e434f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.201705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 107/220] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:46.202393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ed2ab-7a14-4528-8527-c5deb48e434f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.218033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ed2ab-7a14-4528-8527-c5deb48e434f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.224941 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 114/221] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:46 2021] PUT /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/75138c18594042d1b46493ac50bf42b0/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:44:46.229600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796916-e3db-435d-b415-be9a326970cd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.229600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796916-e3db-435d-b415-be9a326970cd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.229600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796916-e3db-435d-b415-be9a326970cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.246340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-92796916-e3db-435d-b415-be9a326970cd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:46.247554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-92796916-e3db-435d-b415-be9a326970cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:46.276732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.277658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.277940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.278216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] PATH_INFO: `/v3/users/75138c18594042d1b46493ac50bf42b0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.279513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] RBAC: Authorizing `identity:get_user(user_id=75138c18594042d1b46493ac50bf42b0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.281744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.288643 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 108/222] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/users/75138c18594042d1b46493ac50bf42b0 => generated 283 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.288643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.294338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413db5a-e114-47f2-be21-392b768d7225 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.300133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.300977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.301259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.301530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.313025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:46.322614 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:46.322802 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 115/223] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:46.322907 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 109/224] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:46.322987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92796916-e3db-435d-b415-be9a326970cd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.329655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.332601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92796916-e3db-435d-b415-be9a326970cd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.338966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.339835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.340009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca639d-0165-4966-af7a-4fb19af0f08f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.340104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.340374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.341926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.344249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.344549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.345256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.345538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.345812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.346357 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 116/225] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.346583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:46.346888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.348503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.352475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.359807 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 110/226] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.362750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ce068-bf61-45c8-b99f-53e9d0685c5c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.365492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.367160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.367956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.368234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.368504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.370125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.371822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.373674 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 117/227] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.383545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc15ae-da18-4490-a160-8f7abfc91ba4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.383688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.383761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.383761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.383761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.383761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/75138c18594042d1b46493ac50bf42b0/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.385451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ad69bd938b400484a11e5ec679eb11, user_id=75138c18594042d1b46493ac50bf42b0, role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.388179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.390422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a0d78-ecb9-428a-99f8-d45c790c1b62 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.394831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.395693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.396601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.396908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] PATH_INFO: `/v3/users/8c368ed9c76647988c870829736ced41` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.411899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] RBAC: Authorizing `identity:get_user(user_id=8c368ed9c76647988c870829736ced41)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.414075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.415882 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 118/228] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/users/8c368ed9c76647988c870829736ced41 => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:46.416642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.426822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2787163-cf0c-4a39-8e6a-51fc52efcd4b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.431300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.431958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.432236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.432506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.433259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.435218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.538163 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 119/229] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:44:46 2021] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:44:46.539120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.549103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d02cd2-22ed-4dc4-b9aa-ff50f06c9538 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.553692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.554450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.554731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.555004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.563903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.568548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.576449 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 120/230] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:46.583259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.599226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 111/231] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:46 2021] PUT /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/75138c18594042d1b46493ac50bf42b0/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:46.605861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a213ffe-38ce-4482-9890-6eb5b1ecc148 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.678880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc38e4-d903-4d82-9274-61d9ff0b7d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.679697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc38e4-d903-4d82-9274-61d9ff0b7d36 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.679982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc38e4-d903-4d82-9274-61d9ff0b7d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.680257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc38e4-d903-4d82-9274-61d9ff0b7d36 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.681744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc38e4-d903-4d82-9274-61d9ff0b7d36 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.684014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc38e4-d903-4d82-9274-61d9ff0b7d36 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.686328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 121/232] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:46.692842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:46.704426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2319-790b-4c02-b545-27a1da29b7a9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:46.709451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5b8b8-9f08-4c77-820b-e768e62bb786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:46.710302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5b8b8-9f08-4c77-820b-e768e62bb786 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:46.710593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5b8b8-9f08-4c77-820b-e768e62bb786 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:46.710918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5b8b8-9f08-4c77-820b-e768e62bb786 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:46.711801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5b8b8-9f08-4c77-820b-e768e62bb786 admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=8c368ed9c76647988c870829736ced41) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:46.712159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5b8b8-9f08-4c77-820b-e768e62bb786 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:46.714198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5b8b8-9f08-4c77-820b-e768e62bb786 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:46.720928 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 112/233] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:46 2021] GET /identity/v3/role_assignments?user.id=8c368ed9c76647988c870829736ced41&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=cb697f13703f4bc19072e3c59c644481 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.103747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682eb81-90fb-428f-bd7a-8e281e0dde0b None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.104286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682eb81-90fb-428f-bd7a-8e281e0dde0b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.104286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682eb81-90fb-428f-bd7a-8e281e0dde0b None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.106082 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 122/234] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:49.112025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70408c-fc09-4b94-8c3b-026b2b35982d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.112425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70408c-fc09-4b94-8c3b-026b2b35982d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.112605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70408c-fc09-4b94-8c3b-026b2b35982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.145915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8b70408c-fc09-4b94-8c3b-026b2b35982d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:49.147121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b70408c-fc09-4b94-8c3b-026b2b35982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:49.159051 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 113/235] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:49.196086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682eb81-90fb-428f-bd7a-8e281e0dde0b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.222524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682eb81-90fb-428f-bd7a-8e281e0dde0b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.231482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.232277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.232556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.232827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.253863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:49.261501 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:44:49.262777 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 123/236] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:49.269390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70408c-fc09-4b94-8c3b-026b2b35982d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.282477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70408c-fc09-4b94-8c3b-026b2b35982d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.293324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.294010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.294291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.294565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.295335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:49.295639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.297270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.313717 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 114/237] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.319929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.333391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5853-47be-4094-9d13-52ca18ca8385 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.342921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.343793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.344072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.344346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] PATH_INFO: `/v3/users/75138c18594042d1b46493ac50bf42b0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.350157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=75138c18594042d1b46493ac50bf42b0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.352278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.354225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 124/238] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/users/75138c18594042d1b46493ac50bf42b0 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.360494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.374989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917004bf-64f3-442d-a774-fa7c1dc1869d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.394227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.394894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.395174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.395450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.409016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.410766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.426807 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 115/239] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:49.433523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.451628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e457df-c1fd-4b07-b765-9127fb4ad9b0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.462643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba03f55-9e09-4922-abe2-48b2b3b43b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.463517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03f55-9e09-4922-abe2-48b2b3b43b28 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.463797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03f55-9e09-4922-abe2-48b2b3b43b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.466124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba03f55-9e09-4922-abe2-48b2b3b43b28 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.469650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba03f55-9e09-4922-abe2-48b2b3b43b28 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.471696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba03f55-9e09-4922-abe2-48b2b3b43b28 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.473692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 125/240] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.480777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.499385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ae34-0ec9-4dc4-b22b-85c1b6ea4f50 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.508954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9cae-28c2-46b6-be78-d2f439bb25d9 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.509243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9cae-28c2-46b6-be78-d2f439bb25d9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.509525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9cae-28c2-46b6-be78-d2f439bb25d9 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.511283 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 126/241] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:49.514175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.514841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.515115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.515389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.516239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=75138c18594042d1b46493ac50bf42b0) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:49.516549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.517393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6cf1c-7413-48ca-b159-33f7d1e78a39 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.517680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6cf1c-7413-48ca-b159-33f7d1e78a39 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.517953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6cf1c-7413-48ca-b159-33f7d1e78a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.518471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.529559 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 116/242] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/role_assignments?user.id=75138c18594042d1b46493ac50bf42b0&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.550152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7be6cf1c-7413-48ca-b159-33f7d1e78a39 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:49.551385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7be6cf1c-7413-48ca-b159-33f7d1e78a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:49.562719 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 127/243] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:49.607259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.623682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f82522-1fa9-4b80-b5b4-9b2834669ea0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.635856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.636941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.637266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.637550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.662163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:49.669879 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:44:49.671147 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 117/244] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:49.677646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6cf1c-7413-48ca-b159-33f7d1e78a39 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.686953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6cf1c-7413-48ca-b159-33f7d1e78a39 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.691506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.692242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.692525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.692830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.693622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:49.693927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.695519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.704894 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 128/245] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.711331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.722116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e934f1e-4db3-4813-ae46-1604c7c36f01 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.727295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c60ef-ad10-4051-91a0-24ce017737be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.728099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c60ef-ad10-4051-91a0-24ce017737be admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.728381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c60ef-ad10-4051-91a0-24ce017737be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.728656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c60ef-ad10-4051-91a0-24ce017737be admin admin] PATH_INFO: `/v3/users/75138c18594042d1b46493ac50bf42b0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.729916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c60ef-ad10-4051-91a0-24ce017737be admin admin] RBAC: Authorizing `identity:get_user(user_id=75138c18594042d1b46493ac50bf42b0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.732095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c60ef-ad10-4051-91a0-24ce017737be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.733918 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 118/246] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/users/75138c18594042d1b46493ac50bf42b0 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.740087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.750392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfb2fc-d0f8-4f5a-9390-1346fbbe1c97 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.754946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.755733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.756015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.756292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.762675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eea38-1dc0-4a45-82fe-6fc7a684ae35 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.762982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eea38-1dc0-4a45-82fe-6fc7a684ae35 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.763901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eea38-1dc0-4a45-82fe-6fc7a684ae35 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.765402 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 119/247] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:49.770066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.775413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.775677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3b0b3-8332-4e14-b2ea-c16ee51d432e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.775677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3b0b3-8332-4e14-b2ea-c16ee51d432e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.775677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3b0b3-8332-4e14-b2ea-c16ee51d432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.783663 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 129/248] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:49.790351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.801606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cbde9-2e5b-4181-81a4-f179fa3b7ab2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.808898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.808898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.808898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.808898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.809939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fcd3b0b3-8332-4e14-b2ea-c16ee51d432e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:49.811155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fcd3b0b3-8332-4e14-b2ea-c16ee51d432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:49.812837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.815315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.817732 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 130/249] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:49.824869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.832652 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 120/250] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:49.837513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125848e-a4ed-4449-b841-7c406d5d05bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.842464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.843394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.843922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.844424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.845633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] RBAC: Adding query filter params (role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=75138c18594042d1b46493ac50bf42b0) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:49.846168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.848316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.856262 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 131/251] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/role_assignments?user.id=75138c18594042d1b46493ac50bf42b0&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:49.871476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3b0b3-8332-4e14-b2ea-c16ee51d432e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.887627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3b0b3-8332-4e14-b2ea-c16ee51d432e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.895739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c7c40-4e39-4e4c-a019-7652eb7b81c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.897136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c7c40-4e39-4e4c-a019-7652eb7b81c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.897417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c7c40-4e39-4e4c-a019-7652eb7b81c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.897683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c7c40-4e39-4e4c-a019-7652eb7b81c7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.901799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c7c40-4e39-4e4c-a019-7652eb7b81c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.903518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c7c40-4e39-4e4c-a019-7652eb7b81c7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.905674 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 121/252] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:49.911281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:49.923571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ffee1-7ca2-4d17-b2d1-eb8b027cd340 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:49.928860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:49.929958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.930463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.930937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.931960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:49.934373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:49.980608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74fb9f-a52d-4877-a824-c0d1274a7bf0 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.980902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74fb9f-a52d-4877-a824-c0d1274a7bf0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.981115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74fb9f-a52d-4877-a824-c0d1274a7bf0 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:49.983275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 122/253] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:49.989551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a75-aacb-4473-9314-3037945a9c6d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:49.989835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a75-aacb-4473-9314-3037945a9c6d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:49.990216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a75-aacb-4473-9314-3037945a9c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.010590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-96168a75-aacb-4473-9314-3037945a9c6d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:50.011927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-96168a75-aacb-4473-9314-3037945a9c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:50.021993 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 132/255] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:44:49 2021] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:44:50.023672 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 123/255] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:50.048330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.061603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538c915-8dd4-44c3-b023-e755782f1a92 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.067581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a794a3-6856-437e-94c5-47ad908a5886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.069128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a794a3-6856-437e-94c5-47ad908a5886 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.069415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a794a3-6856-437e-94c5-47ad908a5886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.069695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a794a3-6856-437e-94c5-47ad908a5886 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.088750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a794a3-6856-437e-94c5-47ad908a5886 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:50.096528 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-f0a794a3-6856-437e-94c5-47ad908a5886 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:50.098185 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 133/256] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:50.105019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96168a75-aacb-4473-9314-3037945a9c6d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.115242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96168a75-aacb-4473-9314-3037945a9c6d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.120566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.121354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.121687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.121962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.122747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:50.123051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.124769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.135542 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 124/257] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:50.136055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b594-a2b0-42c4-9cda-fd0cf7bed8e7 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.136563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b594-a2b0-42c4-9cda-fd0cf7bed8e7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.136709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b594-a2b0-42c4-9cda-fd0cf7bed8e7 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.138798 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 134/258] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:50.144698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.145779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1391-1712-4f7d-8552-dc6c14f8e4b0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.146715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1391-1712-4f7d-8552-dc6c14f8e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.146930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1391-1712-4f7d-8552-dc6c14f8e4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.155942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c321bf-f9b1-477a-9e14-212cea54a8d2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.161020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.162004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.162287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.162552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] PATH_INFO: `/v3/users/9b06d15908344cf986dd0385331e18ea` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.171486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-202d1391-1712-4f7d-8552-dc6c14f8e4b0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:50.172726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-202d1391-1712-4f7d-8552-dc6c14f8e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:50.179569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] RBAC: Authorizing `identity:get_user(user_id=9b06d15908344cf986dd0385331e18ea)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.182046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.184126 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 125/259] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/users/9b06d15908344cf986dd0385331e18ea => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:50.187919 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 135/260] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:50.190854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.201580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ce8d-c292-40cf-8ca6-45c1e1131019 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.207113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.207776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.208059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.208399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.218220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.219496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1391-1712-4f7d-8552-dc6c14f8e4b0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.220177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.230959 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 126/261] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:50.231267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1391-1712-4f7d-8552-dc6c14f8e4b0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.236763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.237117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.237652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.237928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.238197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.248718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592aed3-b808-4cb9-96e0-53de76af1350 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.253273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.253604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:50.254132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.254411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.254682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.256429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.258510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.260358 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 127/262] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:50.262445 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:50.263787 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 136/263] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:50.266316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.270150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.276671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c93b-e2c6-4d89-865d-acdfb62d5c1e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.281176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.281871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.282151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.282483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.282806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879a147-5563-4f55-82f0-68dc6b6de350 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.283313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] RBAC: Adding query filter params (role.id=3909633dfd444fa5b26579f3cdd899d3, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=9b06d15908344cf986dd0385331e18ea) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:50.283679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.285547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.287883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.288532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.288814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.289134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.289885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:50.290195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.291533 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 128/264] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/role_assignments?user.id=9b06d15908344cf986dd0385331e18ea&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=3909633dfd444fa5b26579f3cdd899d3 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:50.291781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.300975 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 137/265] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:50.307459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.318847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b0c77-abeb-4fdc-b122-42063e510f89 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.323564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.324453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.324733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.325052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] PATH_INFO: `/v3/users/8c368ed9c76647988c870829736ced41` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.326381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] RBAC: Authorizing `identity:get_user(user_id=8c368ed9c76647988c870829736ced41)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.328571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.330604 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 129/266] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/users/8c368ed9c76647988c870829736ced41 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:50.337266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.347566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a5bec-fee6-4e04-af3f-5672dd230d96 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.354915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e7e62-d358-43ec-9ef8-59ab0e8ef351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.355793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7e62-d358-43ec-9ef8-59ab0e8ef351 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.356067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7e62-d358-43ec-9ef8-59ab0e8ef351 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.356339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e7e62-d358-43ec-9ef8-59ab0e8ef351 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.357614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e7e62-d358-43ec-9ef8-59ab0e8ef351 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.359989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e7e62-d358-43ec-9ef8-59ab0e8ef351 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.361753 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 138/267] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:50 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:50.368046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:50.378996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9165f4-6b2e-4d67-ab4c-23cb183ce3ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:50.385163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527d2bb-fb2b-4d8c-81b1-582587735512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:50.386083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d2bb-fb2b-4d8c-81b1-582587735512 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:50.386363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d2bb-fb2b-4d8c-81b1-582587735512 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:50.386631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527d2bb-fb2b-4d8c-81b1-582587735512 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/8c368ed9c76647988c870829736ced41/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:50.388759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d2bb-fb2b-4d8c-81b1-582587735512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ad69bd938b400484a11e5ec679eb11, user_id=8c368ed9c76647988c870829736ced41, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:50.391494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527d2bb-fb2b-4d8c-81b1-582587735512 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:50.470207 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 130/268] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:50 2021] PUT /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/8c368ed9c76647988c870829736ced41/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:52.680316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da990-6b18-4f7a-9ddc-ca5d9f27627a None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.680855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da990-6b18-4f7a-9ddc-ca5d9f27627a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.680855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da990-6b18-4f7a-9ddc-ca5d9f27627a None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.682754 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 139/269] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:52.689694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6fd0f-a5f2-4a74-910b-55975df9dd94 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.690259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0a1e0-ad9b-4648-9b5f-d2091994ff99 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.690472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0a1e0-ad9b-4648-9b5f-d2091994ff99 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.690747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0a1e0-ad9b-4648-9b5f-d2091994ff99 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.691125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6fd0f-a5f2-4a74-910b-55975df9dd94 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.691598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6fd0f-a5f2-4a74-910b-55975df9dd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.692656 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 140/270] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:52.698346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a1ef-a8d0-40c8-971c-b3fd50062cd3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.698638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a1ef-a8d0-40c8-971c-b3fd50062cd3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.699171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a1ef-a8d0-40c8-971c-b3fd50062cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.711536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-aad6fd0f-a5f2-4a74-910b-55975df9dd94 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:52.713073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aad6fd0f-a5f2-4a74-910b-55975df9dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:52.720379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f3a1a1ef-a8d0-40c8-971c-b3fd50062cd3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:52.721577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f3a1a1ef-a8d0-40c8-971c-b3fd50062cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:52.776342 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 131/271] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:52.777593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993463-868f-41f2-8cce-3d799e15af3c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.777876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993463-868f-41f2-8cce-3d799e15af3c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.778147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993463-868f-41f2-8cce-3d799e15af3c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.779901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 132/272] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:52.785484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269ad6-5f6e-4097-9133-ae5ef2f812ea None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.785729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269ad6-5f6e-4097-9133-ae5ef2f812ea None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.785999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269ad6-5f6e-4097-9133-ae5ef2f812ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.788120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 141/273] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:52.804019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1a1ef-a8d0-40c8-971c-b3fd50062cd3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.812952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-82269ad6-5f6e-4097-9133-ae5ef2f812ea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:52.814162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-82269ad6-5f6e-4097-9133-ae5ef2f812ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:52.815738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1a1ef-a8d0-40c8-971c-b3fd50062cd3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:52.820829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:52.822186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.822746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.822846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 133/274] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:52.823816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.823918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269ad6-5f6e-4097-9133-ae5ef2f812ea None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.833001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269ad6-5f6e-4097-9133-ae5ef2f812ea None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:52.838249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:52.839037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.839320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.839587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.840770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:52.842024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:52.842555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:52.844539 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 134/275] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:52.850469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.850591 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:52.852062 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 142/276] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:52.854742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.860233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2290b5-f820-47ac-8641-e89986fc536c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:52.864567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa475d6d-692f-4446-918d-a04da88c055b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:52.864681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91ecd7-546d-47e4-8d6b-4af4db3959b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:52.865398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ecd7-546d-47e4-8d6b-4af4db3959b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.865682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ecd7-546d-47e4-8d6b-4af4db3959b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.865955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ecd7-546d-47e4-8d6b-4af4db3959b9 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.866670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91ecd7-546d-47e4-8d6b-4af4db3959b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:52.868549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91ecd7-546d-47e4-8d6b-4af4db3959b9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:52.870248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:52.871172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.871616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.872034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.883220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:52.890153 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:52.891316 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 143/277] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:52.894201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.903611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb34a9c-666f-4ab7-8959-1ed5c718036f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:52.907865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:52.908488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.908764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.909072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.909810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:52.910110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:52.912342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:52.920491 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 144/278] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:52.925324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.930530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1065cb-25fb-45a2-afb3-d2c1396fb25c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:52.934675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:52.935286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.935562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.935832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.936685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:52.937072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:52.938630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:52.953347 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 145/279] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:52.953347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.960058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa13e8-5f21-450f-9fbd-95b60ddb254e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:52.964022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:52.964868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.965176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.965445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] PATH_INFO: `/v3/users/20824e5fc0c640b1a7a315723c8251bf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.979096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] RBAC: Authorizing `identity:get_user(user_id=20824e5fc0c640b1a7a315723c8251bf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:52.981268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:52.982883 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 146/280] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/users/20824e5fc0c640b1a7a315723c8251bf => generated 293 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:52.983628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.984710 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 135/281] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:44:52 2021] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:52.986268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e959e-825d-4e13-bfb7-6415865fba7b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:52.986554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e959e-825d-4e13-bfb7-6415865fba7b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:52.986824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e959e-825d-4e13-bfb7-6415865fba7b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:52.988906 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 136/282] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:52.989837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e959e-825d-4e13-bfb7-6415865fba7b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:52.995570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c46b2-cabd-4629-9f44-f9dab3d36f4d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.000522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e15be3-6844-4ea9-a928-f4337a6d2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.001517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e15be3-6844-4ea9-a928-f4337a6d2820 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.001796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e15be3-6844-4ea9-a928-f4337a6d2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.002063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e15be3-6844-4ea9-a928-f4337a6d2820 admin admin] PATH_INFO: `/v3/users/9b06d15908344cf986dd0385331e18ea` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.003366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e15be3-6844-4ea9-a928-f4337a6d2820 admin admin] RBAC: Authorizing `identity:get_user(user_id=9b06d15908344cf986dd0385331e18ea)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.006285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e15be3-6844-4ea9-a928-f4337a6d2820 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.007815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e959e-825d-4e13-bfb7-6415865fba7b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.007951 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 147/283] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/users/9b06d15908344cf986dd0385331e18ea => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:53.009222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12ec4-b08f-475f-a79a-c6c88d616c10 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.009586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12ec4-b08f-475f-a79a-c6c88d616c10 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.009865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a12ec4-b08f-475f-a79a-c6c88d616c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.017424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.020595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.020595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.020595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.020595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, user.id=20824e5fc0c640b1a7a315723c8251bf, scope.system=all) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:53.020595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.023437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.032056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 137/284] 10.222.0.32 () {56 vars in 1329 bytes} [Sat Dec 25 20:44:52 2021] GET /identity/v3/role_assignments?user.id=20824e5fc0c640b1a7a315723c8251bf&scope.system=all&role.id=cb697f13703f4bc19072e3c59c644481 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:53.032248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-21a12ec4-b08f-475f-a79a-c6c88d616c10 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:53.033353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.033615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-21a12ec4-b08f-475f-a79a-c6c88d616c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:53.048351 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 148/285] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:53.055813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52083a5b-8133-4704-abbe-5a2afb120428 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.061250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.062595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.063123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.063641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.065389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.067849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.070083 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 138/286] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:53 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:53.076852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.077286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12ec4-b08f-475f-a79a-c6c88d616c10 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.086741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a12ec4-b08f-475f-a79a-c6c88d616c10 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.088783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168fd13-1acc-40cb-828f-50497bf65b0b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.091890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.092960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.093322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.093643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.095421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.097339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.097899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.098360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/9b06d15908344cf986dd0385331e18ea/roles/3909633dfd444fa5b26579f3cdd899d3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.102066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ad69bd938b400484a11e5ec679eb11, user_id=9b06d15908344cf986dd0385331e18ea, role_id=3909633dfd444fa5b26579f3cdd899d3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.105915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.107591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:53.115530 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:53.117127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 149/287] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:53.123896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.134387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4525594-d510-4595-b70d-089d04acd0be admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.139355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.140046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.140324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.140596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.141435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:53.141738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.143436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.153780 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 150/288] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:53.160048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.171702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323c49-53ae-4c3b-8fe3-e2c113ecb78b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.176499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.178034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.178313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.178584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] PATH_INFO: `/v3/users/8c368ed9c76647988c870829736ced41` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.180026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] RBAC: Authorizing `identity:get_user(user_id=8c368ed9c76647988c870829736ced41)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.182323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.184321 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 151/289] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:53 2021] GET /identity/v3/users/8c368ed9c76647988c870829736ced41 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:53.191051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.204809 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 139/290] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:44:53 2021] PUT /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11/users/9b06d15908344cf986dd0385331e18ea/roles/3909633dfd444fa5b26579f3cdd899d3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:53.206243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e2bef-b12d-4206-ac0e-22871e75e42b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.280233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.280942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.281230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.281507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.292167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.293999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.304859 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 152/291] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:53 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:44:53.311294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.322328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbb426-8b79-49d8-85f2-8c99e10c8911 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.327194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53678f53-e7e3-4744-8fb4-a4644db9f4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.328338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53678f53-e7e3-4744-8fb4-a4644db9f4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.328802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53678f53-e7e3-4744-8fb4-a4644db9f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.329304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53678f53-e7e3-4744-8fb4-a4644db9f4d8 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.330749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53678f53-e7e3-4744-8fb4-a4644db9f4d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.333039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53678f53-e7e3-4744-8fb4-a4644db9f4d8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.335085 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 140/292] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:53 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:53.341727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:53.353054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b782-f93a-48d3-a875-aead458dc467 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:53.360169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe02b4-743f-4d5d-a8ee-bd225f5f5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:53.361126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe02b4-743f-4d5d-a8ee-bd225f5f5f42 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:53.361579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe02b4-743f-4d5d-a8ee-bd225f5f5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:53.361997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe02b4-743f-4d5d-a8ee-bd225f5f5f42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:53.363002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe02b4-743f-4d5d-a8ee-bd225f5f5f42 admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=8c368ed9c76647988c870829736ced41) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:53.363460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe02b4-743f-4d5d-a8ee-bd225f5f5f42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:53.366087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe02b4-743f-4d5d-a8ee-bd225f5f5f42 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:53.373481 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 153/293] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:53 2021] GET /identity/v3/role_assignments?user.id=8c368ed9c76647988c870829736ced41&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=cb697f13703f4bc19072e3c59c644481 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:55.510580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195089b2-7383-40a3-8ec7-6b4c4645569c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.511096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195089b2-7383-40a3-8ec7-6b4c4645569c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.511096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195089b2-7383-40a3-8ec7-6b4c4645569c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.513148 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 141/294] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:55.519360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53737-b51b-45c5-b8b7-1a1858671d67 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.519804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53737-b51b-45c5-b8b7-1a1858671d67 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.519985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53737-b51b-45c5-b8b7-1a1858671d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.542279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c0b53737-b51b-45c5-b8b7-1a1858671d67 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:55.547638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c0b53737-b51b-45c5-b8b7-1a1858671d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:55.551499 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 154/295] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:55.576465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195089b2-7383-40a3-8ec7-6b4c4645569c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.589256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195089b2-7383-40a3-8ec7-6b4c4645569c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.593641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.594421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.594698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.594970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.607467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:55.615119 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:55.616328 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 142/296] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:55.622990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b53737-b51b-45c5-b8b7-1a1858671d67 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.637255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b53737-b51b-45c5-b8b7-1a1858671d67 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.641975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.642638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.642918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.643191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.643949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:55.644258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:55.646444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:55.656642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 155/297] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:55.663348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.673620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aedbb4-5acb-450d-a24b-2fa82b1a702b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.685607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b41e4-7c5e-4614-84c6-9625a19f315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.686746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b41e4-7c5e-4614-84c6-9625a19f315b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.687200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b41e4-7c5e-4614-84c6-9625a19f315b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.687641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b41e4-7c5e-4614-84c6-9625a19f315b admin admin] PATH_INFO: `/v3/users/20824e5fc0c640b1a7a315723c8251bf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.689079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b41e4-7c5e-4614-84c6-9625a19f315b admin admin] RBAC: Authorizing `identity:get_user(user_id=20824e5fc0c640b1a7a315723c8251bf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:55.691363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b41e4-7c5e-4614-84c6-9625a19f315b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:55.693235 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 143/298] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/users/20824e5fc0c640b1a7a315723c8251bf => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:55.699710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.700369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4657aa-26be-4dc1-8798-1ad25cbabdc2 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.700763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4657aa-26be-4dc1-8798-1ad25cbabdc2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.701064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4657aa-26be-4dc1-8798-1ad25cbabdc2 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.702838 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 144/299] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:44:55.708967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763947d-7c6a-46de-909b-3333d47b14fb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.709252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763947d-7c6a-46de-909b-3333d47b14fb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.709521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763947d-7c6a-46de-909b-3333d47b14fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.710937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d746e-f1ce-4503-8c93-3959102a1bcf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.715413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad55f8-78ee-4b8c-9bc5-bf4691c0a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.716259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad55f8-78ee-4b8c-9bc5-bf4691c0a563 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.716540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad55f8-78ee-4b8c-9bc5-bf4691c0a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.716815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad55f8-78ee-4b8c-9bc5-bf4691c0a563 admin admin] PATH_INFO: `/v3/system/users/20824e5fc0c640b1a7a315723c8251bf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.718594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad55f8-78ee-4b8c-9bc5-bf4691c0a563 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=20824e5fc0c640b1a7a315723c8251bf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:55.719632 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-47ad55f8-78ee-4b8c-9bc5-bf4691c0a563 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:55.719632 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:44:55.719632 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:44:55.720490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad55f8-78ee-4b8c-9bc5-bf4691c0a563 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:55.729506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8763947d-7c6a-46de-909b-3333d47b14fb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:55.730678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8763947d-7c6a-46de-909b-3333d47b14fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:55.738360 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 145/300] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:55.763419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763947d-7c6a-46de-909b-3333d47b14fb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.773573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763947d-7c6a-46de-909b-3333d47b14fb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.777924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.778707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.778984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.779250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.790028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:55.797109 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:55.798483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 146/301] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:55.804447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.813779 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 156/302] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 20:44:55 2021] PUT /identity/v3/system/users/20824e5fc0c640b1a7a315723c8251bf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:55.821035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1d05-1ce8-4794-a19a-e0334b978af7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.825490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.826276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.826558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.826829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.827604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:55.827914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:55.829713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:55.840348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfc8a5-03eb-4723-bda8-8b6e7871be81 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.840957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfc8a5-03eb-4723-bda8-8b6e7871be81 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.841068 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 147/303] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:55.841334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfc8a5-03eb-4723-bda8-8b6e7871be81 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.843384 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 157/304] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:55.847351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.850687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a31c-1456-4100-8a35-e60949e0968c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.851083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a31c-1456-4100-8a35-e60949e0968c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.851460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a31c-1456-4100-8a35-e60949e0968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.858159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be163d33-760a-4d15-a27c-7d9d3d6bc253 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.862617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb3d28-3f43-4a72-ae21-17036f04615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.863494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb3d28-3f43-4a72-ae21-17036f04615e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.863774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb3d28-3f43-4a72-ae21-17036f04615e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.864124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb3d28-3f43-4a72-ae21-17036f04615e admin admin] PATH_INFO: `/v3/users/bd77b1f44415443180b687d5b7b24ce8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.879778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9524a31c-1456-4100-8a35-e60949e0968c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:55.881279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb3d28-3f43-4a72-ae21-17036f04615e admin admin] RBAC: Authorizing `identity:get_user(user_id=bd77b1f44415443180b687d5b7b24ce8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:55.881417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9524a31c-1456-4100-8a35-e60949e0968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:55.883397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb3d28-3f43-4a72-ae21-17036f04615e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:55.885304 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 148/305] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/users/bd77b1f44415443180b687d5b7b24ce8 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:55.892930 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 158/306] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:55.893124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667ad3-6092-4095-a90a-4ba78f72e49e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.893124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667ad3-6092-4095-a90a-4ba78f72e49e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.893124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667ad3-6092-4095-a90a-4ba78f72e49e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.893375 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 149/307] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:55.900918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524a31c-1456-4100-8a35-e60949e0968c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.901148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5edb-7535-48a8-b03d-eee9104559f3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.901148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5edb-7535-48a8-b03d-eee9104559f3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.901148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5edb-7535-48a8-b03d-eee9104559f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.911765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524a31c-1456-4100-8a35-e60949e0968c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.916897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.917761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.918134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.918503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.919446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] RBAC: Adding query filter params (role.id=3909633dfd444fa5b26579f3cdd899d3, user.id=bd77b1f44415443180b687d5b7b24ce8, scope.system=all) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:55.919857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:55.921887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:55.927469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a07b5edb-7535-48a8-b03d-eee9104559f3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:55.928694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a07b5edb-7535-48a8-b03d-eee9104559f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:55.933095 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 159/308] 10.222.0.32 () {56 vars in 1329 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/role_assignments?user.id=bd77b1f44415443180b687d5b7b24ce8&scope.system=all&role.id=3909633dfd444fa5b26579f3cdd899d3 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:55.933095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.939439 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 150/309] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:55.951165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1f1b1-45ad-4bae-9328-029342212f96 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.956406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.957577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.958034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.958548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.973025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b5edb-7535-48a8-b03d-eee9104559f3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.974415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:55.981851 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:55.982855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b5edb-7535-48a8-b03d-eee9104559f3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:55.983965 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 160/310] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/roles/reader => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:44:55.992913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:55.992913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:55.992913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:55.992913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:55.993322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:55.993392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:55.993392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:55.995537 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 151/311] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:56.001642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:56.006282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6e99f-4aa1-425d-abab-23effd11554b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:56.011356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:56.012043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:56.012383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:56.012665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:56.014184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:56.014438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:56.016472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:56.017912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c497890-24a1-4ef9-9c6c-71a85c99c6c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:56.024538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:56.025540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:56.025989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:56.026419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] PATH_INFO: `/v3/groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:56.026546 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 161/312] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:56.027394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:56.028593 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:44:56.028593 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:44:56.028593 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:44:56.030135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:56.032854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:56.045083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe1230-c1bf-46a2-9e2d-a6cd96ed91a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:56.049689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:56.050581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:56.052795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:56.052795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] PATH_INFO: `/v3/users/9b06d15908344cf986dd0385331e18ea` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:56.053125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] RBAC: Authorizing `identity:get_user(user_id=9b06d15908344cf986dd0385331e18ea)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:56.055273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:56.057165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 162/313] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:56 2021] GET /identity/v3/users/9b06d15908344cf986dd0385331e18ea => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:56.063189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:56.073540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce80b51-dd01-4832-8449-0b21fd78302e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:56.078956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:56.079569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:56.079852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:56.090001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:56.090001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:56.091194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:56.102439 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 163/314] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:44:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:44:56.108710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:56.119006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982930a-9e36-4191-96a9-6ad6f9caed4a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:56.126800 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 152/315] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 20:44:56 2021] POST /identity/v3/groups => generated 229 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:44:56.126940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78db5ee-27f2-407d-b7a3-34a14a939985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:56.126940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db5ee-27f2-407d-b7a3-34a14a939985 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:56.126940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db5ee-27f2-407d-b7a3-34a14a939985 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:56.126940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db5ee-27f2-407d-b7a3-34a14a939985 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:56.127325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78db5ee-27f2-407d-b7a3-34a14a939985 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:56.129409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78db5ee-27f2-407d-b7a3-34a14a939985 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:56.131351 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 164/316] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:44:56 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:56.143647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:56.155244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580aaf-f5f3-4db3-a8ea-1536d939d136 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:56.160651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73bb7e-024c-4f64-bb69-75fff9409e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:56.162077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bb7e-024c-4f64-bb69-75fff9409e64 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:56.162424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bb7e-024c-4f64-bb69-75fff9409e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:56.162762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bb7e-024c-4f64-bb69-75fff9409e64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:56.163754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73bb7e-024c-4f64-bb69-75fff9409e64 admin admin] RBAC: Adding query filter params (role.id=3909633dfd444fa5b26579f3cdd899d3, scope.project.id=f9ad69bd938b400484a11e5ec679eb11, user.id=9b06d15908344cf986dd0385331e18ea) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:56.164187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73bb7e-024c-4f64-bb69-75fff9409e64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:56.166426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73bb7e-024c-4f64-bb69-75fff9409e64 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:56.173954 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 153/317] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:44:56 2021] GET /identity/v3/role_assignments?user.id=9b06d15908344cf986dd0385331e18ea&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=3909633dfd444fa5b26579f3cdd899d3 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:58.296048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbaf7d-30b9-4efb-b817-1afd1ec05008 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.296563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbaf7d-30b9-4efb-b817-1afd1ec05008 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.296637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbaf7d-30b9-4efb-b817-1afd1ec05008 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.298671 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 165/318] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:58.304289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aade19-acf9-4e2e-b1f1-6665f1af31bc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.304739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aade19-acf9-4e2e-b1f1-6665f1af31bc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.304816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aade19-acf9-4e2e-b1f1-6665f1af31bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.322888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-33aade19-acf9-4e2e-b1f1-6665f1af31bc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:58.324058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-33aade19-acf9-4e2e-b1f1-6665f1af31bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:58.331567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 154/319] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:44:58.355050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615b72-b42c-4a60-b657-c0348eaadfe2 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.355391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615b72-b42c-4a60-b657-c0348eaadfe2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.355872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615b72-b42c-4a60-b657-c0348eaadfe2 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.356717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aade19-acf9-4e2e-b1f1-6665f1af31bc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.357623 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 166/320] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:58.363159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0df351-bcde-446a-a6e2-c86235654646 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.363440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0df351-bcde-446a-a6e2-c86235654646 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.363711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0df351-bcde-446a-a6e2-c86235654646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.365952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aade19-acf9-4e2e-b1f1-6665f1af31bc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.370527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.371304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.371580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.371849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.382087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8e0df351-bcde-446a-a6e2-c86235654646 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:58.382821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:58.383272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8e0df351-bcde-446a-a6e2-c86235654646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:58.389788 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:44:58.390873 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 167/321] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:58.396466 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 155/322] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:58.397560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0df351-bcde-446a-a6e2-c86235654646 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.409662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0df351-bcde-446a-a6e2-c86235654646 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.413880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.414519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.415064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.415340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.415755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.416148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:58.416379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.417967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.426099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a539b-a502-4a46-b000-4b53ad418da7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.429244 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 168/323] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:58.430489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.431352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.431631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.431885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.431988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.442143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64405691-fd05-4b40-a94c-5266fcab3423 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.443647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:44:58.447390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.448276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.448558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.448827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] PATH_INFO: `/v3/users/20824e5fc0c640b1a7a315723c8251bf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.450095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] RBAC: Authorizing `identity:get_user(user_id=20824e5fc0c640b1a7a315723c8251bf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.450504 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:44:58.451803 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 156/324] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:44:58.452186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.453885 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 169/325] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/users/20824e5fc0c640b1a7a315723c8251bf => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:58.457835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.460004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.467964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d10c-f782-41bf-bf3d-e4e22c8f6e77 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.470518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f526cb3-bce7-47c7-bf29-3effa5c34362 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.472120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.472749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.473061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.473331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.474100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:58.474401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.474829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.475435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.475711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.475953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.476046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.476778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] RBAC: Adding query filter params (role.id=cb697f13703f4bc19072e3c59c644481, user.id=20824e5fc0c640b1a7a315723c8251bf, scope.system=all) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:44:58.477283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.479409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.484243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 157/326] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:58.490117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.495524 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 170/327] 10.222.0.32 () {56 vars in 1329 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/role_assignments?user.id=20824e5fc0c640b1a7a315723c8251bf&scope.system=all&role.id=cb697f13703f4bc19072e3c59c644481 => generated 510 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:58.500031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c93c-e8a9-444d-8637-9adffe73605c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.504388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e342dc-0db7-403b-bc76-0764ec54c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.505864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e342dc-0db7-403b-bc76-0764ec54c820 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.506137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e342dc-0db7-403b-bc76-0764ec54c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.506400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e342dc-0db7-403b-bc76-0764ec54c820 admin admin] PATH_INFO: `/v3/users/bd77b1f44415443180b687d5b7b24ce8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.507696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e342dc-0db7-403b-bc76-0764ec54c820 admin admin] RBAC: Authorizing `identity:get_user(user_id=bd77b1f44415443180b687d5b7b24ce8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.509887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e342dc-0db7-403b-bc76-0764ec54c820 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.511811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 158/328] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/users/bd77b1f44415443180b687d5b7b24ce8 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:44:58.518052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.528349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121edf4-9f3f-42b2-87c4-c67c82bdf00c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.532758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.533669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.533942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.534209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] PATH_INFO: `/v3/system/users/bd77b1f44415443180b687d5b7b24ce8/roles/3909633dfd444fa5b26579f3cdd899d3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.535787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bd77b1f44415443180b687d5b7b24ce8, role_id=3909633dfd444fa5b26579f3cdd899d3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.537999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.595593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70794fcf-26ed-489f-9c01-66ec07f56c9c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.595798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70794fcf-26ed-489f-9c01-66ec07f56c9c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.596072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70794fcf-26ed-489f-9c01-66ec07f56c9c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.597912 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 159/329] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:44:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:44:58.604527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8b83-2c90-40df-9827-9a041f500d2e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.604812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8b83-2c90-40df-9827-9a041f500d2e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.605118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e8b83-2c90-40df-9827-9a041f500d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.612920 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 171/330] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 20:44:58 2021] PUT /identity/v3/system/users/bd77b1f44415443180b687d5b7b24ce8/roles/3909633dfd444fa5b26579f3cdd899d3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:44:58.625772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ca5e8b83-2c90-40df-9827-9a041f500d2e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:44:58.627246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca5e8b83-2c90-40df-9827-9a041f500d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:44:58.636956 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 160/331] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:44:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:44:58.661934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.672214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f37a3d-9aaa-4d6e-a710-66be2e61fcb4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.676832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf36f86-db7d-43be-bf1f-1af091b1a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.677764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36f86-db7d-43be-bf1f-1af091b1a9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.678049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36f86-db7d-43be-bf1f-1af091b1a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.678347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf36f86-db7d-43be-bf1f-1af091b1a9d8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.679662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf36f86-db7d-43be-bf1f-1af091b1a9d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.681520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf36f86-db7d-43be-bf1f-1af091b1a9d8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.683490 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 172/332] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:44:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:44:58.689600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e8b83-2c90-40df-9827-9a041f500d2e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:44:58.699312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e8b83-2c90-40df-9827-9a041f500d2e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:44:58.703866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b343b1-8cd2-4f8c-9080-bec3771a9b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:44:58.704556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b343b1-8cd2-4f8c-9080-bec3771a9b71 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:44:58.704835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b343b1-8cd2-4f8c-9080-bec3771a9b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:44:58.705137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b343b1-8cd2-4f8c-9080-bec3771a9b71 admin admin] PATH_INFO: `/v3/groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:44:58.705868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b343b1-8cd2-4f8c-9080-bec3771a9b71 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:44:58.707821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b343b1-8cd2-4f8c-9080-bec3771a9b71 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:44:58.807137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 161/333] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 20:44:58 2021] POST /identity/v3/groups => generated 226 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:01.233894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6dd53-28ae-4c62-af70-21646537fdeb None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.234915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6dd53-28ae-4c62-af70-21646537fdeb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.235402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6dd53-28ae-4c62-af70-21646537fdeb None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.237706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 173/334] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:01.243894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2974fd-ded8-4b57-841c-eaada66bee7e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.245008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2974fd-ded8-4b57-841c-eaada66bee7e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.245489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2974fd-ded8-4b57-841c-eaada66bee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.269512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4d2974fd-ded8-4b57-841c-eaada66bee7e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:01.271106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d2974fd-ded8-4b57-841c-eaada66bee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:01.279231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 162/335] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:01.326299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6dd53-28ae-4c62-af70-21646537fdeb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.340589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6dd53-28ae-4c62-af70-21646537fdeb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.346813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.347868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.348348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.349453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.364368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:01.372500 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 25 20:45:01.377057 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 174/336] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:01.380325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2974fd-ded8-4b57-841c-eaada66bee7e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.389956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2974fd-ded8-4b57-841c-eaada66bee7e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.397078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.398001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.398651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.399129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.400090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:01.400606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.402418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.413003 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 163/337] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:01.420446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.434617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94581fa-65d5-4754-b58e-4c5f457f1eda admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.443023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaa326-3f6d-462d-8746-f9224885b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.444271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaa326-3f6d-462d-8746-f9224885b2db admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.444781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaa326-3f6d-462d-8746-f9224885b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.445301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaa326-3f6d-462d-8746-f9224885b2db admin admin] PATH_INFO: `/v3/users/bd77b1f44415443180b687d5b7b24ce8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.447156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daaa326-3f6d-462d-8746-f9224885b2db admin admin] RBAC: Authorizing `identity:get_user(user_id=bd77b1f44415443180b687d5b7b24ce8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.449536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daaa326-3f6d-462d-8746-f9224885b2db admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.451399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 175/338] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/users/bd77b1f44415443180b687d5b7b24ce8 => generated 293 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:01.457795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.468675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a573703-f7a9-40eb-8070-30686020186e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.478796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.478796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.478796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.479377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.481817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13496-1673-4d7a-9205-a99b1dbe8eef None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.482307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13496-1673-4d7a-9205-a99b1dbe8eef None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.482774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a13496-1673-4d7a-9205-a99b1dbe8eef None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.484771 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 176/339] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:01.485381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] RBAC: Adding query filter params (role.id=3909633dfd444fa5b26579f3cdd899d3, user.id=bd77b1f44415443180b687d5b7b24ce8, scope.system=all) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:01.485911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.487992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.494849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0c39-dd28-4d03-80b1-f2de5421171b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.495421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0c39-dd28-4d03-80b1-f2de5421171b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.499529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0c39-dd28-4d03-80b1-f2de5421171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.519037 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 164/340] 10.222.0.32 () {56 vars in 1329 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/role_assignments?user.id=bd77b1f44415443180b687d5b7b24ce8&scope.system=all&role.id=3909633dfd444fa5b26579f3cdd899d3 => generated 510 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:01.526019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b2ec0c39-dd28-4d03-80b1-f2de5421171b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:01.527576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b2ec0c39-dd28-4d03-80b1-f2de5421171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:01.546529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 177/341] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:01.587536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.602123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667654-879a-420b-b928-dab1b02cb8cd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.610793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32185781-8100-433f-804d-adb408f14350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.611722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185781-8100-433f-804d-adb408f14350 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.612008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185781-8100-433f-804d-adb408f14350 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.612285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185781-8100-433f-804d-adb408f14350 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.633601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32185781-8100-433f-804d-adb408f14350 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:01.645890 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-32185781-8100-433f-804d-adb408f14350 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:45:01.647171 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 165/342] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:01.653666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec0c39-dd28-4d03-80b1-f2de5421171b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.667634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec0c39-dd28-4d03-80b1-f2de5421171b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.677373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.678450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.678931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.679411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.680463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:01.681001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.682823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.697611 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 178/343] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:01.705098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32185781-8100-433f-804d-adb408f14350 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.718282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32185781-8100-433f-804d-adb408f14350 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.729205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.729878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.730165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.730445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.749625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.751329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.763510 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 166/344] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:01.769684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.787696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362622-a411-4dc9-bb8b-48c47c50e4d4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.796913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.798124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.798604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.799072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.803255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.805748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.807891 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 179/345] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:01.814124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.825914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b405fb-e5b9-4470-a73c-a93986ba4b24 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.837214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46ae1-27df-4a05-b2dd-fc651145a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.838093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46ae1-27df-4a05-b2dd-fc651145a551 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.838376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46ae1-27df-4a05-b2dd-fc651145a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.838652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46ae1-27df-4a05-b2dd-fc651145a551 admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.851744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46ae1-27df-4a05-b2dd-fc651145a551 admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.852791 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-19d46ae1-27df-4a05-b2dd-fc651145a551 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:01.852791 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:01.852791 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:01.854114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46ae1-27df-4a05-b2dd-fc651145a551 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.856055 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 167/346] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:01.862714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:01.878897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff699844-a222-48da-abe7-79d941524322 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:01.888592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f728001-dccd-4fc0-8454-5a88c9e7d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:01.889575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f728001-dccd-4fc0-8454-5a88c9e7d41b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.890060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f728001-dccd-4fc0-8454-5a88c9e7d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.890532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f728001-dccd-4fc0-8454-5a88c9e7d41b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.891602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f728001-dccd-4fc0-8454-5a88c9e7d41b admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=43439940dd2449978937f225023600e8) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:01.892146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f728001-dccd-4fc0-8454-5a88c9e7d41b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:01.894234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f728001-dccd-4fc0-8454-5a88c9e7d41b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:01.905681 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 180/347] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:01 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=43439940dd2449978937f225023600e8&role.id=cb697f13703f4bc19072e3c59c644481 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:01.980862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b483-e31d-4d6f-a55b-9293421ea78f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.981212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b483-e31d-4d6f-a55b-9293421ea78f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.981449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b483-e31d-4d6f-a55b-9293421ea78f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:01.983243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 168/348] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:01.989758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a19fb-ff41-405d-abdf-4a3626ad5d03 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:01.990383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a19fb-ff41-405d-abdf-4a3626ad5d03 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:01.990860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a19fb-ff41-405d-abdf-4a3626ad5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.010901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f60a19fb-ff41-405d-abdf-4a3626ad5d03 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:02.012381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f60a19fb-ff41-405d-abdf-4a3626ad5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:02.024572 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 181/349] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:02.053197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b483-e31d-4d6f-a55b-9293421ea78f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:02.067729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b483-e31d-4d6f-a55b-9293421ea78f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:02.072491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:02.073391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.073725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.074003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.087551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:02.095501 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:45:02.097119 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 169/350] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:02.104020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a19fb-ff41-405d-abdf-4a3626ad5d03 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:02.121413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a19fb-ff41-405d-abdf-4a3626ad5d03 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:02.129860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:02.130894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.131371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.131858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.132839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:02.133409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:02.135235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:02.147399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 182/351] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:02.160634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:02.181743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eea8c-2a82-4e31-926d-417ad7c3e380 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:02.192529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:02.193260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.193542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.193817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.207603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:02.209620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:02.220423 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 170/352] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:02.227289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:02.251731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d2fd-cd58-4aa1-bb61-23eb810fa227 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:02.263316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:02.264125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.264404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.264679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.269923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:02.272056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:02.274765 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 183/353] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:02 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:02.280596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:02.290668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b49f-6947-41b2-8384-0a84b4c7c522 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:02.301125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6493ea-3b3e-4799-b732-b4ab9a72bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:02.302605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6493ea-3b3e-4799-b732-b4ab9a72bb89 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.302885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6493ea-3b3e-4799-b732-b4ab9a72bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.303163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6493ea-3b3e-4799-b732-b4ab9a72bb89 admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.309742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6493ea-3b3e-4799-b732-b4ab9a72bb89 admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:02.311718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6493ea-3b3e-4799-b732-b4ab9a72bb89 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:02.313878 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 171/354] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:02 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:02.320463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:02.334002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a39b9c-af36-44c6-b3ba-e8a41806f38e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:02.345560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490240c2-69da-492b-9e78-9af3fb71fb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:02.346224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490240c2-69da-492b-9e78-9af3fb71fb58 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.346510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490240c2-69da-492b-9e78-9af3fb71fb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.346790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490240c2-69da-492b-9e78-9af3fb71fb58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.347642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490240c2-69da-492b-9e78-9af3fb71fb58 admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=43439940dd2449978937f225023600e8) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:02.347954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490240c2-69da-492b-9e78-9af3fb71fb58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:02.350395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490240c2-69da-492b-9e78-9af3fb71fb58 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:02.356923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 184/355] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:02 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=43439940dd2449978937f225023600e8&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:02.862828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a64a-ab47-4484-bfd5-838375c21e7f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.863262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a64a-ab47-4484-bfd5-838375c21e7f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.863433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a64a-ab47-4484-bfd5-838375c21e7f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.865220 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 172/356] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:02.871161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64dd7-5395-4c42-a59e-fbc7a7285bea None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.871530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64dd7-5395-4c42-a59e-fbc7a7285bea None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.871813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64dd7-5395-4c42-a59e-fbc7a7285bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.896789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ccd64dd7-5395-4c42-a59e-fbc7a7285bea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:02.898018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ccd64dd7-5395-4c42-a59e-fbc7a7285bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:02.907446 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 185/357] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:02.937157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a64a-ab47-4484-bfd5-838375c21e7f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:02.960813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a64a-ab47-4484-bfd5-838375c21e7f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:02.965670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:02.966465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:02.966742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:02.967010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:02.986941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:02.994474 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:45:02.995848 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 173/358] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:03.001877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64dd7-5395-4c42-a59e-fbc7a7285bea None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.014808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64dd7-5395-4c42-a59e-fbc7a7285bea None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.023843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.024773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.025302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.025771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.026814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:03.027318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.029182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.044527 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 186/359] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:03.050614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.061243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeda2f0-7669-47e6-81db-28f606a1a3f2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.068067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.068711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.069026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.069300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.081877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.083719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.096927 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 174/360] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:03.103273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.116683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efca00-d772-4639-b6b0-aea3ca8bb59a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.127106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.127979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.128259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.128532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.133634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.135718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.137437 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 187/361] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:03.143763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.158032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bccd4-0066-490f-b49d-fe0dc089db5e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.162947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b98c4-e787-484a-9d21-21035f29e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.163928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b98c4-e787-484a-9d21-21035f29e1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.164215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b98c4-e787-484a-9d21-21035f29e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.164477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b98c4-e787-484a-9d21-21035f29e1f3 admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.169916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b98c4-e787-484a-9d21-21035f29e1f3 admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.171892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b98c4-e787-484a-9d21-21035f29e1f3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.173754 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 175/362] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:03.181219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.194671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e8517-fd23-407f-a5d8-32f07c6a382e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.203849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60d6ae-9757-43ab-bcdb-4239c4f9935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.204504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d6ae-9757-43ab-bcdb-4239c4f9935a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.204786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d6ae-9757-43ab-bcdb-4239c4f9935a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.205083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d6ae-9757-43ab-bcdb-4239c4f9935a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.205924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60d6ae-9757-43ab-bcdb-4239c4f9935a admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=f9ad69bd938b400484a11e5ec679eb11) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:03.206236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60d6ae-9757-43ab-bcdb-4239c4f9935a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.208098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60d6ae-9757-43ab-bcdb-4239c4f9935a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.217157 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 188/363] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=cb697f13703f4bc19072e3c59c644481 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:03.659730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769888a-d0fd-41a6-a36e-5df2b49026ff None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.660251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769888a-d0fd-41a6-a36e-5df2b49026ff None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.660251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769888a-d0fd-41a6-a36e-5df2b49026ff None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.662854 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 176/364] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:03.668700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1e199-6cda-4764-867e-2dcdb9ae6b9a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.669212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1e199-6cda-4764-867e-2dcdb9ae6b9a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.669420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1e199-6cda-4764-867e-2dcdb9ae6b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.693885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1cf1e199-6cda-4764-867e-2dcdb9ae6b9a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:03.695073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1cf1e199-6cda-4764-867e-2dcdb9ae6b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:03.707086 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 189/365] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:03.757122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769888a-d0fd-41a6-a36e-5df2b49026ff None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.769615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769888a-d0fd-41a6-a36e-5df2b49026ff None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.775887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.776686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.776989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.777262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.790974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:03.797931 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:03.799425 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 177/366] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:03.805472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1e199-6cda-4764-867e-2dcdb9ae6b9a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.814739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1e199-6cda-4764-867e-2dcdb9ae6b9a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.823660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.824336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.824613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.824897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.825741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:03.826053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.827673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.841174 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 190/367] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:03.847126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.859456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a02bb4-09ac-4a88-a4f5-f0ddda288d98 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.864229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.864892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.865176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.865452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.878502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.881055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.894451 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 178/368] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:45:03.900770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.913937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f8ae2-e870-4055-a625-8f2d438900bc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.922381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37bfda-0ede-4f91-9913-e7ac8c5226f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.923237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37bfda-0ede-4f91-9913-e7ac8c5226f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.923632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37bfda-0ede-4f91-9913-e7ac8c5226f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.923914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37bfda-0ede-4f91-9913-e7ac8c5226f6 admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.925159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37bfda-0ede-4f91-9913-e7ac8c5226f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.927516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37bfda-0ede-4f91-9913-e7ac8c5226f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.929480 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 191/369] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:03.935261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:03.945926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c932-7f99-42d3-9d90-a6b97214d2c9 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.946213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c932-7f99-42d3-9d90-a6b97214d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.946492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c932-7f99-42d3-9d90-a6b97214d2c9 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.952864 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 192/370] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:03.953058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde1b6d-709b-443a-85f7-197deb2d0921 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:03.954127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b5b6f-6a7b-49a6-8c7c-d36d9b35fecc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.954417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b5b6f-6a7b-49a6-8c7c-d36d9b35fecc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.954694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b5b6f-6a7b-49a6-8c7c-d36d9b35fecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.962007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:03.962849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:03.963133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:03.963409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] PATH_INFO: `/v3/groups/e63cbbd9914e467093f8290625e4602c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:03.977517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] RBAC: Authorizing `identity:get_group(group_id=e63cbbd9914e467093f8290625e4602c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:03.979500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:03.981259 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 179/371] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/groups/e63cbbd9914e467093f8290625e4602c => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:03.986407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a89b5b6f-6a7b-49a6-8c7c-d36d9b35fecc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:03.987590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a89b5b6f-6a7b-49a6-8c7c-d36d9b35fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:03.989726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:04.002185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acd28f-7985-48b1-949c-6e8c24e08351 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:04.007465 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 193/372] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:04.010548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:04.011253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:04.011577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:04.011902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:04.012737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] RBAC: Adding query filter params (group.id=e63cbbd9914e467093f8290625e4602c, role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=41b3685f056e42a38cb9ec18c9d20fa2) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:04.013113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:04.015194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:04.021619 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 180/373] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:03 2021] GET /identity/v3/role_assignments?group.id=e63cbbd9914e467093f8290625e4602c&scope.project.id=41b3685f056e42a38cb9ec18c9d20fa2&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:04.051154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b5b6f-6a7b-49a6-8c7c-d36d9b35fecc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:04.061865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b5b6f-6a7b-49a6-8c7c-d36d9b35fecc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:04.070281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:04.071114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:04.071396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:04.071668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:04.086219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:04.093866 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:45:04.095515 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 194/374] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:04.101802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:04.112331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0f6f-cd8a-456b-9a39-fc8a33a75dab admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:04.118926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:04.120074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:04.120360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:04.120634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:04.121445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:04.121747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:04.123503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:04.136637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 181/375] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:04.143753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:04.154722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956f04-2ed1-4f7e-a553-6a181f0fd54f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:04.163477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:04.164203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:04.164426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:04.164705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:04.174990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:04.178692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:04.195699 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 195/376] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:04.201691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:04.212789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed1148-0943-4ab7-9b86-f621af3ccc35 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:04.223952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:04.224847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:04.225165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:04.225444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:04.226785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:04.228853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:04.230982 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 182/377] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:04 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:04.237198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:04.248736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec74c05-9810-436b-9076-b64477ff1acd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:04.257987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a166bb2-de37-4e25-9301-72bfbad16db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:04.258905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166bb2-de37-4e25-9301-72bfbad16db1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:04.259151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166bb2-de37-4e25-9301-72bfbad16db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:04.259427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166bb2-de37-4e25-9301-72bfbad16db1 admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:04.265828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a166bb2-de37-4e25-9301-72bfbad16db1 admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:04.266904 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-3a166bb2-de37-4e25-9301-72bfbad16db1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:04.266904 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:04.266904 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:04.268090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a166bb2-de37-4e25-9301-72bfbad16db1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:04.270021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 196/378] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:04 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:04.276258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:04.290542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e38fa-2e6b-4bff-9914-961aa4174245 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:04.295807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe6f51-8d17-481a-9cb5-7786a445e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:04.296459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6f51-8d17-481a-9cb5-7786a445e2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:04.296741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6f51-8d17-481a-9cb5-7786a445e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:04.297052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6f51-8d17-481a-9cb5-7786a445e2d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:04.297892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe6f51-8d17-481a-9cb5-7786a445e2d7 admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=f9ad69bd938b400484a11e5ec679eb11) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:04.298203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe6f51-8d17-481a-9cb5-7786a445e2d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:04.300026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe6f51-8d17-481a-9cb5-7786a445e2d7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:04.307456 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 183/379] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:04 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:05.488150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cfd32-069c-4830-bfd1-8978c229a5ac None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.488832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cfd32-069c-4830-bfd1-8978c229a5ac None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.488832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cfd32-069c-4830-bfd1-8978c229a5ac None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.491171 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 197/380] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:05.497298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c0bd5-1ec5-4431-b558-394bf8a64cf5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.497802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c0bd5-1ec5-4431-b558-394bf8a64cf5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.497969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c0bd5-1ec5-4431-b558-394bf8a64cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.520297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-621c0bd5-1ec5-4431-b558-394bf8a64cf5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:05.521559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-621c0bd5-1ec5-4431-b558-394bf8a64cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:05.543498 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 184/381] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:05.578581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cfd32-069c-4830-bfd1-8978c229a5ac None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.594453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cfd32-069c-4830-bfd1-8978c229a5ac None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:05.602095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:05.603079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.603370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.603650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.619914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:05.626904 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:45:05.628170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 198/382] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:05.635266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c0bd5-1ec5-4431-b558-394bf8a64cf5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.654208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c0bd5-1ec5-4431-b558-394bf8a64cf5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:05.666617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:05.667298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.667577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.667894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.668661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] RBAC: Adding query filter params (name=member) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:05.669001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:05.670729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:05.688471 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 185/383] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:05.697764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.717520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec42dd-3482-46cb-9617-1c566043bf47 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:05.728012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a39554-4fa0-4005-be3a-8be15430e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:05.731241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39554-4fa0-4005-be3a-8be15430e15a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.731241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39554-4fa0-4005-be3a-8be15430e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.734788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39554-4fa0-4005-be3a-8be15430e15a admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.738275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a39554-4fa0-4005-be3a-8be15430e15a admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:05.740746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a39554-4fa0-4005-be3a-8be15430e15a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:05.742715 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 199/384] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:05 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:05.750971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.755755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef47c4-cbd1-4c71-882a-4fe0517abc03 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.756047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef47c4-cbd1-4c71-882a-4fe0517abc03 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.756327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef47c4-cbd1-4c71-882a-4fe0517abc03 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.758347 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 200/385] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:05.767055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973c25-3c29-4513-9ec5-58e447d35e39 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.767055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973c25-3c29-4513-9ec5-58e447d35e39 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.767055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973c25-3c29-4513-9ec5-58e447d35e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.767716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef53c7f-5215-4358-a9ad-b62bbba6462a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:05.771993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:05.773173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.773657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.774178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.775640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:05.780007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:05.782480 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 186/386] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:05 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:05.788949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.803016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f956e36-2dfd-4a3b-91fc-855b908c72d0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:05.809921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6f973c25-3c29-4513-9ec5-58e447d35e39 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:05.811126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6f973c25-3c29-4513-9ec5-58e447d35e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:05.811432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:05.812660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.814225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.814705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8/groups/5888aacef2fd421499da3007d1e93a07/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.817113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43439940dd2449978937f225023600e8, group_id=5888aacef2fd421499da3007d1e93a07, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:05.820236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:05.833318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 201/387] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:05.862063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973c25-3c29-4513-9ec5-58e447d35e39 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.873091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973c25-3c29-4513-9ec5-58e447d35e39 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:05.878707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:05.879544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.879859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.880134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.892966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:05.901307 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:45:05.905774 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 202/388] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:05.909263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.920521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41c67f-12d7-4f56-b311-a78907be47b0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:05.925392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:05.925966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:05.926326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:05.926534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:05.927867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:05.928146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:05.929894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:05.941004 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 203/389] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:05.942017 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 187/390] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 20:45:05 2021] PUT /identity/v3/projects/43439940dd2449978937f225023600e8/groups/5888aacef2fd421499da3007d1e93a07/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:05.965952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:05.977657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f6d3c-5533-4adf-9037-485c1877bfe6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.044917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.045713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.045985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.046262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.047588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:06.049530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:06.051446 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 204/391] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:05 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:06.057379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:06.075968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993278cd-7c37-431e-88c6-99d1799ef80a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.084994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47016c90-2e68-473d-ae18-53f88a2d6100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.085991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47016c90-2e68-473d-ae18-53f88a2d6100 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.086349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47016c90-2e68-473d-ae18-53f88a2d6100 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.086696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47016c90-2e68-473d-ae18-53f88a2d6100 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.088036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47016c90-2e68-473d-ae18-53f88a2d6100 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:06.094551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47016c90-2e68-473d-ae18-53f88a2d6100 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:06.096980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 188/392] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:06 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:06.103266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:06.113901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a390baf-6eb6-48bc-b43c-b7421be53a4d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.125388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db3207-1e82-44dd-bec5-59e79e0179f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.126713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db3207-1e82-44dd-bec5-59e79e0179f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.127232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db3207-1e82-44dd-bec5-59e79e0179f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.127681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db3207-1e82-44dd-bec5-59e79e0179f3 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8/groups/5888aacef2fd421499da3007d1e93a07/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.130777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db3207-1e82-44dd-bec5-59e79e0179f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43439940dd2449978937f225023600e8, group_id=5888aacef2fd421499da3007d1e93a07, role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:06.133740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db3207-1e82-44dd-bec5-59e79e0179f3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:06.225254 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 205/393] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 20:45:06 2021] PUT /identity/v3/projects/43439940dd2449978937f225023600e8/groups/5888aacef2fd421499da3007d1e93a07/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:06.340616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16f82-b215-4f25-8df3-c7d2b5be1ca6 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.340960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16f82-b215-4f25-8df3-c7d2b5be1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.341126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16f82-b215-4f25-8df3-c7d2b5be1ca6 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.342917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 189/394] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:06.349511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ab530-bf68-4922-9d14-df7cdad64a3f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.349808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ab530-bf68-4922-9d14-df7cdad64a3f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.350065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ab530-bf68-4922-9d14-df7cdad64a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.374397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d57ab530-bf68-4922-9d14-df7cdad64a3f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:06.375599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d57ab530-bf68-4922-9d14-df7cdad64a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:06.452801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 206/395] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:06.490791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae16f82-b215-4f25-8df3-c7d2b5be1ca6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:06.507322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae16f82-b215-4f25-8df3-c7d2b5be1ca6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.511969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.512771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.513081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.513349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.530458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:06.538180 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:45:06.539726 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 190/396] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:06.545872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ab530-bf68-4922-9d14-df7cdad64a3f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:06.558057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ab530-bf68-4922-9d14-df7cdad64a3f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.563974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.564639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.564932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.565204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.565965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] RBAC: Adding query filter params (name=member) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:06.566268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:06.567902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:06.580597 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 207/397] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:06.586743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:06.597921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69155-9a7a-4e21-92ff-01b13229fbaa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.608395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.609595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.610104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.610631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.612083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:06.614857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:06.617102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 191/398] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:06 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:06.622806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:06.637981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844377e-4cac-4a5d-b1fc-7872a08f1831 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.644980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55886d55-db6b-4ce2-93ba-eb56616fcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.645902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d55-db6b-4ce2-93ba-eb56616fcffe admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.646176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d55-db6b-4ce2-93ba-eb56616fcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.646446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d55-db6b-4ce2-93ba-eb56616fcffe admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.653667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55886d55-db6b-4ce2-93ba-eb56616fcffe admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:06.655717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55886d55-db6b-4ce2-93ba-eb56616fcffe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:06.657806 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 208/399] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:06 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:06.664128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:06.674755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8817-3d7f-4016-a2fc-c21cfe4027cf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:06.685117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0dcb8-6e64-4ff6-aa66-6e3498f2c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:06.686300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0dcb8-6e64-4ff6-aa66-6e3498f2c8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:06.686852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0dcb8-6e64-4ff6-aa66-6e3498f2c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:06.687320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0dcb8-6e64-4ff6-aa66-6e3498f2c8ec admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11/groups/5888aacef2fd421499da3007d1e93a07/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:06.689707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0dcb8-6e64-4ff6-aa66-6e3498f2c8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ad69bd938b400484a11e5ec679eb11, group_id=5888aacef2fd421499da3007d1e93a07, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:06.692723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0dcb8-6e64-4ff6-aa66-6e3498f2c8ec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:06.790665 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 192/400] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 20:45:06 2021] PUT /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11/groups/5888aacef2fd421499da3007d1e93a07/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:07.318776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f494e-fe0a-4568-a217-9bd0140f38c2 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.319166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f494e-fe0a-4568-a217-9bd0140f38c2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.319341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f494e-fe0a-4568-a217-9bd0140f38c2 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.321426 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 209/401] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:07.327470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45695990-18b0-4950-87fa-2cd94987a819 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.327789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45695990-18b0-4950-87fa-2cd94987a819 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.328030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45695990-18b0-4950-87fa-2cd94987a819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.353870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-45695990-18b0-4950-87fa-2cd94987a819 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:07.355051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-45695990-18b0-4950-87fa-2cd94987a819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:07.423491 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 193/402] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:07.470772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f494e-fe0a-4568-a217-9bd0140f38c2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.483277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f494e-fe0a-4568-a217-9bd0140f38c2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.487720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.488506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.488782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.489098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.505312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8663e-1ad1-4a21-9534-68700e94c6a6 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.505620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8663e-1ad1-4a21-9534-68700e94c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.505860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8663e-1ad1-4a21-9534-68700e94c6a6 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.507925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 194/403] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:07.513591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a048f-fdf4-4a19-95d9-36f3729b9f7f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.513950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a048f-fdf4-4a19-95d9-36f3729b9f7f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.514141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a048f-fdf4-4a19-95d9-36f3729b9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.515972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:07.523557 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:07.525652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 210/404] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:07.531486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.548662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-529a048f-fdf4-4a19-95d9-36f3729b9f7f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:07.549861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-529a048f-fdf4-4a19-95d9-36f3729b9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:07.553050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf0cf2-f4c3-40e4-a312-2c60147eb801 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.563973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.566467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.566467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.566467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.566467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:07.566467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.568400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.572122 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 195/405] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:07.584859 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 211/406] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:07.591165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a048f-fdf4-4a19-95d9-36f3729b9f7f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.599714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.607722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a048f-fdf4-4a19-95d9-36f3729b9f7f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.617412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cf1f0-c0a7-4120-b961-21fb94cc033b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.621456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.626072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.626072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.626072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] PATH_INFO: `/v3/groups/e63cbbd9914e467093f8290625e4602c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.626072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] RBAC: Authorizing `identity:get_group(group_id=e63cbbd9914e467093f8290625e4602c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.626380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.628607 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 196/407] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/groups/e63cbbd9914e467093f8290625e4602c => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:07.634157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.635164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.636137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.636560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.637351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.651747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c81ab9-e178-4915-ba65-834de39a9fdc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.658370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:07.665587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.666578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.666695 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:45:07.666877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.667163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.668067 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 212/408] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:07.668558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.670586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.672567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 197/409] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:07.679230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.687283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.690668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b876-b1c2-4e91-98ce-db128cffc427 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.701545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f30b-e2c6-4c1e-9c7d-32b03b590759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.703022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f30b-e2c6-4c1e-9c7d-32b03b590759 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.703304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f30b-e2c6-4c1e-9c7d-32b03b590759 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.703575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f30b-e2c6-4c1e-9c7d-32b03b590759 admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2/groups/e63cbbd9914e467093f8290625e4602c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.705623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6f0b-bd56-40d9-b144-99ff2032667a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.708925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910f30b-e2c6-4c1e-9c7d-32b03b590759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b3685f056e42a38cb9ec18c9d20fa2, group_id=e63cbbd9914e467093f8290625e4602c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.715256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.715614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910f30b-e2c6-4c1e-9c7d-32b03b590759 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.716992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.717279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.718360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.719913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:07.720687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.723666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.733001 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 198/410] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:07.740215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.753908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcb0c4-f2ab-442a-a053-a3118936225e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.759369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.760293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.760631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.760943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.762293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.764232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.766321 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 199/411] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:07.772283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.782860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b66c1-1499-4ea4-9ffa-974e6c3bd092 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.787566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.788407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.788776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.789091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.790332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.792498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.794675 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 200/412] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:07 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:07.808738 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 213/413] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 20:45:07 2021] PUT /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2/groups/e63cbbd9914e467093f8290625e4602c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:07.809087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:07.822074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca5630-7c22-4805-916f-b3c9f8f12486 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:07.885902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff0c7-4e44-4949-9d20-a49c9006f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:07.886698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff0c7-4e44-4949-9d20-a49c9006f075 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:07.887029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff0c7-4e44-4949-9d20-a49c9006f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:07.887308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff0c7-4e44-4949-9d20-a49c9006f075 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11/groups/5888aacef2fd421499da3007d1e93a07/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:07.889594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff0c7-4e44-4949-9d20-a49c9006f075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ad69bd938b400484a11e5ec679eb11, group_id=5888aacef2fd421499da3007d1e93a07, role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:07.892219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff0c7-4e44-4949-9d20-a49c9006f075 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:07.972388 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 201/414] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 20:45:07 2021] PUT /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11/groups/5888aacef2fd421499da3007d1e93a07/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:45:09.195541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eba73-d000-48f7-a15f-e8b67be8575b None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.196079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eba73-d000-48f7-a15f-e8b67be8575b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.196079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eba73-d000-48f7-a15f-e8b67be8575b None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.198146 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 214/415] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:09.203888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517b12e-475e-4cfe-a227-8a1c4c1f6c33 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.204326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517b12e-475e-4cfe-a227-8a1c4c1f6c33 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.204416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517b12e-475e-4cfe-a227-8a1c4c1f6c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.225320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8517b12e-475e-4cfe-a227-8a1c4c1f6c33 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:09.226520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8517b12e-475e-4cfe-a227-8a1c4c1f6c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:09.308826 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 202/416] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:09.348287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eba73-d000-48f7-a15f-e8b67be8575b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.369771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eba73-d000-48f7-a15f-e8b67be8575b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.374391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.380591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.380591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.380591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.392535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:09.399700 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:45:09.404988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 215/417] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:09.408369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517b12e-475e-4cfe-a227-8a1c4c1f6c33 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.422325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517b12e-475e-4cfe-a227-8a1c4c1f6c33 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.435774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba1c01-c121-4b89-aa2b-8494f4c4b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.436508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba1c01-c121-4b89-aa2b-8494f4c4b23c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.436794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba1c01-c121-4b89-aa2b-8494f4c4b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.437094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba1c01-c121-4b89-aa2b-8494f4c4b23c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.437856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba1c01-c121-4b89-aa2b-8494f4c4b23c admin admin] RBAC: Adding query filter params (name=member) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:09.438158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba1c01-c121-4b89-aa2b-8494f4c4b23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.439757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba1c01-c121-4b89-aa2b-8494f4c4b23c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.453160 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 203/418] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:09.459695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.474130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e6262-21ad-448e-b089-d2475b9e77ef admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.482477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.483062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.483338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.483608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.495971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ecf1-136c-4099-a234-35153c1b0eb7 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.496174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.496259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ecf1-136c-4099-a234-35153c1b0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.500020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ecf1-136c-4099-a234-35153c1b0eb7 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.500154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.500232 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 204/419] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:09.504693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876a27-0c63-4ed9-b9eb-33851f9a9b80 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.505005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876a27-0c63-4ed9-b9eb-33851f9a9b80 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.505277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8876a27-0c63-4ed9-b9eb-33851f9a9b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.511619 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 216/420] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:09.522578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.536497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41581c67-90c2-4624-b93b-6334d9275741 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.541969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e8876a27-0c63-4ed9-b9eb-33851f9a9b80 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:09.543614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e8876a27-0c63-4ed9-b9eb-33851f9a9b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:09.547514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.548441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.548718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.549024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.551175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.553420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.555671 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 217/421] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:09.561912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.565563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 205/422] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:09.574371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a350188-5b94-413f-8b7b-ef0a856d43d7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.579629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.580592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.580903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.581169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.583311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.589214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.591552 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 218/423] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:09.597995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8876a27-0c63-4ed9-b9eb-33851f9a9b80 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.608059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.612740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8876a27-0c63-4ed9-b9eb-33851f9a9b80 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.620696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.621214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d5df2-eef3-47d9-8f4e-dd617e9075f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.621446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.621729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.622000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.622902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=43439940dd2449978937f225023600e8) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:09.623250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.625365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.635033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.635849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.636319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.636534 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 206/424] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=43439940dd2449978937f225023600e8&role.id=cb697f13703f4bc19072e3c59c644481 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:09.636700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.648965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:09.656722 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:45:09.658088 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 219/425] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:09.665169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.682650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d9f30-9c2d-418f-a8f4-563067ff05c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.694105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.694788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.695064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.695335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.696103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:09.696409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.698073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.714715 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 207/426] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:09.720586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.738816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b96dd7-c823-45d8-8acd-fefb301385f7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.749176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.749845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.750117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.750389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.765310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.767073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.783350 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 220/427] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:09.789813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.804673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bebd6-3cbf-40e9-9fb6-d2146bfae802 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.813189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.814483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.814967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.815450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.817029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.819554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.821690 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 208/428] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:09.827816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.839426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c9b10-f1b2-4155-aed5-1e377846088d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.849871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6ffa-09ac-4aa9-a08b-55c698fe6d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.850741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6ffa-09ac-4aa9-a08b-55c698fe6d6f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.851019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6ffa-09ac-4aa9-a08b-55c698fe6d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.851292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6ffa-09ac-4aa9-a08b-55c698fe6d6f admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.852492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce6ffa-09ac-4aa9-a08b-55c698fe6d6f admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.854424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce6ffa-09ac-4aa9-a08b-55c698fe6d6f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.856376 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 221/429] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:09.862771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:09.875447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c368a25-cd71-42b5-aa87-8b76122732c6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:09.882487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c26d8-003f-4941-82d7-b6182d30e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:09.883575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c26d8-003f-4941-82d7-b6182d30e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:09.884080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c26d8-003f-4941-82d7-b6182d30e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:09.884561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c26d8-003f-4941-82d7-b6182d30e4c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:09.885729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c26d8-003f-4941-82d7-b6182d30e4c0 admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=43439940dd2449978937f225023600e8) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:09.886385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c26d8-003f-4941-82d7-b6182d30e4c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:09.888604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c26d8-003f-4941-82d7-b6182d30e4c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:09.900539 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 209/430] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:09 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=43439940dd2449978937f225023600e8&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:10.163677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eadea-b73d-4e7d-9a1d-5591d0098fcb None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.163861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eadea-b73d-4e7d-9a1d-5591d0098fcb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.164125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eadea-b73d-4e7d-9a1d-5591d0098fcb None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.166199 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 222/431] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:10.172622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414548-8b46-4872-b83c-5cda284e95f6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.173200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414548-8b46-4872-b83c-5cda284e95f6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.173693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414548-8b46-4872-b83c-5cda284e95f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.194432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0a414548-8b46-4872-b83c-5cda284e95f6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:10.195945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0a414548-8b46-4872-b83c-5cda284e95f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:10.207805 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 210/432] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:10.241596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eadea-b73d-4e7d-9a1d-5591d0098fcb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:10.256745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eadea-b73d-4e7d-9a1d-5591d0098fcb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:10.261161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:10.261946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.262220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.262488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.273641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:10.280322 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 25 20:45:10.283793 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 223/433] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:10.291156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414548-8b46-4872-b83c-5cda284e95f6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:10.301451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414548-8b46-4872-b83c-5cda284e95f6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:10.309021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:10.309915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.310366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.310815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.311570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] RBAC: Adding query filter params (name=member) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:10.311871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:10.313534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:10.324550 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 211/434] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:10.330814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:10.340848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d7e77-39a2-4698-be2e-4390afa13cfd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:10.347321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:10.347947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.348225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.349048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.361313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:10.363420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:10.373964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 224/435] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:10.380950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:10.391951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a6712-1735-488e-b23f-ae5ecf58b2fc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:10.397486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:10.398680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.399226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.399748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.401190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:10.403559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:10.408129 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 212/436] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:10 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:10.412292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:10.422184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757702f2-41ab-4421-b0b4-679158e5331c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:10.427293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0749acb-a0b2-47dc-98f8-fb5863d794be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:10.428423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749acb-a0b2-47dc-98f8-fb5863d794be admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.428952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749acb-a0b2-47dc-98f8-fb5863d794be admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.429461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749acb-a0b2-47dc-98f8-fb5863d794be admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.430955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0749acb-a0b2-47dc-98f8-fb5863d794be admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:10.433133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0749acb-a0b2-47dc-98f8-fb5863d794be admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:10.435119 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 225/437] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:10 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:10.443345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:10.453855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01172f40-637c-421a-9e4f-79adb560cc9e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:10.459374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12908c-f449-40c9-bbce-4aae3e9cff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:10.460263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12908c-f449-40c9-bbce-4aae3e9cff2e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:10.460692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12908c-f449-40c9-bbce-4aae3e9cff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:10.461159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12908c-f449-40c9-bbce-4aae3e9cff2e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:10.462188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12908c-f449-40c9-bbce-4aae3e9cff2e admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=cb697f13703f4bc19072e3c59c644481, scope.project.id=f9ad69bd938b400484a11e5ec679eb11) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:10.462706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12908c-f449-40c9-bbce-4aae3e9cff2e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:10.464852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12908c-f449-40c9-bbce-4aae3e9cff2e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:10.474554 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 213/438] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:10 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=cb697f13703f4bc19072e3c59c644481 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:11.004109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30524e-e397-498d-bfd1-5c4e08d7a7f3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.004392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30524e-e397-498d-bfd1-5c4e08d7a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.005193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30524e-e397-498d-bfd1-5c4e08d7a7f3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.006949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 226/439] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:11.012697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101904-8c79-49aa-8ec7-5d79af1140d2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.013033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101904-8c79-49aa-8ec7-5d79af1140d2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.013314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3101904-8c79-49aa-8ec7-5d79af1140d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.031114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b3101904-8c79-49aa-8ec7-5d79af1140d2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:11.032310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b3101904-8c79-49aa-8ec7-5d79af1140d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:11.039726 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 214/440] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:11.064139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30524e-e397-498d-bfd1-5c4e08d7a7f3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.076486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30524e-e397-498d-bfd1-5c4e08d7a7f3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.080671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.081466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.081745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.082016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.092533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:11.099449 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:11.100584 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 227/441] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:11.106648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101904-8c79-49aa-8ec7-5d79af1140d2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.115558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3101904-8c79-49aa-8ec7-5d79af1140d2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.120053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4aa6d8-e516-471a-9b12-6a90964f5d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.120699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa6d8-e516-471a-9b12-6a90964f5d08 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.120996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa6d8-e516-471a-9b12-6a90964f5d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.121265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa6d8-e516-471a-9b12-6a90964f5d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.122004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4aa6d8-e516-471a-9b12-6a90964f5d08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:11.122302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4aa6d8-e516-471a-9b12-6a90964f5d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.123943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4aa6d8-e516-471a-9b12-6a90964f5d08 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.132601 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 215/442] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:11.138235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.148290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ee626-0df6-4e6c-b9c7-800ee3c16ab6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.152497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.153142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.153420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.153690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.161711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.163426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.171921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 228/443] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:11.177045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68c929-ddc5-4281-9143-7997500a6e1d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.177331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68c929-ddc5-4281-9143-7997500a6e1d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.177604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68c929-ddc5-4281-9143-7997500a6e1d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.177718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.179352 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 216/444] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:11.184467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9f2a-3262-4a23-b5a3-a8717a2c794e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.184747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9f2a-3262-4a23-b5a3-a8717a2c794e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.185053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9f2a-3262-4a23-b5a3-a8717a2c794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.186306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ce50-6bae-4c5c-937f-771c981cef69 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.190509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.191310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.191585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.191858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.193539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.195283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.196904 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 229/445] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:11.203781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.203910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-427b9f2a-3262-4a23-b5a3-a8717a2c794e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:11.205026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-427b9f2a-3262-4a23-b5a3-a8717a2c794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:11.213136 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 217/446] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:11.213808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5de1-fc6a-47f3-a9ff-3adb44ad609f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.218095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.218901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.219178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.219444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] PATH_INFO: `/v3/groups/e63cbbd9914e467093f8290625e4602c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.220600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] RBAC: Authorizing `identity:get_group(group_id=e63cbbd9914e467093f8290625e4602c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.222525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.224121 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 230/447] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/groups/e63cbbd9914e467093f8290625e4602c => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:11.230005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9f2a-3262-4a23-b5a3-a8717a2c794e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.237630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.239198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9f2a-3262-4a23-b5a3-a8717a2c794e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.243413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.244302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.244576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.244845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.245688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] RBAC: Adding query filter params (group.id=e63cbbd9914e467093f8290625e4602c, role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=41b3685f056e42a38cb9ec18c9d20fa2) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:11.245993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.247222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea5f2-b22d-4874-87a9-c2c0c186071f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.247802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.251538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.252292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.252571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.252839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.253512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 218/448] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/role_assignments?group.id=e63cbbd9914e467093f8290625e4602c&scope.project.id=41b3685f056e42a38cb9ec18c9d20fa2&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:11.264351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:11.272442 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:45:11.273743 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 231/449] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:11.280200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.290229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d77ea-2f7a-4000-889c-efc36cbc3097 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.294696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.295372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.295646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.295914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.296673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:11.297008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.298614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.307664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 219/450] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:11.313854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.325220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205a45-4867-4d37-a655-2da1562357a3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.329723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.330379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.330660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.330933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.340406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.342201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.351998 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 232/451] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:11.358227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.368150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18c2e8-ef4b-4d60-80b9-7cd152658b67 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.373069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.373950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.376644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.376644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] PATH_INFO: `/v3/projects/f9ad69bd938b400484a11e5ec679eb11` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.376644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f9ad69bd938b400484a11e5ec679eb11)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.377791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.380100 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 220/452] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/projects/f9ad69bd938b400484a11e5ec679eb11 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:11.386307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.396139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18114ae-ad14-4ee4-b6fd-9c3da48d21dc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.400688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41e52b-490b-4ad1-8529-0eb89cc044c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.401594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e52b-490b-4ad1-8529-0eb89cc044c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.401876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e52b-490b-4ad1-8529-0eb89cc044c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.402153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e52b-490b-4ad1-8529-0eb89cc044c4 admin admin] PATH_INFO: `/v3/groups/5888aacef2fd421499da3007d1e93a07` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.403380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41e52b-490b-4ad1-8529-0eb89cc044c4 admin admin] RBAC: Authorizing `identity:get_group(group_id=5888aacef2fd421499da3007d1e93a07)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.405358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41e52b-490b-4ad1-8529-0eb89cc044c4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.407051 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 233/453] 10.222.0.32 () {56 vars in 1201 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/groups/5888aacef2fd421499da3007d1e93a07 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:11.413539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:11.423497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ecef-e313-498a-bfbe-1300019845f7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:11.428479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771ca23-2a63-4443-a9d0-32a3bbee2abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:11.429183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771ca23-2a63-4443-a9d0-32a3bbee2abf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:11.429469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771ca23-2a63-4443-a9d0-32a3bbee2abf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:11.429748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771ca23-2a63-4443-a9d0-32a3bbee2abf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:11.430606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771ca23-2a63-4443-a9d0-32a3bbee2abf admin admin] RBAC: Adding query filter params (group.id=5888aacef2fd421499da3007d1e93a07, role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=f9ad69bd938b400484a11e5ec679eb11) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:11.430920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771ca23-2a63-4443-a9d0-32a3bbee2abf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:11.432760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771ca23-2a63-4443-a9d0-32a3bbee2abf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:11.439298 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 221/454] 10.222.0.32 () {56 vars in 1397 bytes} [Sat Dec 25 20:45:11 2021] GET /identity/v3/role_assignments?group.id=5888aacef2fd421499da3007d1e93a07&scope.project.id=f9ad69bd938b400484a11e5ec679eb11&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:14.656710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290463ae-7070-4555-8077-bb9fc3d11c8b None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.657254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290463ae-7070-4555-8077-bb9fc3d11c8b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.657358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290463ae-7070-4555-8077-bb9fc3d11c8b None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.659365 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 234/455] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:14.675141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f769ca-c105-4d14-acf3-805190c035b8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.675655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f769ca-c105-4d14-acf3-805190c035b8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.675729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f769ca-c105-4d14-acf3-805190c035b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.701962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-68f769ca-c105-4d14-acf3-805190c035b8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:14.703174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68f769ca-c105-4d14-acf3-805190c035b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:14.711541 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 222/456] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:14.751191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290463ae-7070-4555-8077-bb9fc3d11c8b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:14.766696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290463ae-7070-4555-8077-bb9fc3d11c8b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:14.771104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017aae6f-dab2-4a66-abdd-5d0991f4465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:14.771873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aae6f-dab2-4a66-abdd-5d0991f4465a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.772150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aae6f-dab2-4a66-abdd-5d0991f4465a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.772425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017aae6f-dab2-4a66-abdd-5d0991f4465a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.787518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017aae6f-dab2-4a66-abdd-5d0991f4465a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:14.789374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017aae6f-dab2-4a66-abdd-5d0991f4465a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:14.809792 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-017aae6f-dab2-4a66-abdd-5d0991f4465a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:14.811028 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 235/457] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:14.818024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f769ca-c105-4d14-acf3-805190c035b8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:14.829792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f769ca-c105-4d14-acf3-805190c035b8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:14.838407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:14.839081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.839361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.839632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.840366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:14.840668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:14.843039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78787-99d6-40ac-ae4d-bd4898236d87 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.843323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78787-99d6-40ac-ae4d-bd4898236d87 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.843592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78787-99d6-40ac-ae4d-bd4898236d87 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.845524 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 236/458] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:14.845742 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:14.845742 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:14.845742 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:14.846689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:14.850840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17579d23-8597-4488-877b-911bfd4eb776 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.851126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17579d23-8597-4488-877b-911bfd4eb776 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.851409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17579d23-8597-4488-877b-911bfd4eb776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.869717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-17579d23-8597-4488-877b-911bfd4eb776 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:14.870906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-17579d23-8597-4488-877b-911bfd4eb776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:14.876370 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 223/459] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:14.883029 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 237/460] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:14.884981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:14.898767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360581bf-37b7-4701-9f53-4213e00b307c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:14.908816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bda8aa-cf77-4b0c-8504-06fccbde241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:14.909444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda8aa-cf77-4b0c-8504-06fccbde241c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.909628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17579d23-8597-4488-877b-911bfd4eb776 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:14.909784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda8aa-cf77-4b0c-8504-06fccbde241c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.909983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bda8aa-cf77-4b0c-8504-06fccbde241c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.910729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda8aa-cf77-4b0c-8504-06fccbde241c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:14.912698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bda8aa-cf77-4b0c-8504-06fccbde241c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:14.918723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17579d23-8597-4488-877b-911bfd4eb776 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:14.923263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:14.924046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.924327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.924603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.935654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:14.937724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:14.955643 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:14.957015 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 238/461] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:14.964166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:14.974380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe0e9-3c4d-4e44-979d-b0869426f114 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:14.979259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:14.980062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:14.980488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:14.980941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:14.981809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:14.982274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:14.984166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:14.996866 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 239/462] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:15.004002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.014581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb97b63-0eb0-4b8c-a8a0-741a90b9ac51 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.019472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.020347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.020778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.021228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.022137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.024575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.028127 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 224/463] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:45:14 2021] POST /identity/v3/users => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:15.036265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d06f-e1f0-49d2-8ce1-02fb3f183b67 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.036772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d06f-e1f0-49d2-8ce1-02fb3f183b67 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.037090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d06f-e1f0-49d2-8ce1-02fb3f183b67 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.039113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 225/464] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:15.045638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a76375-c2c0-4a66-b2e3-802e972a042b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.045947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a76375-c2c0-4a66-b2e3-802e972a042b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.046219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a76375-c2c0-4a66-b2e3-802e972a042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.065919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d2a76375-c2c0-4a66-b2e3-802e972a042b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:15.067687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2a76375-c2c0-4a66-b2e3-802e972a042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:15.075570 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 226/465] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:15.103384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a76375-c2c0-4a66-b2e3-802e972a042b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.113568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a76375-c2c0-4a66-b2e3-802e972a042b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.124663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.124663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.124663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.124663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.132559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.134434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.153034 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:15.154574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 227/466] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:15.157397 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 240/467] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:45:15 2021] POST /identity/v3/users => generated 248 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:15.170262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.172196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e874b7-4d22-4fee-aa3f-55fb976f0b14 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.177507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392687d3-4832-4aeb-b311-ffb7ae6a1bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.178187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392687d3-4832-4aeb-b311-ffb7ae6a1bcb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.178468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392687d3-4832-4aeb-b311-ffb7ae6a1bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.178726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392687d3-4832-4aeb-b311-ffb7ae6a1bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.179473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392687d3-4832-4aeb-b311-ffb7ae6a1bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:15.179776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392687d3-4832-4aeb-b311-ffb7ae6a1bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.181476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392687d3-4832-4aeb-b311-ffb7ae6a1bcb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.196010 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 228/468] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:15.202273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.212741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8befcd-63d6-423b-a9de-a00d3ef1daab admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.218051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41956-0a2c-44f2-a62e-a780bd6dbcb2 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.218404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41956-0a2c-44f2-a62e-a780bd6dbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.218601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea41956-0a2c-44f2-a62e-a780bd6dbcb2 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.220457 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 229/469] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:15.226882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.227576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.227855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.228132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.228857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.230878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.236258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fb4d3-fc00-4921-a08f-4dc5df3a6bb0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.236536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fb4d3-fc00-4921-a08f-4dc5df3a6bb0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.236806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fb4d3-fc00-4921-a08f-4dc5df3a6bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.265422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f48fb4d3-fc00-4921-a08f-4dc5df3a6bb0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:15.266657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f48fb4d3-fc00-4921-a08f-4dc5df3a6bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:15.277698 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 230/470] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:15.305652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fb4d3-fc00-4921-a08f-4dc5df3a6bb0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.317766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fb4d3-fc00-4921-a08f-4dc5df3a6bb0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.324454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.325376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.325709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.325991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.338423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.340386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.361765 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:15.364565 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 231/471] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:15.371908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.384385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f582-f9a4-46ea-86ec-e4dfc8562844 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.386120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 241/472] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:45:15 2021] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:15.390613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4591e2-1f26-483e-a68e-8f88c4133018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.391637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4591e2-1f26-483e-a68e-8f88c4133018 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.392119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4591e2-1f26-483e-a68e-8f88c4133018 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.392619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4591e2-1f26-483e-a68e-8f88c4133018 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.393854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4591e2-1f26-483e-a68e-8f88c4133018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:15.394463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4591e2-1f26-483e-a68e-8f88c4133018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.396512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4591e2-1f26-483e-a68e-8f88c4133018 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.412115 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 232/473] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:15.419758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.437012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d9a35-dcf3-4958-9222-86844e9cae79 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.449796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.450887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.451380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.451861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.452829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.455103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.757925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ba30-712f-404d-a058-5c6cd0715e7b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.758919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ba30-712f-404d-a058-5c6cd0715e7b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.759412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91ba30-712f-404d-a058-5c6cd0715e7b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.761711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 233/474] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:15.767343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9355-fd9f-4fae-b054-b41039ce506a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.767864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9355-fd9f-4fae-b054-b41039ce506a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.768337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9355-fd9f-4fae-b054-b41039ce506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.788465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9b2b9355-fd9f-4fae-b054-b41039ce506a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:15.789993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9b2b9355-fd9f-4fae-b054-b41039ce506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:15.798086 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 234/475] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:15.812518 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 242/476] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:45:15 2021] POST /identity/v3/users => generated 249 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:15.831359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b9355-fd9f-4fae-b054-b41039ce506a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.842129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b9355-fd9f-4fae-b054-b41039ce506a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.847107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.848038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.848587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.849120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:15.850070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:15.851953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:15.932217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.sql.core [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 25 20:45:15.932217 ncdv-master-1 devstack@keystone.service[96732]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 25 20:45:15.932217 ncdv-master-1 devstack@keystone.service[96732]: [parameters: {'id': '7df9715494c64b5d82e5a4e09ca25e91', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 25 20:45:15.932217 ncdv-master-1 devstack@keystone.service[96732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 25 20:45:15.947435 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 25 20:45:15.953633 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 235/477] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 20:45:15 2021] POST /identity/v3/roles => generated 144 bytes in 123 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:15.961272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:15.974730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5874b-c700-4959-8cd0-c4261566d03f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:15.981326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00d990-f625-445d-982b-648850ca79ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:15.982338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d990-f625-445d-982b-648850ca79ed admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:15.982786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d990-f625-445d-982b-648850ca79ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:15.983214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d990-f625-445d-982b-648850ca79ed admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:16.000087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00d990-f625-445d-982b-648850ca79ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:16.008595 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-5b00d990-f625-445d-982b-648850ca79ed admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 25 20:45:16.013197 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 243/478] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:16.017151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:16.027772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f39bcb-7f92-4443-8193-dfdd479f7a5a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:16.032582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e36dbe-7e70-44c8-be45-01322a4e94a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:16.033519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e36dbe-7e70-44c8-be45-01322a4e94a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:16.033987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e36dbe-7e70-44c8-be45-01322a4e94a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:16.034423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e36dbe-7e70-44c8-be45-01322a4e94a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:16.035347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e36dbe-7e70-44c8-be45-01322a4e94a9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:16.035848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e36dbe-7e70-44c8-be45-01322a4e94a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:16.037639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e36dbe-7e70-44c8-be45-01322a4e94a9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:16.053149 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 236/479] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.134021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfb893-1d98-46fd-9748-79ac4e57b331 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.134998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfb893-1d98-46fd-9748-79ac4e57b331 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.135474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfb893-1d98-46fd-9748-79ac4e57b331 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.137502 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 244/480] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:18.143416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0deb8-7955-4e46-bd26-4b3c80bd1c23 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.144331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0deb8-7955-4e46-bd26-4b3c80bd1c23 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.144808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0deb8-7955-4e46-bd26-4b3c80bd1c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.146373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e75b9-afe8-4769-86c2-9f9bcee7fec9 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.146658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e75b9-afe8-4769-86c2-9f9bcee7fec9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.146933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e75b9-afe8-4769-86c2-9f9bcee7fec9 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.149026 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 245/481] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:18.155165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01235d-9e76-4e45-9ba0-0acb1519cefc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.155447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01235d-9e76-4e45-9ba0-0acb1519cefc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.155721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01235d-9e76-4e45-9ba0-0acb1519cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.165890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-93a0deb8-7955-4e46-bd26-4b3c80bd1c23 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:18.167374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93a0deb8-7955-4e46-bd26-4b3c80bd1c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:18.175413 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 237/482] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:18.185911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bd01235d-9e76-4e45-9ba0-0acb1519cefc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:18.187112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd01235d-9e76-4e45-9ba0-0acb1519cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:18.198205 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 246/483] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:18.200207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0deb8-7955-4e46-bd26-4b3c80bd1c23 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.213743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0deb8-7955-4e46-bd26-4b3c80bd1c23 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.218400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.219399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.219887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.220369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.226364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01235d-9e76-4e45-9ba0-0acb1519cefc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.236053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01235d-9e76-4e45-9ba0-0acb1519cefc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.241538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.241986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:18.242313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.242588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.242855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.250031 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:18.256899 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 238/484] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.257041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:18.258126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.260614 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:18.262062 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 247/485] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.267957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.272742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15628b9-2e6e-434a-85bd-583d3383052e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.279951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623d6e5-eee8-4739-aa1f-d011cf2f76b8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.284715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.285400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.285727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.286506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.286755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.287255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.287556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.288039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.288516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.288994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.289156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.290085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.290577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.292368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.299010 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 248/486] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.305324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.307327 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 239/487] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.313205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.315470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34354b1-2979-4fac-9f6e-66da03755f46 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.320611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.321690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.321967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.322238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.323951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a2bd4-9efe-47a5-bb76-07a9b46e11ea admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.328591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.329652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.330141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.330615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.334693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.336513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.342456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.344461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.356685 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:18.358297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 249/488] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.364507 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:18.364640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.366333 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 240/489] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:18.375145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b25e1-41e9-4ac4-8bb4-1c6f01b7a4c0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.377052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.379864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.380699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.381072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.381410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.384899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.384899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.384899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.395713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c9389-a84d-47b1-b29a-b216832a522b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.398620 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 250/490] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:18.405104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.411627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.412590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.413055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.413881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.414523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.414998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.416585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cd86c-02d0-4e1b-9250-4f093a224879 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.417047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.424905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.424905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.424905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.424905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.433172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.436905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.443545 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 241/491] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.449600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.451787 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 25 20:45:18.453450 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 251/492] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.464361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b674ff-5c0e-45b5-81c5-634839e6fb0b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.466110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.476457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b743a-0354-44ee-8320-c4fff37c09b9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.480724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe3680-8991-43c2-a853-16d1e7a8041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.481577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3680-8991-43c2-a853-16d1e7a8041d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.481860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3680-8991-43c2-a853-16d1e7a8041d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.482128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe3680-8991-43c2-a853-16d1e7a8041d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.487024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.487682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.487966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.488234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.489127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.489439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.490454 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:18.490454 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:18.490454 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:18.491892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a82df-763c-49dc-8122-611d1babde2c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.492529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe3680-8991-43c2-a853-16d1e7a8041d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.494838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe3680-8991-43c2-a853-16d1e7a8041d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.508997 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-15fe3680-8991-43c2-a853-16d1e7a8041d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:45:18.510528 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 242/493] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:18.511825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81d08-811c-4d03-a18f-49aebdfaed5d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.512111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81d08-811c-4d03-a18f-49aebdfaed5d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.512385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81d08-811c-4d03-a18f-49aebdfaed5d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.514065 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 243/494] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:18.519383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c81d08-811c-4d03-a18f-49aebdfaed5d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.532101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c81d08-811c-4d03-a18f-49aebdfaed5d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.534051 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 252/495] 10.222.0.32 () {56 vars in 1158 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:18.535168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7776bfd-1d1c-41bb-8a1f-68f489415fe8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.535484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7776bfd-1d1c-41bb-8a1f-68f489415fe8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.536628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.537320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.537597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.537866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.538699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.539004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.540014 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:18.540014 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:18.540014 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:18.540614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7776bfd-1d1c-41bb-8a1f-68f489415fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.541257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.560092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c7776bfd-1d1c-41bb-8a1f-68f489415fe8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:18.561326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c7776bfd-1d1c-41bb-8a1f-68f489415fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:18.570563 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 253/496] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:18.571369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7776bfd-1d1c-41bb-8a1f-68f489415fe8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.580576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7776bfd-1d1c-41bb-8a1f-68f489415fe8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.591026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 244/497] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.592914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.593549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.593878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.594154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.596898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.608397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.609026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ece3d-f7c0-46a6-949c-83b850e3fc72 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.610508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.614569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.615203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.615479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.615753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.622425 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 254/498] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:18.623302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.630533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.632302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.637443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b75349-3424-46a3-9189-c6bf8cc53496 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.641871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.642650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.642930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.643200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.643477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 245/499] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:18.644450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.654805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:18.655573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5880-442a-4ac5-b9e3-6ddbdfb1b462 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.659994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.660809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.661139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.661386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.662936 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:18.664117 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 255/500] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.669826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.671922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.673921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.681146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49528fc-75c4-4a25-85e3-643bf452c7c3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.685867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.686728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.687009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.687282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.693204 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:18.694547 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 246/501] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.697610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.705318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.707212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.714071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8720c9-4fed-482d-99a8-be115ab6d5cb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.719895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.720798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.721315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.721796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.722753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.723300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.725094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.726366 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:18.727909 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 256/502] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.728516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.735380 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 247/503] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.736456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.744834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9191-fc20-4101-8d86-5961a0b5ceee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.749844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.750526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.750856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.751133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.751990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.752299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.753151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60118d-2903-4ee3-b96b-8198ac646b25 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.754169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.759606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.760629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.761157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.761627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.762589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.763791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.766256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.768917 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 257/504] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.774569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.787880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20bc8b-cf24-4b02-b303-8b5376f791cf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.791207 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 248/505] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.792180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.793133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.794128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.794505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.794901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.803801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529f7ff-d22e-4678-9ee1-588469092625 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.806933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.809294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.809726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.810762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.811347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.811809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.821397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.823605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.827184 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:18.833545 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 258/506] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.834481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.837921 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:18.839591 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 249/507] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.845779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.851086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e52ec-79f9-46ba-942e-5e365c5258a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.856800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e851b-44cd-4d87-ab5c-f69d5178986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.857917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e851b-44cd-4d87-ab5c-f69d5178986a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.858022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbf5ad-4519-400b-af0a-204764075283 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.858591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e851b-44cd-4d87-ab5c-f69d5178986a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.859232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e851b-44cd-4d87-ab5c-f69d5178986a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.862734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.863127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.863398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.863671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.864977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.865281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.866862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.870275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e851b-44cd-4d87-ab5c-f69d5178986a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.872524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e851b-44cd-4d87-ab5c-f69d5178986a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.879453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 250/508] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.884380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.886547 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c91e851b-44cd-4d87-ab5c-f69d5178986a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:18.887841 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 259/509] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.888896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af622e2-ba04-4cf1-bc04-8e149d6d1062 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.889197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af622e2-ba04-4cf1-bc04-8e149d6d1062 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.889469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af622e2-ba04-4cf1-bc04-8e149d6d1062 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.891278 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 260/510] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:18.891768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af622e2-ba04-4cf1-bc04-8e149d6d1062 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.897065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121274f4-0232-4b10-bacf-53a74fd392b9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.901436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.902075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.902357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.902630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.903416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.903723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.904618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af622e2-ba04-4cf1-bc04-8e149d6d1062 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.904717 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:18.904717 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:18.904717 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:18.905924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.908784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a44a8-5995-4258-a2da-39829dc050d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.909910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a44a8-5995-4258-a2da-39829dc050d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.909910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a44a8-5995-4258-a2da-39829dc050d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.910188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a44a8-5995-4258-a2da-39829dc050d8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.918196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a44a8-5995-4258-a2da-39829dc050d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.920361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a44a8-5995-4258-a2da-39829dc050d8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.928976 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 251/511] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.928976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.936694 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-900a44a8-5995-4258-a2da-39829dc050d8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 25 20:45:18.938033 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 261/512] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:18.939062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d5c9-b922-4dcb-9159-222ec8137c96 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.939343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d5c9-b922-4dcb-9159-222ec8137c96 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.939615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39d5c9-b922-4dcb-9159-222ec8137c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.942779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6952d-74c2-4f3d-a842-48f89db35aeb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.950469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.951223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.951504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.951778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.952667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.952985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.954829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.960547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3d39d5c9-b922-4dcb-9159-222ec8137c96 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:18.961943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3d39d5c9-b922-4dcb-9159-222ec8137c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:18.967777 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 252/513] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.968491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.981118 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 262/514] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:18.981118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d5c9-b922-4dcb-9159-222ec8137c96 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.981335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935131d-c34b-47d8-8a0d-8d5c10f01a48 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.985026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.985722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:18.986074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:18.986417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:18.987315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=0f668b27e2af43fd812f309f6908199c) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:18.987699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:18.989667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:18.991631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39d5c9-b922-4dcb-9159-222ec8137c96 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:18.995826 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 253/515] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/role_assignments?user.id=0f668b27e2af43fd812f309f6908199c&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:18.996940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:18.998978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:18.999849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.000301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.000779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.001826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.002556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.005663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.007854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4401-8706-49d5-acc9-75597bc9e490 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.012830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.013653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.014046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.014418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.015409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79e05d879a534c6c890d4aea42c89975) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.015786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.018070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.025423 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 254/516] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/role_assignments?user.id=79e05d879a534c6c890d4aea42c89975&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.026476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.029815 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 263/517] 10.222.0.32 () {56 vars in 1158 bytes} [Sat Dec 25 20:45:18 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.036916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.041341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2aeb72-1e70-4780-ad20-9faf739079e0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.046302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.047438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.047943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.048048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2517a38-9d32-4355-94b5-6a18bcaa2c7e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.048487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.054390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.055182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.055577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.055925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.063471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.065646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.066253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.068498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.079226 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 264/518] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:45:19.085714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.086541 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:19.088285 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 255/519] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:19.096343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541d585-af2f-4a93-9381-978bd0e6a6a8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.097728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.102226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.103228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.103578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.103918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.117970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.120238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe3abe-172e-4bed-b8b1-66df8dd50d54 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.120384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.131789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.132503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.132782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.135871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.136831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.137243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.141275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.148421 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:19.150734 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 265/520] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:19.161822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.173857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 256/521] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.177912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdedc2-0931-4b60-82b8-ad75c97f8d24 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.180478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.193790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.194577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.196006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.196307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.197164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c098d95-2ef0-4ed0-9b4a-68f446918340 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.198399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.198715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.202997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.206595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.207289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.208012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.208287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.210146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.216312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.227670 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 266/522] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.237209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.248851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83e31d-bdd1-4fca-abf5-fce0decd9c37 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.254314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe785e-e472-420e-bd31-50594124efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.256157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe785e-e472-420e-bd31-50594124efa5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.256638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe785e-e472-420e-bd31-50594124efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.257256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe785e-e472-420e-bd31-50594124efa5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.265601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe785e-e472-420e-bd31-50594124efa5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.267937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe785e-e472-420e-bd31-50594124efa5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.284139 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c4fe785e-e472-420e-bd31-50594124efa5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:19.286227 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 267/523] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:19.287396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916146f-d691-419c-b0b2-afb18d49aa3b None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.287607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916146f-d691-419c-b0b2-afb18d49aa3b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.287862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916146f-d691-419c-b0b2-afb18d49aa3b None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.289789 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 268/524] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:19.293944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916146f-d691-419c-b0b2-afb18d49aa3b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.306998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916146f-d691-419c-b0b2-afb18d49aa3b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.311356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.311999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.312276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.312548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.313370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.313676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.314733 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:19.314733 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:19.314733 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:19.315831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c09f93-0066-469d-8dc6-07c053c29703 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.333802 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 269/525] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:19.335062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a498ce-52a2-473e-8fde-f485ef8ade2e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.335400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a498ce-52a2-473e-8fde-f485ef8ade2e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.335678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a498ce-52a2-473e-8fde-f485ef8ade2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.340223 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 257/526] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:45:19 2021] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:45:19.341534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.355109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57420806-8f06-4485-b3ee-06d212c5d3c4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.356954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-97a498ce-52a2-473e-8fde-f485ef8ade2e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:19.360938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-97a498ce-52a2-473e-8fde-f485ef8ade2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:19.361041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.361760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.362310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.362903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.364610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=94e4b61a62d24f6c9274c0f46d514656) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.365158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.367752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.368232 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 270/527] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:19.375759 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 258/528] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/role_assignments?user.id=94e4b61a62d24f6c9274c0f46d514656&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.395624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a498ce-52a2-473e-8fde-f485ef8ade2e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.405533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a498ce-52a2-473e-8fde-f485ef8ade2e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.410538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.412062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.412340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.412610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.425556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:19.433606 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:19.435129 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 271/529] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:19.442234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.453059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c422dc-c3d3-4ce3-93e7-375f083e0721 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.458207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.459289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.459772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.460287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.461287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.461804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.464010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.475001 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 259/530] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.485053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.504027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543fbfa-c3b3-4995-85fc-bf59931fdcf1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.518913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.519852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.520160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.520431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.540513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.542458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.560455 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:19.562071 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 272/531] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:19.573546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.585216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e539a7-bf55-40a9-9fc0-ff6937337870 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.590174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.590855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.591186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.591458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.592202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.592559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.594630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.609524 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 260/532] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.615942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.627024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafd3a4-56a3-412b-af1f-4f18eb74b2bc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.633847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.635417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.635754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.636125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.645806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.647824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.662549 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 25 20:45:19.664100 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 273/533] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:19.670444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.681783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f81d2-5e17-4c75-99aa-3de5306e04b3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.686712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.687431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.687714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.687979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.688817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.689216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.691196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.710517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 261/534] 10.222.0.32 () {56 vars in 1160 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:19.716349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.726863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d8a34-e1b7-4b8a-85b6-e4c402a67e64 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.732558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.733292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.733633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.733971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.742203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.744285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.753472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 274/535] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:45:19.759579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.769216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c2245-00fd-441e-adf1-ff5540e5bb56 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.774569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.775345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.775620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.775886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.786692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.788513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.804956 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:19.806396 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 262/536] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:19.812260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.825757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5854f-92bc-412c-bd8c-f5eb4b494f42 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.830842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.831549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.831891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.832225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.833615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.833981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.835684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.850804 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 275/537] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.856386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.867072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177844c-1778-4b6e-8697-4c1ccbb8d7c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.872966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.873879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.874230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.874603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.881912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.883994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.898012 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:19.899575 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 263/538] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:19.907407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.918256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b337d11-72a8-4a1d-853b-1edc23fe164b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.922854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2184b39-a3a4-4023-82d3-b873862f85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.923627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2184b39-a3a4-4023-82d3-b873862f85ba admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.923908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2184b39-a3a4-4023-82d3-b873862f85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.924227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2184b39-a3a4-4023-82d3-b873862f85ba admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.925044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2184b39-a3a4-4023-82d3-b873862f85ba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.925399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2184b39-a3a4-4023-82d3-b873862f85ba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.927427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2184b39-a3a4-4023-82d3-b873862f85ba admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.940108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 276/539] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:19.951614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:19.972957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba232e-b3f6-44c8-a204-f61e3c2d978d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:19.981186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad29c-de8f-4a13-a8f3-ec7c09b3f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:19.981835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad29c-de8f-4a13-a8f3-ec7c09b3f9fd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:19.982110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad29c-de8f-4a13-a8f3-ec7c09b3f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:19.982478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad29c-de8f-4a13-a8f3-ec7c09b3f9fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:19.983366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ad29c-de8f-4a13-a8f3-ec7c09b3f9fd admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=043f47597a6b4368afbad7be8a7f40b3) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:19.983671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ad29c-de8f-4a13-a8f3-ec7c09b3f9fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:19.985621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ad29c-de8f-4a13-a8f3-ec7c09b3f9fd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:19.998426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 264/540] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:19 2021] GET /identity/v3/role_assignments?user.id=043f47597a6b4368afbad7be8a7f40b3&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:21.901939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a1dbe-a7d3-4c22-bf4c-b48598040fb8 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:21.902650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a1dbe-a7d3-4c22-bf4c-b48598040fb8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:21.902650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a1dbe-a7d3-4c22-bf4c-b48598040fb8 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:21.904705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 277/541] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:21.915402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55e68-188c-4102-a837-28b52c7d93b8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:21.915402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55e68-188c-4102-a837-28b52c7d93b8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:21.915402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55e68-188c-4102-a837-28b52c7d93b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:21.945284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f6e55e68-188c-4102-a837-28b52c7d93b8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:21.946809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f6e55e68-188c-4102-a837-28b52c7d93b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:21.962772 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 265/542] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:22.003163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a1dbe-a7d3-4c22-bf4c-b48598040fb8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.022528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a1dbe-a7d3-4c22-bf4c-b48598040fb8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.027103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.027891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.028166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.028436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.046252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:22.053674 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:22.055148 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 278/543] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.060972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e55e68-188c-4102-a837-28b52c7d93b8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.073817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e55e68-188c-4102-a837-28b52c7d93b8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.080938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c50ac1-3106-427e-8c5d-7d37b0eddc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.081837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c50ac1-3106-427e-8c5d-7d37b0eddc5d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.082338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c50ac1-3106-427e-8c5d-7d37b0eddc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.082834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c50ac1-3106-427e-8c5d-7d37b0eddc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.083787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c50ac1-3106-427e-8c5d-7d37b0eddc5d admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.084315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c50ac1-3106-427e-8c5d-7d37b0eddc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.086131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c50ac1-3106-427e-8c5d-7d37b0eddc5d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.100092 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 266/544] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.105985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.120405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05f6d7-9ab3-444b-9b88-9e769d72538d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.130904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.131691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.131968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.132234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.143987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.146423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.151653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348455e8-2e8e-49a7-b3ea-cef12a5629cf None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.152363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348455e8-2e8e-49a7-b3ea-cef12a5629cf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.152841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348455e8-2e8e-49a7-b3ea-cef12a5629cf None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.159065 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 267/545] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:22.173378 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:22.174599 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 279/546] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.177287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd820-67fd-480d-ab0a-9c369a3948d3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.177780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd820-67fd-480d-ab0a-9c369a3948d3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.178248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd820-67fd-480d-ab0a-9c369a3948d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.181392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.195308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5227d12-9889-494d-a80b-4485096d1d6b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.198884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-476fd820-67fd-480d-ab0a-9c369a3948d3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:22.200064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-476fd820-67fd-480d-ab0a-9c369a3948d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:22.203371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.204288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.204747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.205243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.206140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.206620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.209313 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 268/547] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:22.209429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.221133 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 280/548] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.226913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd820-67fd-480d-ab0a-9c369a3948d3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.240026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd820-67fd-480d-ab0a-9c369a3948d3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.245476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.246311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.246596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.246864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.257241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.259245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.270030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.290172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acb80-86b4-4806-b077-a8aa92dc3381 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.291587 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 25 20:45:22.293636 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 269/549] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/users/cinder => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:22.302857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.303805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.304092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.305268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.308140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.323630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a285d-55cd-4cd9-808b-2a8d6b6fd3a3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.328858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.329593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.329902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.332900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.332900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.332900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.333601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.334064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:22.341271 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:22.343070 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 281/550] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:22.353885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.370664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 270/551] 10.222.0.32 () {56 vars in 1158 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:22.371919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907120b-48fd-458e-99fd-0ffcfaa2fede admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.378020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.379738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.381142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.381142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.381142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.381840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.382148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.383857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.393247 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 282/552] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.398560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d6d79-ed12-4fef-85e4-1d4ec1653a9d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.399941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.411214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.411952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.413510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.413797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.416809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847c158-a751-407d-b350-1eab16d80176 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.427379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.429193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.429528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.429810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.436692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.441345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.447795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.449736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.467215 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:22.468765 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 283/553] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.470457 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:22.471829 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 271/554] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.476443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.482694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.493168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925582d9-83af-4a43-ac79-b57f14193642 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.494995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c90729-50c8-47f3-b349-3d9fefdd0531 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.498094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f19d0-1bc6-455b-a953-611610084f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.498747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f19d0-1bc6-455b-a953-611610084f9c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.499027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f19d0-1bc6-455b-a953-611610084f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.499300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f19d0-1bc6-455b-a953-611610084f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.500035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f19d0-1bc6-455b-a953-611610084f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.500332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f19d0-1bc6-455b-a953-611610084f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.501587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721cdd2-8164-4029-8d90-2c5761c75cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.501968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f19d0-1bc6-455b-a953-611610084f9c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.502681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721cdd2-8164-4029-8d90-2c5761c75cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.503140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721cdd2-8164-4029-8d90-2c5761c75cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.503827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721cdd2-8164-4029-8d90-2c5761c75cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.505422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721cdd2-8164-4029-8d90-2c5761c75cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.505958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721cdd2-8164-4029-8d90-2c5761c75cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.507779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721cdd2-8164-4029-8d90-2c5761c75cd2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.520390 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 284/555] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.522483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc7e5-d566-407d-a698-82a613260271 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.523115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc7e5-d566-407d-a698-82a613260271 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.523680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc7e5-d566-407d-a698-82a613260271 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.525843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 285/557] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:22.526743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc7e5-d566-407d-a698-82a613260271 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.527349 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 272/557] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.536653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958255be-16ff-4b92-b865-cda40a005519 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.536962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958255be-16ff-4b92-b865-cda40a005519 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.537240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958255be-16ff-4b92-b865-cda40a005519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.550452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc7e5-d566-407d-a698-82a613260271 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.555701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f31425-9ac5-47f9-b53a-3c6a4fe69dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.556718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f31425-9ac5-47f9-b53a-3c6a4fe69dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.557210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f31425-9ac5-47f9-b53a-3c6a4fe69dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.557692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f31425-9ac5-47f9-b53a-3c6a4fe69dd4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.559394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-958255be-16ff-4b92-b865-cda40a005519 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:22.560681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-958255be-16ff-4b92-b865-cda40a005519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:22.566984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f31425-9ac5-47f9-b53a-3c6a4fe69dd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.569514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f31425-9ac5-47f9-b53a-3c6a4fe69dd4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.575725 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 273/558] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:22.575725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958255be-16ff-4b92-b865-cda40a005519 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.593035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958255be-16ff-4b92-b865-cda40a005519 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.597014 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-34f31425-9ac5-47f9-b53a-3c6a4fe69dd4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:45:22.597842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd980-2386-4772-b227-89190bbd2edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.598879 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 286/559] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.599937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd980-2386-4772-b227-89190bbd2edb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.599937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd980-2386-4772-b227-89190bbd2edb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.599937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd980-2386-4772-b227-89190bbd2edb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.600170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb352-d585-4adc-b2b0-9f4ae64861a1 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.600245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb352-d585-4adc-b2b0-9f4ae64861a1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.600487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfb352-d585-4adc-b2b0-9f4ae64861a1 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.602638 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 287/560] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:22.603349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb352-d585-4adc-b2b0-9f4ae64861a1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.611766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd980-2386-4772-b227-89190bbd2edb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.614441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd980-2386-4772-b227-89190bbd2edb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.619853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfb352-d585-4adc-b2b0-9f4ae64861a1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.624380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.625177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.625462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.625734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.627846 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-636cd980-2386-4772-b227-89190bbd2edb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:22.629159 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 274/561] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.633076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6250c-fe90-4f8a-b61e-410a2a717d3e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.633076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6250c-fe90-4f8a-b61e-410a2a717d3e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.633076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6250c-fe90-4f8a-b61e-410a2a717d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.641644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:22.650409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2ef6250c-fe90-4f8a-b61e-410a2a717d3e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:22.651588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2ef6250c-fe90-4f8a-b61e-410a2a717d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:22.651996 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:22.658291 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 288/562] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.658291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.664530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c7d1a-c5f0-4ab8-bf42-c5f529c55c05 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.664671 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 275/563] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:22.665638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6250c-fe90-4f8a-b61e-410a2a717d3e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.675300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6250c-fe90-4f8a-b61e-410a2a717d3e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.680865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.681085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.681837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.682119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.682397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.682646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.683114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.683291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.683575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.683979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.685073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.685600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.685711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.687789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.699338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 276/564] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.700215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.709150 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 289/565] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.710021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.715839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68870-b32c-48ce-9942-f68099b199fc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.720442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.721124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.721402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.721671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.722416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.722700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba760f-550e-4324-be05-8f1c1d07daee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.722798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.724869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.727866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.728642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.728948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.729223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.737099 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 277/566] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.737099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.743035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57912fe-5b28-4ac7-b8bd-1a29c3934d06 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.744448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:22.747552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.748398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.748675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.748981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/0f668b27e2af43fd812f309f6908199c/roles/6c7be361d0af46dfaf17213b5a844088` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.751259 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:22.752441 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 290/567] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.753243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.762542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1d701-cd9b-4322-a5e5-49c77e67aa86 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.767096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.767887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.768166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.768437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.769213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=0f668b27e2af43fd812f309f6908199c, role_id=6c7be361d0af46dfaf17213b5a844088)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.772407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.781293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.783179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.799841 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:22.801053 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 291/568] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.806002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.811034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa61583-a53e-4db0-aba5-d865f4bfae2b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.815350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.816073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.816350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.816616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.827291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.829244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.846048 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:22.852539 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 292/569] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:22.852539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.854082 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 278/570] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:22 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/0f668b27e2af43fd812f309f6908199c/roles/6c7be361d0af46dfaf17213b5a844088 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:22.860916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.867716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10866-26fa-498f-aca6-045057a1aafb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.929988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.930673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.931083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.931421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.932276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.932639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.934437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.940730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073ab6a-0aa6-441b-975f-26b4ab2dd52b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.946481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.949522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.949807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.950084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.950842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.951145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.952830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.952973 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 293/571] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.954110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.966793 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 279/572] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.968203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:22.971672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b0244-549e-4bfc-8d04-55ce9e18aabc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.977686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.978597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.979077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.979576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0019227-36c9-4845-8039-a971ea00ce3e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:22.979743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.980719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:22.981287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:22.983145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:22.984115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:22.984937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:22.985219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:22.985487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:22.998278 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 294/573] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:22.999540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.002298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.004129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.011437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7ff8-8b29-4930-a699-a143e9282305 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.017798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.018968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.019463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.019995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.025905 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:23.032673 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 280/574] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.032673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.034646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.037655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.039788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f445f5-3bb7-4e03-b4f7-2b4bdfe79587 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.045074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.046159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.046435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.046710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.054678 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:23.055996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.056609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 295/575] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.057692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.058062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.069331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed219571-f4d6-4a75-ae93-dabdb3261672 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.074180 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 25 20:45:23.075671 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 281/576] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.076307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.076697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.077659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.078170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.078650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.079611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.080148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.082587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.088024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c047a4-3d67-4ec4-a331-a4897d605a77 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.093241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.093928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.094636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.094911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.096211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.096525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.103139 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 296/577] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.103294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.104480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.113170 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 282/578] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.114412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.119123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917539-e269-4e5c-b5cc-132e0a6bd507 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.124789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882b658-c3d1-4fa9-8115-be9c7bba1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.125559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7ff17-9126-4340-8077-46504aa9256f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.125710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882b658-c3d1-4fa9-8115-be9c7bba1161 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.125904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882b658-c3d1-4fa9-8115-be9c7bba1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.126174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882b658-c3d1-4fa9-8115-be9c7bba1161 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.127005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882b658-c3d1-4fa9-8115-be9c7bba1161 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.127310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882b658-c3d1-4fa9-8115-be9c7bba1161 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.129181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882b658-c3d1-4fa9-8115-be9c7bba1161 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.132088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc381b-4d23-45c0-9d98-5fae732dbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.132088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc381b-4d23-45c0-9d98-5fae732dbe80 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.132088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc381b-4d23-45c0-9d98-5fae732dbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.132088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc381b-4d23-45c0-9d98-5fae732dbe80 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.139231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc381b-4d23-45c0-9d98-5fae732dbe80 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.141264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc381b-4d23-45c0-9d98-5fae732dbe80 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.149031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 297/579] 10.222.0.32 () {56 vars in 1158 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.150596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee28193-bd64-4bcc-ad95-2d15f6add7e5 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.152825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee28193-bd64-4bcc-ad95-2d15f6add7e5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.152825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee28193-bd64-4bcc-ad95-2d15f6add7e5 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.152825 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 298/580] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:23.153444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee28193-bd64-4bcc-ad95-2d15f6add7e5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.157035 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-ecbc381b-4d23-45c0-9d98-5fae732dbe80 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 25 20:45:23.158204 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 283/581] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.165093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199277e-99c7-499c-bff3-40d8190c9c6a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.165093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199277e-99c7-499c-bff3-40d8190c9c6a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.165093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199277e-99c7-499c-bff3-40d8190c9c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.166961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee28193-bd64-4bcc-ad95-2d15f6add7e5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.171366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.172228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.172499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.172764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79e05d879a534c6c890d4aea42c89975/roles/6c7be361d0af46dfaf17213b5a844088` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.180969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1199277e-99c7-499c-bff3-40d8190c9c6a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:23.182603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1199277e-99c7-499c-bff3-40d8190c9c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:23.188060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=79e05d879a534c6c890d4aea42c89975, role_id=6c7be361d0af46dfaf17213b5a844088)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.190795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.191281 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 284/582] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:23.192080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199277e-99c7-499c-bff3-40d8190c9c6a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.205876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199277e-99c7-499c-bff3-40d8190c9c6a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.210249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.212813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.212813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.212813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.221945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.224278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.241225 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:23.242456 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 285/583] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.243214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.252691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08f216-3cb3-4789-8e21-eb39e6572aaf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.257157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.257686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.257961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.258230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.259043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.259343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.261149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.277947 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 286/584] 10.222.0.32 () {56 vars in 1156 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.278715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.288367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50dc6-d7c4-4695-8372-cff112cdba2d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.292711 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 299/585] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:23 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79e05d879a534c6c890d4aea42c89975/roles/6c7be361d0af46dfaf17213b5a844088 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:23.293605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.362592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.365003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.365667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.366250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.377554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef339d6b-3a97-436b-842a-435b280bd927 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.380694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:23.383272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.384028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.384398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.384740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.385589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.385959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.387718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.391051 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:23.392977 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 287/586] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.393986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.407011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e921a80-2592-45c5-a031-529c1901f8c2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.412154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.413737 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 300/587] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.413838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.413838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.413962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.414140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.425150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.425556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374ea93-2936-4546-baa2-73074ad44750 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.428462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.431542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.432233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.432616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.432993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.433933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.434414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.437177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.446467 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 288/588] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:23.446467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.454850 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 301/589] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.461079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.463707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14396f2-d421-4d4c-820f-9a8035a870bf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.470022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.471156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664f6d7-0178-4469-b90b-245d32a0a1d7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.471429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.472040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.472569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.476040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.477123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.477518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.477941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.483453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.485737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.490840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.492763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.504998 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:23.506444 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 289/590] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.507376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.512016 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:23.513710 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 302/591] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.519599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.523736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cc453-fadc-4b90-9af4-7d3d4932610d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.528556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.529404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.529681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.529948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.530749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b5b53-ae15-4caf-8bc0-c2cb4c657f64 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.539125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.539773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.540451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.540735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.541863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.542170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.542267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.544017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.544187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.558897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 303/592] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.559724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.567752 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:23.569337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabff77-0b07-4551-a0fc-11a4cc951efa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.569449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 290/593] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.575597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.578426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.579284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.579747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.580198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.581191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.581677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.584032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.586526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59722382-10ea-4142-8943-3ce88259ccd9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.590996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.591622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.591895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.592163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.592895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.593197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.594802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.598228 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 304/594] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.599335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.609636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b178a1-6ab3-4886-bdce-60f097e5f538 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.610153 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 291/595] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.611009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.615744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.616864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.617363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.617860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/94e4b61a62d24f6c9274c0f46d514656/roles/6c7be361d0af46dfaf17213b5a844088` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.623260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d612c2-c331-49b5-8efe-4fec4e75125c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.627906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.628738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.629053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.629472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.634496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=94e4b61a62d24f6c9274c0f46d514656, role_id=6c7be361d0af46dfaf17213b5a844088)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.636611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.637569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.639973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.654261 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:23.655570 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 292/596] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.656222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.665980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5ac9f-fbe1-4f3e-8fbe-fffcb188f207 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.670416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.671165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.671436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.671702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.683465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.685513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.699781 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 25 20:45:23.700980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 293/597] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/users/neutron => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:23.702764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.713307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69efb-d27c-4c00-8877-14333a306e83 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.717784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.722679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.722679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.722679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.722679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.722679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.722679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.734000 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 294/598] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.734807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.744788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885cd14-6de5-4e6a-ad76-3c21118f02e1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.755513 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 305/599] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:23 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/94e4b61a62d24f6c9274c0f46d514656/roles/6c7be361d0af46dfaf17213b5a844088 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:23.756144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.757041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.757767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.758051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.758321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.765551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.765551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.765551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.781099 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 295/600] 10.222.0.32 () {56 vars in 1160 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.790865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:23.811574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be41a5-1c86-4f31-8af9-8dd00d1f4891 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.833856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68122c6-590c-45f1-9291-0f40f7723e92 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:23.839058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.839763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.840047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.840318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.841178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=eea4089e93f04fc5893b3e86954ead79) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:23.841534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.843996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.850665 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 306/601] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/role_assignments?user.id=eea4089e93f04fc5893b3e86954ead79&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 259 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:23.926616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:23.927451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:23.927731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:23.928004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:23.945668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:23.947426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:23.977374 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:23.978639 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 296/602] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:23.985441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:24.003687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1093-b939-4df7-a14d-75fda70ad843 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:24.008980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:24.009657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:24.009938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:24.010210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:24.017418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:24.017743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:24.019447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:24.033127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 307/603] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:24.039355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:24.054806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a3426-bc2b-4c12-8d73-7b20fb2db3d0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:24.059363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:24.060169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:24.060445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:24.060709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:24.074301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:24.076285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:24.096898 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:24.098381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 297/604] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:24.104579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:24.114924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85572-6999-4068-a7ec-9822dfc2c82b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:24.124809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34ceb4-4be0-4fc2-a7f0-bc105bf09b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:24.125515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34ceb4-4be0-4fc2-a7f0-bc105bf09b91 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:24.125796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34ceb4-4be0-4fc2-a7f0-bc105bf09b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:24.126068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34ceb4-4be0-4fc2-a7f0-bc105bf09b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:24.126871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34ceb4-4be0-4fc2-a7f0-bc105bf09b91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:24.127179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34ceb4-4be0-4fc2-a7f0-bc105bf09b91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:24.129153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34ceb4-4be0-4fc2-a7f0-bc105bf09b91 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:24.149657 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 308/605] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:24.155582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:24.166999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ad3c-1dcf-4301-823c-84568aae0e65 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:24.171418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7dc89-c71b-4ec4-bdab-737613319dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:24.172301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dc89-c71b-4ec4-bdab-737613319dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:24.172570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dc89-c71b-4ec4-bdab-737613319dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:24.172835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7dc89-c71b-4ec4-bdab-737613319dcc admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/043f47597a6b4368afbad7be8a7f40b3/roles/6c7be361d0af46dfaf17213b5a844088` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:24.188965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dc89-c71b-4ec4-bdab-737613319dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=043f47597a6b4368afbad7be8a7f40b3, role_id=6c7be361d0af46dfaf17213b5a844088)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:24.191580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7dc89-c71b-4ec4-bdab-737613319dcc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:24.276659 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 298/606] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:24 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/043f47597a6b4368afbad7be8a7f40b3/roles/6c7be361d0af46dfaf17213b5a844088 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:25.806908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426cae0-33b7-455b-be61-ba36d05c83d4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:25.807455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426cae0-33b7-455b-be61-ba36d05c83d4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:25.807455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426cae0-33b7-455b-be61-ba36d05c83d4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:25.809478 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 309/607] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:25.819500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32e77-55d3-49d8-9cb2-4fe64d6fb382 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:25.819925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32e77-55d3-49d8-9cb2-4fe64d6fb382 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:25.820137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32e77-55d3-49d8-9cb2-4fe64d6fb382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:25.841857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-18b32e77-55d3-49d8-9cb2-4fe64d6fb382 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:25.843058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-18b32e77-55d3-49d8-9cb2-4fe64d6fb382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:25.916691 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 299/608] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:25.955536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426cae0-33b7-455b-be61-ba36d05c83d4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:25.975253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426cae0-33b7-455b-be61-ba36d05c83d4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:25.984383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:25.985187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:25.985465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:25.985732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:25.997069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:26.003850 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:26.009654 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 310/609] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:26.016045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32e77-55d3-49d8-9cb2-4fe64d6fb382 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.025196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32e77-55d3-49d8-9cb2-4fe64d6fb382 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.029618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0ad49-7209-4b09-9dbb-489f40629d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.030274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ad49-7209-4b09-9dbb-489f40629d1c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.030552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ad49-7209-4b09-9dbb-489f40629d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.030823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ad49-7209-4b09-9dbb-489f40629d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.031584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0ad49-7209-4b09-9dbb-489f40629d1c admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.031868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0ad49-7209-4b09-9dbb-489f40629d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.037554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0ad49-7209-4b09-9dbb-489f40629d1c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.046563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 300/610] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.053040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.062918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fe98-d1d9-4910-a26b-eeb9321c4295 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.072542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.073374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.073649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.073919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.085352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.087182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.102413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec17916-fc69-4bf4-a42c-ba2151528c80 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.102693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec17916-fc69-4bf4-a42c-ba2151528c80 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.102964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec17916-fc69-4bf4-a42c-ba2151528c80 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.104854 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 301/611] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:26.108335 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:26.109874 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 311/612] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:26.110245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3830e61-81bc-488f-b744-5e1cdd3e6113 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.110533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3830e61-81bc-488f-b744-5e1cdd3e6113 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.110863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3830e61-81bc-488f-b744-5e1cdd3e6113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.125941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.142363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd6a02-a1f6-4009-b4b4-3c294dfdf4f3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.143652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f3830e61-81bc-488f-b744-5e1cdd3e6113 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:26.145062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f3830e61-81bc-488f-b744-5e1cdd3e6113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:26.152605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.153963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.155335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.155787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.157911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.158415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.161067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.162998 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 302/613] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:26.176726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 312/614] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.185952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3830e61-81bc-488f-b744-5e1cdd3e6113 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.188330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.200921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3830e61-81bc-488f-b744-5e1cdd3e6113 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.201076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4efc7-37d3-47a9-9f6e-7d7fe9fb0ea1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.208317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.210153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.210596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.211523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.211944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.212367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.213269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.213697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.228327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.232457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.233643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:26.243499 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:26.248959 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 313/615] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:26.260765 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 25 20:45:26.262477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 303/616] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:26.265417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.271430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.277985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878ce7-8437-488c-b64d-324f48f22f9e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.289242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.290133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.290557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.290973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.292357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903ab6-61ed-4314-b5bd-51c95e5939b0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.293373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.293829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.295722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.306752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.307307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 314/617] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.307420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.312527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.312527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.312527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.312527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.312527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.314208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.329171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805192-d926-4503-b964-7416d03ed381 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.349465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.351665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.352336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.353208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.359563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 304/618] 10.222.0.32 () {56 vars in 1158 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.366540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.386268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.388810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.391290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb75d7-8d95-468c-aef5-864f138a70b3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.402879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.405597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.406057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.406473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.423865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.425911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.431098 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:26.432496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 315/619] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:26.439473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.442687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 305/620] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:26.448063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.456860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81b251-74a6-40fe-940c-2674da5524f0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.457182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e79b-c65c-46d2-9ff3-9e88088d93f6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.461922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.462947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.463450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.463887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.465838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.466484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.466812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.467082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.467821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.468152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.469831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.475654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.477656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.491988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 316/621] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:26.500694 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:26.502938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.503619 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 306/622] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:26.509835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.514057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85dfc8-7a97-42dc-9ab3-8c2cde6762bd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.523478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.525411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.525685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.527334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.529640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5df94-7bcf-464e-a8e7-dbb4d8dbb8ed admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.539949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.540639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.541526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.541767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.542843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.543142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.544245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.546337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.548120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.568666 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 307/623] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.570205 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:45:26.571709 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 317/624] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:26.574516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.577658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.587601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed2cf0-d863-43c8-bd9c-fc20ad2f4a11 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.592278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.593143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.593566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.593983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.594363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6667d-3f5b-4eb9-9f02-f6bf25e3a280 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.595111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.595575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.597561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.611040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.611987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.612359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.612744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.618358 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 318/625] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:26.624101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.624747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.626275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.635728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f635f-eebd-43bb-9b65-d33a152f2225 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.651918 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:26.653995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.654791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.655241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.655657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.665455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.665873 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 308/626] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:26.667763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.670170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.685476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc63314-b521-490f-90c8-5ad0664b81fc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.685631 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 319/627] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:45:26.692826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.696069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.697039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.697710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.698134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.699132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.699630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.701830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.711146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc47824-ad9e-4b0c-bcdf-7b65cf6819ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.715900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 309/628] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:26.721428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389a8c9-6d57-410f-acc9-8667a477b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.721948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.722218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a8c9-6d57-410f-acc9-8667a477b578 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.722494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a8c9-6d57-410f-acc9-8667a477b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.722787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a8c9-6d57-410f-acc9-8667a477b578 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.733381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cd991-1841-4fc7-9ef7-878e88bbb722 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.739644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.740472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.740952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.741368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.742761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=0f668b27e2af43fd812f309f6908199c) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.742960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389a8c9-6d57-410f-acc9-8667a477b578 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.743438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.745185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389a8c9-6d57-410f-acc9-8667a477b578 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.746090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.752823 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 310/629] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/role_assignments?user.id=0f668b27e2af43fd812f309f6908199c&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:26.773483 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-1389a8c9-6d57-410f-acc9-8667a477b578 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:26.775240 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 320/630] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:26.782243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.798630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cb0fb-3f84-447e-96d8-a23b3eb7d849 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.804154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.805107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.805597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.806010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.806888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.807337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.809108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.834828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 311/631] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.835431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ffef-cc1e-41a4-bbeb-38ab704586ca None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.835431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ffef-cc1e-41a4-bbeb-38ab704586ca None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.835431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ffef-cc1e-41a4-bbeb-38ab704586ca None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.835431 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 321/632] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:26.835940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.836012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0e55-192c-4e96-b844-f8a6c46fd720 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.836012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0e55-192c-4e96-b844-f8a6c46fd720 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.836012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb0e55-192c-4e96-b844-f8a6c46fd720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.840138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74073b-0bf5-4514-887e-7c7d32056295 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.845283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.846388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.846840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.847272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.853685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e5fb0e55-192c-4e96-b844-f8a6c46fd720 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:26.854960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e5fb0e55-192c-4e96-b844-f8a6c46fd720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:26.856331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.859200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.868989 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 322/633] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:26.875174 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:26.877110 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 312/634] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:26.883389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb0e55-192c-4e96-b844-f8a6c46fd720 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.888778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.894242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb0e55-192c-4e96-b844-f8a6c46fd720 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.899372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f9a74-15c9-4d38-80df-57332d0b6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.900396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9a74-15c9-4d38-80df-57332d0b6bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.900869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9a74-15c9-4d38-80df-57332d0b6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.901344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ae76-01a6-4425-b2ee-b4b5004ca642 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.901513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9a74-15c9-4d38-80df-57332d0b6bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.902710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f9a74-15c9-4d38-80df-57332d0b6bb2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.903306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f9a74-15c9-4d38-80df-57332d0b6bb2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.905860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f9a74-15c9-4d38-80df-57332d0b6bb2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.906673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5dfec-7378-4332-beb7-c77f94e8dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.907578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5dfec-7378-4332-beb7-c77f94e8dcaa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.908029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5dfec-7378-4332-beb7-c77f94e8dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.908637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5dfec-7378-4332-beb7-c77f94e8dcaa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.920413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 323/635] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.927653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d07f8-15e0-4a1c-8ae2-f42cfc8d78d9 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.927838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5dfec-7378-4332-beb7-c77f94e8dcaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:26.928409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d07f8-15e0-4a1c-8ae2-f42cfc8d78d9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.928863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d07f8-15e0-4a1c-8ae2-f42cfc8d78d9 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.931192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 324/636] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:26 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:26.931474 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-59e5dfec-7378-4332-beb7-c77f94e8dcaa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:26.932380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d07f8-15e0-4a1c-8ae2-f42cfc8d78d9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.932972 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 313/637] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:26.940277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5047dd8-b850-447f-bf12-6e7c4f842178 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.940669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5047dd8-b850-447f-bf12-6e7c4f842178 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.941663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5047dd8-b850-447f-bf12-6e7c4f842178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.946932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d07f8-15e0-4a1c-8ae2-f42cfc8d78d9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:26.952116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:26.955488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:26.955488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:26.955488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:26.955488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79e05d879a534c6c890d4aea42c89975) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:26.955488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:26.957280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:26.963883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e5047dd8-b850-447f-bf12-6e7c4f842178 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:26.965212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e5047dd8-b850-447f-bf12-6e7c4f842178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:26.965666 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 325/638] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/role_assignments?user.id=79e05d879a534c6c890d4aea42c89975&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:26.973595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:26.990126 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 314/639] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:26.994201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aae81-c0e6-4f66-9a3e-38bf442c1519 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.007729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.008568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.008851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.009147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.010052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.010366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.012157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.023542 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 326/640] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:27.023743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5047dd8-b850-447f-bf12-6e7c4f842178 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.034562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5047dd8-b850-447f-bf12-6e7c4f842178 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.041413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.053531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.054350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.054679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.054951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.059444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b37ac-84ec-4ed5-982d-0b7041b92edb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.069822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:27.070038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.070707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.070988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.071315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.077125 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:27.078728 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 315/641] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:27.085605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.088467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.090488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.098503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdde42e-be7a-4600-a1c4-c57ac25dc68d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.106275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.107009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.107287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.107562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.108387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.108745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.110624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.111632 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:27.114473 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 327/642] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:27.123609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.123884 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 316/643] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:27.130176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.134831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ccf31-f619-4d78-8336-6f4bc6ef38e1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.140019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.140868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.141089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248022c-ca02-4b9e-97e9-207de0529784 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.141262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.141427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.142232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.142537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.146219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.147051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.147332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.147603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.148000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.160627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.162166 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 328/644] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:27.162539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.170707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.183050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ba63f-9f2f-4ba4-804a-43b9e6c8dce8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.187835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.188731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.189054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.189331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.189684 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:27.192338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 317/645] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:27.204649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.205116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.207385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.217090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b21f00-c0f5-47c6-8632-5f0f15260ad3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.222081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.223064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.223546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.224014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.224135 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 25 20:45:27.225105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.225609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.225773 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 329/646] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:27.227622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.232528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.243281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e282a3-ceba-4d48-b947-a5e23aa37e6b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.248502 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 318/647] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:27.250052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.254177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.255366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.255648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.255920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.256826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.257097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.258938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.261212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87449-5417-4086-a8b0-d7019e9bb6bd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.268908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.270048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.270331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.270611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.279924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.281983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.283415 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 330/648] 10.222.0.32 () {56 vars in 1156 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:27.289584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.298898 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 25 20:45:27.300378 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 319/649] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:27.301856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7e21c-cda3-4049-91c6-b9aec5db9fb6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.306869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.307407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.308556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.309075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.309572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.318092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf5a-3d72-4bf3-a2d4-b61bdbe328c5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.322011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.323320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.324095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.324498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.324710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.324855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.325903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.326347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.328342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.343258 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:27.344381 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 331/650] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:27.351434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.351842 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 320/651] 10.222.0.32 () {56 vars in 1158 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:27.354003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.361766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be70fe0-ec5b-41c0-818c-9f8f93c87d9b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.365120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47561b-d1d3-492e-a8f6-6d9888fd6e36 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.367754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.369191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.369476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.369748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.370482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.370844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.372770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.373427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.374340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.374781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.380335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.384958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.386156 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 332/652] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:27.387352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.391994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.398302 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 321/653] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:45:27.404386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.405386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fc399-c42d-4e6f-8c96-51177251caf6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.410466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.411699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.419116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.419116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.419273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b37fd-47a2-4eb3-8000-3f30076b5fc0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.419520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.420283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.420580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.420853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.422073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.424342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.432232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.434146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.440616 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:27.443361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 333/654] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:27.452998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.455216 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:27.458670 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 322/655] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:27.464682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.471180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a191-71ba-41d5-b391-a7ddc5774c61 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.474640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8169-995c-434f-bcc5-07dae48a3f40 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.476224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.477030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.477256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.477641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.478483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.478849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.480433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.481160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.481267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.481544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.481875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.482670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.483042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.484678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.495240 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 334/656] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:27.498573 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 323/657] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:27.506008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.509866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.521518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29560df-55de-47b8-9ae0-4c12775276dd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.521772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70773fb-8042-4a59-acdc-ed2be24b5ffc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.526522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.527361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.527644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.527918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.531182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.532067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.532345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.532615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/eea4089e93f04fc5893b3e86954ead79/roles/6c7be361d0af46dfaf17213b5a844088` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.536822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.538828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.554367 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:27.555923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 335/658] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:27.563643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.565046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=eea4089e93f04fc5893b3e86954ead79, role_id=6c7be361d0af46dfaf17213b5a844088)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.567740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.573868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af3b83-b0bd-4a3b-85fe-9e2babaf0de7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.578647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa5665-895b-4fb4-a2cb-d94ca69c5952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.579408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5665-895b-4fb4-a2cb-d94ca69c5952 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.579744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5665-895b-4fb4-a2cb-d94ca69c5952 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.580126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa5665-895b-4fb4-a2cb-d94ca69c5952 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.581003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa5665-895b-4fb4-a2cb-d94ca69c5952 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.581414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa5665-895b-4fb4-a2cb-d94ca69c5952 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.584195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa5665-895b-4fb4-a2cb-d94ca69c5952 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.597331 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 336/659] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:27.601899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2750-16de-443d-82cd-6de254a3eb68 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.602187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2750-16de-443d-82cd-6de254a3eb68 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.602463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2750-16de-443d-82cd-6de254a3eb68 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.604231 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 337/660] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:27.605134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2750-16de-443d-82cd-6de254a3eb68 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.618156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2750-16de-443d-82cd-6de254a3eb68 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.623557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13467e-33f0-4c8f-8b4a-aecf2599e9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.624220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13467e-33f0-4c8f-8b4a-aecf2599e9ab admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.624504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13467e-33f0-4c8f-8b4a-aecf2599e9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.624779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13467e-33f0-4c8f-8b4a-aecf2599e9ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.625642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13467e-33f0-4c8f-8b4a-aecf2599e9ab admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=94e4b61a62d24f6c9274c0f46d514656) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.625956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13467e-33f0-4c8f-8b4a-aecf2599e9ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.627774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13467e-33f0-4c8f-8b4a-aecf2599e9ab admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.634168 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 338/661] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/role_assignments?user.id=94e4b61a62d24f6c9274c0f46d514656&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:27.635276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab39667-73e1-4a43-8b28-36ffed657941 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.635563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab39667-73e1-4a43-8b28-36ffed657941 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.635841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab39667-73e1-4a43-8b28-36ffed657941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.659087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9ab39667-73e1-4a43-8b28-36ffed657941 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:27.663933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9ab39667-73e1-4a43-8b28-36ffed657941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:27.672075 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 324/662] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:27 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/eea4089e93f04fc5893b3e86954ead79/roles/6c7be361d0af46dfaf17213b5a844088 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:45:27.733412 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 339/663] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:27.760482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.771517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae5f0-0cc1-4c78-aa7f-e3de7d801427 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.776785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.777655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.777991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.778270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.791751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:27.799396 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:27.801597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 325/664] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:27.808253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab39667-73e1-4a43-8b28-36ffed657941 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.818167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab39667-73e1-4a43-8b28-36ffed657941 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.823109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.823919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.824206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.824482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.825408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.825720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.827346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.837562 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 340/665] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:27.843868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.857080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7180e2d-72f7-4f8e-b77a-116b566ddfe0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.865662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.866579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.866863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.867144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.885558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.887548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.918677 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:27.920250 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 326/666] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:27.926230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.939319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3067-8f72-4c08-8303-63225d35ebd7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:27.952847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:27.953610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:27.953894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:27.954172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:27.954971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:27.955283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:27.956977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:27.972759 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 341/667] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:27.979322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:27.998516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be6b14-5d37-40ac-9e9f-efe21b59ad56 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.003256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.004155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.004440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.004805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.014075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.016194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.032546 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 25 20:45:28.033320 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 327/668] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:27 2021] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:28.039712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:28.051935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05a24f-f804-45ee-831e-8ecaac9b23dc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.062791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.063452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.063737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.064013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.064849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:28.065233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.067220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.096462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 342/669] 10.222.0.32 () {56 vars in 1160 bytes} [Sat Dec 25 20:45:28 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:28.103098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:28.115780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284cf7a-f14e-4f99-aac8-f51560dc81e9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.120839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.121756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.122233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.122699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.131623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.133759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.143818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 328/670] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:28.150880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:28.163027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ab031-9380-4a99-9b13-fd2d9d019833 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.168869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.169931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.170526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.170947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.182153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.184279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.202203 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:28.203999 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 343/671] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:28.211252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:28.222116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86389427-404f-42de-bd05-c34e02da4b04 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.227828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.228792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.229281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.229785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.230695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:28.231201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.233050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.246969 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 329/672] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:28.253114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:28.264298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf90493-efda-4689-b2b2-872c9689bc3e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.269631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.271208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.271721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.272171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.280182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.282445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.296062 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:28.297794 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 344/673] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:28.303955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:28.315015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6e0c2-22ed-4ced-ac3b-ffa7fb231293 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.320759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2406580-e4cf-4ed6-bc76-390bf4f2947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.321767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2406580-e4cf-4ed6-bc76-390bf4f2947f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.322229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2406580-e4cf-4ed6-bc76-390bf4f2947f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.322679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2406580-e4cf-4ed6-bc76-390bf4f2947f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.323675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2406580-e4cf-4ed6-bc76-390bf4f2947f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:28.324199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2406580-e4cf-4ed6-bc76-390bf4f2947f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.326292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2406580-e4cf-4ed6-bc76-390bf4f2947f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.340150 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 330/674] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:28.346795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:28.359179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01970b4-1485-424f-8af7-de71484098c3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:28.364734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d825e-6e52-46ab-a340-55495a19f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:28.365685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d825e-6e52-46ab-a340-55495a19f7af admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:28.366207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d825e-6e52-46ab-a340-55495a19f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:28.366699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d825e-6e52-46ab-a340-55495a19f7af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:28.367802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d825e-6e52-46ab-a340-55495a19f7af admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=043f47597a6b4368afbad7be8a7f40b3) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:28.368308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d825e-6e52-46ab-a340-55495a19f7af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:28.370725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d825e-6e52-46ab-a340-55495a19f7af admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:28.377830 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 345/675] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:28 2021] GET /identity/v3/role_assignments?user.id=043f47597a6b4368afbad7be8a7f40b3&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:29.595710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768166-14cb-4bc0-9717-68c24e40b174 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:29.596252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768166-14cb-4bc0-9717-68c24e40b174 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:29.596252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768166-14cb-4bc0-9717-68c24e40b174 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:29.598865 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 331/676] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:29.604730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c35302-bb5d-41b3-9032-8f24078706b1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:29.605178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c35302-bb5d-41b3-9032-8f24078706b1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:29.605336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c35302-bb5d-41b3-9032-8f24078706b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:29.629870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-62c35302-bb5d-41b3-9032-8f24078706b1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:29.631065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-62c35302-bb5d-41b3-9032-8f24078706b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:29.643398 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 346/677] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:29.684184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768166-14cb-4bc0-9717-68c24e40b174 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:29.696949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768166-14cb-4bc0-9717-68c24e40b174 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:29.701407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:29.702206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:29.702489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:29.702764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:29.703431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:29.704435 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:29.704435 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:29.704435 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:29.705352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:29.718894 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 25 20:45:29.720332 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 332/678] 10.222.0.32 () {56 vars in 1150 bytes} [Sat Dec 25 20:45:29 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:29.727233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c35302-bb5d-41b3-9032-8f24078706b1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:29.736291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c35302-bb5d-41b3-9032-8f24078706b1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:29.745407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:29.746064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:29.746347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:29.746625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:29.747346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:29.747654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:29.748661 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:29.748661 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:29.748661 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:29.749570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1efbe3-b00c-4816-82a2-6633168809df admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:29.757467 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 347/679] 10.222.0.32 () {56 vars in 1145 bytes} [Sat Dec 25 20:45:29 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:29.763476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:29.774929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a415b03-720d-4e86-abe6-e439c062f00b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:29.784643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:29.785368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:29.785647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:29.785920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:29.786634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:29.786938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:29.787938 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:29.787938 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:29.787938 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:29.788824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02491b42-c353-44bd-ad7e-c948e56a58f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:29.798174 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 333/680] 10.222.0.32 () {56 vars in 1145 bytes} [Sat Dec 25 20:45:29 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:30.255580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b267-8e27-4a51-a82e-364308c3158e None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.255960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b267-8e27-4a51-a82e-364308c3158e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.256213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b267-8e27-4a51-a82e-364308c3158e None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.258348 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 348/681] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:30.264979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f997-a7fc-4389-ae72-75c6ccd86930 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.265270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f997-a7fc-4389-ae72-75c6ccd86930 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.265548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f997-a7fc-4389-ae72-75c6ccd86930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.293969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dfb1f997-a7fc-4389-ae72-75c6ccd86930 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:30.295175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dfb1f997-a7fc-4389-ae72-75c6ccd86930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:30.303090 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 334/682] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 25 20:45:30.349684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71b267-8e27-4a51-a82e-364308c3158e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.368754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71b267-8e27-4a51-a82e-364308c3158e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.374914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.375699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.375980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.376412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.392520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:30.400009 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:30.401615 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 349/683] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:30.410183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f997-a7fc-4389-ae72-75c6ccd86930 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.420310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f997-a7fc-4389-ae72-75c6ccd86930 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.437555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.438248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.438526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.438800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.439567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:30.439871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.441518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.450779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 335/684] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:30.456744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.469925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8414e-8a57-4cc9-91ac-efde5b395e26 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.477701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.478546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.478834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.479112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.497578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.499541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.522187 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:30.523533 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 350/685] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:30.529526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.542092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930566cf-9fdc-4342-a816-f4a8ad4ba2d4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.557540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aa179-ff4d-45ba-b842-1116d39444b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.558218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa179-ff4d-45ba-b842-1116d39444b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.558496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa179-ff4d-45ba-b842-1116d39444b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.558767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa179-ff4d-45ba-b842-1116d39444b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.559501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa179-ff4d-45ba-b842-1116d39444b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:30.559807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa179-ff4d-45ba-b842-1116d39444b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.561409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa179-ff4d-45ba-b842-1116d39444b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.578277 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 336/686] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:30.584822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.597999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d789e4-90d6-477d-b257-f7c7a3e41309 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.604914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.605704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.605986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.606259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.626088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.628040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887addb-da17-4143-9501-b6077d887a23 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.628534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.628725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887addb-da17-4143-9501-b6077d887a23 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.628725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887addb-da17-4143-9501-b6077d887a23 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.632431 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 337/687] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:30.637847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6a24-ab4c-4138-a4a9-104c88d7763f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.638130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6a24-ab4c-4138-a4a9-104c88d7763f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.638406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6a24-ab4c-4138-a4a9-104c88d7763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.658746 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:45:30.663107 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 351/688] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:30.666604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.673265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a13f6a24-ab4c-4138-a4a9-104c88d7763f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:30.677192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a13f6a24-ab4c-4138-a4a9-104c88d7763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:30.682029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c216f-fb94-4b9f-a4fb-2f20722fdd0a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.691422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.692663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.693032 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 338/689] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:30.693284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.693561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.694545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:30.694859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.696806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.715804 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 352/690] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:30.721560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6a24-ab4c-4138-a4a9-104c88d7763f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.734321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6a24-ab4c-4138-a4a9-104c88d7763f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.739840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.740511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.740806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.741110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.744514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.759562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448837d-ffb1-45ff-924a-c12571baa840 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.766294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.768427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.769780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.770675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.770955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.771227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.788193 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 339/691] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:45:30.788680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:30.793929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.795983 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:30.797427 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 353/692] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:30.803464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.803697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be06d-a0e3-427f-8844-8c8295fa378b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.813526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96ccb6-5486-46f8-b808-91a61f571631 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.817661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.818736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.818953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.819126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.819429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.819595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.819846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.820118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.820949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:30.821263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.822910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.837233 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 354/693] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:30.842438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.843823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.848733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.860303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecb4c4-918b-4379-9649-6a36f7c29564 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.872979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.873880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.875588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.875870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.886055 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:30.889703 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 340/694] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:30.896627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.897753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.904920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.911146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b40de-b636-4633-8c42-24362fc7804c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.927598 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:30.929199 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 355/695] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:30.929775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.930535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.930790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.931079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.931814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:30.932119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.933727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.935170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.945931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0642b3-d63b-4981-ab21-3fecf284d8ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.951383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.952098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.952381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.952707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:30.953474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:30.953781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:30.955462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:30.962389 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 341/696] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:30.968582 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 356/697] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:30.970381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.974344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:30.984459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218fc1c-4a91-45fd-be05-722323368ccc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.986252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cdce5-ae20-40e1-8750-54623887a6fe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:30.994890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:30.995908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:30.996212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:30.996487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.001037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.001782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.003460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.003754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.015631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.018111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.019789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.022327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.042188 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 25 20:45:31.043663 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 357/698] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/users/swift => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:31.049544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.052136 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:31.058348 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 342/699] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:31.059495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.060404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7ca9-2f45-4881-97e5-77bf0af3c0a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.065182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.065948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.066233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.066575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.067985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.068295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.070330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.072506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706f206-b61c-4b26-90a3-2d6ac7682dde admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.091917 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 358/700] 10.222.0.32 () {56 vars in 1156 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:31.092582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.093358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.093640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.093914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.094730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.095035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.098395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.099791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.108902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe7522-d9cc-4c36-a6f7-82bd9cfae40e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.120650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.121380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.121662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.121954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.125152 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 343/701] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:31.131742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.139941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.143009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.146908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dc188-c4f6-4226-84dc-c67add4dc123 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.157099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.157898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.158182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.158461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.160762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79e05d879a534c6c890d4aea42c89975) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.161105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.163368 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 359/702] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 20:45:31.164769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.173522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.183288 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 344/703] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/role_assignments?user.id=79e05d879a534c6c890d4aea42c89975&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:31.185785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ce16a-5b55-4f14-9202-ad89a3a4f46b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.190529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.191337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.192231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.192514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.204226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.206114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.224929 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:31.226521 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 360/704] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:31.232810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.243906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ae1c7-3080-4f6c-8eb8-cdfa65b44815 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.248634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.249342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.249624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.249903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.250651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.250959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.252591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.267024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 345/705] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:31.273262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.284105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121807d-5885-41d2-ae54-4769bfc05739 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.289703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.290569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.290853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.291179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.299477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.302109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.316571 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:31.318242 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 361/706] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:31.324628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.335379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47162a97-15d1-4449-9650-c34eb3026be4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.340236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364133a-840b-4a9d-ab69-45586bb64fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.341010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364133a-840b-4a9d-ab69-45586bb64fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.341296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364133a-840b-4a9d-ab69-45586bb64fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.341618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364133a-840b-4a9d-ab69-45586bb64fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.342427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364133a-840b-4a9d-ab69-45586bb64fa7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.342793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364133a-840b-4a9d-ab69-45586bb64fa7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.344782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364133a-840b-4a9d-ab69-45586bb64fa7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.358504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 346/707] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:31.365810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.377543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2a152-4ad4-48d5-b60b-8346fd274c8a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.382556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46bf5-5fc1-4a9e-b380-78a137535d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.383169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46bf5-5fc1-4a9e-b380-78a137535d1f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.383452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46bf5-5fc1-4a9e-b380-78a137535d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.388797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46bf5-5fc1-4a9e-b380-78a137535d1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.388797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46bf5-5fc1-4a9e-b380-78a137535d1f admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=eea4089e93f04fc5893b3e86954ead79) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.388797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46bf5-5fc1-4a9e-b380-78a137535d1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.388797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46bf5-5fc1-4a9e-b380-78a137535d1f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.394712 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 362/708] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/role_assignments?user.id=eea4089e93f04fc5893b3e86954ead79&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:31.462634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e958272-b0ea-48ba-abbe-af8864c0494e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.462956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e958272-b0ea-48ba-abbe-af8864c0494e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.463203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e958272-b0ea-48ba-abbe-af8864c0494e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.465408 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 347/709] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:31.471629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dc28c-bff3-45b5-b89f-31f727b067d5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.471999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dc28c-bff3-45b5-b89f-31f727b067d5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.472354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dc28c-bff3-45b5-b89f-31f727b067d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.501016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0f3dc28c-bff3-45b5-b89f-31f727b067d5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:31.502248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0f3dc28c-bff3-45b5-b89f-31f727b067d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:31.521471 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 363/710] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:31.567966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e958272-b0ea-48ba-abbe-af8864c0494e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.586897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9942-2bff-4bab-ac0c-8316cd6e73c3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.587222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9942-2bff-4bab-ac0c-8316cd6e73c3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.587453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9942-2bff-4bab-ac0c-8316cd6e73c3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.588888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e958272-b0ea-48ba-abbe-af8864c0494e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.590380 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 364/711] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:31.596247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.597063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57dc35-7718-4730-ada2-6a3adfbd60c2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.597171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.597354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57dc35-7718-4730-ada2-6a3adfbd60c2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.597471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.597636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57dc35-7718-4730-ada2-6a3adfbd60c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.598267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.616284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.618816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.623961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3d57dc35-7718-4730-ada2-6a3adfbd60c2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:31.625202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3d57dc35-7718-4730-ada2-6a3adfbd60c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:31.644529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 365/712] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:31.651168 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:31.652729 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 348/713] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:31.659140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57dc35-7718-4730-ada2-6a3adfbd60c2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.669962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57dc35-7718-4730-ada2-6a3adfbd60c2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.675996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.677969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.678752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.679042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.679320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.680118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.680482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.682715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.686955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f36fb2-ff3c-4818-8c76-767f632b0e6a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.698517 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 366/714] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:31.700413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.701272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.701561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.701833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.702503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.704090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.706833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.717892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d8f62-b360-447f-b2d1-717a96cf2d07 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.718212 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 25 20:45:31.719740 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 349/715] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:31.728170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a7054-9d71-4648-b6c2-3a015beb674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.728771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.728956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7054-9d71-4648-b6c2-3a015beb674c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.729159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7054-9d71-4648-b6c2-3a015beb674c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.729437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a7054-9d71-4648-b6c2-3a015beb674c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.730335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a7054-9d71-4648-b6c2-3a015beb674c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.732242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a7054-9d71-4648-b6c2-3a015beb674c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.740338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ba87b-6e00-4030-9d49-c7664bac6b36 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.746471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.747350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.747458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.748333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.748455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] RBAC: Adding query filter params (name=network) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.750380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.750570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.755506 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 350/716] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:31.761303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:31.772436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b0724-6f2c-4eb6-8092-b89d1a65d3d7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:31.776819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec85e1-004a-49a6-97d5-0ba2bb1658b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:31.777436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec85e1-004a-49a6-97d5-0ba2bb1658b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:31.777714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec85e1-004a-49a6-97d5-0ba2bb1658b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:31.777991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec85e1-004a-49a6-97d5-0ba2bb1658b5 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:31.778696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec85e1-004a-49a6-97d5-0ba2bb1658b5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:31.779002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec85e1-004a-49a6-97d5-0ba2bb1658b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:31.780562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec85e1-004a-49a6-97d5-0ba2bb1658b5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:31.787012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 351/717] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:31 2021] GET /identity/v3/services?type=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:31.819738 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 367/718] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:45:31 2021] POST /identity/v3/users => generated 254 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:33.001815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720863d8-ba61-49aa-b72a-353737a51447 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:33.002783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720863d8-ba61-49aa-b72a-353737a51447 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:33.003271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720863d8-ba61-49aa-b72a-353737a51447 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:33.006059 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 352/719] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:33.012491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bbd04-783b-4b86-adbf-977d90abd05c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:33.013372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bbd04-783b-4b86-adbf-977d90abd05c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:33.013859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bbd04-783b-4b86-adbf-977d90abd05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:33.037320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-535bbd04-783b-4b86-adbf-977d90abd05c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:33.039654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-535bbd04-783b-4b86-adbf-977d90abd05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:33.048182 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 368/720] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 25 20:45:33.074611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720863d8-ba61-49aa-b72a-353737a51447 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:33.088124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720863d8-ba61-49aa-b72a-353737a51447 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:33.092961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67f9d6-0ce3-4c7f-b4d9-fc05d6bb2b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:33.093877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f9d6-0ce3-4c7f-b4d9-fc05d6bb2b0f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:33.094391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f9d6-0ce3-4c7f-b4d9-fc05d6bb2b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:33.094865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f9d6-0ce3-4c7f-b4d9-fc05d6bb2b0f admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:33.095792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f9d6-0ce3-4c7f-b4d9-fc05d6bb2b0f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:33.097011 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-cb67f9d6-0ce3-4c7f-b4d9-fc05d6bb2b0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:33.097011 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:33.097011 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:33.098253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f9d6-0ce3-4c7f-b4d9-fc05d6bb2b0f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:33.201637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 353/721] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:45:33 2021] POST /identity/v3/services => generated 251 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:45:33.986710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead7de4-1618-425c-83fe-fb6c1c52bd67 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:33.987054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead7de4-1618-425c-83fe-fb6c1c52bd67 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:33.987267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead7de4-1618-425c-83fe-fb6c1c52bd67 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:33.989838 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 369/722] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:33.995796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ca2b-c3df-4dba-a94a-66389ed96500 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:33.996156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ca2b-c3df-4dba-a94a-66389ed96500 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:33.996441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9ca2b-c3df-4dba-a94a-66389ed96500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.025905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f7c9ca2b-c3df-4dba-a94a-66389ed96500 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:34.027113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f7c9ca2b-c3df-4dba-a94a-66389ed96500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:34.054392 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 354/723] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:33 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:34.102330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead7de4-1618-425c-83fe-fb6c1c52bd67 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.118706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead7de4-1618-425c-83fe-fb6c1c52bd67 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.123316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.124094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.124375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.124650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.145825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:34.152725 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:34.153962 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 370/724] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:34.160379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ca2b-c3df-4dba-a94a-66389ed96500 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.169708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9ca2b-c3df-4dba-a94a-66389ed96500 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.177593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.178260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.178543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.178822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.179588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:34.179898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.181523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.190727 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 355/725] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:34.196974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.207073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058078ee-bd57-4479-841d-475aad348e7a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.217604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.218328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.218611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.218888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.235477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.237394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.259999 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:34.261242 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 371/726] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:34.267471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.277453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b77d6-2f4e-4773-81ca-076559499eba admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.285055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.286254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.286575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.286882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.287646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:34.287974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.289638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.302722 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 356/727] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:34.308419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.321940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f91f4-87c5-41b3-9c12-01a0940853fd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.330078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.330870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.331149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.331467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.343978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.346038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.365205 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:45:34.366718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 372/728] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:34.373035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.383653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010960f-3f56-4c70-b20b-76265f8ccd65 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.393574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.394276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.394611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.394890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.395766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:34.396077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.401068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.433672 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 357/729] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:34.439813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.453948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8516-2af3-405a-aab1-9fd041dccd07 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.459263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.460045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.460327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.460602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.481973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.483806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.508156 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:34.508156 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 373/730] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:34.514426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.525008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b245a2-4ed9-4413-8bcc-33eec1572fc5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.538915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.539651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.539938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.540215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.541002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:34.541312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.542927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.560293 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 358/731] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:34.566078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.581944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36faef4-753d-4b65-bf34-db7641c34c3e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.590451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.591247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.591530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.591802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.606185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.608317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.628533 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:34.630049 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 374/732] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:34.635943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.646644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b49a4-915b-4a16-956c-6c0e8bc4f55f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.656564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccb2c2-5a89-420f-bb80-2baec4b37597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.657251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccb2c2-5a89-420f-bb80-2baec4b37597 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.657537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccb2c2-5a89-420f-bb80-2baec4b37597 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.657911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccb2c2-5a89-420f-bb80-2baec4b37597 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.658714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccb2c2-5a89-420f-bb80-2baec4b37597 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:34.659023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccb2c2-5a89-420f-bb80-2baec4b37597 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.661495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccb2c2-5a89-420f-bb80-2baec4b37597 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.678386 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 359/733] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:34.684565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.701170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1f351-31dc-4e5f-aeef-1cdd0956cb34 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.709056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70738b-17f3-4e88-a279-1196f2a9f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.709940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70738b-17f3-4e88-a279-1196f2a9f8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.710227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70738b-17f3-4e88-a279-1196f2a9f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.710504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70738b-17f3-4e88-a279-1196f2a9f8c8 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79e05d879a534c6c890d4aea42c89975/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.712540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70738b-17f3-4e88-a279-1196f2a9f8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=79e05d879a534c6c890d4aea42c89975, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.715503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ad372-3795-4ae5-ac43-37a4c1405833 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.715790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ad372-3795-4ae5-ac43-37a4c1405833 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.716063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ad372-3795-4ae5-ac43-37a4c1405833 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.717864 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 360/734] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:34.719257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70738b-17f3-4e88-a279-1196f2a9f8c8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.726525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1eea9-ac53-4981-b33f-862167e4fcb3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.726815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1eea9-ac53-4981-b33f-862167e4fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.727094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1eea9-ac53-4981-b33f-862167e4fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.750151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7dc1eea9-ac53-4981-b33f-862167e4fcb3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:34.751631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7dc1eea9-ac53-4981-b33f-862167e4fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:34.760536 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 361/735] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:34 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:34.788147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1eea9-ac53-4981-b33f-862167e4fcb3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:34.797910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1eea9-ac53-4981-b33f-862167e4fcb3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:34.807055 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 375/736] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:34 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79e05d879a534c6c890d4aea42c89975/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:34.811342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f544-a5e7-4933-87b9-5819e079e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:34.812342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f544-a5e7-4933-87b9-5819e079e0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.812907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f544-a5e7-4933-87b9-5819e079e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.813500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f544-a5e7-4933-87b9-5819e079e0a9 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.814545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f544-a5e7-4933-87b9-5819e079e0a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:34.816555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f544-a5e7-4933-87b9-5819e079e0a9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:34.888198 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 362/737] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:45:34 2021] POST /identity/v3/services => generated 240 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:45:34.936005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a394-4b89-48cd-a405-1a406099ae4f None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.936632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a394-4b89-48cd-a405-1a406099ae4f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.937137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a394-4b89-48cd-a405-1a406099ae4f None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.939553 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 376/738] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:34.945467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937276a4-2f74-4092-9aaa-e88948ae564d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:34.946086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937276a4-2f74-4092-9aaa-e88948ae564d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:34.946561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937276a4-2f74-4092-9aaa-e88948ae564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:34.970724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-937276a4-2f74-4092-9aaa-e88948ae564d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:34.972312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-937276a4-2f74-4092-9aaa-e88948ae564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:35.003340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cfa15-722b-49d4-b2c0-219266f17ae5 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.003523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cfa15-722b-49d4-b2c0-219266f17ae5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.003808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cfa15-722b-49d4-b2c0-219266f17ae5 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.007066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 377/739] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:35.012621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c8455-4ad1-41dc-b3bd-b180c45d3b9e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.012981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c8455-4ad1-41dc-b3bd-b180c45d3b9e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.013200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c8455-4ad1-41dc-b3bd-b180c45d3b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.058310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8e3c8455-4ad1-41dc-b3bd-b180c45d3b9e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:35.059554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8e3c8455-4ad1-41dc-b3bd-b180c45d3b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:35.066212 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 363/740] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:34 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:35.084595 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 378/741] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:35 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:35.098748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937276a4-2f74-4092-9aaa-e88948ae564d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.109423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937276a4-2f74-4092-9aaa-e88948ae564d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.112620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c8455-4ad1-41dc-b3bd-b180c45d3b9e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.120386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.121121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.121395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.121663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.125970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c8455-4ad1-41dc-b3bd-b180c45d3b9e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.133853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.134673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.134959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.135237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.137569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:35.145408 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:35.146839 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 364/742] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:35.153866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.159112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:35.165983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa49fb-4f5f-4bfc-ba50-d6007d1f8f3c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.166168 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:35.172644 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 379/743] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:35.174716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.179415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.180102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.180379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.180652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.181464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.181766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.183404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.188380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d62dcb-d18f-4ee2-a98a-4ef86f126833 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.194812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.195813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.196336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.196801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.197849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.198324 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 365/744] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.198647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.199683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.200675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.209960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fb9e8-4e03-4fed-86cf-ad1baba08b01 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.212968 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 380/745] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:35.219347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.219592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.220390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.220670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.220968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.231596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.232645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8060969-8ab9-4557-9c1c-504499c38739 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.233567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.238703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.239808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.240277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.241194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.250899 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:35.254651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.256737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.257006 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 366/746] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:35.258901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.271194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92216801-cfec-4bb9-bf08-7d49ac9850c7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.275791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.276445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.276724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.277039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.277767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.278061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.279558 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:35.279668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.281581 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 381/747] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:35.288280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.299508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2018a-1da3-4cf2-bf7a-59f0382a2eab admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.301044 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 367/748] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.302388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.305119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.306005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.306477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.307037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.308158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.308674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.311316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.313498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ceebfd-02bd-4447-85ef-f5af8c1a29e9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.318851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.319896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.320003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.320268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.327364 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 382/749] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.334086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.334356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.336164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.345785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ecbb8-434b-480b-872b-06fa4d9bbf4e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.350884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.351225 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 25 20:45:35.352106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.352577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.353076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.357004 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 368/750] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:35.358887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.362299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.364770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.369406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02edf05-b269-4498-b4e5-aafa53d2e887 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.374228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.382800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.382800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.382800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.382800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.382800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.382800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.383187 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 25 20:45:35.384406 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 383/751] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:35.391434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.402009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299f308-6229-4725-a368-fc2b1bfeef40 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.402306 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 369/752] 10.222.0.32 () {56 vars in 1170 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.409610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.410509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.411435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.411885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.412378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.413528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.414005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.416067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.418839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f524-9fd2-47cc-a376-43cf133dc54f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.425167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.426350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.426636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.426910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.435778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.437546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.438485 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 384/753] 10.222.0.32 () {56 vars in 1156 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:35.445215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.452980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 370/754] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:45:35.454857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.455930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b530bd-1e14-4042-b7cb-ca3f6aeffde1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.460953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.461668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.462018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.462503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.464769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d71488-6e74-4fdf-8474-58938f2fc706 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.469891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.470849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.471275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.471707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.471821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.473912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.483335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.483972 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 385/755] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:45:35.485728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.490530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.499628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051e5e-6a5c-4dcf-b82a-38bc229eb4c8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.505097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.505882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.506227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.506563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.508827 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:35.510434 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 371/756] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:35.516498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.517393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.519407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.526861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4bbb8-c4b6-4d4d-896d-bcd1ae106b14 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.531837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.532744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.533272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.533773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.534672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.535276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.537160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.537557 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:35.539096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 386/757] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:35.544829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.555097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf877a-e49b-4135-a72e-abe8bf06448c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.555312 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 372/758] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.557377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.560194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.561025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.561403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.561784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.562595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.562993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.564648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.569536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5d3b4-08d0-4ab8-956e-8969b817a10b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.574541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.577606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.577606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.577606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.577823 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 387/759] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.583289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.584005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.586322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.592992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a8c10-918d-484c-aaa9-1fc2ef695686 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.603158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.603933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.607568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.607568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.619490 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:35.620849 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 373/760] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:35.621773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.623859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.626917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.646717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cffd75-9570-410a-8871-ed2b93d07b71 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.651562 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:35.653407 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 388/761] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:35.661156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.661329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.664905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.664905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.665073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.665173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.665173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.666574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.682657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bc4f8-50ec-4f44-87af-f4cd4bca0aa9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.694843 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 374/762] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.696387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.697115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.697394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.697662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.698562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.698865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.700431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.705395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.717836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71357f-8217-4352-982d-bdb656fac409 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.726951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc27fa2-7bdd-467a-bff0-69807ef7358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.728610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc27fa2-7bdd-467a-bff0-69807ef7358e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.728952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc27fa2-7bdd-467a-bff0-69807ef7358e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.729225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc27fa2-7bdd-467a-bff0-69807ef7358e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.730533 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 389/763] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:35.730665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc27fa2-7bdd-467a-bff0-69807ef7358e admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=23c0a773f0c542baaa1bd937a8412456) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.730996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc27fa2-7bdd-467a-bff0-69807ef7358e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.738828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc27fa2-7bdd-467a-bff0-69807ef7358e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.740648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:35.753489 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 375/764] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/role_assignments?user.id=23c0a773f0c542baaa1bd937a8412456&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:35.756416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbaf2a-adc9-4c16-9991-ed26698aa6d1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:35.761460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f029a6-b512-4ee8-82f7-750a632e8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:35.762127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f029a6-b512-4ee8-82f7-750a632e8dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:35.762406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f029a6-b512-4ee8-82f7-750a632e8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:35.762729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f029a6-b512-4ee8-82f7-750a632e8dc3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:35.763687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f029a6-b512-4ee8-82f7-750a632e8dc3 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=eea4089e93f04fc5893b3e86954ead79) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:35.763998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f029a6-b512-4ee8-82f7-750a632e8dc3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:35.766104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f029a6-b512-4ee8-82f7-750a632e8dc3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:35.773287 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 390/765] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:35 2021] GET /identity/v3/role_assignments?user.id=eea4089e93f04fc5893b3e86954ead79&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:36.655457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d946d-e6bd-45b6-afcd-9bc814726b42 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:36.655972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d946d-e6bd-45b6-afcd-9bc814726b42 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:36.655972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d946d-e6bd-45b6-afcd-9bc814726b42 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:36.657767 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 376/766] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:36.665855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b127-071a-4632-b78c-956c0ed45e9e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:36.666271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b127-071a-4632-b78c-956c0ed45e9e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:36.666462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114b127-071a-4632-b78c-956c0ed45e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:36.686462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7114b127-071a-4632-b78c-956c0ed45e9e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:36.687646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7114b127-071a-4632-b78c-956c0ed45e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:36.699908 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 391/767] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:36 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:36.724217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d946d-e6bd-45b6-afcd-9bc814726b42 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:36.736554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d946d-e6bd-45b6-afcd-9bc814726b42 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:36.741178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:36.741974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:36.742249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:36.742520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:36.743180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:36.745037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:36.757224 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 25 20:45:36.758746 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 377/768] 10.222.0.32 () {56 vars in 1150 bytes} [Sat Dec 25 20:45:36 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:36.765016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b127-071a-4632-b78c-956c0ed45e9e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:36.774834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114b127-071a-4632-b78c-956c0ed45e9e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:36.779693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:36.780342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:36.780618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:36.780900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:36.781624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:36.781923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:36.783492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:36.788501 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 392/769] 10.222.0.32 () {56 vars in 1145 bytes} [Sat Dec 25 20:45:36 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:36.794397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:36.804076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2342c1-065e-4c1a-8d22-b7107b13de7b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:36.808639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:36.809333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:36.809609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:36.809877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:36.810601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:36.810905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:36.812521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:36.819531 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 378/770] 10.222.0.32 () {56 vars in 1145 bytes} [Sat Dec 25 20:45:36 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:36.825863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:36.836664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3966a7-f789-4b17-904c-4c7470496960 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:36.841345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:36.841998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:36.842276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:36.842543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:36.843333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] RBAC: Adding query filter params (interface=public, service_id=364d8c976ba34aa5a931931ee3adae04, region_id=RegionOne) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:36.843639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:36.844642 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:36.844642 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:36.844642 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:36.845529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17826-3371-40b9-bb40-2c380e245bd0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:36.853972 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 393/771] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:45:36 2021] GET /identity/v3/endpoints?service_id=364d8c976ba34aa5a931931ee3adae04&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:36.859698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:36.869841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd86c-ab5c-4181-b816-684bdf001ced admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:36.874581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d279a-44a6-417e-8d42-7b4f4832d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:36.875271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d279a-44a6-417e-8d42-7b4f4832d542 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:36.875553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d279a-44a6-417e-8d42-7b4f4832d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:36.875820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d279a-44a6-417e-8d42-7b4f4832d542 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:36.876498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d279a-44a6-417e-8d42-7b4f4832d542 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:36.878095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d279a-44a6-417e-8d42-7b4f4832d542 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:36.884226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 379/772] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:45:36 2021] GET /identity/v3/services => generated 772 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.155642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a768b3-7278-4dcd-9c37-511ad66b18e8 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.156323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a768b3-7278-4dcd-9c37-511ad66b18e8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.156323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a768b3-7278-4dcd-9c37-511ad66b18e8 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.158314 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 394/773] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:38.167000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc05743-a296-44ab-afb8-e6f4b9e98aeb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.167548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc05743-a296-44ab-afb8-e6f4b9e98aeb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.167835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc05743-a296-44ab-afb8-e6f4b9e98aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.196992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4cc05743-a296-44ab-afb8-e6f4b9e98aeb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:38.198186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4cc05743-a296-44ab-afb8-e6f4b9e98aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:38.214613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 380/774] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:38.240842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a768b3-7278-4dcd-9c37-511ad66b18e8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.258864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a768b3-7278-4dcd-9c37-511ad66b18e8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.266453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.267241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.267522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.267797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.283474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:38.291116 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:38.292390 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 395/775] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:38.299035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc05743-a296-44ab-afb8-e6f4b9e98aeb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.314528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc05743-a296-44ab-afb8-e6f4b9e98aeb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.322923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f31da-3b81-4e7e-9635-b4cb6f9890bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.323600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f31da-3b81-4e7e-9635-b4cb6f9890bd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.323879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f31da-3b81-4e7e-9635-b4cb6f9890bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.324154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f31da-3b81-4e7e-9635-b4cb6f9890bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.324952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f31da-3b81-4e7e-9635-b4cb6f9890bd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.325261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f31da-3b81-4e7e-9635-b4cb6f9890bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.326849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f31da-3b81-4e7e-9635-b4cb6f9890bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.340800 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 381/776] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.346923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.358019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b51975-b6d8-4b02-945b-a9a7a1374db6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.366941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.377982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.377982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.377982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.384786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.386691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.395020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e52b-56b3-4342-923b-174eb7bf42ae None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.395462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e52b-56b3-4342-923b-174eb7bf42ae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.395618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e52b-56b3-4342-923b-174eb7bf42ae None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.400808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 382/777] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:38 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:38.408920 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:38.409219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0e83d-80ea-413e-96dd-6374dcd2f9f8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.409411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0e83d-80ea-413e-96dd-6374dcd2f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.409696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0e83d-80ea-413e-96dd-6374dcd2f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.411025 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 396/778] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:38.417425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.431928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bf4e-d074-4722-a474-8115d6afd481 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.439315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2ca0e83d-80ea-413e-96dd-6374dcd2f9f8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:38.440522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2ca0e83d-80ea-413e-96dd-6374dcd2f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:38.443276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.443944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.444218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.444487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.445328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.445657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.447525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.449372 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 383/779] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:38.475443 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 397/780] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.475622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0e83d-80ea-413e-96dd-6374dcd2f9f8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.490716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0e83d-80ea-413e-96dd-6374dcd2f9f8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.497670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.509003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99059e-ba20-4ce8-b107-15fb37a68bdb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.511900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.513758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.514407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.515637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.519287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.520802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.522146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.522583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] PATH_INFO: `/v3/services/network` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.525037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.528223 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:38.528223 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:38.528223 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:38.529439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.532703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.534883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.548612 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 25 20:45:38.550058 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 398/781] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/services/network => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:38.556905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.557624 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:45:38.558621 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 384/782] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:38.564920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.572468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49646f05-f17d-49bc-8fa1-9fac0d27394a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.578500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.579432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.580401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.581617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb73272-c911-4a2f-932f-354ad14cadc5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.582695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.584266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] RBAC: Adding query filter params (name=network) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.585264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.588386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.591164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.592119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.592601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.593159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.594489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.595370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.598250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.602371 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 399/783] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.608167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.619129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81bbc2-cae8-4bac-805b-b3aba1d20f21 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.629346 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 385/784] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:38.635770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.642098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.642764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.643043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.643322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.644033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] RBAC: Adding query filter params (type=network) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.644342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.646484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.648114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0534c-5c2f-413e-af67-06a34c2fd440 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.653485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.654393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.654933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.655441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.666298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.667362 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 400/785] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/services?type=network => generated 350 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.668726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.673417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.679572 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 386/786] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:45:38.685670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.697575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab932b80-f56e-4b25-aa34-dae90b6a366a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.699930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd80d-8cb1-4b88-9b8a-f89132df0a50 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.708376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.709685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.710748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.711494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc1ab9-e228-4f6c-9b48-1511c26dcef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.712037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.713628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] RBAC: Adding query filter params (interface=public, service_id=6cdbea39b7fe4079b7d0d2ada0960c62, region_id=RegionOne) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.714168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc1ab9-e228-4f6c-9b48-1511c26dcef0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.714660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc1ab9-e228-4f6c-9b48-1511c26dcef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.715170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.715645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc1ab9-e228-4f6c-9b48-1511c26dcef0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.717598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.724706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 401/787] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/endpoints?service_id=6cdbea39b7fe4079b7d0d2ada0960c62&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:38.732840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.744402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc1ab9-e228-4f6c-9b48-1511c26dcef0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.746568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc1ab9-e228-4f6c-9b48-1511c26dcef0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.750029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c79cb7-86d6-47f7-a867-5be825793c78 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.761144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.762194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.763348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.764261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.766695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.768560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.783019 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 402/788] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/services => generated 772 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.783645 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-75cc1ab9-e228-4f6c-9b48-1511c26dcef0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:38.785509 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 387/789] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:38.791897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.802958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81251a-4857-48ea-a18c-9b1e728a7171 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.808197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.809458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.809748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.810027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.810771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.811077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.811448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45770-857d-485f-b35f-e9613143028c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.811976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45770-857d-485f-b35f-e9613143028c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.812445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45770-857d-485f-b35f-e9613143028c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.812660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.815101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 388/790] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:38.829242 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 403/791] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.831081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f4fe1-f898-4946-a2c8-23b943fff9e9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.831593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f4fe1-f898-4946-a2c8-23b943fff9e9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.832711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f4fe1-f898-4946-a2c8-23b943fff9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.846390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.866806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafd57f-aa9c-4718-93af-1ef4b255a208 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.867138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f31f4fe1-f898-4946-a2c8-23b943fff9e9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:38.868648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f31f4fe1-f898-4946-a2c8-23b943fff9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:38.873142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.874391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.874877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.875365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.877463 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 389/792] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:38.879712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14bb3-4769-4168-9648-6554db7f214d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.880043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14bb3-4769-4168-9648-6554db7f214d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.880318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14bb3-4769-4168-9648-6554db7f214d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.882768 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 390/793] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:38.886197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.888408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.888530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc55cc-4e5b-455c-b8c8-c78eb826f867 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.888860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc55cc-4e5b-455c-b8c8-c78eb826f867 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.889167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc55cc-4e5b-455c-b8c8-c78eb826f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.904458 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:38.906388 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 404/794] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:38.911841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-41cc55cc-4e5b-455c-b8c8-c78eb826f867 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:38.911841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-41cc55cc-4e5b-455c-b8c8-c78eb826f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:38.913345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.919299 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 391/795] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:38.920156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc55cc-4e5b-455c-b8c8-c78eb826f867 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.926507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9836ad-368c-4b42-9b9d-451e4026c3fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.931572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.932550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.933106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.933596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.934590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.935120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.937429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.938632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc55cc-4e5b-455c-b8c8-c78eb826f867 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.951740 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 405/796] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:38.959688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.960803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.961779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.962063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.962334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.972384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669023bd-b484-4622-b5c3-7d30148e2528 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:38.975762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:38.977557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:38.978607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:38.979260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:38.979891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:38.981374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79e05d879a534c6c890d4aea42c89975) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:38.981856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:38.983986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:38.984312 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:38.985978 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 392/797] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:38.986819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.992004 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 406/798] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/role_assignments?user.id=79e05d879a534c6c890d4aea42c89975&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:38.997194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:38.999652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7c2a-4819-4a19-9a75-8f337b0d959e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.003636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.005173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.005559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.005958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.019291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3f178-7741-477d-8b6f-bd57921526ad admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.020395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:39.028086 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:39.028989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.029836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.030295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.030794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.031772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.032289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.034169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.040903 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 393/799] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:39.040903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.054573 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 407/800] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.061366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.062263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee52c9-c8ea-45f1-a4f9-9f238da2c46f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.073531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7faa2-094b-4e96-b862-817c67cf8f19 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.073718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.074439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.074766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.075098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.075951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.076309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.078243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.083070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.083941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.084208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.084480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.096145 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 394/801] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.103749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.105663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.106458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.117300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b0b54-b420-4601-ba61-d99b5673c467 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.131623 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:39.134748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.135789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.136291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.136779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.146620 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 408/802] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:39.147892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.157407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.159749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.164211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14495f-f006-4644-9f6b-658ed205545c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.182914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.183581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.183853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.184120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.184860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.185191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.186574 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:39.187061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.188565 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 395/803] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:39.195898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.215007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52884f-8de6-4274-9d63-afc5f1bb8526 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.217746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 409/804] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.226776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.227462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.227738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.228007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.228749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.229093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.229965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.230688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.246340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c7c1-a1d4-4948-9eaa-1e1a0434bf43 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.253610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.255874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.256411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.256918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.259514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 396/805] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.266897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.272528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.275199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.283332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef3ae-60e5-4f4f-8ce8-94f3e6df12f7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.289307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.290344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.290631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.290906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.295366 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 25 20:45:39.297112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 410/806] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:39.299301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.301884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.303289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.315146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430f9d4-f45a-476b-b4cb-338401dd82da admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.319631 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 25 20:45:39.321853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.322242 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 397/807] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:39.322982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.323267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.323546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.324382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.324700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.327262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.328027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.342993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b2f38-3658-453f-b954-78eb1a8c01ed admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.348762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.349734 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 411/808] 10.222.0.32 () {56 vars in 1156 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.349955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.350245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.350622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.352323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.352323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.353747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.355236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.373235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e4205-d2c6-41ee-8e31-3275ea49c7b9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.375160 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 398/809] 10.222.0.32 () {56 vars in 1170 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.383191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.391485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d646-b3e9-4f1b-936e-d000eeeb7331 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.392287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.393309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.393728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.394173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.396498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.397788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.398134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.398410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.405746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.407847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.410509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.412950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.427614 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:39.429428 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 412/810] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:39.432909 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:39.434970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.438807 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 399/811] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:39.439935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.446133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5361e92-20ba-48eb-b963-93086a1d9cb6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.451774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ab984-c9cb-4a2c-bfa7-a1c1d791d1a7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.452150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.453073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.453647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.454137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.455074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.455558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.456785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.457536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.457774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.458153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.458662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.459551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.460078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.462288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.471074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 413/812] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.476582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.480660 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 400/813] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:39.482100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.487117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcd6c6-2236-4b04-84c1-0c6f4e2ccd0d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.495760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.495963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbcd93-78b2-402d-9a0b-f9228a622318 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.497138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.497605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.498077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.501899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.503034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.503436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.503826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.515634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.517697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.521057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.524848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.545086 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:39.553294 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:39.554399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 414/814] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:39.561149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.561567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 401/815] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:39.567007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.577175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0ade-f75a-499a-955d-8ac8ce4d414a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.583734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2808-5ff4-4ac0-a837-a3047c14dd62 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.587465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.588319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.588600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.588890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.590105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.591547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.594350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.596355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.597136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.597422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.598275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.599077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:39.600761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.606152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.622622 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 415/816] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.628256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.629475 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 402/817] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:39.635723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:39.643605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b248f1a-2a12-48e7-9c1d-d7b0c5c5389e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.653288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdc4f9-4f25-48f2-b3cb-1f220860a714 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:39.655546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991ee3-3410-431a-ba1c-1c3c8eac8f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.656030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991ee3-3410-431a-ba1c-1c3c8eac8f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.656407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991ee3-3410-431a-ba1c-1c3c8eac8f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.656680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991ee3-3410-431a-ba1c-1c3c8eac8f8a admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/eea4089e93f04fc5893b3e86954ead79/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.661351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7991ee3-3410-431a-ba1c-1c3c8eac8f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=eea4089e93f04fc5893b3e86954ead79, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.665443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd4617-e8a3-41ce-865f-558d37c5e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:39.666644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7991ee3-3410-431a-ba1c-1c3c8eac8f8a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.667792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd4617-e8a3-41ce-865f-558d37c5e519 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.668120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd4617-e8a3-41ce-865f-558d37c5e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.668448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd4617-e8a3-41ce-865f-558d37c5e519 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/23c0a773f0c542baaa1bd937a8412456/roles/6c7be361d0af46dfaf17213b5a844088` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.688756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd4617-e8a3-41ce-865f-558d37c5e519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=23c0a773f0c542baaa1bd937a8412456, role_id=6c7be361d0af46dfaf17213b5a844088)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:39.691544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd4617-e8a3-41ce-865f-558d37c5e519 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:39.740201 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 416/818] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:39 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/eea4089e93f04fc5893b3e86954ead79/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:39.774412 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 403/819] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:39 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/23c0a773f0c542baaa1bd937a8412456/roles/6c7be361d0af46dfaf17213b5a844088 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:45:39.985471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15c83b-89e4-4174-90e1-0b2ea96b2781 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.985891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15c83b-89e4-4174-90e1-0b2ea96b2781 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.986145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15c83b-89e4-4174-90e1-0b2ea96b2781 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:39.988224 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 417/820] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:39.994800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166cdf-6df5-4e25-b07f-3fbe3645330e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:39.995166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166cdf-6df5-4e25-b07f-3fbe3645330e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:39.995374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166cdf-6df5-4e25-b07f-3fbe3645330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:40.016149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-51166cdf-6df5-4e25-b07f-3fbe3645330e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:40.017418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51166cdf-6df5-4e25-b07f-3fbe3645330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:40.081009 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 404/821] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:40.107349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15c83b-89e4-4174-90e1-0b2ea96b2781 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:40.120816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15c83b-89e4-4174-90e1-0b2ea96b2781 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:40.125729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:40.126648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:40.126927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:40.127252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:40.127921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:40.129664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:40.142275 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 25 20:45:40.144978 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 418/822] 10.222.0.32 () {56 vars in 1150 bytes} [Sat Dec 25 20:45:40 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:40.151005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51166cdf-6df5-4e25-b07f-3fbe3645330e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:40.161254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51166cdf-6df5-4e25-b07f-3fbe3645330e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:40.166667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:40.167354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:40.167685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:40.168008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:40.168742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:40.169138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:40.170863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:40.181040 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 405/823] 10.222.0.32 () {56 vars in 1145 bytes} [Sat Dec 25 20:45:40 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:40.183070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:40.196082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2ebb3-9597-4045-a199-dcb2cf73dc55 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:40.203457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f406cf-61d8-429c-bc8e-3adc8d7b5d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:40.203457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f406cf-61d8-429c-bc8e-3adc8d7b5d7e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:40.203457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f406cf-61d8-429c-bc8e-3adc8d7b5d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:40.203457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f406cf-61d8-429c-bc8e-3adc8d7b5d7e admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:40.203807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f406cf-61d8-429c-bc8e-3adc8d7b5d7e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:40.203807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f406cf-61d8-429c-bc8e-3adc8d7b5d7e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:40.205401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f406cf-61d8-429c-bc8e-3adc8d7b5d7e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:40.211691 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 419/824] 10.222.0.32 () {56 vars in 1145 bytes} [Sat Dec 25 20:45:40 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:40.218245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:40.229822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041f3f1-1463-4f09-a1e8-65cffc572a3b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:40.234925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc65cd-fedc-4121-b48c-32db8a46fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:40.235847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc65cd-fedc-4121-b48c-32db8a46fa11 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:40.236331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc65cd-fedc-4121-b48c-32db8a46fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:40.236849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc65cd-fedc-4121-b48c-32db8a46fa11 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:40.237899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc65cd-fedc-4121-b48c-32db8a46fa11 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:40.239163 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-f8dc65cd-fedc-4121-b48c-32db8a46fa11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:40.239163 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:40.239163 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:40.240396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc65cd-fedc-4121-b48c-32db8a46fa11 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:40.367682 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 406/825] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:45:40 2021] POST /identity/v3/endpoints => generated 346 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:41.748754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef85627-31c8-4c6f-a7ee-f46ca7520186 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:41.749295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef85627-31c8-4c6f-a7ee-f46ca7520186 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:41.749396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef85627-31c8-4c6f-a7ee-f46ca7520186 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:41.751365 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 420/826] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:41.757818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc7abb-f210-481d-9af7-6b4555c6a454 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:41.758651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc7abb-f210-481d-9af7-6b4555c6a454 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:41.759122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc7abb-f210-481d-9af7-6b4555c6a454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:41.781360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b4cc7abb-f210-481d-9af7-6b4555c6a454 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:41.782898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b4cc7abb-f210-481d-9af7-6b4555c6a454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:41.804554 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 407/827] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:41 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:41.838157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef85627-31c8-4c6f-a7ee-f46ca7520186 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:41.854635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef85627-31c8-4c6f-a7ee-f46ca7520186 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:41.864956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:41.865754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:41.866037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:41.866315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] PATH_INFO: `/v3/services/network` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:41.866974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:41.868824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:41.882795 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 25 20:45:41.884235 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 421/828] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:41 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:41.890446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc7abb-f210-481d-9af7-6b4555c6a454 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:41.905877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc7abb-f210-481d-9af7-6b4555c6a454 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:41.916954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97bd01-fc9a-40e3-81f3-7f5ac5d34345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:41.917903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97bd01-fc9a-40e3-81f3-7f5ac5d34345 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:41.918381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97bd01-fc9a-40e3-81f3-7f5ac5d34345 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:41.918863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97bd01-fc9a-40e3-81f3-7f5ac5d34345 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:41.919780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97bd01-fc9a-40e3-81f3-7f5ac5d34345 admin admin] RBAC: Adding query filter params (name=network) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:41.920278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97bd01-fc9a-40e3-81f3-7f5ac5d34345 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:41.922074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97bd01-fc9a-40e3-81f3-7f5ac5d34345 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:41.932774 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 408/829] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:41 2021] GET /identity/v3/services?name=network => generated 124 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:41.938751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:41.951204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c953-b652-4d5a-b7ee-92c827da00a4 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:41.951790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c953-b652-4d5a-b7ee-92c827da00a4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:41.952263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c953-b652-4d5a-b7ee-92c827da00a4 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:41.954869 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 409/830] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:41.957764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57124c-2d2e-4c28-b8a7-dc6fc222c2f6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:41.961358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefbc9d-797d-4f58-b05e-3f6ea9dfe7ae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:41.961358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefbc9d-797d-4f58-b05e-3f6ea9dfe7ae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:41.961541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefbc9d-797d-4f58-b05e-3f6ea9dfe7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:41.971081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:41.971757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:41.972126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:41.972634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:41.976140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] RBAC: Adding query filter params (type=network) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:41.976569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:41.978256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:41.990899 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 422/831] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:41 2021] GET /identity/v3/services?type=network => generated 350 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:41.994917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eaefbc9d-797d-4f58-b05e-3f6ea9dfe7ae None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:41.996148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eaefbc9d-797d-4f58-b05e-3f6ea9dfe7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:41.997244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:42.010549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab69e3b-aa66-416e-9218-e592104bf37d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:42.015681 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 410/832] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:41 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:42.025585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9fb5-b05b-45ce-947c-f8c6a0fca0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:42.026243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9fb5-b05b-45ce-947c-f8c6a0fca0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:42.026529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9fb5-b05b-45ce-947c-f8c6a0fca0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:42.026809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9fb5-b05b-45ce-947c-f8c6a0fca0a2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:42.027570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9fb5-b05b-45ce-947c-f8c6a0fca0a2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:42.028578 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-32fd9fb5-b05b-45ce-947c-f8c6a0fca0a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:42.028578 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:42.028578 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:42.029547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9fb5-b05b-45ce-947c-f8c6a0fca0a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:42.043022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefbc9d-797d-4f58-b05e-3f6ea9dfe7ae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:42.052174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefbc9d-797d-4f58-b05e-3f6ea9dfe7ae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:42.056843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:42.057675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:42.057956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:42.058232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:42.058958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:42.060595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:42.072732 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 25 20:45:42.074868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 411/833] 10.222.0.32 () {56 vars in 1153 bytes} [Sat Dec 25 20:45:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:42.080605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:42.090815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e53eba-5d2b-4af3-8022-d1264d7eb64a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:42.095405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:42.096059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:42.096340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:42.096609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:42.097546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:42.097854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:42.099559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:42.104790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 412/834] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:42.110854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:42.120959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026d5e5-6b68-4f0b-ba11-67edf7c50966 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:42.125690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf7cf5-8f08-4d26-bd3a-ee3be918a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:42.126382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7cf5-8f08-4d26-bd3a-ee3be918a26d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:42.126664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7cf5-8f08-4d26-bd3a-ee3be918a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:42.126941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf7cf5-8f08-4d26-bd3a-ee3be918a26d admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:42.127703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7cf5-8f08-4d26-bd3a-ee3be918a26d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:42.128007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7cf5-8f08-4d26-bd3a-ee3be918a26d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:42.130226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf7cf5-8f08-4d26-bd3a-ee3be918a26d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:42.135056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 413/835] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:42 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:42.167069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 423/836] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:45:41 2021] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:45:42.872414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688721-b205-426e-853f-2f71f4e2b3d8 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:42.872962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688721-b205-426e-853f-2f71f4e2b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:42.873042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688721-b205-426e-853f-2f71f4e2b3d8 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:42.875052 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 414/837] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:42.880837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa906-3f06-4e7a-bb11-3f1ac1f6ad42 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:42.881305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa906-3f06-4e7a-bb11-3f1ac1f6ad42 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:42.881406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51aa906-3f06-4e7a-bb11-3f1ac1f6ad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:42.900109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c51aa906-3f06-4e7a-bb11-3f1ac1f6ad42 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:42.901339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c51aa906-3f06-4e7a-bb11-3f1ac1f6ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:42.919070 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 424/838] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:42 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:42.943997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2688721-b205-426e-853f-2f71f4e2b3d8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:42.957350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2688721-b205-426e-853f-2f71f4e2b3d8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:42.962110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:42.963280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:42.963765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:42.964238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:42.976078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:42.983327 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:45:42.985007 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 415/839] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:45:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:42.994468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aa906-3f06-4e7a-bb11-3f1ac1f6ad42 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.004266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51aa906-3f06-4e7a-bb11-3f1ac1f6ad42 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.009491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58546da8-284f-4c45-9082-4d8355c4f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.010579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546da8-284f-4c45-9082-4d8355c4f322 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.011067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546da8-284f-4c45-9082-4d8355c4f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.011570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546da8-284f-4c45-9082-4d8355c4f322 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.012557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58546da8-284f-4c45-9082-4d8355c4f322 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.013129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58546da8-284f-4c45-9082-4d8355c4f322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.015042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58546da8-284f-4c45-9082-4d8355c4f322 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.025784 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 425/840] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:45:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:43.032403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.043328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2cbe2-0a78-4781-98b1-aaed19a5fc60 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.048534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.049627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.050113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.050651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.054408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462fcf-0cbe-4afa-bc03-606250f28a1c None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.054700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462fcf-0cbe-4afa-bc03-606250f28a1c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.054981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462fcf-0cbe-4afa-bc03-606250f28a1c None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.057008 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 426/841] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:43.064301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.065989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be705-8920-4dcf-ba62-506b84be1105 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.066320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be705-8920-4dcf-ba62-506b84be1105 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.066598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be705-8920-4dcf-ba62-506b84be1105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.072566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.087838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6c7be705-8920-4dcf-ba62-506b84be1105 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:43.089354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6c7be705-8920-4dcf-ba62-506b84be1105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:43.090601 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:43.092095 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 416/842] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:43.098550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.108893 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 427/843] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:43 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:43.113004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a1a8-c8a4-410e-8e38-00cbe41ee018 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.117714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.118681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.118966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.119245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.120034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.120385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.122077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.128981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be705-8920-4dcf-ba62-506b84be1105 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.139183 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 417/844] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:43.139337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be705-8920-4dcf-ba62-506b84be1105 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.146394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.149504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.150601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.151083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.151595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.156050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f4068-cf8f-4205-9dbf-f224859ca96e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.161204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.161994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.162280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.162559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.165413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:43.170418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.172402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.173416 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:45:43.180250 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 428/845] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:43.181724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.187118 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 25 20:45:43.192905 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 418/846] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:43.193039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c47b5-d853-4420-8289-e6ca36480608 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.195136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.197332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.198108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.198480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.198875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.200014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.200662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.202719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.207639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4936d01-3929-4c5f-9942-bba5bddadd93 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.212502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.213402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.214052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.214187 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 429/847] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:43.214597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.216315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.216647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.221239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.223867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.235516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b72e-3292-4530-9bd6-ac4a884abec7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.240955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 419/848] 10.222.0.32 () {56 vars in 1170 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:43.245308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.246263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.247388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.247875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.248406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.259929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875572-80ef-4f52-bc67-53b43d6c0fa0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.263152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.265333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.265863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.266229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.266605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.266981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.277933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.279933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.286744 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:43.292909 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 420/850] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:45:43.293043 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 430/850] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:43.294668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.295595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.305430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e4d9-f39b-4bfa-81fa-0d9c6c4df641 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.307116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e9a71-29ce-42b4-b033-ad0bb7c7cf08 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.310411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.311180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.311533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.311928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.312831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.313237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.313509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.314467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.314920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.315173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.315559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.328580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.334381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 421/851] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:43.334544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.336668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.348250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248deb-17ac-4285-bea9-3834bd322bdd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.353030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.353865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.354145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.354471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.357985 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:43.359685 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 431/852] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:43.368909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.369066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.369066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.378432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa1827-1e5e-4f8c-90d7-905a2606012a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.384324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.384775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.385259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.385497 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 25 20:45:43.385840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.386694 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 422/853] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:43.387002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.387445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.389359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.392776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.404768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96e75-f1ce-42a1-9d17-6c6dc50a333e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.408066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 432/854] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:43.410494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0f4f7-0079-44a7-9511-04859fc93d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.411369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0f4f7-0079-44a7-9511-04859fc93d52 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.413060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0f4f7-0079-44a7-9511-04859fc93d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.413060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0f4f7-0079-44a7-9511-04859fc93d52 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.413534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0f4f7-0079-44a7-9511-04859fc93d52 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.413816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.413913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0f4f7-0079-44a7-9511-04859fc93d52 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.415959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0f4f7-0079-44a7-9511-04859fc93d52 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.423359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9519a77-8580-4575-943a-cee3fec5f4fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.428847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631d0d-831c-420a-9196-858a22194927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.429674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631d0d-831c-420a-9196-858a22194927 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.429951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631d0d-831c-420a-9196-858a22194927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.430224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631d0d-831c-420a-9196-858a22194927 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.435648 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 423/855] 10.222.0.32 () {56 vars in 1156 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:43.437001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23330-493a-44b6-93d9-48a1a333031f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.437287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23330-493a-44b6-93d9-48a1a333031f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.437559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23330-493a-44b6-93d9-48a1a333031f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.439356 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 424/856] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:43.441807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631d0d-831c-420a-9196-858a22194927 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.442567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23330-493a-44b6-93d9-48a1a333031f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.444583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631d0d-831c-420a-9196-858a22194927 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.454783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23330-493a-44b6-93d9-48a1a333031f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.459713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.460335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.460615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.460903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.461240 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-a4631d0d-831c-420a-9196-858a22194927 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:43.462929 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 433/857] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:43.464292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df0e4-fbd0-401a-bee3-985429ab4e2b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.464744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df0e4-fbd0-401a-bee3-985429ab4e2b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.465210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2df0e4-fbd0-401a-bee3-985429ab4e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.469457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.471201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.480397 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 425/858] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:45:43.487739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.487868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2e2df0e4-fbd0-401a-bee3-985429ab4e2b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:43.488099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2e2df0e4-fbd0-401a-bee3-985429ab4e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:43.490423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126e89-85ff-4568-9da8-1ee51aa1d4f6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.495150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.495782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.499814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.499928 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 434/859] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:43 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:43.500044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.500132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df0e4-fbd0-401a-bee3-985429ab4e2b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.500203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.500203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.500203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.510952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2df0e4-fbd0-401a-bee3-985429ab4e2b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.512227 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 426/860] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:43.518063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.521469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.522263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.522540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.522810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.529416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21340a-2420-4340-ae30-6729011f1db6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.533743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.534477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.535270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.535586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.535687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.536076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.537030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=23c0a773f0c542baaa1bd937a8412456) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.537450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.539295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.545448 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 427/861] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/role_assignments?user.id=23c0a773f0c542baaa1bd937a8412456&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:43.546196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.556100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009583-986f-4cd9-9022-db150a443cf7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.567066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.567066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.567066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.567066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.567388 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:43.567473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.567473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.569086 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 435/862] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:43.571433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.584189 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 25 20:45:43.585789 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 428/863] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:43.585970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c06d-184e-4e97-ae53-9f094284cc3d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.593801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.597439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.598299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.601428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.601428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.601428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.601428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.602842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.605839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de68f-8aaf-4077-9c5b-c3f30bcbc12b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.611106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.612201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.612743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.613344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.614361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.614882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.616998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.621066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 436/864] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:43.624546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.631362 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 429/865] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:43.639268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.640627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47d68f-dcc9-4e6e-abc4-52d8a97b6b17 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.647290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.648288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.648713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.649135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.653189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42991bc-7479-47e5-8a76-2984f326c628 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.657373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.658403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.659304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.659727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.660142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.660251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.661335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.661789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.664160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.676507 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:43.677173 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 430/866] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:43.678432 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 437/867] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:43.685181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.697010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd35a-1984-4fe4-a350-68ce6d9d2fbd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.702382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b936-246c-47ee-a32c-f3441a798829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.703312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b936-246c-47ee-a32c-f3441a798829 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.703772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b936-246c-47ee-a32c-f3441a798829 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.704193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b936-246c-47ee-a32c-f3441a798829 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.705237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b936-246c-47ee-a32c-f3441a798829 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.705707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b936-246c-47ee-a32c-f3441a798829 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.707798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b936-246c-47ee-a32c-f3441a798829 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.722048 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 431/868] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:43.730557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:43.744579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5418ee2-3870-4d74-a1f6-ac78acd08f1d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:43.750027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f3286-3420-48a5-ad3a-9372c0b28506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:43.751023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3286-3420-48a5-ad3a-9372c0b28506 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:43.751485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3286-3420-48a5-ad3a-9372c0b28506 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:43.751957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3286-3420-48a5-ad3a-9372c0b28506 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:43.753059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f3286-3420-48a5-ad3a-9372c0b28506 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=eea4089e93f04fc5893b3e86954ead79) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:43.753539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f3286-3420-48a5-ad3a-9372c0b28506 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:43.756329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f3286-3420-48a5-ad3a-9372c0b28506 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:43.764113 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 438/869] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:43 2021] GET /identity/v3/role_assignments?user.id=eea4089e93f04fc5893b3e86954ead79&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:44.830916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabba7-7c32-43f5-b068-da8cf2a9f970 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:44.831450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabba7-7c32-43f5-b068-da8cf2a9f970 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:44.831450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eabba7-7c32-43f5-b068-da8cf2a9f970 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:44.834293 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 432/870] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:44.840688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce05a4-c81b-4025-a030-c9e800aba8a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:44.841189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce05a4-c81b-4025-a030-c9e800aba8a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:44.841262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce05a4-c81b-4025-a030-c9e800aba8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:44.859380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-abce05a4-c81b-4025-a030-c9e800aba8a3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:44.860851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-abce05a4-c81b-4025-a030-c9e800aba8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:44.869406 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 439/871] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:44 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:44.894261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eabba7-7c32-43f5-b068-da8cf2a9f970 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:44.907275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eabba7-7c32-43f5-b068-da8cf2a9f970 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:44.911724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28da7-426f-4a1d-a5f5-7882d65fc8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:44.912380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28da7-426f-4a1d-a5f5-7882d65fc8fb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:44.912663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28da7-426f-4a1d-a5f5-7882d65fc8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:44.913003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28da7-426f-4a1d-a5f5-7882d65fc8fb admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:44.913740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28da7-426f-4a1d-a5f5-7882d65fc8fb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:44.915315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28da7-426f-4a1d-a5f5-7882d65fc8fb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:45.008576 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 433/872] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:45:44 2021] POST /identity/v3/services => generated 269 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:46.069412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b92e-1fc8-4926-9527-6b7d7f1f31ca None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.069930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b92e-1fc8-4926-9527-6b7d7f1f31ca None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.069930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b92e-1fc8-4926-9527-6b7d7f1f31ca None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.071913 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 440/873] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:46.077681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0255fef-c9a7-4408-9e02-83eb09af2f9a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.078093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0255fef-c9a7-4408-9e02-83eb09af2f9a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.078229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0255fef-c9a7-4408-9e02-83eb09af2f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.095571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d0255fef-c9a7-4408-9e02-83eb09af2f9a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:46.096734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d0255fef-c9a7-4408-9e02-83eb09af2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:46.112478 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 434/874] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:46 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:46.138378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b92e-1fc8-4926-9527-6b7d7f1f31ca None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.150839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b92e-1fc8-4926-9527-6b7d7f1f31ca None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.155189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.155974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.156247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.156511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.167009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:46.174342 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 25 20:45:46.174859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466c86-8165-45b1-971d-daffe27718e8 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.175147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466c86-8165-45b1-971d-daffe27718e8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.175947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c466c86-8165-45b1-971d-daffe27718e8 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.176051 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 441/875] 10.222.0.32 () {56 vars in 1141 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:46.179303 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 435/876] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:46.181976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.184110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b835-2e2d-47a4-9033-8810c528ac4e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.184388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b835-2e2d-47a4-9033-8810c528ac4e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.184659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7b835-2e2d-47a4-9033-8810c528ac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.192611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5302cac-908c-4a3c-a5ba-324d03e921df admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.197267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.197928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.198257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.198536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.199341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.199648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.201287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.205803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-04b7b835-2e2d-47a4-9033-8810c528ac4e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:46.207265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-04b7b835-2e2d-47a4-9033-8810c528ac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:46.210739 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 442/877] 10.222.0.32 () {56 vars in 1136 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:46.216693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.222645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 436/878] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:46 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:46.233986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f4536-d6de-470a-8eb3-2f7b838ea784 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.239516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.240552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.241184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.241675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.247641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7b835-2e2d-47a4-9033-8810c528ac4e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.255887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.257437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7b835-2e2d-47a4-9033-8810c528ac4e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.258258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.262264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6253e0-79ee-411f-93ad-1f45a687fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.262955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6253e0-79ee-411f-93ad-1f45a687fdab admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.263239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6253e0-79ee-411f-93ad-1f45a687fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.263519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6253e0-79ee-411f-93ad-1f45a687fdab admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.264291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6253e0-79ee-411f-93ad-1f45a687fdab admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.265975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6253e0-79ee-411f-93ad-1f45a687fdab admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.279450 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:46.281038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 443/879] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:46.287827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.298121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4c11d-481d-45aa-ba80-ff4295383a18 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.303689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec982f-5ab0-47a6-bd90-3cf376ce10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.304324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec982f-5ab0-47a6-bd90-3cf376ce10f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.304603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec982f-5ab0-47a6-bd90-3cf376ce10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.304913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec982f-5ab0-47a6-bd90-3cf376ce10f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.305668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec982f-5ab0-47a6-bd90-3cf376ce10f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.305956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec982f-5ab0-47a6-bd90-3cf376ce10f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.307554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec982f-5ab0-47a6-bd90-3cf376ce10f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.318869 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 444/880] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:46.320255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abc21-671e-46fc-bde9-7b8772ccf2a1 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.320556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abc21-671e-46fc-bde9-7b8772ccf2a1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.320918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abc21-671e-46fc-bde9-7b8772ccf2a1 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.322716 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 445/881] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:46.324625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920abc21-671e-46fc-bde9-7b8772ccf2a1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.336329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920abc21-671e-46fc-bde9-7b8772ccf2a1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.340829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.341619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.341900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.342175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.345405 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 437/882] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:45:46 2021] POST /identity/v3/services => generated 251 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:45:46.345554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0088884-e918-445a-be87-4a2b0622a10b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.345729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0088884-e918-445a-be87-4a2b0622a10b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.346005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0088884-e918-445a-be87-4a2b0622a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.351798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.353906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.369804 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 25 20:45:46.374674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b0088884-e918-445a-be87-4a2b0622a10b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:46.376481 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 446/883] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:46.376782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b0088884-e918-445a-be87-4a2b0622a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:46.377478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.387794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec67dc-7794-41bd-a6b4-a84b7877d18e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.401956 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 438/884] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:46 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:46.402421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.403163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.403450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.403722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.404553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.404859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.406722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.427850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0088884-e918-445a-be87-4a2b0622a10b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.433843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 447/885] 10.222.0.32 () {56 vars in 1170 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:46.437617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0088884-e918-445a-be87-4a2b0622a10b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.439994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.442944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.446497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.446801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.447085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.449049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.450687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.450884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f6b9b-ceef-49db-b63e-dd3fbba6c1f4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.456191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.456905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.457247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.457576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.463845 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 25 20:45:46.465121 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 439/886] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:46.467311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.469104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.472104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.480361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 448/887] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:45:46.482717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84fc11-bed1-4f19-832c-866b18985f33 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.486740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.487638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.488922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.489210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.489486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.490397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.491768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.496554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.497789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b2975-e6f8-47f0-af49-f131adaf8a93 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.503139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.503984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.504346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.504629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.508436 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 440/888] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:46.509842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.517180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.519082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.519857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116300a2-57d1-41bc-8027-23608678b9bb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.525118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.525788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.526071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.526350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.527652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.527965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.530313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.537086 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 441/889] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:46.538289 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:46.546741 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 449/890] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:46.546942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.559416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196cc0c-759e-4ac1-a3e5-bc25bfe21aa1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.564590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.565370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.565649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.565922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.566776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.567137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.568971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.583179 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 442/891] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:46.589667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.601318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7af5f3-e71c-4048-8a5a-dcaad9c5a04d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.605838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.606660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.606937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.607210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.615792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.617818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.632175 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:46.633774 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 450/892] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:46.640389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.651557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643a3bd-5477-455d-ba5f-9d9f6a8c1ecd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.656312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51606da8-b95c-4152-a351-1371665abde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.657019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606da8-b95c-4152-a351-1371665abde7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.657342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606da8-b95c-4152-a351-1371665abde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.657622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51606da8-b95c-4152-a351-1371665abde7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.658425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606da8-b95c-4152-a351-1371665abde7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.658731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606da8-b95c-4152-a351-1371665abde7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.661234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51606da8-b95c-4152-a351-1371665abde7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.674698 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 443/893] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:46.682066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:46.693179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9892f-2248-47f1-9882-f8aed29445ef admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:46.698354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613161a-f52d-4b31-a154-fa6583813ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:46.699327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613161a-f52d-4b31-a154-fa6583813ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:46.699805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613161a-f52d-4b31-a154-fa6583813ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:46.700302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613161a-f52d-4b31-a154-fa6583813ae1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:46.701409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613161a-f52d-4b31-a154-fa6583813ae1 admin admin] RBAC: Adding query filter params (role.id=d95a5a3b71ae4e669b519c06c80439d1, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=23c0a773f0c542baaa1bd937a8412456) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:46.701928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613161a-f52d-4b31-a154-fa6583813ae1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:46.703995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613161a-f52d-4b31-a154-fa6583813ae1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:46.711321 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 451/894] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:46 2021] GET /identity/v3/role_assignments?user.id=23c0a773f0c542baaa1bd937a8412456&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=d95a5a3b71ae4e669b519c06c80439d1 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:47.545375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8423-0f7b-494f-aba2-143bb99c1359 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:47.545935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8423-0f7b-494f-aba2-143bb99c1359 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:47.545935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8423-0f7b-494f-aba2-143bb99c1359 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:47.548012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 444/895] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:47.554467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd1eaa-5d70-483a-9c80-8b07ad4a37c8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:47.554911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd1eaa-5d70-483a-9c80-8b07ad4a37c8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:47.554988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd1eaa-5d70-483a-9c80-8b07ad4a37c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:47.573187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-81fd1eaa-5d70-483a-9c80-8b07ad4a37c8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:47.574348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-81fd1eaa-5d70-483a-9c80-8b07ad4a37c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:47.582492 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 452/896] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:47 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:47.607302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8423-0f7b-494f-aba2-143bb99c1359 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:47.620514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8423-0f7b-494f-aba2-143bb99c1359 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:47.625040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:47.625841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:47.631355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:47.631355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:47.631355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:47.631355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:47.640815 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 25 20:45:47.642290 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 445/897] 10.222.0.32 () {56 vars in 1153 bytes} [Sat Dec 25 20:45:47 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:47.648520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd1eaa-5d70-483a-9c80-8b07ad4a37c8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:47.657791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd1eaa-5d70-483a-9c80-8b07ad4a37c8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:47.662396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:47.663114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:47.663385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:47.663650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:47.664352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:47.664655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:47.666280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:47.671571 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 453/898] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:47 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:47.678115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:47.687896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981000da-74df-4e91-9a86-3431e7491082 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:47.693067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:47.693725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:47.694010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:47.694292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:47.694972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:47.695272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:47.696850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:47.702359 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 446/899] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:47 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:47.708433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:47.718056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451f98a-4fa7-40ba-bd37-91f9530610c6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:47.722637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84fd1-96f0-48d5-8202-3e01cde6c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:47.723270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84fd1-96f0-48d5-8202-3e01cde6c5dd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:47.723546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84fd1-96f0-48d5-8202-3e01cde6c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:47.723817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84fd1-96f0-48d5-8202-3e01cde6c5dd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:47.724597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84fd1-96f0-48d5-8202-3e01cde6c5dd admin admin] RBAC: Adding query filter params (interface=public, service_id=2fbfe1f541d64b77998af33cd334cca7, region_id=RegionOne) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:47.724922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84fd1-96f0-48d5-8202-3e01cde6c5dd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:47.726597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84fd1-96f0-48d5-8202-3e01cde6c5dd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:47.732266 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 454/900] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:45:47 2021] GET /identity/v3/endpoints?service_id=2fbfe1f541d64b77998af33cd334cca7&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:47.738914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:47.749442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0026f-220c-4315-99a0-2cc44339f796 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:47.754711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e007d-6a2b-4e93-b019-543d9069a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:47.755375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e007d-6a2b-4e93-b019-543d9069a71a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:47.755647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e007d-6a2b-4e93-b019-543d9069a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:47.755916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e007d-6a2b-4e93-b019-543d9069a71a admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:47.756598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e007d-6a2b-4e93-b019-543d9069a71a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:47.758214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e007d-6a2b-4e93-b019-543d9069a71a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:47.765126 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 447/901] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:45:47 2021] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:45:48.985035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35929d-1e05-4669-a91a-3caccdfd6e8e None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:48.985705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35929d-1e05-4669-a91a-3caccdfd6e8e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:48.985705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35929d-1e05-4669-a91a-3caccdfd6e8e None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:48.988359 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 455/902] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:48.994919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2602-6660-41aa-be3a-9b7ebc67a24a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:48.995521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2602-6660-41aa-be3a-9b7ebc67a24a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:48.995521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2602-6660-41aa-be3a-9b7ebc67a24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.013627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4f5f2602-6660-41aa-be3a-9b7ebc67a24a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:49.014870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4f5f2602-6660-41aa-be3a-9b7ebc67a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:49.022957 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 448/903] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:48 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:49.047334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35929d-1e05-4669-a91a-3caccdfd6e8e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.060264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35929d-1e05-4669-a91a-3caccdfd6e8e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.066559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c7de-c730-4b98-9a99-c23865eb59ac None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.069114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c7de-c730-4b98-9a99-c23865eb59ac None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.069114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c7de-c730-4b98-9a99-c23865eb59ac None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.069341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.069341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.069341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.069341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.069662 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 449/904] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:49.069861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.071520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.079083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c95a9-8616-42d4-adc0-33f500294bb2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.079375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c95a9-8616-42d4-adc0-33f500294bb2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.079652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c95a9-8616-42d4-adc0-33f500294bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.090208 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 25 20:45:49.092450 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 456/905] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:49.097950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.099339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-722c95a9-8616-42d4-adc0-33f500294bb2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:49.100742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-722c95a9-8616-42d4-adc0-33f500294bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:49.108038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f05a-2db0-476b-a104-de4cfe86f100 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.116963 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 450/906] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:49 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:49.118791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.119439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.119720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.119994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.120707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.121056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.122646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.127738 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 457/907] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:49.134269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c95a9-8616-42d4-adc0-33f500294bb2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.141214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.144961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c95a9-8616-42d4-adc0-33f500294bb2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.150733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.151427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4dad6-45d1-4825-b82c-cc923473e22b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.151887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.152413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.152994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.153891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.154392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.156317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.156561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.157154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.157506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.157854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.158654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.159818 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:49.159818 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:45:49.159818 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:45:49.160676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.163826 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 451/908] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:49.170711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.180981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc184d8-5907-426b-91e6-9c07aee949da admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.185455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.186098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.186378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.186650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.187436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] RBAC: Adding query filter params (interface=public, service_id=383067b016504c909e385dd05538d28f, region_id=RegionOne) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.187800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.188799 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:45:49.188799 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:45:49.188799 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:45:49.189730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.198035 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 452/909] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/endpoints?service_id=383067b016504c909e385dd05538d28f&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:49.203792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.213424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459ffbe-d7d2-41b6-bd5f-8a602ae4754b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.217895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aace07-1f62-47b8-b50a-8da593179b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.218545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aace07-1f62-47b8-b50a-8da593179b2d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.218829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aace07-1f62-47b8-b50a-8da593179b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.219105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aace07-1f62-47b8-b50a-8da593179b2d admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.222443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aace07-1f62-47b8-b50a-8da593179b2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.222443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aace07-1f62-47b8-b50a-8da593179b2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.227799 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 453/910] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/services => generated 1268 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:45:49.229716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0153ad4-c2f9-4450-988f-c37d51f73929 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.230001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0153ad4-c2f9-4450-988f-c37d51f73929 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.230272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0153ad4-c2f9-4450-988f-c37d51f73929 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.232131 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 454/911] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:49.238753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869a338-5133-4c10-8a11-653cca0baa8d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.239075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869a338-5133-4c10-8a11-653cca0baa8d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.239305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869a338-5133-4c10-8a11-653cca0baa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.258885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a869a338-5133-4c10-8a11-653cca0baa8d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:49.260103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a869a338-5133-4c10-8a11-653cca0baa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:49.273064 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 455/912] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:49 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:49.286908 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 458/913] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:45:49 2021] POST /identity/v3/services => generated 241 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:49.297816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869a338-5133-4c10-8a11-653cca0baa8d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.309204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869a338-5133-4c10-8a11-653cca0baa8d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.325423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.326277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.326619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.326897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.340037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:49.348937 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 25 20:45:49.350319 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 456/914] 10.222.0.32 () {56 vars in 1141 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:49.357368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.369406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b51d01-aeb2-497f-b4f3-fc9812bae886 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.374724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.378368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.378368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.378368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.378368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.378368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.379394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.390099 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 459/915] 10.222.0.32 () {56 vars in 1136 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:49.396909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.412386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba5dc-495a-409b-81d4-e4dad1f88546 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.418016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.419308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.419817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.420329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.434230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.436499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.455939 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:49.457627 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 457/916] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:49.464207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.475875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54deba-93fe-4a14-a3b0-055990c8efb4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.481390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.482511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.482989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.483529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.484479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.485099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.487138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.503552 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 460/917] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:49.509945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.523544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf701732-7c86-448e-8674-2e3a2bee279e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.531369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.531682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.532057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.532427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.543536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.545922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.563337 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 25 20:45:49.565191 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 458/918] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:49.571397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.586019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca070146-58cb-4bb0-bdae-96e69473c6a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.591051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.591947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.592365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.592804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.593855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.594323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.596385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.621008 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 461/919] 10.222.0.32 () {56 vars in 1170 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:49.626972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.637056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39714f-1f4d-44b4-8d6a-99546be81f6c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.647057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.648153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.648570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.649048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.668270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.669399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.689201 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:49.690672 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 459/920] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:49.697971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.712568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada823c-e8ae-4bec-9f11-c0562cb62882 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.720138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.721210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.721893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.723019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.724359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.725226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.727780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.741021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 462/921] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:49.747698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.758367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896d0e3-4d2b-4871-a4b6-fdc095099631 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.763567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.764558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.765136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.765585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.774192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.776548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.792469 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:49.800103 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 460/922] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:49.801420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.814379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746dfac-0803-40e4-ba58-704e19b9ef05 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.821558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff64a4-1665-450f-8f9c-0a19919e9f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.822443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff64a4-1665-450f-8f9c-0a19919e9f52 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.822922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff64a4-1665-450f-8f9c-0a19919e9f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.823388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff64a4-1665-450f-8f9c-0a19919e9f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.824386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff64a4-1665-450f-8f9c-0a19919e9f52 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:49.824829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff64a4-1665-450f-8f9c-0a19919e9f52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.828061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff64a4-1665-450f-8f9c-0a19919e9f52 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:49.851488 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 463/923] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:49.856503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:49.872214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a398fc-a91e-4bdd-a38a-5bf991901a43 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:49.878942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad8a03-e6d8-4ab3-aa9c-715031131043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:49.880003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad8a03-e6d8-4ab3-aa9c-715031131043 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:49.880344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad8a03-e6d8-4ab3-aa9c-715031131043 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:49.880676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad8a03-e6d8-4ab3-aa9c-715031131043 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/23c0a773f0c542baaa1bd937a8412456/roles/d95a5a3b71ae4e669b519c06c80439d1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:49.883456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad8a03-e6d8-4ab3-aa9c-715031131043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=23c0a773f0c542baaa1bd937a8412456, role_id=d95a5a3b71ae4e669b519c06c80439d1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:49.886282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad8a03-e6d8-4ab3-aa9c-715031131043 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:50.035175 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 461/924] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:45:49 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/23c0a773f0c542baaa1bd937a8412456/roles/d95a5a3b71ae4e669b519c06c80439d1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:45:50.300827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12e05-cc39-4b71-b8e2-225823566d79 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:50.301359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12e05-cc39-4b71-b8e2-225823566d79 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:50.301359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd12e05-cc39-4b71-b8e2-225823566d79 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:50.303347 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 464/925] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:50.309198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b07535-b380-48ec-9b0e-b9478bd8c6d5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:50.309481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b07535-b380-48ec-9b0e-b9478bd8c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:50.309755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b07535-b380-48ec-9b0e-b9478bd8c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:50.327639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-40b07535-b380-48ec-9b0e-b9478bd8c6d5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:50.328796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-40b07535-b380-48ec-9b0e-b9478bd8c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:50.386979 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 462/926] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:50 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:50.412600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12e05-cc39-4b71-b8e2-225823566d79 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:50.426127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd12e05-cc39-4b71-b8e2-225823566d79 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:50.432408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:50.433243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:50.433625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:50.433848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:50.434503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:50.436078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:50.448655 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 25 20:45:50.450188 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 465/927] 10.222.0.32 () {56 vars in 1153 bytes} [Sat Dec 25 20:45:50 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:50.456585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b07535-b380-48ec-9b0e-b9478bd8c6d5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:50.465678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b07535-b380-48ec-9b0e-b9478bd8c6d5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:50.470220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:50.470871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:50.471147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:50.471416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:50.472149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:50.472454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:50.474084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:50.480419 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 463/928] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:50 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:50.486563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:50.497409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d1144-f449-4c14-83c2-6228056d8173 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:50.501963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54efa-9d8f-4751-9c21-99845a2a26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:50.502604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54efa-9d8f-4751-9c21-99845a2a26de admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:50.502879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54efa-9d8f-4751-9c21-99845a2a26de admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:50.503148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54efa-9d8f-4751-9c21-99845a2a26de admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:50.504410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54efa-9d8f-4751-9c21-99845a2a26de admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:50.504710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54efa-9d8f-4751-9c21-99845a2a26de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:50.506331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54efa-9d8f-4751-9c21-99845a2a26de admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:50.511838 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 466/929] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:50 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:50.517839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:50.528048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75fc83-93d5-41f4-a311-eeeb2c252948 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:50.532837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217d60c-026d-4971-9328-3c83728461dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:50.533540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d60c-026d-4971-9328-3c83728461dd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:50.533817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d60c-026d-4971-9328-3c83728461dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:50.534086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217d60c-026d-4971-9328-3c83728461dd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:50.534877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217d60c-026d-4971-9328-3c83728461dd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:50.536460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217d60c-026d-4971-9328-3c83728461dd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:50.607590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 464/930] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:45:50 2021] POST /identity/v3/endpoints => generated 347 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:51.766316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6f3c8-80ca-4fcd-a2bf-041bc32c7166 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:51.766933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6f3c8-80ca-4fcd-a2bf-041bc32c7166 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:51.766933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6f3c8-80ca-4fcd-a2bf-041bc32c7166 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:51.768730 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 467/931] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:51.775635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafdd3-5a30-4a9d-888f-839c4e45ca29 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:51.776121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafdd3-5a30-4a9d-888f-839c4e45ca29 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:51.776251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafdd3-5a30-4a9d-888f-839c4e45ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:51.793919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cebafdd3-5a30-4a9d-888f-839c4e45ca29 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:51.795100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cebafdd3-5a30-4a9d-888f-839c4e45ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:51.816989 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 465/932] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:51 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:51.838618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6f3c8-80ca-4fcd-a2bf-041bc32c7166 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:51.851378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6f3c8-80ca-4fcd-a2bf-041bc32c7166 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:51.855864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:51.856650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:51.856956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:51.857235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:51.857896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:51.859466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:51.870952 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 25 20:45:51.876974 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 468/933] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:51 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:51.879449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebafdd3-5a30-4a9d-888f-839c4e45ca29 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:51.888568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebafdd3-5a30-4a9d-888f-839c4e45ca29 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:51.893336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:51.894045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:51.894839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:51.895113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:51.895827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:51.896138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:51.897752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:51.907698 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 466/934] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:51 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:51.909046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:51.918859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093464f5-a93a-45cb-89ee-8f2ad284a069 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:51.923499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be5567-554b-4fd5-9477-f65c953e4d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:51.924153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be5567-554b-4fd5-9477-f65c953e4d23 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:51.924438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be5567-554b-4fd5-9477-f65c953e4d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:51.924711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be5567-554b-4fd5-9477-f65c953e4d23 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:51.926010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be5567-554b-4fd5-9477-f65c953e4d23 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:51.926314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be5567-554b-4fd5-9477-f65c953e4d23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:51.927934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be5567-554b-4fd5-9477-f65c953e4d23 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:51.938724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 469/935] 10.222.0.32 () {56 vars in 1135 bytes} [Sat Dec 25 20:45:51 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:51.940074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:51.955172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b3cc-4b9d-4391-aa76-90698a9e250a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:51.959919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:51.960571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:51.960853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:51.961173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:51.962351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:51.963508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.020158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931c97-5f48-4340-9380-1089a90b1bcc None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.020450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931c97-5f48-4340-9380-1089a90b1bcc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.020727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931c97-5f48-4340-9380-1089a90b1bcc None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.022723 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 470/936] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:52.028152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864e2d-fe5b-4439-917a-d857ea17f851 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.028441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864e2d-fe5b-4439-917a-d857ea17f851 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.028719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864e2d-fe5b-4439-917a-d857ea17f851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.047505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-be864e2d-fe5b-4439-917a-d857ea17f851 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:52.048703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be864e2d-fe5b-4439-917a-d857ea17f851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:52.059186 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 471/937] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:52 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:52.064610 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 467/938] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:45:51 2021] POST /identity/v3/endpoints => generated 346 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:52.086486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864e2d-fe5b-4439-917a-d857ea17f851 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.096748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864e2d-fe5b-4439-917a-d857ea17f851 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.113931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.115073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.115547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.115964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.116800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.120295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.134442 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 25 20:45:52.141105 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 472/939] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:52.143884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.155166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5584d-6fdd-49ef-9114-4dc771867bed admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.160266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.161256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.161682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.162096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.163003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:52.163526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.165484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.171302 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 468/940] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:52.178538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.189262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed629e-c318-4a7d-aebc-59c89b53e981 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.195063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.195990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.196416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.196852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.197831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:52.198279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.200124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.211650 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 473/941] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:52.213493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.224373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c7f32-68b7-4ac1-ae61-dc09f8eaeb7b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.229523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66e84-b3c8-4d0d-85dc-4dad189a29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.230391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66e84-b3c8-4d0d-85dc-4dad189a29d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.230871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66e84-b3c8-4d0d-85dc-4dad189a29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.231300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66e84-b3c8-4d0d-85dc-4dad189a29d6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.232326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66e84-b3c8-4d0d-85dc-4dad189a29d6 admin admin] RBAC: Adding query filter params (interface=public, service_id=69b91f97b12244e0a28befff4f611a8e, region_id=RegionOne) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:52.232784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66e84-b3c8-4d0d-85dc-4dad189a29d6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.234667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66e84-b3c8-4d0d-85dc-4dad189a29d6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.245582 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 469/942] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/endpoints?service_id=69b91f97b12244e0a28befff4f611a8e&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:52.248937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.260134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316c8e5-8819-40d8-baa0-8f576ed75271 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.265290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e0b96-46c3-46c9-aefa-b4c36eef60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.266210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e0b96-46c3-46c9-aefa-b4c36eef60ed admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.266659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e0b96-46c3-46c9-aefa-b4c36eef60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.267073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e0b96-46c3-46c9-aefa-b4c36eef60ed admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.267963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e0b96-46c3-46c9-aefa-b4c36eef60ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.269898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e0b96-46c3-46c9-aefa-b4c36eef60ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.277237 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 474/943] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:45:52.556820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3258413-5b4e-494c-86b4-4e52c3e8c08d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.557186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3258413-5b4e-494c-86b4-4e52c3e8c08d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.557309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3258413-5b4e-494c-86b4-4e52c3e8c08d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.559325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 470/944] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:52.564982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce937e-80a4-486a-a96b-ac0dace1a434 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.565270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce937e-80a4-486a-a96b-ac0dace1a434 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.565548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce937e-80a4-486a-a96b-ac0dace1a434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.583637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-67ce937e-80a4-486a-a96b-ac0dace1a434 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:52.584796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-67ce937e-80a4-486a-a96b-ac0dace1a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:52.592840 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 475/945] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:52 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:52.619289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3258413-5b4e-494c-86b4-4e52c3e8c08d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.631686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3258413-5b4e-494c-86b4-4e52c3e8c08d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.636279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.637116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.637393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.637662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.649037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:45:52.656391 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 25 20:45:52.657647 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 471/946] 10.222.0.32 () {56 vars in 1141 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:52.664523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce937e-80a4-486a-a96b-ac0dace1a434 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.676506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce937e-80a4-486a-a96b-ac0dace1a434 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.681237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.681926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.682201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.682471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.683328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:52.683634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.685379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.697849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 476/947] 10.222.0.32 () {56 vars in 1136 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:52.704400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.716198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4ae1f-1cec-4e38-804c-9746d986e2ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.721022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.721918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.722862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.723134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.734042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.735909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.753192 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:52.754676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 472/948] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:52.761266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.775345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2147c-0953-4008-8e10-81968553b814 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.780649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.781589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.782122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.782569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.783459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:52.783933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.786351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.798979 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 477/949] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:52.805143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.815751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be263c0-ae20-4f90-9ed3-82ecad6b9316 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.820756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.821836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.822285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.822764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.830210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.832976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.847892 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 25 20:45:52.849589 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 473/950] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:52.855749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.866235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127ee23-cc71-4f71-9c04-f8993de13e60 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.871312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.872231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.872710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.873187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.874239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:52.874716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.876830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.896252 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 478/951] 10.222.0.32 () {56 vars in 1170 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:52.902482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.913205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938667a5-0e75-42f8-9246-5c2123f5d069 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.917967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.918862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.919311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.919787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.927973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.929939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.939247 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 474/952] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:45:52.945476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:52.956270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca151e7-4678-4891-9531-e9928bc9bf3b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:52.961939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:52.962991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:52.963488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:52.963928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:52.977626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:52.979667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:52.996946 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:45:52.998664 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 479/953] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:53.005236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:53.014178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822238d8-9a60-4f43-8a4b-a7ffeb9703e2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:53.018726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:53.020127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.020404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.020672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.021426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:53.021723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:53.023384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:53.035040 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 475/954] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:45:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:53.041425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:53.051406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254af6dc-d6d8-4e90-a583-94db286b294a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:53.056118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009727f-351c-45ff-91e3-c1325c8793f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:53.056981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009727f-351c-45ff-91e3-c1325c8793f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.057301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009727f-351c-45ff-91e3-c1325c8793f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.057623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009727f-351c-45ff-91e3-c1325c8793f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.065141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009727f-351c-45ff-91e3-c1325c8793f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:53.067737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009727f-351c-45ff-91e3-c1325c8793f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:53.082361 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-e009727f-351c-45ff-91e3-c1325c8793f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:53.084391 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 480/955] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:53.092469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:53.103437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163bb5-a427-4b62-b839-9b866bbb9461 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:53.108118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:53.108780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.109145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.109425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.110267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:53.110573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:53.112550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:53.123119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a213cb-86e1-437e-8e12-d3621da26d59 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.123660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a213cb-86e1-437e-8e12-d3621da26d59 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.124108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a213cb-86e1-437e-8e12-d3621da26d59 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.126094 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 481/956] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:53.128895 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 476/957] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:45:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:53.132868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f45f-2622-4eec-863f-87c8ae01299c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.133362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:53.133568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f45f-2622-4eec-863f-87c8ae01299c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.134072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f45f-2622-4eec-863f-87c8ae01299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.143512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9cc68-0a77-46d2-ad3a-416b0f071484 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:53.148680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:53.149311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.149585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.149855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.150768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] RBAC: Adding query filter params (role.id=d95a5a3b71ae4e669b519c06c80439d1, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=23c0a773f0c542baaa1bd937a8412456) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:53.151000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:53.152782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:53.155439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3b08f45f-2622-4eec-863f-87c8ae01299c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:53.156866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3b08f45f-2622-4eec-863f-87c8ae01299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:53.158791 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 477/958] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:45:53 2021] GET /identity/v3/role_assignments?user.id=23c0a773f0c542baaa1bd937a8412456&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=d95a5a3b71ae4e669b519c06c80439d1 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:53.171706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 482/959] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:53 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:53.197163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:53.208527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e498-a4f3-4f40-aa4d-cc839f6eaf39 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:53.213934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:53.215137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.215621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.216132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.217185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:53.219127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:53.231452 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 25 20:45:53.233401 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 478/960] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:53 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:53.240197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08f45f-2622-4eec-863f-87c8ae01299c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:53.250550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08f45f-2622-4eec-863f-87c8ae01299c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:53.256299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515347d9-4e7c-4680-af4f-780ef9eaf144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:53.257340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515347d9-4e7c-4680-af4f-780ef9eaf144 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.257820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515347d9-4e7c-4680-af4f-780ef9eaf144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.258288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515347d9-4e7c-4680-af4f-780ef9eaf144 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.259268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515347d9-4e7c-4680-af4f-780ef9eaf144 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:53.259772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515347d9-4e7c-4680-af4f-780ef9eaf144 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:53.261623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515347d9-4e7c-4680-af4f-780ef9eaf144 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:53.267763 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 483/961] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:53 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:53.274906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:53.285280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4701-2f3a-41f6-be8e-0eed4308ee08 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:53.290352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484edc6-7f9b-4646-a69d-9966e2084d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:53.291319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484edc6-7f9b-4646-a69d-9966e2084d75 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:53.291800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484edc6-7f9b-4646-a69d-9966e2084d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:53.292290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484edc6-7f9b-4646-a69d-9966e2084d75 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:53.293364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484edc6-7f9b-4646-a69d-9966e2084d75 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:53.293876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484edc6-7f9b-4646-a69d-9966e2084d75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:53.295696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484edc6-7f9b-4646-a69d-9966e2084d75 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:53.301608 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 479/962] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:53 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:54.738420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c51ef-229c-4132-a169-39291879ade2 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.738938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c51ef-229c-4132-a169-39291879ade2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.739189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c51ef-229c-4132-a169-39291879ade2 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.741123 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 484/963] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:54.747293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d119b8-dbaa-4863-b6bd-bd772bbb3b3c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.747709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d119b8-dbaa-4863-b6bd-bd772bbb3b3c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.747923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d119b8-dbaa-4863-b6bd-bd772bbb3b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.766327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-59d119b8-dbaa-4863-b6bd-bd772bbb3b3c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:54.767516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-59d119b8-dbaa-4863-b6bd-bd772bbb3b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:54.776272 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 480/964] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:54 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:54.795924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e7136-7d63-429f-8a61-32b2015a2f68 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.796214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e7136-7d63-429f-8a61-32b2015a2f68 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.796521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e7136-7d63-429f-8a61-32b2015a2f68 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.798552 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 485/965] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:54.804050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368e450-e534-43e6-b316-763e7e6f7361 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.804333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368e450-e534-43e6-b316-763e7e6f7361 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.804602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368e450-e534-43e6-b316-763e7e6f7361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.807239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e7136-7d63-429f-8a61-32b2015a2f68 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:54.823175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e7136-7d63-429f-8a61-32b2015a2f68 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:54.828356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:54.829023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.829305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.829580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.830297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:54.831336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6368e450-e534-43e6-b316-763e7e6f7361 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:54.832678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:54.833507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6368e450-e534-43e6-b316-763e7e6f7361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:54.834050 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.common [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 25 20:45:54.847133 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 481/966] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:54 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:54.871973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368e450-e534-43e6-b316-763e7e6f7361 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:54.881508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368e450-e534-43e6-b316-763e7e6f7361 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:54.885987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:54.886775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.887053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.887325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.887977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:54.889573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:54.901258 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 25 20:45:54.903083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.sql.core [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 25 20:45:54.903083 ncdv-master-1 devstack@keystone.service[96733]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 25 20:45:54.903083 ncdv-master-1 devstack@keystone.service[96733]: [parameters: {'id': '07f30b8a99f740adb55dffd464d81bac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 25 20:45:54.903083 ncdv-master-1 devstack@keystone.service[96733]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96733) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 25 20:45:54.907681 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 482/967] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:54.908824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:54.918261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f4bf-ef67-4b25-abad-fe8d5bbec392 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:54.921648 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 07f30b8a99f740adb55dffd464d81bac.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 07f30b8a99f740adb55dffd464d81bac. Dec 25 20:45:54.923051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:54.923672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.924088 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 486/968] 10.222.0.32 () {60 vars in 1161 bytes} [Sat Dec 25 20:45:54 2021] POST /identity/v3/projects => generated 262 bytes in 117 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:54.924190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.928768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.928768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:54.928768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:54.928768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:54.932146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:54.940002 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 483/969] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:54.941794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:54.945979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b645ec-2262-4707-b23c-37322fcc0974 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:54.951453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923aa01-a384-404e-88db-3fe2d61999f9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:54.951967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:54.953433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.954024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.954586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.956211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:54.956982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.957331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.957701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.958518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:54.958899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:54.960544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:54.967544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:54.970022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:54.971325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 484/970] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:54 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:54.972567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:54.982128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c23563-08c9-4bad-8c25-70b51d447f69 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:54.986502 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:45:54.986699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4982a27-d1f5-4ba1-b2e8-4652ddcf07b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:54.987372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4982a27-d1f5-4ba1-b2e8-4652ddcf07b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:54.988230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4982a27-d1f5-4ba1-b2e8-4652ddcf07b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:54.988562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4982a27-d1f5-4ba1-b2e8-4652ddcf07b4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:54.989295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4982a27-d1f5-4ba1-b2e8-4652ddcf07b4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:54.989843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 487/971] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:54.995305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4982a27-d1f5-4ba1-b2e8-4652ddcf07b4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:54.997009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:55.010107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1d35-0990-48c4-be7f-9b02646237bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:55.014704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970eb675-f7d6-4c56-ad62-1e4e01364696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:55.015395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eb675-f7d6-4c56-ad62-1e4e01364696 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.015744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eb675-f7d6-4c56-ad62-1e4e01364696 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.016086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eb675-f7d6-4c56-ad62-1e4e01364696 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.016963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970eb675-f7d6-4c56-ad62-1e4e01364696 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:55.017357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970eb675-f7d6-4c56-ad62-1e4e01364696 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:55.019347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970eb675-f7d6-4c56-ad62-1e4e01364696 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:55.039091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 488/972] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:54 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:55.076778 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 485/973] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:45:54 2021] POST /identity/v3/endpoints => generated 349 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:55.726807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a87e-8e69-447a-b7a4-21e30770e0a7 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.727292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a87e-8e69-447a-b7a4-21e30770e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.727670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a87e-8e69-447a-b7a4-21e30770e0a7 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.729811 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 489/974] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:55.735765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046ca2-06f4-43ac-88b5-3f65db818d8e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.736048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046ca2-06f4-43ac-88b5-3f65db818d8e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.736319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80046ca2-06f4-43ac-88b5-3f65db818d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.754680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-80046ca2-06f4-43ac-88b5-3f65db818d8e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:55.755842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-80046ca2-06f4-43ac-88b5-3f65db818d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:55.777197 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 486/975] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:55 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:55.788068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af467-fda6-4db8-a949-fb7a46d8f697 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.788520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af467-fda6-4db8-a949-fb7a46d8f697 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.788600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180af467-fda6-4db8-a949-fb7a46d8f697 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.790609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 490/976] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:55.796099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f724-111d-402b-a695-c4f95e859c4c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.796382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f724-111d-402b-a695-c4f95e859c4c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.796658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f724-111d-402b-a695-c4f95e859c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.799104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180af467-fda6-4db8-a949-fb7a46d8f697 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:55.811647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180af467-fda6-4db8-a949-fb7a46d8f697 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:55.816623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:55.816991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3db1f724-111d-402b-a695-c4f95e859c4c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:55.817444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.817718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.817988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.818158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3db1f724-111d-402b-a695-c4f95e859c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:55.820703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:55.820703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:55.826868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 487/977] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:55 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:55.835464 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 25 20:45:55.836776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 491/978] 10.222.0.32 () {56 vars in 1126 bytes} [Sat Dec 25 20:45:55 2021] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:55.842970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f724-111d-402b-a695-c4f95e859c4c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:55.853217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f724-111d-402b-a695-c4f95e859c4c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:55.855240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:55.858029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:55.858684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.858962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.859234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.859968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:55.860243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:55.861838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:55.865222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27972c09-28f6-458a-9b5f-eaf7dfb60cd5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:55.866979 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 488/979] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:55 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:55.870336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf756e-19dd-4a48-9173-b3637246776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:55.871072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf756e-19dd-4a48-9173-b3637246776f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.871447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf756e-19dd-4a48-9173-b3637246776f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.871815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf756e-19dd-4a48-9173-b3637246776f admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.872756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf756e-19dd-4a48-9173-b3637246776f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:55.873030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:55.874549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf756e-19dd-4a48-9173-b3637246776f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:55.882261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26c87-2831-48a2-8347-0e57462cd9f5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:55.886941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93ff1-347d-49b4-ae78-f1a3b0193740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:55.889822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93ff1-347d-49b4-ae78-f1a3b0193740 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:55.889822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93ff1-347d-49b4-ae78-f1a3b0193740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:55.889822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93ff1-347d-49b4-ae78-f1a3b0193740 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:55.889822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93ff1-347d-49b4-ae78-f1a3b0193740 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:55.889822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93ff1-347d-49b4-ae78-f1a3b0193740 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:55.890788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93ff1-347d-49b4-ae78-f1a3b0193740 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:55.895857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 489/980] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:45:55 2021] GET /identity/v3/services?type=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:55.968437 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 492/981] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:45:55 2021] POST /identity/v3/services => generated 242 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:57.586052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e1f7-2bfa-4b5e-b4bf-72adc361a709 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.586620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e1f7-2bfa-4b5e-b4bf-72adc361a709 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.586620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e1f7-2bfa-4b5e-b4bf-72adc361a709 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.588628 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 490/982] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:57.594709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136316e8-70b1-48b0-a868-a8f2fde2640c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.595116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136316e8-70b1-48b0-a868-a8f2fde2640c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.595316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136316e8-70b1-48b0-a868-a8f2fde2640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.614523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-136316e8-70b1-48b0-a868-a8f2fde2640c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:57.616031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-136316e8-70b1-48b0-a868-a8f2fde2640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:57.636979 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 493/983] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:57 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:57.649458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061f851-d7a2-4597-b752-11695228dfd6 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.649743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061f851-d7a2-4597-b752-11695228dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.650016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061f851-d7a2-4597-b752-11695228dfd6 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.651943 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 491/984] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:57.657567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edba7a-13eb-4811-933a-5a22b3c5aec0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.657862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edba7a-13eb-4811-933a-5a22b3c5aec0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.658125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edba7a-13eb-4811-933a-5a22b3c5aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.658225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061f851-d7a2-4597-b752-11695228dfd6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.673270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061f851-d7a2-4597-b752-11695228dfd6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.676932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-02edba7a-13eb-4811-933a-5a22b3c5aec0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:57.678101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-02edba7a-13eb-4811-933a-5a22b3c5aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:57.678304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.679061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.683932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.684225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.684927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.686506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.687662 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 494/985] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:57 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:45:57.698825 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 25 20:45:57.704972 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 492/986] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:45:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:57.706720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edba7a-13eb-4811-933a-5a22b3c5aec0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.714899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.717223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edba7a-13eb-4811-933a-5a22b3c5aec0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.721869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.723231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.723508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.723780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.724985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:57.725320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.727199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.728893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc95bb-185c-4da2-aa73-01216f7f228d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.736973 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 495/987] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:57.738312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.739597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.740444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.740726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.741031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.741742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.743817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.745175 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.common [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 25 20:45:57.756143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef8683-6218-4f6f-b10e-7fe79a910a24 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.760657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.761412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.761762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.762105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.762880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:57.763250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.764909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.770158 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 496/988] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:45:57 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:57.776444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.786668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb008c-7b64-4782-970b-a257b3b18808 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.791274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.791949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.792222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.792514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.793348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] RBAC: Adding query filter params (interface=admin, service_id=69b91f97b12244e0a28befff4f611a8e, region_id=RegionOne) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:57.793657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.795224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.800926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.sql.core [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 25 20:45:57.800926 ncdv-master-1 devstack@keystone.service[96732]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 25 20:45:57.800926 ncdv-master-1 devstack@keystone.service[96732]: [parameters: {'user_id': '3db52641a35349589cf269f47f518cd1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 25 20:45:57.800926 ncdv-master-1 devstack@keystone.service[96732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 25 20:45:57.806439 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 497/989] 10.222.0.32 () {56 vars in 1270 bytes} [Sat Dec 25 20:45:57 2021] GET /identity/v3/endpoints?service_id=69b91f97b12244e0a28befff4f611a8e&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:57.807687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.807908 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 25 20:45:57.809943 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 493/990] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 20:45:57 2021] POST /identity/v3/users => generated 160 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:45:57.816801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.819266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe10aa-91c8-46df-b3e4-5fc3358e20f8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.824205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.824975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.825333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.825725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.826575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.828235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.832317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197849e-8f8a-479e-8219-d840600813f1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.840979 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 498/991] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:45:57 2021] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:45:57.842010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8cb4-f3ed-4a49-8072-2f01d122cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.842897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8cb4-f3ed-4a49-8072-2f01d122cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.843178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8cb4-f3ed-4a49-8072-2f01d122cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.843449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8cb4-f3ed-4a49-8072-2f01d122cc0d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.852832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8cb4-f3ed-4a49-8072-2f01d122cc0d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.855309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8cb4-f3ed-4a49-8072-2f01d122cc0d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.871717 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-df7e8cb4-f3ed-4a49-8072-2f01d122cc0d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 25 20:45:57.873324 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 494/992] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:45:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:57.880206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:57.890598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348df7-ad1f-4b76-8815-7456dc61527d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:57.895934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1d0fd-a7be-4d1d-86e5-5ed67660f623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:57.896622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d0fd-a7be-4d1d-86e5-5ed67660f623 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:57.896936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d0fd-a7be-4d1d-86e5-5ed67660f623 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:57.897218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d0fd-a7be-4d1d-86e5-5ed67660f623 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:57.898036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1d0fd-a7be-4d1d-86e5-5ed67660f623 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:57.898346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1d0fd-a7be-4d1d-86e5-5ed67660f623 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:57.900211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1d0fd-a7be-4d1d-86e5-5ed67660f623 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:57.940128 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 499/993] 10.222.0.32 () {56 vars in 1122 bytes} [Sat Dec 25 20:45:57 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:58.398074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cf88-bfac-49a3-90d3-77547a931c8f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.398475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cf88-bfac-49a3-90d3-77547a931c8f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.398649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cf88-bfac-49a3-90d3-77547a931c8f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.403536 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 495/994] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:58 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:45:58.409318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9136a-bd6a-41b0-879e-0e3c06399275 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.409964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9136a-bd6a-41b0-879e-0e3c06399275 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.410248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9136a-bd6a-41b0-879e-0e3c06399275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.427848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c8d9136a-bd6a-41b0-879e-0e3c06399275 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:58.429071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8d9136a-bd6a-41b0-879e-0e3c06399275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:58.437289 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 500/995] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:58 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:58.463273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cf88-bfac-49a3-90d3-77547a931c8f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:58.475652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cf88-bfac-49a3-90d3-77547a931c8f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:58.479986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:58.480630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.480938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.487018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.487018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:58.487018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:58.506024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d33e-24bd-4b56-a8c6-643808820d3c None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.506316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d33e-24bd-4b56-a8c6-643808820d3c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.506593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d33e-24bd-4b56-a8c6-643808820d3c None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.508397 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 501/996] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:45:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:45:58.513697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab11770-9048-4306-bedc-5e1b06b77152 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.514245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab11770-9048-4306-bedc-5e1b06b77152 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.514245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab11770-9048-4306-bedc-5e1b06b77152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.532246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2ab11770-9048-4306-bedc-5e1b06b77152 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:45:58.533449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2ab11770-9048-4306-bedc-5e1b06b77152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:45:58.545428 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 502/997] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:45:58 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:45:58.571999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab11770-9048-4306-bedc-5e1b06b77152 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:58.586192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab11770-9048-4306-bedc-5e1b06b77152 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:58.590776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:58.591557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.591836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.592107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.592757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:58.594411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:58.605222 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 25 20:45:58.606499 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 503/998] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:45:58 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:45:58.607617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 496/999] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:45:58 2021] POST /identity/v3/services => generated 242 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:45:58.613825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:58.624352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20fa5-a771-472e-a42b-ad91e541d974 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:58.643032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:58.643704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.644530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.644813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.645564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:58.645871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:58.647534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:58.658138 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 504/1000] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:58 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:58.661828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:58.673801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b27b-36c9-4862-919d-66e15f885457 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:58.680471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:58.681526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.682006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.682500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.683420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:58.683991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:58.685864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:58.693307 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 497/1001] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:45:58 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:45:58.699849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:58.710396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f339-fc20-4152-ac90-12bd8fed0359 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:58.715126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19208ecc-c4d4-4683-a6fa-bdb5afbf043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:58.715790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19208ecc-c4d4-4683-a6fa-bdb5afbf043a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.716074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19208ecc-c4d4-4683-a6fa-bdb5afbf043a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.716352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19208ecc-c4d4-4683-a6fa-bdb5afbf043a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.717199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19208ecc-c4d4-4683-a6fa-bdb5afbf043a admin admin] RBAC: Adding query filter params (interface=public, service_id=0c1354310289433e9fb8410e18d3d92e, region_id=RegionOne) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:45:58.717515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19208ecc-c4d4-4683-a6fa-bdb5afbf043a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:58.719112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19208ecc-c4d4-4683-a6fa-bdb5afbf043a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:58.725115 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 505/1002] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:45:58 2021] GET /identity/v3/endpoints?service_id=0c1354310289433e9fb8410e18d3d92e&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:45:58.731828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:45:58.745213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9c7e-4bc3-4eed-b6b5-16c6831235b3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:45:58.750184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc316c2-90fd-4b63-a957-65cee97c0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:45:58.751026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc316c2-90fd-4b63-a957-65cee97c0959 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:45:58.751473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc316c2-90fd-4b63-a957-65cee97c0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:45:58.751888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc316c2-90fd-4b63-a957-65cee97c0959 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:45:58.752797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc316c2-90fd-4b63-a957-65cee97c0959 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:45:58.755288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc316c2-90fd-4b63-a957-65cee97c0959 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:45:58.762993 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 498/1003] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:45:58 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:46:00.324104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c33db5-31b9-4539-81c3-b9e579e6087e None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:00.324661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c33db5-31b9-4539-81c3-b9e579e6087e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:00.324661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c33db5-31b9-4539-81c3-b9e579e6087e None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:00.326648 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 506/1004] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:00.332276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f520a9-dea0-47d7-be4e-0f4f84209a68 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:00.332694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f520a9-dea0-47d7-be4e-0f4f84209a68 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:00.332860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f520a9-dea0-47d7-be4e-0f4f84209a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:00.351472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d9f520a9-dea0-47d7-be4e-0f4f84209a68 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:00.353037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d9f520a9-dea0-47d7-be4e-0f4f84209a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:00.360923 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 499/1005] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:00 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:00.386813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c33db5-31b9-4539-81c3-b9e579e6087e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:00.399121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c33db5-31b9-4539-81c3-b9e579e6087e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:00.403401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:00.404205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:00.404488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:00.404762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:00.405502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:00.407061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:00.417995 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 25 20:46:00.419273 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 507/1006] 10.222.0.32 () {56 vars in 1147 bytes} [Sat Dec 25 20:46:00 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:00.425916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f520a9-dea0-47d7-be4e-0f4f84209a68 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:00.435203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f520a9-dea0-47d7-be4e-0f4f84209a68 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:00.440222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:00.441595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:00.441878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:00.442159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:00.442913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:00.443227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:00.444803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:00.452898 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 500/1007] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:46:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:00.456070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:00.465785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540a7ef-623f-496f-b6a9-dbab37f9aed8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:00.470222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd44c7-c8e9-41a9-b20d-eac314bb15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:00.470863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd44c7-c8e9-41a9-b20d-eac314bb15c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:00.471141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd44c7-c8e9-41a9-b20d-eac314bb15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:00.471414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd44c7-c8e9-41a9-b20d-eac314bb15c4 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:00.472143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd44c7-c8e9-41a9-b20d-eac314bb15c4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:00.472447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd44c7-c8e9-41a9-b20d-eac314bb15c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:00.474046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd44c7-c8e9-41a9-b20d-eac314bb15c4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:00.478958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 508/1008] 10.222.0.32 () {56 vars in 1143 bytes} [Sat Dec 25 20:46:00 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:00.484847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:00.495117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a129da-f715-48e1-8b72-12389b6547f8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:00.499534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808e441-952b-4101-8106-02d62ba14db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:00.500171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808e441-952b-4101-8106-02d62ba14db5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:00.500451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808e441-952b-4101-8106-02d62ba14db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:00.500723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808e441-952b-4101-8106-02d62ba14db5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:00.501521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808e441-952b-4101-8106-02d62ba14db5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:00.503126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808e441-952b-4101-8106-02d62ba14db5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:00.664467 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 501/1009] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:46:00 2021] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:01.049757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a533-f7e7-4b1f-ad4d-dd068a816b93 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.050624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a533-f7e7-4b1f-ad4d-dd068a816b93 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.050820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a533-f7e7-4b1f-ad4d-dd068a816b93 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.052633 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 509/1010] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:01.058396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3509e9-5ad9-47c8-b141-3903ff0fbc2a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.058686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3509e9-5ad9-47c8-b141-3903ff0fbc2a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.058961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3509e9-5ad9-47c8-b141-3903ff0fbc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.076951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6d3509e9-5ad9-47c8-b141-3903ff0fbc2a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:01.078133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d3509e9-5ad9-47c8-b141-3903ff0fbc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:01.094949 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 502/1011] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:01 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:01.120367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910a533-f7e7-4b1f-ad4d-dd068a816b93 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.132995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910a533-f7e7-4b1f-ad4d-dd068a816b93 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.137355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87ad4e-b6a2-4a06-965f-66108dd9464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.138124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87ad4e-b6a2-4a06-965f-66108dd9464f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.138403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87ad4e-b6a2-4a06-965f-66108dd9464f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.138671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87ad4e-b6a2-4a06-965f-66108dd9464f admin admin] PATH_INFO: `/v3/services/image` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.139318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87ad4e-b6a2-4a06-965f-66108dd9464f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.140907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87ad4e-b6a2-4a06-965f-66108dd9464f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.151609 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ed87ad4e-b6a2-4a06-965f-66108dd9464f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 25 20:46:01.152947 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 510/1012] 10.222.0.32 () {56 vars in 1126 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:01.159229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3509e9-5ad9-47c8-b141-3903ff0fbc2a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.168367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3509e9-5ad9-47c8-b141-3903ff0fbc2a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.173018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.173745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.174119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.174472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.175771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] RBAC: Adding query filter params (name=image) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:01.176167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.177764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.182707 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 503/1013] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:01.186219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86b33-6f82-4e03-a112-3c8df0050273 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.186507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86b33-6f82-4e03-a112-3c8df0050273 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.186787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86b33-6f82-4e03-a112-3c8df0050273 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.188571 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 511/1014] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:01.189921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.194507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1ec5-7a75-4e75-a99f-ea4946f92c3b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.194793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1ec5-7a75-4e75-a99f-ea4946f92c3b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.195072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b1ec5-7a75-4e75-a99f-ea4946f92c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.199825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d2286-332e-4d23-8fb7-30418e2fefc6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.204309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.204970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.205249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.205515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.206233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:01.206533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.208071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.212538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-da1b1ec5-7a75-4e75-a99f-ea4946f92c3b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:01.216915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 504/1015] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:01.217034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-da1b1ec5-7a75-4e75-a99f-ea4946f92c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:01.219107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.221870 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 512/1016] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:01 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:46:01.228296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439daa9b-75c6-47c2-85ed-501c647fcb72 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.232604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.233246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.233522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.233791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.234554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] RBAC: Adding query filter params (interface=public, service_id=0668d8455ce64258be8d02ff23ce55ea, region_id=RegionOne) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:01.234858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.236400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.241825 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 505/1017] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/endpoints?service_id=0668d8455ce64258be8d02ff23ce55ea&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:01.247398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b1ec5-7a75-4e75-a99f-ea4946f92c3b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.248161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.256993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b1ec5-7a75-4e75-a99f-ea4946f92c3b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.257970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf77d0-bb58-4dc7-8450-8d2e999f4c28 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.261709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.262477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.262850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.262954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.263142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] PATH_INFO: `/v3/services/compute` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.263564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.263780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.263877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.264100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.264810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.265392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.266598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.276901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 506/1018] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 20:46:01.277056 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 25 20:46:01.281060 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 513/1019] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:01.285007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.295247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d306cc5-2e55-43e7-ade9-0cd4338ae363 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.300003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.301235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.301514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.301784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.302511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] RBAC: Adding query filter params (name=compute) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:01.302818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.304463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.310303 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 507/1020] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:01.316696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.327317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc445-274e-4832-99ab-fe793f344fae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.332173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9f824-cac1-4acb-a912-19a0e2a0d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.332999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9f824-cac1-4acb-a912-19a0e2a0d82c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.333352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9f824-cac1-4acb-a912-19a0e2a0d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.333695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9f824-cac1-4acb-a912-19a0e2a0d82c admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.334523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9f824-cac1-4acb-a912-19a0e2a0d82c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:01.334901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9f824-cac1-4acb-a912-19a0e2a0d82c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.336598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9f824-cac1-4acb-a912-19a0e2a0d82c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.342646 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 514/1021] 10.222.0.32 () {56 vars in 1133 bytes} [Sat Dec 25 20:46:01 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:01.349595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:01.359840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab576a8b-aab8-429b-96b8-810579e83b3e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:01.365263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c61f9-7091-4d6b-bf39-996d1f777905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:01.366028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c61f9-7091-4d6b-bf39-996d1f777905 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:01.366375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c61f9-7091-4d6b-bf39-996d1f777905 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:01.366740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c61f9-7091-4d6b-bf39-996d1f777905 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:01.367581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c61f9-7091-4d6b-bf39-996d1f777905 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:01.369598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c61f9-7091-4d6b-bf39-996d1f777905 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:01.499292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 508/1022] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:46:01 2021] POST /identity/v3/endpoints => generated 334 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:03.127425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b293ebb-7571-49a1-9890-be25a8c54eee None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.127954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b293ebb-7571-49a1-9890-be25a8c54eee None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.128034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b293ebb-7571-49a1-9890-be25a8c54eee None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.129835 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 515/1023] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:03.135429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7ea1a-6e26-4df3-b609-8e683a6ee99c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.135800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7ea1a-6e26-4df3-b609-8e683a6ee99c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.136014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7ea1a-6e26-4df3-b609-8e683a6ee99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.153712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2de7ea1a-6e26-4df3-b609-8e683a6ee99c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:03.154888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2de7ea1a-6e26-4df3-b609-8e683a6ee99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:03.171416 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 509/1024] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:03 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:03.196546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b293ebb-7571-49a1-9890-be25a8c54eee None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:03.209107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b293ebb-7571-49a1-9890-be25a8c54eee None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:03.213462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890bf20-5c33-4629-ad76-b3a741940c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:03.214178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890bf20-5c33-4629-ad76-b3a741940c9f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.214463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890bf20-5c33-4629-ad76-b3a741940c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.214737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890bf20-5c33-4629-ad76-b3a741940c9f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.215910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890bf20-5c33-4629-ad76-b3a741940c9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:03.217601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890bf20-5c33-4629-ad76-b3a741940c9f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:03.219220 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 516/1025] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:03.225754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7ea1a-6e26-4df3-b609-8e683a6ee99c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:03.234696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7ea1a-6e26-4df3-b609-8e683a6ee99c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:03.239371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523e3a-3236-4a2e-a2d6-4a1190d25622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:03.240115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523e3a-3236-4a2e-a2d6-4a1190d25622 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.240398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523e3a-3236-4a2e-a2d6-4a1190d25622 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.240801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523e3a-3236-4a2e-a2d6-4a1190d25622 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.241547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523e3a-3236-4a2e-a2d6-4a1190d25622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:03.243671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2523e3a-3236-4a2e-a2d6-4a1190d25622 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:03.372757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 510/1026] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:46:03 2021] POST /identity/v3/projects => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:46:03.710769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bd0b-b8f0-4f67-aea5-6766db2333be None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.711141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bd0b-b8f0-4f67-aea5-6766db2333be None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.711326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bd0b-b8f0-4f67-aea5-6766db2333be None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.713273 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 517/1027] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:03.718869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070760c6-89f7-4bd4-ac15-2fc1406b8865 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.719285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070760c6-89f7-4bd4-ac15-2fc1406b8865 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.719565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070760c6-89f7-4bd4-ac15-2fc1406b8865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.737004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-070760c6-89f7-4bd4-ac15-2fc1406b8865 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:03.738675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-070760c6-89f7-4bd4-ac15-2fc1406b8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:03.794929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 511/1028] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:03 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:03.819719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1bd0b-b8f0-4f67-aea5-6766db2333be None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:03.834940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1bd0b-b8f0-4f67-aea5-6766db2333be None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:03.843519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:03.844365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.844642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.844937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] PATH_INFO: `/v3/services/image` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.845597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:03.847193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:03.858054 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 25 20:46:03.860155 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 518/1029] 10.222.0.32 () {56 vars in 1126 bytes} [Sat Dec 25 20:46:03 2021] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:03.865862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070760c6-89f7-4bd4-ac15-2fc1406b8865 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:03.875046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070760c6-89f7-4bd4-ac15-2fc1406b8865 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:03.880074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:03.880811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.881195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.881538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.882320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:03.882685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:03.884354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:03.889321 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 512/1030] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:03 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:03.895781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:03.906004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec6d34-e4f7-4dd0-806e-234c9388fe17 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:03.910561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0c78b-f53d-4805-9168-5c62ddf3b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:03.911198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c78b-f53d-4805-9168-5c62ddf3b7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.911472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c78b-f53d-4805-9168-5c62ddf3b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.911744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0c78b-f53d-4805-9168-5c62ddf3b7d3 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.912445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c78b-f53d-4805-9168-5c62ddf3b7d3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:03.912748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c78b-f53d-4805-9168-5c62ddf3b7d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:03.914368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0c78b-f53d-4805-9168-5c62ddf3b7d3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:03.919196 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 519/1031] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:03 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:03.925703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:03.935250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec486c-792c-46e8-8404-cc62333678c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:03.939829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:03.941161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:03.941522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:03.941859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:03.942674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:03.946659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.014822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e345d-7823-4d80-bcdc-eabdde2774c4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.015104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e345d-7823-4d80-bcdc-eabdde2774c4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.015375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e345d-7823-4d80-bcdc-eabdde2774c4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.017222 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 520/1032] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:46:04.022570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee5970-17da-47f0-9f6f-4a8b3e8bad1d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.022763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee5970-17da-47f0-9f6f-4a8b3e8bad1d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.023041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee5970-17da-47f0-9f6f-4a8b3e8bad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.036053 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 513/1033] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:46:03 2021] POST /identity/v3/endpoints => generated 327 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:46:04.048261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2fee5970-17da-47f0-9f6f-4a8b3e8bad1d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:04.049531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2fee5970-17da-47f0-9f6f-4a8b3e8bad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:04.069452 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 521/1034] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:46:04.095714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.106592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29845c56-0ec4-4666-b29c-88172ffe54c8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.111173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.112009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.112288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.113123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.124794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:04.132903 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 25 20:46:04.134153 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 514/1035] 10.222.0.32 () {56 vars in 1141 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:04.140852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee5970-17da-47f0-9f6f-4a8b3e8bad1d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.150129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee5970-17da-47f0-9f6f-4a8b3e8bad1d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.154840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.155512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.155791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.156065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.156825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:04.157172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.158771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.172304 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 522/1036] 10.222.0.32 () {56 vars in 1136 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:04.179765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.191319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f3de8-0838-419d-b6ba-cac9606b3c72 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.197394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.198291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.198651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.199001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.210560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.212563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.230295 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:46:04.231743 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 515/1037] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:04.238702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.249336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57081e9d-d37e-49c4-a379-173c3357570a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.254799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.255526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.255895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.256240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.257079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:04.257390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.259010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.271914 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 523/1038] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:04.278273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.289663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76d23e-4865-46db-b196-1ec372cb53d6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.294370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.295158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.295439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.295712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.303937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.306030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.320020 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:46:04.321592 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 516/1039] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:04.327740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.337715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58451a2f-2cda-4595-9930-27de6e505140 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.342282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.343028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.343377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.343791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.344676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:04.345072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.347496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.365317 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 524/1040] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:04.371817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.381642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef317c-ca95-455d-9cef-477483994d6e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.386296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.386935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.387213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.387500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.395517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.397342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.406589 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 517/1041] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:04.413761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.423549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca437-9bd9-4a50-8c60-c423e8f3a3a8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.428671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.429545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.429893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.430238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.440651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.442553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.463924 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:46:04.465257 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 525/1042] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:46:04.472564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.481567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d814-1f01-4891-b7f7-cd4b06d1315f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.486115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.486830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.487177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.488132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.488949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:04.489316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.490971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.502771 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 518/1043] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:04.509285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.519065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2c5b-1c2c-411c-a370-3e16e8f7dfd3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.523624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.524501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.524910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.525273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.532179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.534792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.547513 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:46:04.548940 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 526/1044] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:46:04.556073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.565649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eda11-9ca6-4516-a03c-61c0e0ce5554 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.570123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af166e39-7e14-4d7f-a90a-2ffd2f08fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.570771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166e39-7e14-4d7f-a90a-2ffd2f08fb8f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.571046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166e39-7e14-4d7f-a90a-2ffd2f08fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.571316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166e39-7e14-4d7f-a90a-2ffd2f08fb8f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.572094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af166e39-7e14-4d7f-a90a-2ffd2f08fb8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:04.572397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af166e39-7e14-4d7f-a90a-2ffd2f08fb8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.574241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af166e39-7e14-4d7f-a90a-2ffd2f08fb8f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.586841 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 519/1045] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:04.593227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:04.604160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3d911-df83-4adf-bb76-89b06bdd7be9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:04.608686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7fe05-c282-4978-8303-a10ed7ca5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:04.609445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7fe05-c282-4978-8303-a10ed7ca5ebb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:04.609842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7fe05-c282-4978-8303-a10ed7ca5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:04.610210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7fe05-c282-4978-8303-a10ed7ca5ebb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:04.611128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7fe05-c282-4978-8303-a10ed7ca5ebb admin admin] RBAC: Adding query filter params (role.id=d95a5a3b71ae4e669b519c06c80439d1, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79e05d879a534c6c890d4aea42c89975) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:04.611533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7fe05-c282-4978-8303-a10ed7ca5ebb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:04.614162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7fe05-c282-4978-8303-a10ed7ca5ebb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:04.620657 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 527/1046] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:04 2021] GET /identity/v3/role_assignments?user.id=79e05d879a534c6c890d4aea42c89975&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=d95a5a3b71ae4e669b519c06c80439d1 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:05.854112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0973-5d81-4fd2-9ae6-03e2a565c504 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:05.854628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0973-5d81-4fd2-9ae6-03e2a565c504 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:05.854739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca0973-5d81-4fd2-9ae6-03e2a565c504 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:05.856753 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 520/1047] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:46:05.863015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85444-75be-43ec-b93f-8d8acb301f58 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:05.863400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85444-75be-43ec-b93f-8d8acb301f58 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:05.863566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85444-75be-43ec-b93f-8d8acb301f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:05.881280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-adf85444-75be-43ec-b93f-8d8acb301f58 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:05.882461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-adf85444-75be-43ec-b93f-8d8acb301f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:05.891224 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 528/1048] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:05.918151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca0973-5d81-4fd2-9ae6-03e2a565c504 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:05.930768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca0973-5d81-4fd2-9ae6-03e2a565c504 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:05.935105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e9d62-ef05-40a6-8592-4fb01125b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:05.935892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e9d62-ef05-40a6-8592-4fb01125b5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:05.936176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e9d62-ef05-40a6-8592-4fb01125b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:05.936453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e9d62-ef05-40a6-8592-4fb01125b5b3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:05.937672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e9d62-ef05-40a6-8592-4fb01125b5b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:05.939339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e9d62-ef05-40a6-8592-4fb01125b5b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:05.941122 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 521/1049] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:05.947541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85444-75be-43ec-b93f-8d8acb301f58 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:05.957135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85444-75be-43ec-b93f-8d8acb301f58 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:05.964749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33373-659b-42eb-b543-a6112538cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:05.965447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33373-659b-42eb-b543-a6112538cee1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:05.965723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33373-659b-42eb-b543-a6112538cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:05.965991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33373-659b-42eb-b543-a6112538cee1 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:05.966696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33373-659b-42eb-b543-a6112538cee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:05.968572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33373-659b-42eb-b543-a6112538cee1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:06.092823 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 529/1050] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:46:05 2021] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:06.521591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088c3c-659b-435c-89d4-7220b024eb34 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:06.521986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088c3c-659b-435c-89d4-7220b024eb34 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:06.522181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088c3c-659b-435c-89d4-7220b024eb34 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:06.524050 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 522/1051] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:06.529695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712a99-deec-499e-9197-6e2fd04a8985 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:06.529986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712a99-deec-499e-9197-6e2fd04a8985 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:06.530263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712a99-deec-499e-9197-6e2fd04a8985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:06.547787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a6712a99-deec-499e-9197-6e2fd04a8985 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:06.548984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a6712a99-deec-499e-9197-6e2fd04a8985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:06.556756 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 530/1052] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:06.582182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088c3c-659b-435c-89d4-7220b024eb34 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:06.594863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088c3c-659b-435c-89d4-7220b024eb34 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:06.599542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdac62-331c-46f3-b8a9-99996f8be08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:06.600824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdac62-331c-46f3-b8a9-99996f8be08c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:06.600824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdac62-331c-46f3-b8a9-99996f8be08c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:06.600824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdac62-331c-46f3-b8a9-99996f8be08c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:06.610918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdac62-331c-46f3-b8a9-99996f8be08c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:06.612725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdac62-331c-46f3-b8a9-99996f8be08c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:06.623138 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 523/1053] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:06.630071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6712a99-deec-499e-9197-6e2fd04a8985 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:06.645937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6712a99-deec-499e-9197-6e2fd04a8985 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:06.651808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ec397-36a0-4826-954f-6f1573e60624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:06.652664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ec397-36a0-4826-954f-6f1573e60624 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:06.652981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ec397-36a0-4826-954f-6f1573e60624 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:06.653258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ec397-36a0-4826-954f-6f1573e60624 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:06.654441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ec397-36a0-4826-954f-6f1573e60624 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:06.656130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ec397-36a0-4826-954f-6f1573e60624 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:06.657975 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 531/1054] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:07.013999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151019-9b69-4182-96d5-7925df8c8c3d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.014532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151019-9b69-4182-96d5-7925df8c8c3d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.014532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151019-9b69-4182-96d5-7925df8c8c3d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.016433 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 524/1055] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:07.021874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a34b8-368d-4927-a41d-f0383b6d321b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.022246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a34b8-368d-4927-a41d-f0383b6d321b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.022500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a34b8-368d-4927-a41d-f0383b6d321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.040091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-998a34b8-368d-4927-a41d-f0383b6d321b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:07.041376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-998a34b8-368d-4927-a41d-f0383b6d321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:07.049072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 532/1056] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:07.074211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151019-9b69-4182-96d5-7925df8c8c3d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.086534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151019-9b69-4182-96d5-7925df8c8c3d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.090834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.091619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.091895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.092163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.102009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:07.109306 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 25 20:46:07.110452 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 525/1057] 10.222.0.32 () {56 vars in 1141 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:07.117190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a34b8-368d-4927-a41d-f0383b6d321b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.126242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a34b8-368d-4927-a41d-f0383b6d321b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.131237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.131873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.132149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.132423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.133190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:07.133492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.135092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.143046 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 533/1058] 10.222.0.32 () {56 vars in 1136 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:07.148961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.158832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b30e7-5669-4619-956d-68188f0c0408 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.163332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.164082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.164356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.164622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.174484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.176791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.193287 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:46:07.194384 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 526/1059] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:07.200387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.209916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33bf61-465a-484a-a64c-402d28b42c1b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.214399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.214978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.215253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.215524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.216236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:07.216539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.218134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.229801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 534/1060] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:07.235520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.245888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d29567-df0d-43e0-907e-917585480a05 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.250296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.251056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.251332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.251598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.259181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.261198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.274675 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:46:07.275985 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 527/1061] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:07.281949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.292198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f368b0-bade-4e44-9004-e6632a611e23 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.296713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.297404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.297689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.297966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.298796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:07.299109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.301578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.319221 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 535/1062] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:07.325653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.335759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b97ab-df2c-425d-a5fc-2f593b180181 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.340233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.341043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.341315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.341582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.352126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.353999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.371865 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:46:07.373230 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 528/1063] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:07.379338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.389186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529566c-6290-44ea-b098-5fd1cd89f1c5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.393801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.394434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.394712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.394979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.395690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:07.395988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.397635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.408586 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 536/1064] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:07.415014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.424704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a14810-efab-4ec8-9f6e-853cdd2c9886 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.429857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.430626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.430903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.431225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.437876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.439802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.452632 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:46:07.453896 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 529/1065] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:07.460132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.469751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeda65-6acc-4965-82d9-a025172ad030 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.474690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430be8e-5e0f-4078-b55e-0a8b30260f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.475322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430be8e-5e0f-4078-b55e-0a8b30260f63 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.475601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430be8e-5e0f-4078-b55e-0a8b30260f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.475874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430be8e-5e0f-4078-b55e-0a8b30260f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.476647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430be8e-5e0f-4078-b55e-0a8b30260f63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:07.476994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430be8e-5e0f-4078-b55e-0a8b30260f63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.478807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430be8e-5e0f-4078-b55e-0a8b30260f63 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.491388 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 537/1066] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:46:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:07.498007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:07.508176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbca61-1a89-42ff-8681-0ceb27780b15 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:07.512571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54de1-543b-46ad-8207-c8da92177939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:07.513462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54de1-543b-46ad-8207-c8da92177939 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:07.513737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54de1-543b-46ad-8207-c8da92177939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:07.514001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54de1-543b-46ad-8207-c8da92177939 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79e05d879a534c6c890d4aea42c89975/roles/d95a5a3b71ae4e669b519c06c80439d1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:07.516171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54de1-543b-46ad-8207-c8da92177939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=79e05d879a534c6c890d4aea42c89975, role_id=d95a5a3b71ae4e669b519c06c80439d1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:07.518781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54de1-543b-46ad-8207-c8da92177939 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:07.623764 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 530/1067] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:46:07 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79e05d879a534c6c890d4aea42c89975/roles/d95a5a3b71ae4e669b519c06c80439d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:46:08.547530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07c62-a379-40a7-9e0d-3eee4a9429ee None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.548101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07c62-a379-40a7-9e0d-3eee4a9429ee None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.548101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07c62-a379-40a7-9e0d-3eee4a9429ee None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.550412 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 538/1068] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:08.556280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f0bf-0a4d-4089-8dc8-61b1ba007b24 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.556705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f0bf-0a4d-4089-8dc8-61b1ba007b24 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.556812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17f0bf-0a4d-4089-8dc8-61b1ba007b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.574422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0d17f0bf-0a4d-4089-8dc8-61b1ba007b24 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:08.575582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0d17f0bf-0a4d-4089-8dc8-61b1ba007b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:08.630466 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 531/1069] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:08.655867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07c62-a379-40a7-9e0d-3eee4a9429ee None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:08.667806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07c62-a379-40a7-9e0d-3eee4a9429ee None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:08.672052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:08.672813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.673153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.673423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.683877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:08.691192 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:08.692343 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 539/1070] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:08.698841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17f0bf-0a4d-4089-8dc8-61b1ba007b24 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:08.707979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17f0bf-0a4d-4089-8dc8-61b1ba007b24 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:08.712583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:08.713266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.713546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.713817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.714570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:08.714877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:08.716451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:08.724668 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 532/1071] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:08.730965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:08.741708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f6a5b-eca5-44ac-b28a-4936409abbbb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:08.746389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:08.747225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.747503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.747836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] PATH_INFO: `/v3/users/26673660add149059b0d136bcdcb6149` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.761267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] RBAC: Authorizing `identity:get_user(user_id=26673660add149059b0d136bcdcb6149)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:08.763358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:08.764998 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 540/1072] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:08 2021] GET /identity/v3/users/26673660add149059b0d136bcdcb6149 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:08.771249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:08.781097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05f89a-15ee-44c9-9aac-bbfa24059f9a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:08.786402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:08.790189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.790189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.790189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.796595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:08.798535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:08.808468 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 533/1073] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:08.815485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:08.825235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395d0d-30dd-4dd1-bca4-36564cd67623 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:08.829768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71874205-137c-4fb9-b664-8f21cee07c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:08.830603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874205-137c-4fb9-b664-8f21cee07c2e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.830934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874205-137c-4fb9-b664-8f21cee07c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.831230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874205-137c-4fb9-b664-8f21cee07c2e admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.832411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71874205-137c-4fb9-b664-8f21cee07c2e admin admin] RBAC: Authorizing `identity:get_project(project_id=215df681754540f9b74ab01d8f7eee00)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:08.834470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71874205-137c-4fb9-b664-8f21cee07c2e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:08.836144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 541/1074] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:08 2021] GET /identity/v3/projects/215df681754540f9b74ab01d8f7eee00 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:08.844371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:08.853813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41a6e-2558-4eef-8727-b3f3bfe89486 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:08.858375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221540c-dd58-46e8-9bcf-2044de927404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:08.859004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221540c-dd58-46e8-9bcf-2044de927404 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:08.859365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221540c-dd58-46e8-9bcf-2044de927404 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:08.859643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221540c-dd58-46e8-9bcf-2044de927404 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:08.860468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221540c-dd58-46e8-9bcf-2044de927404 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=215df681754540f9b74ab01d8f7eee00, user.id=26673660add149059b0d136bcdcb6149) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:08.860781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221540c-dd58-46e8-9bcf-2044de927404 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:08.863285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221540c-dd58-46e8-9bcf-2044de927404 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:08.869810 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 534/1075] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:08 2021] GET /identity/v3/role_assignments?user.id=26673660add149059b0d136bcdcb6149&scope.project.id=215df681754540f9b74ab01d8f7eee00&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:10.022527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28dba7-ab46-462c-ab73-a2d471bdfebd None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.023127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28dba7-ab46-462c-ab73-a2d471bdfebd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.023257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28dba7-ab46-462c-ab73-a2d471bdfebd None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.025069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 542/1076] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:10.031130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7ec2-3db9-4755-be11-f8b5cb1b6b98 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.031674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7ec2-3db9-4755-be11-f8b5cb1b6b98 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.031674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce7ec2-3db9-4755-be11-f8b5cb1b6b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.049564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e9ce7ec2-3db9-4755-be11-f8b5cb1b6b98 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:10.051241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e9ce7ec2-3db9-4755-be11-f8b5cb1b6b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:10.058901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 535/1077] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:10.084912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28dba7-ab46-462c-ab73-a2d471bdfebd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.096849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28dba7-ab46-462c-ab73-a2d471bdfebd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.101201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.102004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.102278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.102546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.112727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:10.120073 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 25 20:46:10.121220 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 543/1078] 10.222.0.32 () {56 vars in 1141 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:10.127611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7ec2-3db9-4755-be11-f8b5cb1b6b98 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.137040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce7ec2-3db9-4755-be11-f8b5cb1b6b98 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.141535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.142176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.142450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.142717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.143502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:10.143805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.145396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.153322 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 536/1079] 10.222.0.32 () {56 vars in 1136 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:10.159464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.169471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f24543-3715-4794-9889-56a112278929 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.173869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.175138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.175418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.175686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.185799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.187599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.204458 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:46:10.205622 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 544/1080] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:10.211908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.221402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39dfeb-c080-4cf3-bde7-58e9579a06e3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.225906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.226551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.226832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.227106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.227828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:10.228133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.229743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.241829 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 537/1081] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:10.248366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.258594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559edeb-c88c-4e59-a8bd-0a031d7eea22 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.263125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.263900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.264174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.264441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.271837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.273859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.287663 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 25 20:46:10.288801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 545/1082] 10.222.0.32 () {56 vars in 1114 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:10.295512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.305686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018351-a18b-45e5-b608-39a57562ca9c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.310202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.310855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.311137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.311413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.312250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:10.312558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.314415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.330964 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 538/1083] 10.222.0.32 () {56 vars in 1154 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:10.338087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.348225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc70252-b37c-4938-bbf7-00f09d899886 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.352715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.353381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.353666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.353939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.361565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.363919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.373049 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 546/1084] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:10.380064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.389554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8c6c7-1e33-43cc-8695-4bff58b6f90d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.394154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.394924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.395215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.395476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.405542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.407330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.424058 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:46:10.425739 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 539/1085] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:10.432976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.441865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b3dd8-e37c-424c-8267-ff5690de9dee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.446542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.447239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.447587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.447926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.448712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:10.449135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.450806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.461725 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 547/1086] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:10.467492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.477308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f81aa4-0f73-4ed8-82f5-6da09a0e8f2c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.481843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.482600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.482881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.483157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.490334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.492251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.505087 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:46:10.508953 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 540/1087] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:46:10.512142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.521435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6e77-4bf1-4ae4-a5d4-f9a805d580a4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.525879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7659e-b4ba-4f65-97ca-eac803d325d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.526499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7659e-b4ba-4f65-97ca-eac803d325d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.526780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7659e-b4ba-4f65-97ca-eac803d325d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.527052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7659e-b4ba-4f65-97ca-eac803d325d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.527823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7659e-b4ba-4f65-97ca-eac803d325d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:10.528134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7659e-b4ba-4f65-97ca-eac803d325d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.530046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7659e-b4ba-4f65-97ca-eac803d325d1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.542264 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 548/1088] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:10.548356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:10.559048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e335c-2edd-4cd5-b347-f7bd3684cbdd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:10.563510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c1c9-2ec0-4ca9-991d-7552d21d3d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:10.564128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c1c9-2ec0-4ca9-991d-7552d21d3d4d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:10.564407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c1c9-2ec0-4ca9-991d-7552d21d3d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:10.564678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c1c9-2ec0-4ca9-991d-7552d21d3d4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:10.565536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c1c9-2ec0-4ca9-991d-7552d21d3d4d admin admin] RBAC: Adding query filter params (role.id=d95a5a3b71ae4e669b519c06c80439d1, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79e05d879a534c6c890d4aea42c89975) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:10.565846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c1c9-2ec0-4ca9-991d-7552d21d3d4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:10.567647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c1c9-2ec0-4ca9-991d-7552d21d3d4d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:10.573484 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 541/1089] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:10 2021] GET /identity/v3/role_assignments?user.id=79e05d879a534c6c890d4aea42c89975&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=d95a5a3b71ae4e669b519c06c80439d1 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:11.313224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47c5b5-f793-4767-bee6-118ca43a7c2f None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:11.313734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47c5b5-f793-4767-bee6-118ca43a7c2f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:11.313843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47c5b5-f793-4767-bee6-118ca43a7c2f None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:11.316061 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 549/1090] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:11.322035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d03b9-5ab9-45ba-a1ae-17cb7d880ae1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:11.322462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d03b9-5ab9-45ba-a1ae-17cb7d880ae1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:11.322565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d03b9-5ab9-45ba-a1ae-17cb7d880ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:11.340315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-668d03b9-5ab9-45ba-a1ae-17cb7d880ae1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:11.341569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-668d03b9-5ab9-45ba-a1ae-17cb7d880ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:11.349443 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 542/1091] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:11.374284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47c5b5-f793-4767-bee6-118ca43a7c2f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:11.387546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47c5b5-f793-4767-bee6-118ca43a7c2f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:11.392077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:11.392852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:11.393163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:11.394074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:11.404499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:11.411405 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:11.412708 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 550/1092] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:11.419340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d03b9-5ab9-45ba-a1ae-17cb7d880ae1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:11.429334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d03b9-5ab9-45ba-a1ae-17cb7d880ae1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:11.434087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:11.440929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:11.440929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:11.440929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:11.440929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:11.440929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:11.440929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:11.447371 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 543/1093] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:11.453799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:11.464267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d57c86-681b-41c9-85d5-ac6715cd3028 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:11.468759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:11.469624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:11.469902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:11.470167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] PATH_INFO: `/v3/users/26673660add149059b0d136bcdcb6149` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:11.471341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] RBAC: Authorizing `identity:get_user(user_id=26673660add149059b0d136bcdcb6149)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:11.473491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:11.475038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 551/1094] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:11 2021] GET /identity/v3/users/26673660add149059b0d136bcdcb6149 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:11.481252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:11.491232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3780f-f6b3-4b76-9c19-aea210bd796f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:11.496485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a77e10-9ed3-4487-a920-6adde0d1df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:11.496814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77e10-9ed3-4487-a920-6adde0d1df91 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:11.497125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77e10-9ed3-4487-a920-6adde0d1df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:11.497392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77e10-9ed3-4487-a920-6adde0d1df91 admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:11.498550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a77e10-9ed3-4487-a920-6adde0d1df91 admin admin] RBAC: Authorizing `identity:get_project(project_id=215df681754540f9b74ab01d8f7eee00)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:11.500525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a77e10-9ed3-4487-a920-6adde0d1df91 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:11.502175 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 544/1095] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:11 2021] GET /identity/v3/projects/215df681754540f9b74ab01d8f7eee00 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:11.508742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:11.518274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc145-fb42-447e-acd7-306a739bb052 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:11.522783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabec6a-1da8-44ac-a3ef-b7d79e1241c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:11.523642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabec6a-1da8-44ac-a3ef-b7d79e1241c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:11.523923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabec6a-1da8-44ac-a3ef-b7d79e1241c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:11.525313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabec6a-1da8-44ac-a3ef-b7d79e1241c0 admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00/users/26673660add149059b0d136bcdcb6149/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:11.526237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabec6a-1da8-44ac-a3ef-b7d79e1241c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215df681754540f9b74ab01d8f7eee00, user_id=26673660add149059b0d136bcdcb6149, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:11.530250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabec6a-1da8-44ac-a3ef-b7d79e1241c0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:11.623545 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 552/1096] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:46:11 2021] PUT /identity/v3/projects/215df681754540f9b74ab01d8f7eee00/users/26673660add149059b0d136bcdcb6149/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:46:13.987597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f35b6-e2f7-4b8c-85c3-721888c17aae None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:13.988006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f35b6-e2f7-4b8c-85c3-721888c17aae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:13.988149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f35b6-e2f7-4b8c-85c3-721888c17aae None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:13.989949 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 545/1097] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:13.995936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452422-f4c6-4c35-926c-a970e8783f63 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:13.996313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452422-f4c6-4c35-926c-a970e8783f63 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:13.996557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452422-f4c6-4c35-926c-a970e8783f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:14.014292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2a452422-f4c6-4c35-926c-a970e8783f63 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:14.015466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a452422-f4c6-4c35-926c-a970e8783f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:14.069805 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 553/1098] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:14.095187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f35b6-e2f7-4b8c-85c3-721888c17aae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:14.106991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f35b6-e2f7-4b8c-85c3-721888c17aae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:14.111275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:14.112037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:14.112317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:14.112589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:14.123125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:14.130400 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:14.131504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 546/1099] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:14.137549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a452422-f4c6-4c35-926c-a970e8783f63 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:14.146784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a452422-f4c6-4c35-926c-a970e8783f63 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:14.151229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:14.151866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:14.152149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:14.152423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:14.153213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:14.153520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:14.155101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:14.163046 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 554/1100] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:14.169026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:14.178273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65fe4c-4c4a-43c4-8e0d-000fe79a760b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:14.182685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:14.183501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:14.183776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:14.184045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] PATH_INFO: `/v3/users/26673660add149059b0d136bcdcb6149` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:14.185256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=26673660add149059b0d136bcdcb6149)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:14.187331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:14.188860 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 547/1101] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:14 2021] GET /identity/v3/users/26673660add149059b0d136bcdcb6149 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:14.195027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:14.204108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadcaa1-6378-418a-b9d0-8096cbead968 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:14.209115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:14.209710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:14.209987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:14.210257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:14.217784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:14.219417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:14.228343 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 555/1102] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:46:14.234561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:14.244124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d65c-a1c6-4aed-95d6-a8544c617bb6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:14.248542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a1479-2b7e-4d85-97a4-e0440d243661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:14.249375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a1479-2b7e-4d85-97a4-e0440d243661 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:14.249653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a1479-2b7e-4d85-97a4-e0440d243661 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:14.249923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a1479-2b7e-4d85-97a4-e0440d243661 admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:14.251077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a1479-2b7e-4d85-97a4-e0440d243661 admin admin] RBAC: Authorizing `identity:get_project(project_id=215df681754540f9b74ab01d8f7eee00)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:14.253570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a1479-2b7e-4d85-97a4-e0440d243661 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:14.255159 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 548/1103] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:14 2021] GET /identity/v3/projects/215df681754540f9b74ab01d8f7eee00 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:14.261501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:14.270610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a28a3-8c45-402f-816c-27d59de36b8b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:14.275212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747c4b-c617-4ff9-862a-99926af22ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:14.275819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747c4b-c617-4ff9-862a-99926af22ade admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:14.276095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747c4b-c617-4ff9-862a-99926af22ade admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:14.276364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747c4b-c617-4ff9-862a-99926af22ade admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:14.277224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747c4b-c617-4ff9-862a-99926af22ade admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=215df681754540f9b74ab01d8f7eee00, user.id=26673660add149059b0d136bcdcb6149) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:14.277531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747c4b-c617-4ff9-862a-99926af22ade admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:14.279310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747c4b-c617-4ff9-862a-99926af22ade admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:14.285070 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 556/1104] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:14 2021] GET /identity/v3/role_assignments?user.id=26673660add149059b0d136bcdcb6149&scope.project.id=215df681754540f9b74ab01d8f7eee00&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:16.710849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545f6f3-1938-4045-8080-431632ba9a04 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:16.712344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545f6f3-1938-4045-8080-431632ba9a04 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:16.712344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545f6f3-1938-4045-8080-431632ba9a04 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:16.713207 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 549/1105] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:16.719267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9eb4b-767e-4ac1-8e72-56fb7585feae None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:16.719682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9eb4b-767e-4ac1-8e72-56fb7585feae None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:16.719808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9eb4b-767e-4ac1-8e72-56fb7585feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:16.737549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-14b9eb4b-767e-4ac1-8e72-56fb7585feae None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:16.738715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-14b9eb4b-767e-4ac1-8e72-56fb7585feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:16.746459 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 557/1106] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:46:16.773217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545f6f3-1938-4045-8080-431632ba9a04 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:16.785620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545f6f3-1938-4045-8080-431632ba9a04 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:16.789867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1ae3-86eb-46fb-bd35-366199166354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:16.790630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1ae3-86eb-46fb-bd35-366199166354 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:16.790905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1ae3-86eb-46fb-bd35-366199166354 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:16.791173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1ae3-86eb-46fb-bd35-366199166354 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:16.792352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a1ae3-86eb-46fb-bd35-366199166354 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:16.794025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a1ae3-86eb-46fb-bd35-366199166354 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:16.795557 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 550/1107] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:16.801215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9eb4b-767e-4ac1-8e72-56fb7585feae None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:16.809755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9eb4b-767e-4ac1-8e72-56fb7585feae None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:16.814168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d5539-9458-4f49-8299-24e38a38854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:16.814795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5539-9458-4f49-8299-24e38a38854c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:16.815072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5539-9458-4f49-8299-24e38a38854c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:16.815343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d5539-9458-4f49-8299-24e38a38854c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:16.816044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d5539-9458-4f49-8299-24e38a38854c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:16.817944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d5539-9458-4f49-8299-24e38a38854c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:16.930766 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 558/1108] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:46:16 2021] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:46:19.336512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443b42-323a-4069-b6e5-2a26695935fa None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:19.337066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443b42-323a-4069-b6e5-2a26695935fa None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:19.337066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443b42-323a-4069-b6e5-2a26695935fa None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:19.338830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 551/1109] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:19.344562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906591-183b-46c8-9002-cbfeec65718e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:19.344969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906591-183b-46c8-9002-cbfeec65718e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:19.345160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906591-183b-46c8-9002-cbfeec65718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:19.362339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9d906591-183b-46c8-9002-cbfeec65718e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:19.363546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d906591-183b-46c8-9002-cbfeec65718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:19.371316 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 559/1110] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:19.397607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443b42-323a-4069-b6e5-2a26695935fa None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:19.409198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443b42-323a-4069-b6e5-2a26695935fa None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:19.413402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:19.414219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:19.414494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:19.414762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] PATH_INFO: `/v3/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:19.416192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] RBAC: Authorizing `identity:get_role(role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:19.417206 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:46:19.417206 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:46:19.417206 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:46:19.418055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:19.419322 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 552/1111] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:19 2021] GET /identity/v3/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:19.424865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d906591-183b-46c8-9002-cbfeec65718e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:19.433556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d906591-183b-46c8-9002-cbfeec65718e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:19.438036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:19.438867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:19.439146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:19.439420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] PATH_INFO: `/v3/users/4cbd6b511dad463db9ca90b4816bfc0f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:19.453438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] RBAC: Authorizing `identity:get_user(user_id=4cbd6b511dad463db9ca90b4816bfc0f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:19.455535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:19.457772 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 560/1112] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:19 2021] GET /identity/v3/users/4cbd6b511dad463db9ca90b4816bfc0f => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:19.463568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:19.472729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad01e6-ff18-4785-a042-4e334b95b730 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:19.477111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:19.477715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:19.477990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:19.478260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:19.485862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:19.487871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:19.497098 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 553/1113] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:19 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:19.502999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:19.512840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c8551-1a45-4f36-a424-324b50844b16 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:19.517337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c3e4e-6bdc-4371-b097-0ecd4c1f584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:19.518162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c3e4e-6bdc-4371-b097-0ecd4c1f584b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:19.518443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c3e4e-6bdc-4371-b097-0ecd4c1f584b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:19.518716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c3e4e-6bdc-4371-b097-0ecd4c1f584b admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:19.520520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c3e4e-6bdc-4371-b097-0ecd4c1f584b admin admin] RBAC: Authorizing `identity:get_project(project_id=215df681754540f9b74ab01d8f7eee00)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:19.522690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c3e4e-6bdc-4371-b097-0ecd4c1f584b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:19.524425 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 561/1114] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:19 2021] GET /identity/v3/projects/215df681754540f9b74ab01d8f7eee00 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:19.530398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:19.539074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85927b01-5470-4a4a-8185-6b3a0172bbd6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:19.543496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af76c8b-ba9c-4677-a9c9-c7842773b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:19.544112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af76c8b-ba9c-4677-a9c9-c7842773b111 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:19.544387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af76c8b-ba9c-4677-a9c9-c7842773b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:19.544655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af76c8b-ba9c-4677-a9c9-c7842773b111 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:19.545508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af76c8b-ba9c-4677-a9c9-c7842773b111 admin admin] RBAC: Adding query filter params (role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=215df681754540f9b74ab01d8f7eee00, user.id=4cbd6b511dad463db9ca90b4816bfc0f) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:19.545815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af76c8b-ba9c-4677-a9c9-c7842773b111 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:19.547604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af76c8b-ba9c-4677-a9c9-c7842773b111 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:19.552748 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 554/1115] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:19 2021] GET /identity/v3/role_assignments?user.id=4cbd6b511dad463db9ca90b4816bfc0f&scope.project.id=215df681754540f9b74ab01d8f7eee00&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:21.899042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585b6c-3c87-4da3-8969-48e1ed588939 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:21.899564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585b6c-3c87-4da3-8969-48e1ed588939 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:21.899655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585b6c-3c87-4da3-8969-48e1ed588939 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:21.901397 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 562/1116] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:21.907107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf7611-aa20-47da-8662-aced4a07e68e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:21.907472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf7611-aa20-47da-8662-aced4a07e68e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:21.907652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf7611-aa20-47da-8662-aced4a07e68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:21.924803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-92cf7611-aa20-47da-8662-aced4a07e68e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:21.925996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-92cf7611-aa20-47da-8662-aced4a07e68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:21.933923 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 555/1117] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:21.958465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e585b6c-3c87-4da3-8969-48e1ed588939 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:21.970482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e585b6c-3c87-4da3-8969-48e1ed588939 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:21.974779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:21.975599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:21.975879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:21.976151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] PATH_INFO: `/v3/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:21.977648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] RBAC: Authorizing `identity:get_role(role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:21.978651 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:46:21.978651 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 20:46:21.978651 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 20:46:21.979514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:21.980816 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 563/1118] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:21 2021] GET /identity/v3/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:21.986918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf7611-aa20-47da-8662-aced4a07e68e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:21.996384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf7611-aa20-47da-8662-aced4a07e68e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:22.000811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:22.001690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:22.001965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:22.002235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] PATH_INFO: `/v3/users/4cbd6b511dad463db9ca90b4816bfc0f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:22.003415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] RBAC: Authorizing `identity:get_user(user_id=4cbd6b511dad463db9ca90b4816bfc0f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:22.006124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:22.007663 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 556/1119] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:21 2021] GET /identity/v3/users/4cbd6b511dad463db9ca90b4816bfc0f => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:22.013267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:22.022456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1577b9-b810-4b72-bc55-a990e813a65e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:22.026921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735e350-1fbc-4812-bf8a-a7f936c68fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:22.027706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735e350-1fbc-4812-bf8a-a7f936c68fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:22.027985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735e350-1fbc-4812-bf8a-a7f936c68fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:22.028256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735e350-1fbc-4812-bf8a-a7f936c68fa8 admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:22.029439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735e350-1fbc-4812-bf8a-a7f936c68fa8 admin admin] RBAC: Authorizing `identity:get_project(project_id=215df681754540f9b74ab01d8f7eee00)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:22.031388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735e350-1fbc-4812-bf8a-a7f936c68fa8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:22.033030 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 564/1120] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:22 2021] GET /identity/v3/projects/215df681754540f9b74ab01d8f7eee00 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:22.038677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:22.047692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75967acd-d1ba-4c12-b910-6345400aee1d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:22.052576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea9bb5-1f2e-41b0-889b-c130cc1ea4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:22.053423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9bb5-1f2e-41b0-889b-c130cc1ea4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:22.053700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9bb5-1f2e-41b0-889b-c130cc1ea4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:22.053972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9bb5-1f2e-41b0-889b-c130cc1ea4ab admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00/users/4cbd6b511dad463db9ca90b4816bfc0f/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:22.056108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea9bb5-1f2e-41b0-889b-c130cc1ea4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=215df681754540f9b74ab01d8f7eee00, user_id=4cbd6b511dad463db9ca90b4816bfc0f, role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:22.058650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea9bb5-1f2e-41b0-889b-c130cc1ea4ab admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:22.125493 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 557/1121] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:46:22 2021] PUT /identity/v3/projects/215df681754540f9b74ab01d8f7eee00/users/4cbd6b511dad463db9ca90b4816bfc0f/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:46:24.495783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcb7e7-f7f2-4a92-a430-33d4972c231b None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:24.496311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcb7e7-f7f2-4a92-a430-33d4972c231b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:24.496311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcb7e7-f7f2-4a92-a430-33d4972c231b None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:24.498108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 565/1122] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:24.503758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9651b-abf9-4fac-83ae-094595df0020 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:24.504690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9651b-abf9-4fac-83ae-094595df0020 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:24.504781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9651b-abf9-4fac-83ae-094595df0020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:24.522462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5ce9651b-abf9-4fac-83ae-094595df0020 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:24.523632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5ce9651b-abf9-4fac-83ae-094595df0020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:24.579378 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 558/1123] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:46:24.604886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcb7e7-f7f2-4a92-a430-33d4972c231b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:24.616667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcb7e7-f7f2-4a92-a430-33d4972c231b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:24.621194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:24.622015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:24.622292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:24.622558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] PATH_INFO: `/v3/roles/d06e1d3c0c084a0996574fae97bc99a1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:24.624000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] RBAC: Authorizing `identity:get_role(role_id=d06e1d3c0c084a0996574fae97bc99a1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:24.625596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:24.626873 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 566/1124] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:24 2021] GET /identity/v3/roles/d06e1d3c0c084a0996574fae97bc99a1 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:24.633136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9651b-abf9-4fac-83ae-094595df0020 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:24.641692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9651b-abf9-4fac-83ae-094595df0020 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:24.646685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:24.647525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:24.647802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:24.648072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] PATH_INFO: `/v3/users/4cbd6b511dad463db9ca90b4816bfc0f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:24.649299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=4cbd6b511dad463db9ca90b4816bfc0f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:24.651372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:24.652955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 559/1125] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:24 2021] GET /identity/v3/users/4cbd6b511dad463db9ca90b4816bfc0f => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:24.658402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:24.667322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b566-98be-49e2-857f-cd93c146260e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:24.671604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:24.672176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:24.672453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:24.672724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:24.680187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:24.681854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:24.690773 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 567/1126] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:46:24.697244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:24.706860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c150d8-2e76-4f32-9fa3-ca351dac58e7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:24.711926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cd0a-9244-4158-a5fb-7aa5893cb307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:24.712757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cd0a-9244-4158-a5fb-7aa5893cb307 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:24.713074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cd0a-9244-4158-a5fb-7aa5893cb307 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:24.713350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cd0a-9244-4158-a5fb-7aa5893cb307 admin admin] PATH_INFO: `/v3/projects/215df681754540f9b74ab01d8f7eee00` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:24.714551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cd0a-9244-4158-a5fb-7aa5893cb307 admin admin] RBAC: Authorizing `identity:get_project(project_id=215df681754540f9b74ab01d8f7eee00)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:24.716545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cd0a-9244-4158-a5fb-7aa5893cb307 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:24.718208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 560/1127] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:24 2021] GET /identity/v3/projects/215df681754540f9b74ab01d8f7eee00 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:24.724703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:24.733545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d04732-3631-40d8-85f4-2ffc2c60b2a3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:24.738653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdd9ca-eb8f-44dd-a072-a9e3ac5a75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:24.739289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd9ca-eb8f-44dd-a072-a9e3ac5a75ec admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:24.739573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd9ca-eb8f-44dd-a072-a9e3ac5a75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:24.739849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd9ca-eb8f-44dd-a072-a9e3ac5a75ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:24.740681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd9ca-eb8f-44dd-a072-a9e3ac5a75ec admin admin] RBAC: Adding query filter params (role.id=d06e1d3c0c084a0996574fae97bc99a1, scope.project.id=215df681754540f9b74ab01d8f7eee00, user.id=4cbd6b511dad463db9ca90b4816bfc0f) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:24.741038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd9ca-eb8f-44dd-a072-a9e3ac5a75ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:24.743125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd9ca-eb8f-44dd-a072-a9e3ac5a75ec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:24.748933 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 568/1128] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:24 2021] GET /identity/v3/role_assignments?user.id=4cbd6b511dad463db9ca90b4816bfc0f&scope.project.id=215df681754540f9b74ab01d8f7eee00&role.id=d06e1d3c0c084a0996574fae97bc99a1 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:27.157203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434734a2-d15e-4877-8841-808fa926b198 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:27.157727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434734a2-d15e-4877-8841-808fa926b198 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:27.157727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434734a2-d15e-4877-8841-808fa926b198 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:27.159857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 561/1129] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:27.168250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603114c-6831-4665-b823-0b2232933137 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:27.168769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603114c-6831-4665-b823-0b2232933137 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:27.168859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603114c-6831-4665-b823-0b2232933137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:27.188718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c603114c-6831-4665-b823-0b2232933137 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:27.189935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c603114c-6831-4665-b823-0b2232933137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:27.197564 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 569/1130] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:27.223711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434734a2-d15e-4877-8841-808fa926b198 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:27.235564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434734a2-d15e-4877-8841-808fa926b198 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:27.239889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c380d-dbdd-40f6-93c1-52674dc903dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:27.240654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c380d-dbdd-40f6-93c1-52674dc903dc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:27.240963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c380d-dbdd-40f6-93c1-52674dc903dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:27.241237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c380d-dbdd-40f6-93c1-52674dc903dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:27.242656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c380d-dbdd-40f6-93c1-52674dc903dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:27.244294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c380d-dbdd-40f6-93c1-52674dc903dc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:27.245875 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 562/1131] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:27.251687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603114c-6831-4665-b823-0b2232933137 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:27.260441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603114c-6831-4665-b823-0b2232933137 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:27.264862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cc691-4d42-46a2-9e55-32b0f2cb0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:27.265563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc691-4d42-46a2-9e55-32b0f2cb0de4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:27.265844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc691-4d42-46a2-9e55-32b0f2cb0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:27.266116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc691-4d42-46a2-9e55-32b0f2cb0de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:27.266817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cc691-4d42-46a2-9e55-32b0f2cb0de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:27.268670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cc691-4d42-46a2-9e55-32b0f2cb0de4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:27.360677 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 570/1132] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:46:27 2021] POST /identity/v3/projects => generated 311 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:29.750666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c858ec-8d4f-4de3-acae-b351490b161f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:29.751200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c858ec-8d4f-4de3-acae-b351490b161f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:29.751200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c858ec-8d4f-4de3-acae-b351490b161f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:29.752960 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 563/1133] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:29.758657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f776-5dac-4386-b52e-77870e41ebc3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:29.759034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f776-5dac-4386-b52e-77870e41ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:29.759215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f776-5dac-4386-b52e-77870e41ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:29.776323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8726f776-5dac-4386-b52e-77870e41ebc3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:29.777524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8726f776-5dac-4386-b52e-77870e41ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:29.832251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 571/1134] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:29.858586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c858ec-8d4f-4de3-acae-b351490b161f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:29.871314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c858ec-8d4f-4de3-acae-b351490b161f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:29.875646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6367ae-2608-4b5d-bd9b-4224219286c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:29.876407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6367ae-2608-4b5d-bd9b-4224219286c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:29.876683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6367ae-2608-4b5d-bd9b-4224219286c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:29.876979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6367ae-2608-4b5d-bd9b-4224219286c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:29.878144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6367ae-2608-4b5d-bd9b-4224219286c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:29.879779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6367ae-2608-4b5d-bd9b-4224219286c2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:29.881361 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 564/1135] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:46:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:29.886903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f776-5dac-4386-b52e-77870e41ebc3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:29.895528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f776-5dac-4386-b52e-77870e41ebc3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:29.899956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549c199-16a1-43a8-a979-8d8a7ba35dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:29.900590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c199-16a1-43a8-a979-8d8a7ba35dda admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:29.900868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c199-16a1-43a8-a979-8d8a7ba35dda admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:29.901178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549c199-16a1-43a8-a979-8d8a7ba35dda admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:29.901881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549c199-16a1-43a8-a979-8d8a7ba35dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:29.903745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549c199-16a1-43a8-a979-8d8a7ba35dda admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:30.026828 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 572/1136] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:46:29 2021] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:32.442082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e2c0-807b-4e90-a61f-0e754c4706d6 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.442602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e2c0-807b-4e90-a61f-0e754c4706d6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.442602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e2c0-807b-4e90-a61f-0e754c4706d6 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.444373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 565/1137] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:32.450026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334967a-abb0-405d-b6ad-143f159fbade None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.450396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334967a-abb0-405d-b6ad-143f159fbade None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.450581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334967a-abb0-405d-b6ad-143f159fbade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.467859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a334967a-abb0-405d-b6ad-143f159fbade None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:32.469060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a334967a-abb0-405d-b6ad-143f159fbade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:32.476574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 573/1138] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:32.501686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389e2c0-807b-4e90-a61f-0e754c4706d6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:32.513898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389e2c0-807b-4e90-a61f-0e754c4706d6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:32.518195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:32.518956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.519230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.519495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.529402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:32.536135 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:32.537260 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 566/1139] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:32.543201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334967a-abb0-405d-b6ad-143f159fbade None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:32.552578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334967a-abb0-405d-b6ad-143f159fbade None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:32.557099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:32.557735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.558018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.558294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.559036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:32.559344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:32.560951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:32.569542 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 574/1140] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:32.575205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:32.585940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9482-1846-42fc-82de-e2e531632133 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:32.590486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:32.591292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.591569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.591844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] PATH_INFO: `/v3/users/375901b56f774c9f82de653cb92b3a49` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.604320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] RBAC: Authorizing `identity:get_user(user_id=375901b56f774c9f82de653cb92b3a49)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:32.606416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:32.607969 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 567/1141] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:32 2021] GET /identity/v3/users/375901b56f774c9f82de653cb92b3a49 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:32.614249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:32.623786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32968-f873-4fc6-ade7-c993019206e4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:32.628279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:32.628910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.629788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.630066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.637672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:32.639359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:32.648073 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 575/1142] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:32.654345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:32.663522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e51a47-8739-4b0a-ae74-8f37b653f15e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:32.667961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7287f4-0a63-435c-8110-7241722f4a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:32.668769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7287f4-0a63-435c-8110-7241722f4a18 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.669082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7287f4-0a63-435c-8110-7241722f4a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.669358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7287f4-0a63-435c-8110-7241722f4a18 admin admin] PATH_INFO: `/v3/projects/762916cfb5574400a98da01b33016f71` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.670514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7287f4-0a63-435c-8110-7241722f4a18 admin admin] RBAC: Authorizing `identity:get_project(project_id=762916cfb5574400a98da01b33016f71)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:32.672466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7287f4-0a63-435c-8110-7241722f4a18 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:32.674231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 568/1143] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:32 2021] GET /identity/v3/projects/762916cfb5574400a98da01b33016f71 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:32.680821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:32.689159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5264c15-8edb-4ec8-91c6-88533220cd93 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:32.694259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b40666-7bf5-451a-a8d2-c4f240b4ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:32.694796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40666-7bf5-451a-a8d2-c4f240b4ffa6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:32.695072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40666-7bf5-451a-a8d2-c4f240b4ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:32.695348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40666-7bf5-451a-a8d2-c4f240b4ffa6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:32.696139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b40666-7bf5-451a-a8d2-c4f240b4ffa6 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=762916cfb5574400a98da01b33016f71, user.id=375901b56f774c9f82de653cb92b3a49) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:32.696450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b40666-7bf5-451a-a8d2-c4f240b4ffa6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:32.698226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b40666-7bf5-451a-a8d2-c4f240b4ffa6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:32.703483 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 576/1144] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:32 2021] GET /identity/v3/role_assignments?user.id=375901b56f774c9f82de653cb92b3a49&scope.project.id=762916cfb5574400a98da01b33016f71&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:35.050722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04185-4dbb-4697-9a2e-9b3376b2183e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:35.051215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04185-4dbb-4697-9a2e-9b3376b2183e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:35.051307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04185-4dbb-4697-9a2e-9b3376b2183e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:35.053087 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 569/1145] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:35.058884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958783-d2cb-4168-809a-8c0a78b0d472 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:35.059314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958783-d2cb-4168-809a-8c0a78b0d472 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:35.059433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958783-d2cb-4168-809a-8c0a78b0d472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:35.077186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-27958783-d2cb-4168-809a-8c0a78b0d472 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:35.078358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-27958783-d2cb-4168-809a-8c0a78b0d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:35.086522 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 577/1146] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:35.110898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04185-4dbb-4697-9a2e-9b3376b2183e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:35.123232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04185-4dbb-4697-9a2e-9b3376b2183e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:35.127555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:35.128314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:35.128593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:35.129402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:35.139266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:35.146660 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:35.147769 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 570/1147] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:35.161762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958783-d2cb-4168-809a-8c0a78b0d472 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:35.170749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958783-d2cb-4168-809a-8c0a78b0d472 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:35.175299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:35.175949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:35.176228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:35.176501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:35.177287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:35.177592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:35.179159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:35.187233 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 578/1148] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:35.194114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:35.204169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d00ba-189f-405c-acb2-ed75534d2649 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:35.209396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:35.210233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:35.210511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:35.210786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] PATH_INFO: `/v3/users/375901b56f774c9f82de653cb92b3a49` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:35.212026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] RBAC: Authorizing `identity:get_user(user_id=375901b56f774c9f82de653cb92b3a49)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:35.214087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:35.215643 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 571/1149] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:35 2021] GET /identity/v3/users/375901b56f774c9f82de653cb92b3a49 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:35.221558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:35.230910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f34ee-7b44-4fd2-9b77-59084251deda admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:35.235466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f28cc-60e7-41ec-834f-309ce2997fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:35.236319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f28cc-60e7-41ec-834f-309ce2997fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:35.236595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f28cc-60e7-41ec-834f-309ce2997fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:35.236868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f28cc-60e7-41ec-834f-309ce2997fc1 admin admin] PATH_INFO: `/v3/projects/762916cfb5574400a98da01b33016f71` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:35.238058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f28cc-60e7-41ec-834f-309ce2997fc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=762916cfb5574400a98da01b33016f71)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:35.240090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f28cc-60e7-41ec-834f-309ce2997fc1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:35.241771 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 579/1150] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:35 2021] GET /identity/v3/projects/762916cfb5574400a98da01b33016f71 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:35.247912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:35.257774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca909480-72ce-461b-b72d-696d6b31758c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:35.262159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e6ae6-1292-4aab-a882-3030fbd7d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:35.262988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6ae6-1292-4aab-a882-3030fbd7d2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:35.263264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6ae6-1292-4aab-a882-3030fbd7d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:35.263540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6ae6-1292-4aab-a882-3030fbd7d2a0 admin admin] PATH_INFO: `/v3/projects/762916cfb5574400a98da01b33016f71/users/375901b56f774c9f82de653cb92b3a49/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:35.265527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e6ae6-1292-4aab-a882-3030fbd7d2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762916cfb5574400a98da01b33016f71, user_id=375901b56f774c9f82de653cb92b3a49, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:35.268063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e6ae6-1292-4aab-a882-3030fbd7d2a0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:35.365676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 572/1151] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:46:35 2021] PUT /identity/v3/projects/762916cfb5574400a98da01b33016f71/users/375901b56f774c9f82de653cb92b3a49/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:46:37.728332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0a1b0-81d5-4cb9-a71a-ab6a0874f541 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:37.728934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0a1b0-81d5-4cb9-a71a-ab6a0874f541 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:37.728934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0a1b0-81d5-4cb9-a71a-ab6a0874f541 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:37.730665 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 580/1152] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:37.736204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077110-56fe-4a38-b739-9efef0a9150c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:37.736618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077110-56fe-4a38-b739-9efef0a9150c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:37.736748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077110-56fe-4a38-b739-9efef0a9150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:37.754014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-87077110-56fe-4a38-b739-9efef0a9150c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:37.755175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-87077110-56fe-4a38-b739-9efef0a9150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:37.809635 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 573/1153] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:37.834909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0a1b0-81d5-4cb9-a71a-ab6a0874f541 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:37.846810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0a1b0-81d5-4cb9-a71a-ab6a0874f541 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:37.851755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:37.852508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:37.852788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:37.853095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:37.862942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:37.869984 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:37.871088 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 581/1154] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:37.877236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87077110-56fe-4a38-b739-9efef0a9150c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:37.885868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87077110-56fe-4a38-b739-9efef0a9150c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:37.890314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:37.890945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:37.891251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:37.891519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:37.892259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:37.892561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:37.894195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:37.902752 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 574/1155] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:37.908441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:37.918772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd38d0-8631-4773-b98b-febbda77b1c7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:37.923170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:37.923972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:37.924251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:37.924519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] PATH_INFO: `/v3/users/375901b56f774c9f82de653cb92b3a49` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:37.925746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] RBAC: Authorizing `identity:get_user(user_id=375901b56f774c9f82de653cb92b3a49)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:37.927810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:37.929397 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 582/1156] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:37 2021] GET /identity/v3/users/375901b56f774c9f82de653cb92b3a49 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:37.934871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:37.943905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95dc9f-c6a3-4314-ba6e-a227ccfcea0d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:37.948299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:37.948938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:37.949214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:37.949483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:37.957570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:37.959259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:37.967905 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 575/1157] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:37 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:37.974925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:37.984396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b0677-65e1-420e-a726-276bf088813f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:37.988779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc94d6-407c-430e-8bed-332866a7374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:37.989638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc94d6-407c-430e-8bed-332866a7374c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:37.989919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc94d6-407c-430e-8bed-332866a7374c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:37.990194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc94d6-407c-430e-8bed-332866a7374c admin admin] PATH_INFO: `/v3/projects/762916cfb5574400a98da01b33016f71` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:37.991353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc94d6-407c-430e-8bed-332866a7374c admin admin] RBAC: Authorizing `identity:get_project(project_id=762916cfb5574400a98da01b33016f71)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:37.993677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc94d6-407c-430e-8bed-332866a7374c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:37.995425 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 583/1158] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:37 2021] GET /identity/v3/projects/762916cfb5574400a98da01b33016f71 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:38.001458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:38.010920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896cbb9-7e24-47bd-b1ac-219b9d3246fa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:38.015414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ad12-18fa-43f4-9052-fbff090fbc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:38.016020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ad12-18fa-43f4-9052-fbff090fbc2c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:38.016296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ad12-18fa-43f4-9052-fbff090fbc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:38.016563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ad12-18fa-43f4-9052-fbff090fbc2c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:38.017405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6ad12-18fa-43f4-9052-fbff090fbc2c admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=762916cfb5574400a98da01b33016f71, user.id=375901b56f774c9f82de653cb92b3a49) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:38.017708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6ad12-18fa-43f4-9052-fbff090fbc2c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:38.019988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6ad12-18fa-43f4-9052-fbff090fbc2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:38.025524 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 576/1159] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:38 2021] GET /identity/v3/role_assignments?user.id=375901b56f774c9f82de653cb92b3a49&scope.project.id=762916cfb5574400a98da01b33016f71&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:40.423456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd98ee-5d8a-4ef0-b900-4fda3c9309e0 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:40.424048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd98ee-5d8a-4ef0-b900-4fda3c9309e0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:40.424048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd98ee-5d8a-4ef0-b900-4fda3c9309e0 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:40.426373 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 584/1160] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:40.432121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6bfa-4455-4513-ada5-07c3e735b249 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:40.432531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6bfa-4455-4513-ada5-07c3e735b249 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:40.432665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec6bfa-4455-4513-ada5-07c3e735b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:40.450029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-13ec6bfa-4455-4513-ada5-07c3e735b249 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:40.455440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-13ec6bfa-4455-4513-ada5-07c3e735b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:40.458806 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 577/1161] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:40.483460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd98ee-5d8a-4ef0-b900-4fda3c9309e0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:40.496409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd98ee-5d8a-4ef0-b900-4fda3c9309e0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:40.500968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:40.504271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:40.504271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:40.504271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:40.509960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:40.511690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:40.520407 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 585/1162] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:46:40.526578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6bfa-4455-4513-ada5-07c3e735b249 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:40.536022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec6bfa-4455-4513-ada5-07c3e735b249 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:40.540492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b5eb4-1be0-4886-b3fc-a67f9a65c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:40.541298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b5eb4-1be0-4886-b3fc-a67f9a65c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:40.541570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b5eb4-1be0-4886-b3fc-a67f9a65c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:40.541834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b5eb4-1be0-4886-b3fc-a67f9a65c8ce admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:40.548508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b5eb4-1be0-4886-b3fc-a67f9a65c8ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:40.550324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b5eb4-1be0-4886-b3fc-a67f9a65c8ce admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:40.564906 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e77b5eb4-1be0-4886-b3fc-a67f9a65c8ce admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 25 20:46:40.566012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 578/1163] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:46:40 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:40.572268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:40.580990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec9741-ceb6-4705-b796-23a1cca62cad admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:40.586009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c4ba5-2002-4578-a8dc-0976cbdf3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:40.586636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4ba5-2002-4578-a8dc-0976cbdf3435 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:40.586917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4ba5-2002-4578-a8dc-0976cbdf3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:40.587191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c4ba5-2002-4578-a8dc-0976cbdf3435 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:40.587901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c4ba5-2002-4578-a8dc-0976cbdf3435 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:40.588205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c4ba5-2002-4578-a8dc-0976cbdf3435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:40.589780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c4ba5-2002-4578-a8dc-0976cbdf3435 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:40.596794 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 586/1164] 10.222.0.32 () {56 vars in 1136 bytes} [Sat Dec 25 20:46:40 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:42.973440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349c6a-e0e5-4359-b4d5-f35fcdabe473 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:42.974439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349c6a-e0e5-4359-b4d5-f35fcdabe473 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:42.974575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd349c6a-e0e5-4359-b4d5-f35fcdabe473 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:42.976377 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 579/1165] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:42.982125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef34f-e763-4fb9-bd49-c05b6aee9b2e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:42.982496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef34f-e763-4fb9-bd49-c05b6aee9b2e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:42.982685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef34f-e763-4fb9-bd49-c05b6aee9b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:43.000030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-344ef34f-e763-4fb9-bd49-c05b6aee9b2e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:43.001239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-344ef34f-e763-4fb9-bd49-c05b6aee9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:43.008724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 587/1166] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:43.033390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349c6a-e0e5-4359-b4d5-f35fcdabe473 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:43.045800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd349c6a-e0e5-4359-b4d5-f35fcdabe473 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:43.050126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb41cbd-b922-44cb-b79a-d0af8086f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:43.050782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41cbd-b922-44cb-b79a-d0af8086f8cb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:43.051060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41cbd-b922-44cb-b79a-d0af8086f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:43.051330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41cbd-b922-44cb-b79a-d0af8086f8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:43.052074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb41cbd-b922-44cb-b79a-d0af8086f8cb admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:43.053100 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-4eb41cbd-b922-44cb-b79a-d0af8086f8cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:46:43.053100 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 20:46:43.053100 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 20:46:43.053981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb41cbd-b922-44cb-b79a-d0af8086f8cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:43.137265 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 580/1167] 10.222.0.32 () {60 vars in 1159 bytes} [Sat Dec 25 20:46:43 2021] POST /identity/v3/domains => generated 267 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:45.533998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacdceb-db25-4ba5-811d-ac5e47db62ce None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:45.534531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacdceb-db25-4ba5-811d-ac5e47db62ce None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:45.534531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacdceb-db25-4ba5-811d-ac5e47db62ce None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:45.536893 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 588/1168] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:45.542617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4140e-87db-4af3-98c7-bac196fdefa6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:45.542991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4140e-87db-4af3-98c7-bac196fdefa6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:45.543168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4140e-87db-4af3-98c7-bac196fdefa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:45.561300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-01a4140e-87db-4af3-98c7-bac196fdefa6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:45.563034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-01a4140e-87db-4af3-98c7-bac196fdefa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:45.617160 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 581/1169] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:45.642337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacdceb-db25-4ba5-811d-ac5e47db62ce None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:45.654254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacdceb-db25-4ba5-811d-ac5e47db62ce None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:45.658616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c97120-f2b7-4604-b0a3-73eb8306a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:45.661159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c97120-f2b7-4604-b0a3-73eb8306a92b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:45.661159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c97120-f2b7-4604-b0a3-73eb8306a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:45.661159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c97120-f2b7-4604-b0a3-73eb8306a92b admin admin] PATH_INFO: `/v3/domains/c4fcc91f80174920988688cd9124a03b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:45.671284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c97120-f2b7-4604-b0a3-73eb8306a92b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c4fcc91f80174920988688cd9124a03b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:45.673292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c97120-f2b7-4604-b0a3-73eb8306a92b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:45.674874 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 589/1170] 10.222.0.32 () {56 vars in 1204 bytes} [Sat Dec 25 20:46:45 2021] GET /identity/v3/domains/c4fcc91f80174920988688cd9124a03b => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:45.681450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4140e-87db-4af3-98c7-bac196fdefa6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:45.690168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4140e-87db-4af3-98c7-bac196fdefa6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:45.694614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef69f7-75e8-46c1-ab5b-861c7b514594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:45.695246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef69f7-75e8-46c1-ab5b-861c7b514594 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:45.695524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef69f7-75e8-46c1-ab5b-861c7b514594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:45.695793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef69f7-75e8-46c1-ab5b-861c7b514594 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:45.696495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef69f7-75e8-46c1-ab5b-861c7b514594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:45.698379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef69f7-75e8-46c1-ab5b-861c7b514594 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:45.804917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 582/1171] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:46:45 2021] POST /identity/v3/projects => generated 361 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:48.198889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52729aed-b416-42f5-b441-b7e1855b2e98 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:48.199401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52729aed-b416-42f5-b441-b7e1855b2e98 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:48.199508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52729aed-b416-42f5-b441-b7e1855b2e98 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:48.201265 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 590/1172] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:48.207025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c97bf-aa1b-428f-9b79-0e10b0a50ba5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:48.207449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c97bf-aa1b-428f-9b79-0e10b0a50ba5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:48.207601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c97bf-aa1b-428f-9b79-0e10b0a50ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:48.224801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3b0c97bf-aa1b-428f-9b79-0e10b0a50ba5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:48.226026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3b0c97bf-aa1b-428f-9b79-0e10b0a50ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:48.280837 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 583/1173] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:48.307995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52729aed-b416-42f5-b441-b7e1855b2e98 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:48.320497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52729aed-b416-42f5-b441-b7e1855b2e98 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:48.324847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ec64-536c-49ed-9a6a-c318f1871cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:48.325725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ec64-536c-49ed-9a6a-c318f1871cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:48.326005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ec64-536c-49ed-9a6a-c318f1871cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:48.326278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ec64-536c-49ed-9a6a-c318f1871cd9 admin admin] PATH_INFO: `/v3/domains/c4fcc91f80174920988688cd9124a03b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:48.327450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487ec64-536c-49ed-9a6a-c318f1871cd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c4fcc91f80174920988688cd9124a03b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:48.329408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487ec64-536c-49ed-9a6a-c318f1871cd9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:48.330943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 591/1174] 10.222.0.32 () {56 vars in 1204 bytes} [Sat Dec 25 20:46:48 2021] GET /identity/v3/domains/c4fcc91f80174920988688cd9124a03b => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:48.336664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c97bf-aa1b-428f-9b79-0e10b0a50ba5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:48.345238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c97bf-aa1b-428f-9b79-0e10b0a50ba5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:48.349634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7c4f7-3e57-4fea-9a3e-f9b1133c7ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:48.350269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c4f7-3e57-4fea-9a3e-f9b1133c7ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:48.350545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c4f7-3e57-4fea-9a3e-f9b1133c7ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:48.350815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c4f7-3e57-4fea-9a3e-f9b1133c7ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:48.351522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7c4f7-3e57-4fea-9a3e-f9b1133c7ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:48.353410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7c4f7-3e57-4fea-9a3e-f9b1133c7ef6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:48.442562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 584/1175] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:46:48 2021] POST /identity/v3/users => generated 311 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:46:50.974813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e1cb-a116-47bd-a96a-b70673fe7ec7 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:50.975199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e1cb-a116-47bd-a96a-b70673fe7ec7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:50.975365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902e1cb-a116-47bd-a96a-b70673fe7ec7 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:50.977170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 592/1176] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:50.982825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f972-dcbc-414e-a465-4b3e7dde33f4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:50.983187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f972-dcbc-414e-a465-4b3e7dde33f4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:50.983376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f972-dcbc-414e-a465-4b3e7dde33f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:51.000783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6390f972-dcbc-414e-a465-4b3e7dde33f4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:51.002008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6390f972-dcbc-414e-a465-4b3e7dde33f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:51.010024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 585/1177] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:51.035266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902e1cb-a116-47bd-a96a-b70673fe7ec7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:51.047093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902e1cb-a116-47bd-a96a-b70673fe7ec7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:51.051450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:51.052210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:51.052486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:51.052756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:51.063025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:51.070306 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:51.071414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 593/1178] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:51.077489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390f972-dcbc-414e-a465-4b3e7dde33f4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:51.086760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390f972-dcbc-414e-a465-4b3e7dde33f4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:51.091218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:51.091855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:51.092133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:51.092407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:51.093192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:51.093499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:51.095063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:51.103004 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 586/1179] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:51.108845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:51.119171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c770a5-cd1c-41d5-b57c-b7bf699fbd7b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:51.123731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:51.124560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:51.124845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:51.125150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] PATH_INFO: `/v3/users/0b8c313ee3b54d06b6e075867ebbb90e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:51.138769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b8c313ee3b54d06b6e075867ebbb90e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:51.140900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:51.142507 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 594/1180] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:51 2021] GET /identity/v3/users/0b8c313ee3b54d06b6e075867ebbb90e => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:51.148453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:51.157775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c8b4-e6ba-419c-9767-4952239957a2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:51.162248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:51.162891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:51.163169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:51.163441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:51.170970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:51.172657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:51.181925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 587/1181] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:51 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:51.187911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:51.197708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3520e2-b9f7-4bd8-8617-3d15468cbfd4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:51.202200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36276f4-fc75-48af-b453-0191b4cf3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:51.203004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36276f4-fc75-48af-b453-0191b4cf3374 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:51.203285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36276f4-fc75-48af-b453-0191b4cf3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:51.203559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36276f4-fc75-48af-b453-0191b4cf3374 admin admin] PATH_INFO: `/v3/projects/c170bd50a4f24795ade62d9391a728c5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:51.204711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36276f4-fc75-48af-b453-0191b4cf3374 admin admin] RBAC: Authorizing `identity:get_project(project_id=c170bd50a4f24795ade62d9391a728c5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:51.206739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36276f4-fc75-48af-b453-0191b4cf3374 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:51.208328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 595/1182] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:51 2021] GET /identity/v3/projects/c170bd50a4f24795ade62d9391a728c5 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:51.214898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:51.223387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77cc10-cefa-4180-bed9-17ed01a5be2a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:51.227892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bf5d6-a104-4753-9aa3-2f13587e26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:51.228497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bf5d6-a104-4753-9aa3-2f13587e26be admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:51.228778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bf5d6-a104-4753-9aa3-2f13587e26be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:51.229088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bf5d6-a104-4753-9aa3-2f13587e26be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:51.229901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bf5d6-a104-4753-9aa3-2f13587e26be admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=c170bd50a4f24795ade62d9391a728c5, user.id=0b8c313ee3b54d06b6e075867ebbb90e) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:51.230208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bf5d6-a104-4753-9aa3-2f13587e26be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:51.231973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bf5d6-a104-4753-9aa3-2f13587e26be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:51.237192 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 588/1183] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:51 2021] GET /identity/v3/role_assignments?user.id=0b8c313ee3b54d06b6e075867ebbb90e&scope.project.id=c170bd50a4f24795ade62d9391a728c5&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:53.601616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056b34-214c-4674-afdf-44597a69cb75 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:53.602166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056b34-214c-4674-afdf-44597a69cb75 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:53.602166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056b34-214c-4674-afdf-44597a69cb75 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:53.603913 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 596/1184] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:53.610054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af94e-c7e8-4287-88b9-2080aecb2657 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:53.610448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af94e-c7e8-4287-88b9-2080aecb2657 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:53.610612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af94e-c7e8-4287-88b9-2080aecb2657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:53.628105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-793af94e-c7e8-4287-88b9-2080aecb2657 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:53.633756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-793af94e-c7e8-4287-88b9-2080aecb2657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:53.637048 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 589/1185] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:53.662246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056b34-214c-4674-afdf-44597a69cb75 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:53.674195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056b34-214c-4674-afdf-44597a69cb75 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:53.678509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:53.679269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:53.679546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:53.679817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:53.689679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:53.696396 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:53.697538 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 597/1186] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:53.703581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af94e-c7e8-4287-88b9-2080aecb2657 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:53.713112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af94e-c7e8-4287-88b9-2080aecb2657 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:53.717636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:53.718281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:53.718560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:53.718828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:53.719571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:53.719872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:53.721494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:53.730183 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 590/1187] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:53.736522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:53.746776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497261d-c740-49fa-9c96-755dd82be8c5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:53.751193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:53.752010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:53.752287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:53.752563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] PATH_INFO: `/v3/users/0b8c313ee3b54d06b6e075867ebbb90e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:53.754269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b8c313ee3b54d06b6e075867ebbb90e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:53.756330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:53.757893 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 598/1188] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:53 2021] GET /identity/v3/users/0b8c313ee3b54d06b6e075867ebbb90e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:53.763599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:53.773452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0e2a4-35ab-486f-aecb-60ed35f88f89 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:53.777894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0030c82-5125-48d9-88f8-38f8f30aa098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:53.778709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0030c82-5125-48d9-88f8-38f8f30aa098 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:53.778989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0030c82-5125-48d9-88f8-38f8f30aa098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:53.779260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0030c82-5125-48d9-88f8-38f8f30aa098 admin admin] PATH_INFO: `/v3/projects/c170bd50a4f24795ade62d9391a728c5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:53.780418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0030c82-5125-48d9-88f8-38f8f30aa098 admin admin] RBAC: Authorizing `identity:get_project(project_id=c170bd50a4f24795ade62d9391a728c5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:53.782429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0030c82-5125-48d9-88f8-38f8f30aa098 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:53.784167 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 591/1189] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:53 2021] GET /identity/v3/projects/c170bd50a4f24795ade62d9391a728c5 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:46:53.789663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:53.798742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660351b0-d00e-4d55-b8e1-647c95e87fe4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:53.803127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1dc08-02a4-46a5-b95a-0495a3503517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:53.803937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1dc08-02a4-46a5-b95a-0495a3503517 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:53.804212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1dc08-02a4-46a5-b95a-0495a3503517 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:53.804483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1dc08-02a4-46a5-b95a-0495a3503517 admin admin] PATH_INFO: `/v3/projects/c170bd50a4f24795ade62d9391a728c5/users/0b8c313ee3b54d06b6e075867ebbb90e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:53.806406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1dc08-02a4-46a5-b95a-0495a3503517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c170bd50a4f24795ade62d9391a728c5, user_id=0b8c313ee3b54d06b6e075867ebbb90e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:53.808937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1dc08-02a4-46a5-b95a-0495a3503517 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:53.885308 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 599/1190] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:46:53 2021] PUT /identity/v3/projects/c170bd50a4f24795ade62d9391a728c5/users/0b8c313ee3b54d06b6e075867ebbb90e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:46:56.247727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b817-ff25-4bb1-a56d-c0d3cb17a3ff None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.248228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b817-ff25-4bb1-a56d-c0d3cb17a3ff None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.248333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b817-ff25-4bb1-a56d-c0d3cb17a3ff None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.250077 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 592/1191] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:46:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:46:56.255920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fc56b-bbfc-4765-873d-16f355b5cd0e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.256348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fc56b-bbfc-4765-873d-16f355b5cd0e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.256448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fc56b-bbfc-4765-873d-16f355b5cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.273660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c73fc56b-bbfc-4765-873d-16f355b5cd0e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:46:56.274818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c73fc56b-bbfc-4765-873d-16f355b5cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:46:56.329580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 600/1192] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:46:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:46:56.355435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b817-ff25-4bb1-a56d-c0d3cb17a3ff None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:56.367662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b817-ff25-4bb1-a56d-c0d3cb17a3ff None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:56.371928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:56.372700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.379649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.379649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.383203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:46:56.389953 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:46:56.391113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 593/1193] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:46:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:46:56.398105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fc56b-bbfc-4765-873d-16f355b5cd0e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:56.406880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fc56b-bbfc-4765-873d-16f355b5cd0e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:56.412118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:56.412756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.414065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.414065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.414065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:56.414378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:56.415962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:56.423898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 601/1194] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:46:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:56.429992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:56.440736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095c61b-036b-4953-80b9-94241513a70d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:56.445204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:56.446035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.446309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.446579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] PATH_INFO: `/v3/users/0b8c313ee3b54d06b6e075867ebbb90e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.447749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b8c313ee3b54d06b6e075867ebbb90e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:56.449871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:56.451413 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 594/1195] 10.222.0.32 () {56 vars in 1198 bytes} [Sat Dec 25 20:46:56 2021] GET /identity/v3/users/0b8c313ee3b54d06b6e075867ebbb90e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:56.457701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:56.467065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662ad3a-5a2b-4f7c-a19f-d45baab5c6f2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:56.471473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:56.472640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.472957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.473231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.480624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:56.482383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:56.490906 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 602/1196] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:46:56 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:46:56.497336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:56.506542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82918b16-31da-40bb-9b9e-0f3e2069cf77 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:56.510884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa006b-d515-48de-be70-2c8e2542afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:56.511681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa006b-d515-48de-be70-2c8e2542afe4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.511955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa006b-d515-48de-be70-2c8e2542afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.512221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa006b-d515-48de-be70-2c8e2542afe4 admin admin] PATH_INFO: `/v3/projects/c170bd50a4f24795ade62d9391a728c5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.513404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa006b-d515-48de-be70-2c8e2542afe4 admin admin] RBAC: Authorizing `identity:get_project(project_id=c170bd50a4f24795ade62d9391a728c5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:56.515344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa006b-d515-48de-be70-2c8e2542afe4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:56.516971 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 595/1197] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:46:56 2021] GET /identity/v3/projects/c170bd50a4f24795ade62d9391a728c5 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:46:56.525608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:46:56.534106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250c484-e30d-4cc5-a469-c96784fa4ff2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:46:56.539227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82500f55-1f62-4ebc-a01e-c540874dc74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:46:56.539833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500f55-1f62-4ebc-a01e-c540874dc74c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:46:56.540111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500f55-1f62-4ebc-a01e-c540874dc74c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:46:56.540383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82500f55-1f62-4ebc-a01e-c540874dc74c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:46:56.541252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82500f55-1f62-4ebc-a01e-c540874dc74c admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=c170bd50a4f24795ade62d9391a728c5, user.id=0b8c313ee3b54d06b6e075867ebbb90e) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:46:56.541563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82500f55-1f62-4ebc-a01e-c540874dc74c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:46:56.543330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82500f55-1f62-4ebc-a01e-c540874dc74c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:46:56.548843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 603/1198] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:46:56 2021] GET /identity/v3/role_assignments?user.id=0b8c313ee3b54d06b6e075867ebbb90e&scope.project.id=c170bd50a4f24795ade62d9391a728c5&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:19.330728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee11c7-09e1-4442-bb60-58237b8d0d5c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:19.331355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee11c7-09e1-4442-bb60-58237b8d0d5c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:19.331355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee11c7-09e1-4442-bb60-58237b8d0d5c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:19.333096 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 596/1199] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:19.339417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edf4ba-2e07-483a-a362-700da474b6c1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:19.339889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edf4ba-2e07-483a-a362-700da474b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:19.339983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edf4ba-2e07-483a-a362-700da474b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:19.358298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b5edf4ba-2e07-483a-a362-700da474b6c1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:19.359469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b5edf4ba-2e07-483a-a362-700da474b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:19.367395 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 604/1200] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:19.393303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee11c7-09e1-4442-bb60-58237b8d0d5c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:19.405661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee11c7-09e1-4442-bb60-58237b8d0d5c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:19.410177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:19.411441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:19.411441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:19.411630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:19.422223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:19.424017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:19.440486 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:19.441646 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 597/1201] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:19.448561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edf4ba-2e07-483a-a362-700da474b6c1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:19.457512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edf4ba-2e07-483a-a362-700da474b6c1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:19.463317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151db38-185b-4bc0-9cf5-2eadd4f8197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:19.463317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151db38-185b-4bc0-9cf5-2eadd4f8197d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:19.463526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151db38-185b-4bc0-9cf5-2eadd4f8197d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:19.463760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151db38-185b-4bc0-9cf5-2eadd4f8197d admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:19.464477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151db38-185b-4bc0-9cf5-2eadd4f8197d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:19.464806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151db38-185b-4bc0-9cf5-2eadd4f8197d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:19.466435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151db38-185b-4bc0-9cf5-2eadd4f8197d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:19.477319 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 605/1202] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:19.482998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:19.492701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf6fd-9572-48f5-866a-4c9f5c6441a8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:19.497188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1b38-aa9f-4dff-8300-b3c52721b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:19.497825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1b38-aa9f-4dff-8300-b3c52721b06f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:19.498103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1b38-aa9f-4dff-8300-b3c52721b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:19.498373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1b38-aa9f-4dff-8300-b3c52721b06f admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:19.499069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1b38-aa9f-4dff-8300-b3c52721b06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:19.500952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1b38-aa9f-4dff-8300-b3c52721b06f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:19.657019 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 598/1203] 10.222.0.32 () {60 vars in 1153 bytes} [Sat Dec 25 20:48:19 2021] POST /identity/v3/users => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:48:22.059864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434aae5-cf93-4889-aca9-18fa14a4c3eb None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.060374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434aae5-cf93-4889-aca9-18fa14a4c3eb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.060461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434aae5-cf93-4889-aca9-18fa14a4c3eb None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.062267 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 606/1204] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:22.067737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c6ea8-73fa-4a10-bca1-53db48377462 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.068185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c6ea8-73fa-4a10-bca1-53db48377462 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.068276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c6ea8-73fa-4a10-bca1-53db48377462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.086688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fe5c6ea8-73fa-4a10-bca1-53db48377462 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:22.087871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fe5c6ea8-73fa-4a10-bca1-53db48377462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:22.095470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 599/1205] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:22.121887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434aae5-cf93-4889-aca9-18fa14a4c3eb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.134539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434aae5-cf93-4889-aca9-18fa14a4c3eb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.138899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.139695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.139974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.140248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.150675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:48:22.157528 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:48:22.158639 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 607/1206] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:22.164761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c6ea8-73fa-4a10-bca1-53db48377462 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.173644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c6ea8-73fa-4a10-bca1-53db48377462 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.178655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.179294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.179571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.179839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.180586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:22.180908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.182521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.190506 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 600/1207] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:22.196962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.206438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85209a-c511-4dc3-9bf8-e35cfb2231cf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.211064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.211811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.212133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.212355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.222510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.224293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.241114 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:22.242237 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 608/1208] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:22.248121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.258087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16223b2c-e2ee-4c6d-b4f0-ff9a95f49cbc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.262541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.263176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.263456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.263729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.264445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:22.264744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.266327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.277542 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 601/1209] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:22.283701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.293044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a3c0f-fd4c-48a6-910d-588b6725b833 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.297472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.298216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.298490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.298754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.306716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.308781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.322799 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 25 20:48:22.323958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 609/1210] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:22.331420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.341271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a396a5-54da-41d1-9611-71517ec031f4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.345952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.346605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.346891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.347169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.348002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:22.348311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.350206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.367684 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 602/1211] 10.222.0.32 () {56 vars in 1164 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:22.375382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.385484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033bdd-e15b-4e4a-933f-d0499c2cd962 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.389999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.390619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.390898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.391168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.398828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.400527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.409151 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 610/1212] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:48:22.416125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.425621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b31461-a0c8-48a8-8935-a7b409f20f0c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.430841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.433946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.433946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.433946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.442399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.444814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.461441 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:22.462621 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 603/1213] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:22.469307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.478611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa234a5-125c-498e-945d-6980dd7eac3d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.483153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.483777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.484051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.484318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.485075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:22.485378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.486926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.499728 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 611/1214] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:22.505603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.515114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad3cc0-a7cb-45e5-add5-99987c772a21 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.519960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.520468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.520750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.521065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.527820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.529779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.543200 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:48:22.544323 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 604/1215] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:48:22.550420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.560460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f63e-42e7-4ad2-9c66-c9aeaefdfd1c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.565049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211637b0-dae5-43d4-a8ec-cced1fb91691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.565682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211637b0-dae5-43d4-a8ec-cced1fb91691 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.569714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211637b0-dae5-43d4-a8ec-cced1fb91691 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.569714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211637b0-dae5-43d4-a8ec-cced1fb91691 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.569714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211637b0-dae5-43d4-a8ec-cced1fb91691 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:22.569714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211637b0-dae5-43d4-a8ec-cced1fb91691 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.569714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211637b0-dae5-43d4-a8ec-cced1fb91691 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.580994 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 612/1216] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:22.586981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:22.597025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d250f7-a200-4db8-b0a9-5eab5b1b17f1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:22.601985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d14b4-6890-48a9-ba93-4a8121850b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:22.604010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d14b4-6890-48a9-ba93-4a8121850b84 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:22.604010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d14b4-6890-48a9-ba93-4a8121850b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:22.604010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d14b4-6890-48a9-ba93-4a8121850b84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:22.604010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d14b4-6890-48a9-ba93-4a8121850b84 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79c9077ed07144bdb0149dd6be7d134a) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:22.604419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d14b4-6890-48a9-ba93-4a8121850b84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:22.606209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d14b4-6890-48a9-ba93-4a8121850b84 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:22.614113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 605/1217] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:48:22 2021] GET /identity/v3/role_assignments?user.id=79c9077ed07144bdb0149dd6be7d134a&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:24.978794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b89ee-d2b5-4861-8056-fbbd7d7f3af8 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:24.979269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b89ee-d2b5-4861-8056-fbbd7d7f3af8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:24.979363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b89ee-d2b5-4861-8056-fbbd7d7f3af8 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:24.981144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 613/1218] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:24.986968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f172a5-3dd5-4b9d-9f2d-e21461070abd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:24.987376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f172a5-3dd5-4b9d-9f2d-e21461070abd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:24.987516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f172a5-3dd5-4b9d-9f2d-e21461070abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.005174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-76f172a5-3dd5-4b9d-9f2d-e21461070abd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:25.006375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-76f172a5-3dd5-4b9d-9f2d-e21461070abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:25.013974 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 606/1219] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:25.038787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b89ee-d2b5-4861-8056-fbbd7d7f3af8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.050697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b89ee-d2b5-4861-8056-fbbd7d7f3af8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.055725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.056464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.056738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.057111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.067193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:48:25.074053 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:48:25.075157 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 614/1220] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:25.081267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f172a5-3dd5-4b9d-9f2d-e21461070abd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.090568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f172a5-3dd5-4b9d-9f2d-e21461070abd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.095084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.095725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.096004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.096276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.097049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] RBAC: Adding query filter params (name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:25.097354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.098916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.107346 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 607/1221] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:25.113142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.123240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325266db-b3d9-4f28-a31f-d2478ad4b2e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.127943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.128723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.129039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.129313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.139993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.141911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.159132 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:25.160263 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 615/1222] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:25.167103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.177215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f96d5-032b-4775-96ae-9fa4bc63b89a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.181799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.182440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.182720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.182991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.183711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:25.184016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.185634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.197100 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 608/1223] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:25.204027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.214121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90dbc-9984-4414-97df-791607b849cd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.218493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.219410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.219685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.229332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.229332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.229644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.243294 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 25 20:48:25.244386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 616/1224] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:25.250538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.260193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17cbf5-70e8-4ddd-a842-16b8bd206453 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.264748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.265430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.265711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.265983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.266814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:25.271269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.271269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.286280 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 609/1225] 10.222.0.32 () {56 vars in 1164 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:25.292838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.302479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1c5ac-8638-47c1-a180-e8519992a26a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.307092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.307847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.308124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.308394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.318418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.320227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.337238 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:25.338341 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 617/1226] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:25.344198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.355497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7147-ce57-4990-a85c-4a7c646bbb3e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.360604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.361373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.361652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.361926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.362643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:25.362944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.364803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.375947 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 610/1227] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:25.381980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.391670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc56f88-f58e-4bea-8c6f-66498a3b7663 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.396156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.397463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.397742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.398052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.404899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.406828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.419954 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:48:25.421124 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 618/1228] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:25.427098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.436598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b67da-1da2-47e3-b747-edd07dbfc935 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.441161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40413f6-0484-4a25-bef6-192896cec3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.441793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40413f6-0484-4a25-bef6-192896cec3ad admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.442075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40413f6-0484-4a25-bef6-192896cec3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.442349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40413f6-0484-4a25-bef6-192896cec3ad admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.443127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40413f6-0484-4a25-bef6-192896cec3ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:25.444349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40413f6-0484-4a25-bef6-192896cec3ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.445851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40413f6-0484-4a25-bef6-192896cec3ad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.457807 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 611/1229] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:48:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:25.464574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:25.474900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea19ff-82ab-488d-98e9-191d890ea939 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:25.479597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f21df-9e9b-4e90-bdf6-10385149f894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:25.480445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f21df-9e9b-4e90-bdf6-10385149f894 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:25.480724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f21df-9e9b-4e90-bdf6-10385149f894 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:25.481043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f21df-9e9b-4e90-bdf6-10385149f894 admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79c9077ed07144bdb0149dd6be7d134a/roles/6c7be361d0af46dfaf17213b5a844088` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:25.495565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f21df-9e9b-4e90-bdf6-10385149f894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=79c9077ed07144bdb0149dd6be7d134a, role_id=6c7be361d0af46dfaf17213b5a844088)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:25.498220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f21df-9e9b-4e90-bdf6-10385149f894 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:25.680365 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 619/1230] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:48:25 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79c9077ed07144bdb0149dd6be7d134a/roles/6c7be361d0af46dfaf17213b5a844088 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 20:48:28.072978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da1814-dddf-4066-b277-133de84d8b37 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.073495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da1814-dddf-4066-b277-133de84d8b37 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.073495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da1814-dddf-4066-b277-133de84d8b37 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.075279 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 612/1231] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:28.081190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b4f57-a9df-4ead-b057-f1373bb1b08a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.081607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b4f57-a9df-4ead-b057-f1373bb1b08a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.081739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b4f57-a9df-4ead-b057-f1373bb1b08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.099095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1f7b4f57-a9df-4ead-b057-f1373bb1b08a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:28.100267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f7b4f57-a9df-4ead-b057-f1373bb1b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:28.156403 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 620/1232] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:28.181876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da1814-dddf-4066-b277-133de84d8b37 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.194884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da1814-dddf-4066-b277-133de84d8b37 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.199243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.200039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.200317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.200587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.210638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:48:28.217536 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 25 20:48:28.218634 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 613/1233] 10.222.0.32 () {56 vars in 1123 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:28.225097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b4f57-a9df-4ead-b057-f1373bb1b08a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.233906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b4f57-a9df-4ead-b057-f1373bb1b08a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.238661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.239296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.239573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.239839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.241132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] RBAC: Adding query filter params (name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:28.241430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.242997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.250720 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 621/1234] 10.222.0.32 () {56 vars in 1124 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:28.257354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.267598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bc688-5ee3-49b8-8949-8aed312d3b9c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.272306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.273107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.273390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.273663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.283800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.285648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.302336 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:28.304002 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 614/1235] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:28.310196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.320262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d8081-7ab0-4c77-95c9-85a96f9c5597 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.324705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.325371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.325649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.325920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.326629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:28.326927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.328478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.339754 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 622/1236] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:28.345605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.355130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effc756-3eca-4142-ac00-fc3b5ebabf49 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.359815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.360577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.360857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.361157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.369052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.371028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.386324 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 25 20:48:28.387556 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 615/1237] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:28.393758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.403431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081533e-1281-4804-921b-1d54f20aa64a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.408192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.408857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.409170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.409452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.414602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:28.414602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.414602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.432929 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 623/1238] 10.222.0.32 () {56 vars in 1164 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:28.439212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.449342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e731-d8a3-416b-905c-a2d2395ce380 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.453826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.454447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.454721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.455034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.462847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.464543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.473132 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 616/1239] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:48:28.479916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.489586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15e2fa-6633-4c26-8006-fea35e450243 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.494900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.495677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.495949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.496218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.506304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.508130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.524341 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:28.525463 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 624/1240] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:28.532270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.541414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fa26-cd7e-456c-b6cf-4e46009c9b09 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.545901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.546564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.546840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.547106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.547809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:28.548107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.549816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.561361 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 617/1241] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:28.567639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.577117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efdb69-dc06-4822-971e-98183f3aa6bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.581654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.582431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.582709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.582980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.589672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.591577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.604978 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:48:28.606074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 625/1242] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:28.612152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.622278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41e7e-50aa-43d9-9ddb-8565e8a90275 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.626727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b77de7-eb96-4381-8e04-1b245743c991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.627351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b77de7-eb96-4381-8e04-1b245743c991 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.627623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b77de7-eb96-4381-8e04-1b245743c991 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.627889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b77de7-eb96-4381-8e04-1b245743c991 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.633228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b77de7-eb96-4381-8e04-1b245743c991 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:28.633228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b77de7-eb96-4381-8e04-1b245743c991 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.633228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b77de7-eb96-4381-8e04-1b245743c991 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.642538 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 618/1243] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:28.648669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:28.658711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfc4e3-4074-491e-bec8-579134243a6f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:28.663781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4db44-ef41-4597-9573-eda4f97d1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:28.664382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4db44-ef41-4597-9573-eda4f97d1d21 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:28.664663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4db44-ef41-4597-9573-eda4f97d1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:28.664972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4db44-ef41-4597-9573-eda4f97d1d21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:28.665807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4db44-ef41-4597-9573-eda4f97d1d21 admin admin] RBAC: Adding query filter params (role.id=6c7be361d0af46dfaf17213b5a844088, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79c9077ed07144bdb0149dd6be7d134a) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:28.666098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4db44-ef41-4597-9573-eda4f97d1d21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:28.667885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4db44-ef41-4597-9573-eda4f97d1d21 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:28.673499 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 626/1244] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:48:28 2021] GET /identity/v3/role_assignments?user.id=79c9077ed07144bdb0149dd6be7d134a&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=6c7be361d0af46dfaf17213b5a844088 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:31.108845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750f7a1-13ff-4429-a97a-f34c5c0de7c7 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.109375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750f7a1-13ff-4429-a97a-f34c5c0de7c7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.109468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750f7a1-13ff-4429-a97a-f34c5c0de7c7 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.111163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 619/1245] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:31.117210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd9a5-b001-479b-8974-cdec5ebb6340 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.117605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd9a5-b001-479b-8974-cdec5ebb6340 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.117754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd9a5-b001-479b-8974-cdec5ebb6340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.134885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bfddd9a5-b001-479b-8974-cdec5ebb6340 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:31.136066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bfddd9a5-b001-479b-8974-cdec5ebb6340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:31.143639 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 627/1246] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:31.169961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750f7a1-13ff-4429-a97a-f34c5c0de7c7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.182277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750f7a1-13ff-4429-a97a-f34c5c0de7c7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.186547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.187311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.187585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.187855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.197681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:48:31.204404 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:48:31.205562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 620/1247] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:31.214792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddd9a5-b001-479b-8974-cdec5ebb6340 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.223907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddd9a5-b001-479b-8974-cdec5ebb6340 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.229062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.231655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.231655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.231655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.231655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:31.231655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.232829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.241183 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 628/1248] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:48:31.247417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.257176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46e24f-33a0-447a-8dae-3f743a5df011 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.261654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.262419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.262735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.263015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.274020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.275817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.292765 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:31.293952 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 621/1249] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:31.300311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.310288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd3c1-c077-419f-868b-9c91482ce711 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.314897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.315534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.318542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.318542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.318542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:31.318542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.318878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.330471 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 629/1250] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:31.336796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.346277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3242a95-0ac8-4fbd-8d8f-0850ea3124b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.351401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.352215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.352495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.352766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.360609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.362639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.377369 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 25 20:48:31.378487 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 622/1251] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:31.386622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.396160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145cfcd-e590-4ad9-bc11-78060f62c8a9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.401154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.401793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.402068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.402337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.403153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:31.403455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.405278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.422601 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 630/1252] 10.222.0.32 () {56 vars in 1164 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:31.429745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.439356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222fcde-39c1-4fe3-abe4-8a1494d18b72 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.444355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.445004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.445281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.445547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.453147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.454852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.464154 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 623/1253] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:48:31.471494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.481101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3729f-549c-4c0c-8ebf-ef1095cfa309 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.485711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.486474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.486752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.487024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.497484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.499305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.516334 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:31.517518 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 631/1254] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:31.524888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.533699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69935f2-743c-4f95-b8f9-e03350512210 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.538274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.538909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.539187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.545187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.545187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:31.545187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.545187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.553470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 624/1255] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:31.560211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.570322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd3950-7c71-438d-b7d4-a52ff0e3a5e7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.574855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.575617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.575902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.579596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.582857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.585446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.598197 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:48:31.599307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 632/1256] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:31.605440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.615264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f865f34-f9e9-488c-a5fb-631fe7dc937b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.619738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce684081-02e7-4513-a1eb-9acf709d308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.620370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce684081-02e7-4513-a1eb-9acf709d308f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.620650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce684081-02e7-4513-a1eb-9acf709d308f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.620946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce684081-02e7-4513-a1eb-9acf709d308f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.621722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce684081-02e7-4513-a1eb-9acf709d308f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:31.622025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce684081-02e7-4513-a1eb-9acf709d308f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.623832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce684081-02e7-4513-a1eb-9acf709d308f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.635589 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 625/1257] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:31.641589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:31.652333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc4b0-2042-46eb-9b3b-29b00581f1e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:31.656982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfba4f4-24a1-411c-bb13-5ccf29d76132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:31.657595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfba4f4-24a1-411c-bb13-5ccf29d76132 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:31.657879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfba4f4-24a1-411c-bb13-5ccf29d76132 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:31.658155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfba4f4-24a1-411c-bb13-5ccf29d76132 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:31.658969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfba4f4-24a1-411c-bb13-5ccf29d76132 admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79c9077ed07144bdb0149dd6be7d134a) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:31.659281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfba4f4-24a1-411c-bb13-5ccf29d76132 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:31.661141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfba4f4-24a1-411c-bb13-5ccf29d76132 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:31.666331 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 633/1258] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:48:31 2021] GET /identity/v3/role_assignments?user.id=79c9077ed07144bdb0149dd6be7d134a&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:34.030763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1da5d-dd00-4ebc-b1e4-3fbf0515ebee None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.031264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1da5d-dd00-4ebc-b1e4-3fbf0515ebee None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.031386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1da5d-dd00-4ebc-b1e4-3fbf0515ebee None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.033109 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 626/1259] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:34.039476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c2306-9f12-40ea-8041-d88e7a0c8884 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.039869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c2306-9f12-40ea-8041-d88e7a0c8884 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.040031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c2306-9f12-40ea-8041-d88e7a0c8884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.057903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-275c2306-9f12-40ea-8041-d88e7a0c8884 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:34.059082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-275c2306-9f12-40ea-8041-d88e7a0c8884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:34.066694 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 634/1260] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:34.091562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1da5d-dd00-4ebc-b1e4-3fbf0515ebee None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.104159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1da5d-dd00-4ebc-b1e4-3fbf0515ebee None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.108485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.109287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.109571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.109845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.120112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:48:34.126951 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:48:34.128068 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 627/1261] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:34.134253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c2306-9f12-40ea-8041-d88e7a0c8884 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.143364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c2306-9f12-40ea-8041-d88e7a0c8884 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.148474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.149154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.149430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.149697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.150437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:34.150736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.152294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.160295 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 635/1262] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:34.166648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.177122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f29aab-35f4-42d6-ab3b-0c6bfe48c2e7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.181716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.182515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.182794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.183064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.193098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.194884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.216571 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:34.216571 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 628/1263] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:34.218512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.228753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d450d24-449e-459c-92bc-82f36d23df3b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.233650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.234399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.234683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.234955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.235670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:34.235973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.237576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.249387 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 636/1264] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:34.255265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.264966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400907e4-2d97-4e83-b598-73be898fae7b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.269613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.270415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.270690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.270955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.278573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.280542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.294754 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 25 20:48:34.295946 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 629/1265] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:34.301789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.311207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d4c3e-0bef-44e4-9f78-c70757196a9f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.315698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.316334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.316610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.316913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.317726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:34.318029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.319894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.337685 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 637/1266] 10.222.0.32 () {56 vars in 1164 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:34.343387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.353452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cab552-6f22-48b2-93bc-f8497535dd4b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.357936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.358695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.358983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.359256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.369558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.371350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.387572 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:34.388672 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 630/1267] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:34.394417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.404376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9ff70-9902-4942-b13b-3d4896e5f185 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.408926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.409559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.409839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.410115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.410831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:34.411137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.413376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.424279 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 638/1268] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:34.430032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.439427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d3475-a2ca-4c76-adfb-1fa67314889a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.444391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.445171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.445446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.445816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.452502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.454460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.467909 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:48:34.468959 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 631/1269] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:34.474908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.484296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82954cc0-dd1a-49a8-8837-e0536bc14f8b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.489341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80496ce9-8f99-4c1f-acad-bc3f29ed1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.489971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496ce9-8f99-4c1f-acad-bc3f29ed1a82 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.490273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496ce9-8f99-4c1f-acad-bc3f29ed1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.490547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496ce9-8f99-4c1f-acad-bc3f29ed1a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.491316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80496ce9-8f99-4c1f-acad-bc3f29ed1a82 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:34.491622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80496ce9-8f99-4c1f-acad-bc3f29ed1a82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.493455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80496ce9-8f99-4c1f-acad-bc3f29ed1a82 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.505157 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 639/1270] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:48:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:34.511663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:34.522235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f873afb-5dd3-4d15-961b-8029d37a94e4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:34.526723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309e1f-b07f-418f-860b-3917ce517c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:34.527564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309e1f-b07f-418f-860b-3917ce517c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:34.527844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309e1f-b07f-418f-860b-3917ce517c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:34.528116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309e1f-b07f-418f-860b-3917ce517c6f admin admin] PATH_INFO: `/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79c9077ed07144bdb0149dd6be7d134a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:34.530092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309e1f-b07f-418f-860b-3917ce517c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de2c022c7e473abd53e78670253e88, user_id=79c9077ed07144bdb0149dd6be7d134a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:34.532639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d309e1f-b07f-418f-860b-3917ce517c6f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:34.614683 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 632/1271] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 20:48:34 2021] PUT /identity/v3/projects/f8de2c022c7e473abd53e78670253e88/users/79c9077ed07144bdb0149dd6be7d134a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 20:48:36.980929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ad385-3a31-4130-9b39-de51a85d59ef None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:36.981462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ad385-3a31-4130-9b39-de51a85d59ef None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:36.981462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ad385-3a31-4130-9b39-de51a85d59ef None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:36.983242 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 640/1272] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:36.989094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be761025-71d4-41a1-bd51-3b17efa8f804 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:36.989528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be761025-71d4-41a1-bd51-3b17efa8f804 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:36.992401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be761025-71d4-41a1-bd51-3b17efa8f804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.007642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-be761025-71d4-41a1-bd51-3b17efa8f804 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:37.008815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be761025-71d4-41a1-bd51-3b17efa8f804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:37.063996 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 633/1273] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:37.090126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ad385-3a31-4130-9b39-de51a85d59ef None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.102611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ad385-3a31-4130-9b39-de51a85d59ef None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.107062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.107939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.108212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.108479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.118640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 20:48:37.125776 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 25 20:48:37.126889 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 641/1274] 10.222.0.32 () {56 vars in 1117 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:37.133071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be761025-71d4-41a1-bd51-3b17efa8f804 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.142008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be761025-71d4-41a1-bd51-3b17efa8f804 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.147093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.147732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.148012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.148292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.149078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:37.149387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.150970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.159006 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 634/1275] 10.222.0.32 () {56 vars in 1120 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:37.165646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.175852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3dd84-25ae-4379-a31f-dc3044c1dc87 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.180711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.181524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.181801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.182074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.192802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.194653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.211565 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:37.212777 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 642/1276] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:48:37.219006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.229381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2657b-f9dc-4e4b-89d9-6e8002ee09bb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.234081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.234756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.235034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.235307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.236031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:37.236336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.238208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.249818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 635/1277] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:37.256141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.267951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc10676-0423-4f2d-80a1-d7a23e3d5e72 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.273188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.273967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.274248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.274521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.281765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.283751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.297991 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 25 20:48:37.299098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 643/1278] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:48:37.307300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.316949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157da4-5fe3-42f1-9035-7aeb2a8a1d33 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.321421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.322068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.322346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.322616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.323447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:37.323751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.325593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.343412 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 636/1279] 10.222.0.32 () {56 vars in 1164 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 20:48:37.351003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.360635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef0ce9-a22b-4f15-90d3-8af01345265d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.365663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.366331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.366627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.366886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.374614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.376371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.385251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 644/1280] 10.222.0.32 () {58 vars in 1324 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:48:37.392707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.403048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75887a3-5374-4e5a-89f6-5aca4cfe2845 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.407739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.408511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.408785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.409200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.421096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.422979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.439691 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 25 20:48:37.440831 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 637/1281] 10.222.0.32 () {56 vars in 1129 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:37.448828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.457776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4ce6-818a-4297-aefa-35c79f5f7c91 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.463179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.463767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.464043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.464314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.465058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:37.465365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.466977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.478184 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 645/1282] 10.222.0.32 () {56 vars in 1130 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:37.484212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.493855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9699-cd3a-425f-a7aa-52c4ba62e06c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.498381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.499134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.499415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.499687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.506934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.511839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.522288 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 25 20:48:37.523424 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 638/1283] 10.222.0.32 () {56 vars in 1132 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:48:37.530035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.539550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aed3a-ab01-41ec-9618-33d06979a715 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.544033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2be85b-bf28-4456-bc7b-05b1156ae269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.544667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2be85b-bf28-4456-bc7b-05b1156ae269 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.544981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2be85b-bf28-4456-bc7b-05b1156ae269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.545259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2be85b-bf28-4456-bc7b-05b1156ae269 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.546041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2be85b-bf28-4456-bc7b-05b1156ae269 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:37.546349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2be85b-bf28-4456-bc7b-05b1156ae269 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.548151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2be85b-bf28-4456-bc7b-05b1156ae269 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.560034 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 646/1284] 10.222.0.32 () {56 vars in 1169 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:37.566579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:37.577326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aef1f9-a220-40a7-aaec-7c01fc4019ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:37.581909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f920aee-17bf-4e00-a225-fdabcbb9367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:37.582530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920aee-17bf-4e00-a225-fdabcbb9367f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:37.582813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920aee-17bf-4e00-a225-fdabcbb9367f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:37.583086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920aee-17bf-4e00-a225-fdabcbb9367f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:37.583900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f920aee-17bf-4e00-a225-fdabcbb9367f admin admin] RBAC: Adding query filter params (role.id=ea5f089fb3e14674bf5b72ebed6e787a, scope.project.id=f8de2c022c7e473abd53e78670253e88, user.id=79c9077ed07144bdb0149dd6be7d134a) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:37.584807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f920aee-17bf-4e00-a225-fdabcbb9367f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:37.586736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f920aee-17bf-4e00-a225-fdabcbb9367f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:37.592330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 639/1285] 10.222.0.32 () {56 vars in 1395 bytes} [Sat Dec 25 20:48:37 2021] GET /identity/v3/role_assignments?user.id=79c9077ed07144bdb0149dd6be7d134a&scope.project.id=f8de2c022c7e473abd53e78670253e88&role.id=ea5f089fb3e14674bf5b72ebed6e787a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:40.017388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1d5f-7f2d-408e-ba63-0ab8b5b8c3ee None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:40.017895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1d5f-7f2d-408e-ba63-0ab8b5b8c3ee None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:40.018006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae1d5f-7f2d-408e-ba63-0ab8b5b8c3ee None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:40.019847 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 647/1286] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:40.025483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843479-914f-45ad-8f67-8c3fc261af09 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:40.025896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843479-914f-45ad-8f67-8c3fc261af09 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:40.026078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843479-914f-45ad-8f67-8c3fc261af09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:40.043427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3a843479-914f-45ad-8f67-8c3fc261af09 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:40.044582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a843479-914f-45ad-8f67-8c3fc261af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:40.052137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 640/1287] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:40.076827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae1d5f-7f2d-408e-ba63-0ab8b5b8c3ee None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:40.089456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae1d5f-7f2d-408e-ba63-0ab8b5b8c3ee None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:40.093773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:40.094542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:40.094821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:40.095093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:40.095746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:40.097366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:40.108767 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 25 20:48:40.109898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 648/1288] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:48:40 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:40.116459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843479-914f-45ad-8f67-8c3fc261af09 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:40.125196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843479-914f-45ad-8f67-8c3fc261af09 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:40.129623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172072b3-c1e3-4d3b-a6a2-5389630884e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:40.130261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172072b3-c1e3-4d3b-a6a2-5389630884e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:40.130538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172072b3-c1e3-4d3b-a6a2-5389630884e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:40.130807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172072b3-c1e3-4d3b-a6a2-5389630884e7 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:40.131529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172072b3-c1e3-4d3b-a6a2-5389630884e7 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:40.131829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172072b3-c1e3-4d3b-a6a2-5389630884e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:40.133417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172072b3-c1e3-4d3b-a6a2-5389630884e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:40.138010 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 641/1289] 10.222.0.32 () {56 vars in 1137 bytes} [Sat Dec 25 20:48:40 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:40.143748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:40.153589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de03b2-6c90-4760-b9a5-80bbf3311b74 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:40.158044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2380e9-ac29-4855-9e82-67e92d032748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:40.158657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2380e9-ac29-4855-9e82-67e92d032748 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:40.161744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2380e9-ac29-4855-9e82-67e92d032748 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:40.161744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2380e9-ac29-4855-9e82-67e92d032748 admin admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:40.161744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2380e9-ac29-4855-9e82-67e92d032748 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:40.161744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2380e9-ac29-4855-9e82-67e92d032748 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:40.161744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2380e9-ac29-4855-9e82-67e92d032748 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:40.166523 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 649/1290] 10.222.0.32 () {56 vars in 1137 bytes} [Sat Dec 25 20:48:40 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:42.536983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ac919-9d9b-4d52-879a-c37e28cc54c2 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:42.537513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ac919-9d9b-4d52-879a-c37e28cc54c2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:42.537606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ac919-9d9b-4d52-879a-c37e28cc54c2 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:42.539306 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 642/1291] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:42.545355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2aa96-d608-40b7-93eb-533a4038ade9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:42.545842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2aa96-d608-40b7-93eb-533a4038ade9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:42.545921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2aa96-d608-40b7-93eb-533a4038ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:42.563256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cdf2aa96-d608-40b7-93eb-533a4038ade9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:42.564456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cdf2aa96-d608-40b7-93eb-533a4038ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:42.572002 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 650/1292] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:42.596728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ac919-9d9b-4d52-879a-c37e28cc54c2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:42.609231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ac919-9d9b-4d52-879a-c37e28cc54c2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:42.613848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f1dc4-fbd9-4495-a399-1ceaa385c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:42.614487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1dc4-fbd9-4495-a399-1ceaa385c764 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:42.614770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1dc4-fbd9-4495-a399-1ceaa385c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:42.615043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f1dc4-fbd9-4495-a399-1ceaa385c764 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:42.615773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f1dc4-fbd9-4495-a399-1ceaa385c764 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:42.617377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f1dc4-fbd9-4495-a399-1ceaa385c764 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:42.712820 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 643/1293] 10.222.0.32 () {60 vars in 1162 bytes} [Sat Dec 25 20:48:42 2021] POST /identity/v3/services => generated 246 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 20:48:45.114289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5047ac4-05a9-4b54-9b1b-81efc57df866 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:45.114859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5047ac4-05a9-4b54-9b1b-81efc57df866 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:45.114859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5047ac4-05a9-4b54-9b1b-81efc57df866 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:45.117187 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 651/1294] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:45.122749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e9ea-0564-4126-863d-a27b074d5e90 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:45.123179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e9ea-0564-4126-863d-a27b074d5e90 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:45.123307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e9ea-0564-4126-863d-a27b074d5e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:45.140744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bd93e9ea-0564-4126-863d-a27b074d5e90 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:45.145513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bd93e9ea-0564-4126-863d-a27b074d5e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:45.158268 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 644/1295] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:45 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:48:45.183302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5047ac4-05a9-4b54-9b1b-81efc57df866 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:45.195165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5047ac4-05a9-4b54-9b1b-81efc57df866 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:45.199436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:45.200198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:45.200472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:45.200738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:45.201420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:45.202977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:45.213727 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 25 20:48:45.215075 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 652/1296] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:48:45 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 20:48:45.222166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e9ea-0564-4126-863d-a27b074d5e90 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:45.231665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93e9ea-0564-4126-863d-a27b074d5e90 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:45.236228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:45.236898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:45.237192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:45.237465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:45.238457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:45.238752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:45.240993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:45.246467 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 645/1297] 10.222.0.32 () {56 vars in 1137 bytes} [Sat Dec 25 20:48:45 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:45.254608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:45.264891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8622-027f-4675-8a75-1128b68ca119 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:45.269731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bc233-50fa-4619-93aa-572091a59c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:45.270376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bc233-50fa-4619-93aa-572091a59c23 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:45.270655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bc233-50fa-4619-93aa-572091a59c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:45.270928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bc233-50fa-4619-93aa-572091a59c23 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:45.271731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bc233-50fa-4619-93aa-572091a59c23 admin admin] RBAC: Adding query filter params (interface=public, service_id=1dc150f505964661b18b5fd0fd334d83, region_id=RegionOne) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:45.272099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bc233-50fa-4619-93aa-572091a59c23 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:45.273715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bc233-50fa-4619-93aa-572091a59c23 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:45.280612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 653/1298] 10.222.0.32 () {56 vars in 1272 bytes} [Sat Dec 25 20:48:45 2021] GET /identity/v3/endpoints?service_id=1dc150f505964661b18b5fd0fd334d83&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:45.287350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:45.296954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17044fd9-4adb-4022-a568-b4fc472b64ff admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:45.301425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06507ddd-cec1-4cb1-af16-90c75673cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:45.302066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507ddd-cec1-4cb1-af16-90c75673cc59 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:45.302345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507ddd-cec1-4cb1-af16-90c75673cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:45.303218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507ddd-cec1-4cb1-af16-90c75673cc59 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:45.303895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507ddd-cec1-4cb1-af16-90c75673cc59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:45.305491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507ddd-cec1-4cb1-af16-90c75673cc59 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:45.312129 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 646/1299] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:48:45 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:48:47.704608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382769-0436-4346-8215-fd12800c4bc0 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:47.705197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382769-0436-4346-8215-fd12800c4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:47.705197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382769-0436-4346-8215-fd12800c4bc0 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:47.706927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 654/1300] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:48:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:48:47.712535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d8c6-9d9f-4076-9463-058bb4d60e44 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:47.712929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d8c6-9d9f-4076-9463-058bb4d60e44 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:47.717318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d8c6-9d9f-4076-9463-058bb4d60e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:47.730233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a621d8c6-9d9f-4076-9463-058bb4d60e44 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:48:47.731391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a621d8c6-9d9f-4076-9463-058bb4d60e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:48:47.739204 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 647/1301] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:48:47 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:48:47.764896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7382769-0436-4346-8215-fd12800c4bc0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:47.777555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7382769-0436-4346-8215-fd12800c4bc0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:47.782571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:47.783397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:47.783720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:47.784032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:47.784741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:47.786400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:47.797010 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 25 20:48:47.798382 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 655/1302] 10.222.0.32 () {56 vars in 1138 bytes} [Sat Dec 25 20:48:47 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 20:48:47.805007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d8c6-9d9f-4076-9463-058bb4d60e44 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:47.813902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d8c6-9d9f-4076-9463-058bb4d60e44 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:47.819035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549fe47-9c5e-4ce2-8f3f-07e9836e2f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:47.819667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549fe47-9c5e-4ce2-8f3f-07e9836e2f92 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:47.819942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549fe47-9c5e-4ce2-8f3f-07e9836e2f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:47.820320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549fe47-9c5e-4ce2-8f3f-07e9836e2f92 admin admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:47.821053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549fe47-9c5e-4ce2-8f3f-07e9836e2f92 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 20:48:47.821356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549fe47-9c5e-4ce2-8f3f-07e9836e2f92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:47.822908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549fe47-9c5e-4ce2-8f3f-07e9836e2f92 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:47.827899 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 648/1303] 10.222.0.32 () {56 vars in 1137 bytes} [Sat Dec 25 20:48:47 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:48:47.833935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:48:47.843896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5766da-e71b-4a7c-bf01-a11caf7e465f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:48:47.848467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151f505-d19f-4af7-b2d8-2dd57b35613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:48:47.852226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151f505-d19f-4af7-b2d8-2dd57b35613d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:48:47.852226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151f505-d19f-4af7-b2d8-2dd57b35613d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:48:47.852226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151f505-d19f-4af7-b2d8-2dd57b35613d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:48:47.852226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151f505-d19f-4af7-b2d8-2dd57b35613d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:48:47.852226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151f505-d19f-4af7-b2d8-2dd57b35613d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:48:47.957423 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 656/1304] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 20:48:47 2021] POST /identity/v3/endpoints => generated 331 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 20:56:37.593296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321337d2-40ea-4977-b2ca-d7adbbe32613 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:37.594207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321337d2-40ea-4977-b2ca-d7adbbe32613 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:37.594635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321337d2-40ea-4977-b2ca-d7adbbe32613 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:37.596628 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 649/1305] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:56:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:37.603109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84b4f-0aff-47fd-95fc-4dab7de72e16 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:37.603925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84b4f-0aff-47fd-95fc-4dab7de72e16 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:37.604356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84b4f-0aff-47fd-95fc-4dab7de72e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:37.677175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1fe84b4f-0aff-47fd-95fc-4dab7de72e16 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:37.678553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1fe84b4f-0aff-47fd-95fc-4dab7de72e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:37.790371 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 657/1306] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:37.815419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321337d2-40ea-4977-b2ca-d7adbbe32613 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:37.817519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-321337d2-40ea-4977-b2ca-d7adbbe32613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:38.050634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321337d2-40ea-4977-b2ca-d7adbbe32613 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:38.244295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed7f81-f82d-4808-83d2-cd15b65280d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:38.245064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7f81-f82d-4808-83d2-cd15b65280d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:38.245344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7f81-f82d-4808-83d2-cd15b65280d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:38.245617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7f81-f82d-4808-83d2-cd15b65280d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:38.246996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed7f81-f82d-4808-83d2-cd15b65280d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:38.248847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed7f81-f82d-4808-83d2-cd15b65280d0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:38.269066 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 650/1307] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:56:37 2021] GET /identity/v3/projects => generated 2553 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:56:40.813938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee7a6-bab6-4a16-97a8-202442659c39 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:40.814393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee7a6-bab6-4a16-97a8-202442659c39 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:40.814471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee7a6-bab6-4a16-97a8-202442659c39 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:40.816262 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 658/1308] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:56:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:40.822287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab7294-895a-4fee-a7be-701bb7c4adee None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:40.822718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab7294-895a-4fee-a7be-701bb7c4adee None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:40.822840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab7294-895a-4fee-a7be-701bb7c4adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:40.916016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a3ab7294-895a-4fee-a7be-701bb7c4adee None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:40.917294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3ab7294-895a-4fee-a7be-701bb7c4adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:41.011468 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 651/1309] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:56:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:41.036527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee7a6-bab6-4a16-97a8-202442659c39 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:41.038093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-239ee7a6-bab6-4a16-97a8-202442659c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:41.277455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee7a6-bab6-4a16-97a8-202442659c39 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:41.367875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06028582-6832-4f52-a6f1-d67081f86ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:41.368712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028582-6832-4f52-a6f1-d67081f86ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:41.369029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028582-6832-4f52-a6f1-d67081f86ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:41.369301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06028582-6832-4f52-a6f1-d67081f86ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:41.370027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06028582-6832-4f52-a6f1-d67081f86ae4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:41.371881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06028582-6832-4f52-a6f1-d67081f86ae4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:41.389969 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 659/1310] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:56:41 2021] GET /identity/v3/projects => generated 2553 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:56:43.899988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61fc5-e44d-4ba8-95ff-694ae648f572 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:43.900520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61fc5-e44d-4ba8-95ff-694ae648f572 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:43.900520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61fc5-e44d-4ba8-95ff-694ae648f572 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:43.902358 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 652/1311] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:56:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:43.908354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22826b85-d953-47fe-ba68-d173582cd36e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:43.908783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22826b85-d953-47fe-ba68-d173582cd36e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:43.909024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22826b85-d953-47fe-ba68-d173582cd36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:43.972639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-22826b85-d953-47fe-ba68-d173582cd36e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:43.974363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-22826b85-d953-47fe-ba68-d173582cd36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:44.068653 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 660/1312] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:44.120551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b0d16-4e5c-4bfd-aec3-283cf35311d7 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:44.120834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b0d16-4e5c-4bfd-aec3-283cf35311d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:44.121135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b0d16-4e5c-4bfd-aec3-283cf35311d7 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:44.122887 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 653/1313] 10.222.0.32 () {54 vars in 964 bytes} [Sat Dec 25 20:56:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:44.128822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc8bd-d182-4b4c-bcc1-e23347fbc4e6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:44.129641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc8bd-d182-4b4c-bcc1-e23347fbc4e6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:44.129921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc8bd-d182-4b4c-bcc1-e23347fbc4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:44.202529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0dbcc8bd-d182-4b4c-bcc1-e23347fbc4e6 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:44.203723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0dbcc8bd-d182-4b4c-bcc1-e23347fbc4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:44.278248 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 661/1314] 10.222.0.32 () {58 vars in 1061 bytes} [Sat Dec 25 20:56:44 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:44.287462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b0d16-4e5c-4bfd-aec3-283cf35311d7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:44.289004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c19b0d16-4e5c-4bfd-aec3-283cf35311d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:44.387599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b0d16-4e5c-4bfd-aec3-283cf35311d7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:44.456633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685e7e-0d63-48a5-b70f-db103044ed65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:44.457363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685e7e-0d63-48a5-b70f-db103044ed65 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:44.457640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685e7e-0d63-48a5-b70f-db103044ed65 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:44.457907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685e7e-0d63-48a5-b70f-db103044ed65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:44.459510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f4685e7e-0d63-48a5-b70f-db103044ed65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:44.561739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685e7e-0d63-48a5-b70f-db103044ed65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:44.563140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685e7e-0d63-48a5-b70f-db103044ed65 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:44.580163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 654/1315] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:56:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:56:47.269699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79af75-ea37-4983-9763-f43063a45500 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:47.270215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79af75-ea37-4983-9763-f43063a45500 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:47.270324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79af75-ea37-4983-9763-f43063a45500 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:47.272346 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 662/1316] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:56:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:47.277894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:47.278257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:47.278475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:47.343288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:47.344506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:47.551775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 655/1317] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:47.587290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79af75-ea37-4983-9763-f43063a45500 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:47.588978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8b79af75-ea37-4983-9763-f43063a45500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:47.710232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79af75-ea37-4983-9763-f43063a45500 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:47.800050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fc3c7-947b-4eaf-a27d-ff7877790bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:47.800976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fc3c7-947b-4eaf-a27d-ff7877790bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:47.801258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fc3c7-947b-4eaf-a27d-ff7877790bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:47.801529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fc3c7-947b-4eaf-a27d-ff7877790bd6 admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:47.802485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fc3c7-947b-4eaf-a27d-ff7877790bd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:47.804205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fc3c7-947b-4eaf-a27d-ff7877790bd6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:47.805897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 663/1318] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:56:47 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:56:47.818783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:47.819946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:47.906311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767956c-0e5f-456d-9f1b-fb5a6bf0e192 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:47.976857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828bb81-4cba-4416-a480-ba9340f90fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:47.977530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828bb81-4cba-4416-a480-ba9340f90fcd service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:47.977808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828bb81-4cba-4416-a480-ba9340f90fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:47.978079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828bb81-4cba-4416-a480-ba9340f90fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:47.979678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8828bb81-4cba-4416-a480-ba9340f90fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:48.081704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828bb81-4cba-4416-a480-ba9340f90fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:48.083538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828bb81-4cba-4416-a480-ba9340f90fcd service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:48.101868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 656/1319] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:56:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:56:51.064820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20843ef-4bd0-4517-a53e-236b8b9fa2a3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:51.065396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20843ef-4bd0-4517-a53e-236b8b9fa2a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:51.065396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20843ef-4bd0-4517-a53e-236b8b9fa2a3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:51.067216 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 664/1320] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:56:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:51.073043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:51.073448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:51.073593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:51.135778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:51.136990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:51.228053 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 657/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:56:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:51.264647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20843ef-4bd0-4517-a53e-236b8b9fa2a3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:51.266185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a20843ef-4bd0-4517-a53e-236b8b9fa2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:51.386617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20843ef-4bd0-4517-a53e-236b8b9fa2a3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:51.475488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52484f37-9614-451e-9831-351d8a0824c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:51.476327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52484f37-9614-451e-9831-351d8a0824c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:51.476602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52484f37-9614-451e-9831-351d8a0824c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:51.476890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52484f37-9614-451e-9831-351d8a0824c6 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:51.486315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52484f37-9614-451e-9831-351d8a0824c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:51.488834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52484f37-9614-451e-9831-351d8a0824c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:51.490524 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 665/1322] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:56:51 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:56:51.502866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:51.504064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:51.588653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd2535-c284-4096-89aa-9f48416e845c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:51.658347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc22fd-16b2-4d02-97d1-28882ef3fff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:51.659017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc22fd-16b2-4d02-97d1-28882ef3fff0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:51.659333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc22fd-16b2-4d02-97d1-28882ef3fff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:51.659572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc22fd-16b2-4d02-97d1-28882ef3fff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:51.661732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f4dc22fd-16b2-4d02-97d1-28882ef3fff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:51.765423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc22fd-16b2-4d02-97d1-28882ef3fff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:51.766771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc22fd-16b2-4d02-97d1-28882ef3fff0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:51.784388 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 658/1323] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:56:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:56:54.925396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1c78-88b8-4c07-bdfb-3fef54cab63e None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:54.926033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1c78-88b8-4c07-bdfb-3fef54cab63e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:54.926033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1c78-88b8-4c07-bdfb-3fef54cab63e None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:54.927746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 666/1324] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:56:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:54.933486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:54.933907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:54.934044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:54.996964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:54.998154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:55.089891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 659/1325] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:56:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:55.125003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe1c78-88b8-4c07-bdfb-3fef54cab63e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:55.126557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cbfe1c78-88b8-4c07-bdfb-3fef54cab63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:55.246575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe1c78-88b8-4c07-bdfb-3fef54cab63e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:55.335327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8c11a-1ab5-48c1-a516-fd1cae81aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:55.336171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c11a-1ab5-48c1-a516-fd1cae81aa21 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:55.336453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c11a-1ab5-48c1-a516-fd1cae81aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:55.336727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c11a-1ab5-48c1-a516-fd1cae81aa21 admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:55.346591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8c11a-1ab5-48c1-a516-fd1cae81aa21 admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:55.349193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8c11a-1ab5-48c1-a516-fd1cae81aa21 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:55.350878 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 667/1326] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:56:55 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:56:55.363543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:55.364734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:55.454709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9b948-83a1-481a-9a25-9f9b76113e7f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:55.524102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e232da7-f357-475b-a249-6e4512140459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:55.524664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232da7-f357-475b-a249-6e4512140459 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:55.524969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232da7-f357-475b-a249-6e4512140459 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:55.525243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e232da7-f357-475b-a249-6e4512140459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:55.526837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e232da7-f357-475b-a249-6e4512140459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:55.630748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e232da7-f357-475b-a249-6e4512140459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:55.632157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e232da7-f357-475b-a249-6e4512140459 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:55.649373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 660/1327] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:56:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:56:59.048190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1bce-4fb6-481f-8c77-c93a5ade37de None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:59.048661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1bce-4fb6-481f-8c77-c93a5ade37de None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:59.048757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1bce-4fb6-481f-8c77-c93a5ade37de None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:59.051282 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 668/1328] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:56:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:56:59.057162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0878-0a43-4b84-9f73-dcb13c64ba01 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:59.057567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0878-0a43-4b84-9f73-dcb13c64ba01 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:59.057708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d0878-0a43-4b84-9f73-dcb13c64ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:59.123295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-370d0878-0a43-4b84-9f73-dcb13c64ba01 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:56:59.124480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-370d0878-0a43-4b84-9f73-dcb13c64ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:59.216203 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 661/1329] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:56:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:56:59.254720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d1bce-4fb6-481f-8c77-c93a5ade37de None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:56:59.256244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b6d1bce-4fb6-481f-8c77-c93a5ade37de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:59.356328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d1bce-4fb6-481f-8c77-c93a5ade37de None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:56:59.426586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288057-dca1-4058-9d13-7d9556636fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:56:59.427218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288057-dca1-4058-9d13-7d9556636fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:56:59.427499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288057-dca1-4058-9d13-7d9556636fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:56:59.427767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288057-dca1-4058-9d13-7d9556636fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:56:59.429403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dd288057-dca1-4058-9d13-7d9556636fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:56:59.535074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288057-dca1-4058-9d13-7d9556636fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:56:59.536504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd288057-dca1-4058-9d13-7d9556636fa3 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:56:59.554161 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 669/1330] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:56:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:02.061647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1045-9828-4a72-bf32-7882cd77b57b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:02.062231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1045-9828-4a72-bf32-7882cd77b57b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:02.062231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1045-9828-4a72-bf32-7882cd77b57b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:02.063987 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 662/1331] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:02.069964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d8ad-e3fa-4c75-8423-d0d0719e14f3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:02.070365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d8ad-e3fa-4c75-8423-d0d0719e14f3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:02.070504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d8ad-e3fa-4c75-8423-d0d0719e14f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:02.137070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e020d8ad-e3fa-4c75-8423-d0d0719e14f3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:02.138250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e020d8ad-e3fa-4c75-8423-d0d0719e14f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:02.236391 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 670/1332] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:02.276570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a1045-9828-4a72-bf32-7882cd77b57b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:02.278623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-781a1045-9828-4a72-bf32-7882cd77b57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:02.387298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a1045-9828-4a72-bf32-7882cd77b57b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:02.460319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb1a97-dfde-4a39-857e-e65e80ae39e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:02.460989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb1a97-dfde-4a39-857e-e65e80ae39e8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:02.461268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb1a97-dfde-4a39-857e-e65e80ae39e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:02.461535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb1a97-dfde-4a39-857e-e65e80ae39e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:02.463131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-57bb1a97-dfde-4a39-857e-e65e80ae39e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:02.569693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb1a97-dfde-4a39-857e-e65e80ae39e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:02.571034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb1a97-dfde-4a39-857e-e65e80ae39e8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:02.589194 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 663/1333] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:57:05.053697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a21c4-005d-468d-a55a-5c31a09153e8 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:05.054193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a21c4-005d-468d-a55a-5c31a09153e8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:05.054193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a21c4-005d-468d-a55a-5c31a09153e8 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:05.056019 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 671/1334] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:05.061857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:05.062278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:05.062597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:05.125048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:05.126230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:05.220303 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 664/1335] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:05.256111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a21c4-005d-468d-a55a-5c31a09153e8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:05.257700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-175a21c4-005d-468d-a55a-5c31a09153e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:05.381502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a21c4-005d-468d-a55a-5c31a09153e8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:05.476780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3fa23-d705-49e3-a488-a40af44de4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:05.477786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3fa23-d705-49e3-a488-a40af44de4ba admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:05.478059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3fa23-d705-49e3-a488-a40af44de4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:05.478335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3fa23-d705-49e3-a488-a40af44de4ba admin admin] PATH_INFO: `/v3/projects/43439940dd2449978937f225023600e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:05.488017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3fa23-d705-49e3-a488-a40af44de4ba admin admin] RBAC: Authorizing `identity:get_project(project_id=43439940dd2449978937f225023600e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:05.490079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3fa23-d705-49e3-a488-a40af44de4ba admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:05.491779 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 672/1336] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:57:05 2021] GET /identity/v3/projects/43439940dd2449978937f225023600e8 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:57:05.503860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:05.505102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:05.592782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec97f2-ec5c-43c1-9ae2-99af00e6ee79 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:05.665615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fbd6b-c1b9-47d6-b803-ecf581125da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:05.666468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fbd6b-c1b9-47d6-b803-ecf581125da7 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:05.666578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fbd6b-c1b9-47d6-b803-ecf581125da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:05.666803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fbd6b-c1b9-47d6-b803-ecf581125da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:05.668478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-656fbd6b-c1b9-47d6-b803-ecf581125da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:05.774852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fbd6b-c1b9-47d6-b803-ecf581125da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:05.776286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fbd6b-c1b9-47d6-b803-ecf581125da7 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:05.795050 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 665/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:08.673785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40661-bbbb-4391-9df8-1d209b323b72 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:08.674365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40661-bbbb-4391-9df8-1d209b323b72 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:08.674365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40661-bbbb-4391-9df8-1d209b323b72 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:08.676221 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 673/1338] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:08.682070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd877c8-d500-4fcd-af66-9f45ab20e4ad None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:08.682491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd877c8-d500-4fcd-af66-9f45ab20e4ad None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:08.682620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd877c8-d500-4fcd-af66-9f45ab20e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:08.767106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1cd877c8-d500-4fcd-af66-9f45ab20e4ad None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:08.769480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1cd877c8-d500-4fcd-af66-9f45ab20e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:08.887658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 666/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:08.926309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40661-bbbb-4391-9df8-1d209b323b72 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:08.928452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ee40661-bbbb-4391-9df8-1d209b323b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:09.021722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40661-bbbb-4391-9df8-1d209b323b72 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:09.025250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e38cb0-9904-4484-bcf1-fc387a7ca112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:09.025877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38cb0-9904-4484-bcf1-fc387a7ca112 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:09.026151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38cb0-9904-4484-bcf1-fc387a7ca112 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:09.026422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e38cb0-9904-4484-bcf1-fc387a7ca112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:09.034971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e38cb0-9904-4484-bcf1-fc387a7ca112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:09.036416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e38cb0-9904-4484-bcf1-fc387a7ca112 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:09.045444 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 674/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:11.490424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778981-dfdb-4be0-906f-0a556b8e8998 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:11.490985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778981-dfdb-4be0-906f-0a556b8e8998 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:11.490985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778981-dfdb-4be0-906f-0a556b8e8998 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:11.492741 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 667/1341] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:11.498307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569bc09-0a63-4248-85ad-cc00fbbf468d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:11.498694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569bc09-0a63-4248-85ad-cc00fbbf468d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:11.498853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569bc09-0a63-4248-85ad-cc00fbbf468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:11.517108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4569bc09-0a63-4248-85ad-cc00fbbf468d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:11.518283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4569bc09-0a63-4248-85ad-cc00fbbf468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:11.526170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 675/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:11.562568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778981-dfdb-4be0-906f-0a556b8e8998 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:11.575362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778981-dfdb-4be0-906f-0a556b8e8998 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:11.579797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03853c32-b79a-457f-9610-b09da1f367b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:11.580720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853c32-b79a-457f-9610-b09da1f367b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:11.581041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853c32-b79a-457f-9610-b09da1f367b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:11.581319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853c32-b79a-457f-9610-b09da1f367b5 admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:11.582545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03853c32-b79a-457f-9610-b09da1f367b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:11.584292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03853c32-b79a-457f-9610-b09da1f367b5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:11.586095 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 668/1343] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:57:11 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:57:11.598883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569bc09-0a63-4248-85ad-cc00fbbf468d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:11.607945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569bc09-0a63-4248-85ad-cc00fbbf468d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:11.611495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e277b4-8046-47a3-9f33-cc6eb475373f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:11.612679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e277b4-8046-47a3-9f33-cc6eb475373f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:11.612985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e277b4-8046-47a3-9f33-cc6eb475373f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:11.613260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e277b4-8046-47a3-9f33-cc6eb475373f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:11.621854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e277b4-8046-47a3-9f33-cc6eb475373f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:11.623270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e277b4-8046-47a3-9f33-cc6eb475373f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:11.632372 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 676/1344] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:14.589916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99259f29-61d2-4e07-8195-028c08747ff9 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:14.590472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99259f29-61d2-4e07-8195-028c08747ff9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:14.590472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99259f29-61d2-4e07-8195-028c08747ff9 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:14.592482 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 669/1345] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:14.598886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18ff3-a906-4910-8932-1fd800d03fe2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:14.599298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18ff3-a906-4910-8932-1fd800d03fe2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:14.599427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18ff3-a906-4910-8932-1fd800d03fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:14.617468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-48f18ff3-a906-4910-8932-1fd800d03fe2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:14.618645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-48f18ff3-a906-4910-8932-1fd800d03fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:14.626373 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 677/1346] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:14.663900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99259f29-61d2-4e07-8195-028c08747ff9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:14.674857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99259f29-61d2-4e07-8195-028c08747ff9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:14.678288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a4abe-035c-4719-88d2-e0d7cfbb7e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:14.678914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a4abe-035c-4719-88d2-e0d7cfbb7e6f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:14.679189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a4abe-035c-4719-88d2-e0d7cfbb7e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:14.679455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a4abe-035c-4719-88d2-e0d7cfbb7e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:14.688092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a4abe-035c-4719-88d2-e0d7cfbb7e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:14.689574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a4abe-035c-4719-88d2-e0d7cfbb7e6f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:14.698614 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 670/1347] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:19.299447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1067ea-3a8f-4891-8759-08b781912e39 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:19.299952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1067ea-3a8f-4891-8759-08b781912e39 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:19.299952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1067ea-3a8f-4891-8759-08b781912e39 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:19.301704 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 678/1348] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:19.307456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224a9b3-67f8-41c0-b41e-e900f50ab6c8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:19.307872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224a9b3-67f8-41c0-b41e-e900f50ab6c8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:19.308001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224a9b3-67f8-41c0-b41e-e900f50ab6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:19.326246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e224a9b3-67f8-41c0-b41e-e900f50ab6c8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:19.327463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e224a9b3-67f8-41c0-b41e-e900f50ab6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:19.336494 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 671/1349] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:57:19.363056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1067ea-3a8f-4891-8759-08b781912e39 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:19.375395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1067ea-3a8f-4891-8759-08b781912e39 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:19.379841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f005df0-f750-4638-8a78-942de4e8ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:19.380480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f005df0-f750-4638-8a78-942de4e8ee22 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:19.380760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f005df0-f750-4638-8a78-942de4e8ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:19.381067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f005df0-f750-4638-8a78-942de4e8ee22 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:19.381822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f005df0-f750-4638-8a78-942de4e8ee22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:19.383642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f005df0-f750-4638-8a78-942de4e8ee22 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:19.397190 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 679/1350] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:57:19 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:57:21.858356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e35dd-ab8b-4747-8739-633b06967b8b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:21.858872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e35dd-ab8b-4747-8739-633b06967b8b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:21.858872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e35dd-ab8b-4747-8739-633b06967b8b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:21.860582 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 672/1351] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:21.866949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495526fa-52a3-443f-83b5-8316027d124b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:21.867379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495526fa-52a3-443f-83b5-8316027d124b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:21.867644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495526fa-52a3-443f-83b5-8316027d124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:21.886082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-495526fa-52a3-443f-83b5-8316027d124b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:21.887266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-495526fa-52a3-443f-83b5-8316027d124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:21.895264 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 680/1352] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:21.930442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e35dd-ab8b-4747-8739-633b06967b8b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:21.943326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e35dd-ab8b-4747-8739-633b06967b8b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:21.949713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9eccb-71f8-46f5-94b2-d6c616d7c69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:21.950601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9eccb-71f8-46f5-94b2-d6c616d7c69c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:21.950906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9eccb-71f8-46f5-94b2-d6c616d7c69c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:21.951180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9eccb-71f8-46f5-94b2-d6c616d7c69c admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:21.952401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9eccb-71f8-46f5-94b2-d6c616d7c69c admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:21.954401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9eccb-71f8-46f5-94b2-d6c616d7c69c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:21.956115 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 673/1353] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:57:21 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:57:21.968834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495526fa-52a3-443f-83b5-8316027d124b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:21.978361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495526fa-52a3-443f-83b5-8316027d124b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:21.981959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a9a5-f5d8-4d03-8b6f-d91db61de3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:21.982595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a9a5-f5d8-4d03-8b6f-d91db61de3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:21.982874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a9a5-f5d8-4d03-8b6f-d91db61de3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:21.983150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a9a5-f5d8-4d03-8b6f-d91db61de3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:21.993211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a9a5-f5d8-4d03-8b6f-d91db61de3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:21.994656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a9a5-f5d8-4d03-8b6f-d91db61de3d7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:22.004742 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 681/1354] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:25.484748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603980-dbe9-4e89-9261-921812312d4a None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:25.485389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603980-dbe9-4e89-9261-921812312d4a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:25.485493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603980-dbe9-4e89-9261-921812312d4a None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:25.487931 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 674/1355] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:25.494090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c8591-7e11-4687-b9b7-6206fdadeb33 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:25.494589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c8591-7e11-4687-b9b7-6206fdadeb33 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:25.494823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c8591-7e11-4687-b9b7-6206fdadeb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:25.516499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ec7c8591-7e11-4687-b9b7-6206fdadeb33 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:25.517707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ec7c8591-7e11-4687-b9b7-6206fdadeb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:25.526139 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 682/1356] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:25.567340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603980-dbe9-4e89-9261-921812312d4a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:25.578179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603980-dbe9-4e89-9261-921812312d4a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:25.581736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f003-992a-4c02-9b8d-67f757657772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:25.582365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f003-992a-4c02-9b8d-67f757657772 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:25.582646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f003-992a-4c02-9b8d-67f757657772 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:25.582920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f003-992a-4c02-9b8d-67f757657772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:25.592146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309f003-992a-4c02-9b8d-67f757657772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:25.593604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309f003-992a-4c02-9b8d-67f757657772 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:25.604786 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 675/1357] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:30.202856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057bf24-8d15-454e-8df1-789838e04725 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:30.203340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057bf24-8d15-454e-8df1-789838e04725 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:30.203340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057bf24-8d15-454e-8df1-789838e04725 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:30.205836 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 683/1358] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:30.211327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a183ba-58b2-445c-ba29-a07850abca44 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:30.211726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a183ba-58b2-445c-ba29-a07850abca44 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:30.211876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a183ba-58b2-445c-ba29-a07850abca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:30.230723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-22a183ba-58b2-445c-ba29-a07850abca44 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:30.231926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-22a183ba-58b2-445c-ba29-a07850abca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:30.240265 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 676/1359] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:30.280665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057bf24-8d15-454e-8df1-789838e04725 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:30.292073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057bf24-8d15-454e-8df1-789838e04725 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:30.295592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fc41b-004c-4300-b8b1-df100a9fe9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:30.296228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fc41b-004c-4300-b8b1-df100a9fe9ee service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:30.296506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fc41b-004c-4300-b8b1-df100a9fe9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:30.296776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fc41b-004c-4300-b8b1-df100a9fe9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:30.305534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fc41b-004c-4300-b8b1-df100a9fe9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:30.306944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fc41b-004c-4300-b8b1-df100a9fe9ee service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:30.316624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 684/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:35.259551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbf328-d3b5-4c61-81eb-ee51e3b8052b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:35.262956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbf328-d3b5-4c61-81eb-ee51e3b8052b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:35.263918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbf328-d3b5-4c61-81eb-ee51e3b8052b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:35.268020 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 677/1361] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 20:57:35 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:35.273452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251361a-dc5e-43e9-bc43-bb3fd7074c60 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:35.273888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251361a-dc5e-43e9-bc43-bb3fd7074c60 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:35.273999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251361a-dc5e-43e9-bc43-bb3fd7074c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:35.352140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f251361a-dc5e-43e9-bc43-bb3fd7074c60 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:35.353368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f251361a-dc5e-43e9-bc43-bb3fd7074c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:35.474899 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 685/1362] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 20:57:35 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:39.988758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb953-5dcd-4e26-b1d9-ee58a5dc9031 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:39.989390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb953-5dcd-4e26-b1d9-ee58a5dc9031 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:39.989390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb953-5dcd-4e26-b1d9-ee58a5dc9031 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:39.991265 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 678/1363] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 20:57:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:39.997126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32aa3-8ac2-49a0-bd78-a27f84ed3ddb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:39.997571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32aa3-8ac2-49a0-bd78-a27f84ed3ddb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:39.997861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32aa3-8ac2-49a0-bd78-a27f84ed3ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:40.017108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ffa32aa3-8ac2-49a0-bd78-a27f84ed3ddb None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:40.018486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ffa32aa3-8ac2-49a0-bd78-a27f84ed3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:40.028069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 686/1364] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 20:57:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:41.374519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa5988-fc80-4c31-8713-eda29ec48803 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:41.375050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa5988-fc80-4c31-8713-eda29ec48803 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:41.375050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa5988-fc80-4c31-8713-eda29ec48803 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:41.377742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 679/1365] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 20:57:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:41.382983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58183e41-efb9-4d22-a6ec-02ca54504a0e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:41.383383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58183e41-efb9-4d22-a6ec-02ca54504a0e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:41.383680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58183e41-efb9-4d22-a6ec-02ca54504a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:41.401778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-58183e41-efb9-4d22-a6ec-02ca54504a0e None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:41.402939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-58183e41-efb9-4d22-a6ec-02ca54504a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:41.411315 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 687/1366] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 20:57:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:45.333477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f9135-1953-415e-9495-528b0671a0b2 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:45.334808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f9135-1953-415e-9495-528b0671a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:45.335320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f9135-1953-415e-9495-528b0671a0b2 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:45.337817 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 680/1367] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:45.344175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a7f3d-891e-45fc-b454-90c844875d27 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:45.345372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a7f3d-891e-45fc-b454-90c844875d27 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:45.345857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a7f3d-891e-45fc-b454-90c844875d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:45.364864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0a7a7f3d-891e-45fc-b454-90c844875d27 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:45.366081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0a7a7f3d-891e-45fc-b454-90c844875d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:45.374134 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 688/1368] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:45.427250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dca0-44d1-468b-9ce3-e5eca5ec922e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:45.427535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dca0-44d1-468b-9ce3-e5eca5ec922e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:45.428010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36dca0-44d1-468b-9ce3-e5eca5ec922e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:45.429834 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 681/1369] 10.222.0.32 () {54 vars in 961 bytes} [Sat Dec 25 20:57:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:45.435759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439ffe-da62-4862-8238-41a95c88cfda None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:45.436272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439ffe-da62-4862-8238-41a95c88cfda None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:45.436658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439ffe-da62-4862-8238-41a95c88cfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:45.489108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-10439ffe-da62-4862-8238-41a95c88cfda None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:45.490460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-10439ffe-da62-4862-8238-41a95c88cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:45.573097 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 689/1370] 10.222.0.32 () {58 vars in 1058 bytes} [Sat Dec 25 20:57:45 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:45.582080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36dca0-44d1-468b-9ce3-e5eca5ec922e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:45.596583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36dca0-44d1-468b-9ce3-e5eca5ec922e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:45.602509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e46d38-d639-4e1b-88d5-26c7ca3ec68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:45.605859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e46d38-d639-4e1b-88d5-26c7ca3ec68e service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:45.605859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e46d38-d639-4e1b-88d5-26c7ca3ec68e service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:45.605859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e46d38-d639-4e1b-88d5-26c7ca3ec68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:45.620066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e46d38-d639-4e1b-88d5-26c7ca3ec68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:45.621837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e46d38-d639-4e1b-88d5-26c7ca3ec68e service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:45.632131 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 682/1371] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:48.282581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c631-7521-449d-80fe-93ca2a4bbb62 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:48.283109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c631-7521-449d-80fe-93ca2a4bbb62 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:48.283109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563c631-7521-449d-80fe-93ca2a4bbb62 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:48.284900 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 690/1372] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:57:48.290482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0889be-a500-4633-9cf0-665b778f646c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:48.290896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0889be-a500-4633-9cf0-665b778f646c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:48.291027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0889be-a500-4633-9cf0-665b778f646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:48.308444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2c0889be-a500-4633-9cf0-665b778f646c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:48.309651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2c0889be-a500-4633-9cf0-665b778f646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:48.318097 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 683/1373] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:48.367355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c631-7521-449d-80fe-93ca2a4bbb62 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:48.383540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563c631-7521-449d-80fe-93ca2a4bbb62 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:48.389983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0382ab-c511-44fa-9088-91e9558f395c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:48.390628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0382ab-c511-44fa-9088-91e9558f395c service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:48.390911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0382ab-c511-44fa-9088-91e9558f395c service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:48.391799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0382ab-c511-44fa-9088-91e9558f395c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:48.400795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0382ab-c511-44fa-9088-91e9558f395c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:48.402433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0382ab-c511-44fa-9088-91e9558f395c service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:48.412731 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 691/1374] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:51.321568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf44f9-a100-4f19-ac7e-117e5950fb63 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:51.322013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf44f9-a100-4f19-ac7e-117e5950fb63 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:51.322118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf44f9-a100-4f19-ac7e-117e5950fb63 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:51.324116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 684/1375] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:51.330511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9471f-7d08-4cb2-a5fd-2d52a0a72ff8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:51.330945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9471f-7d08-4cb2-a5fd-2d52a0a72ff8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:51.331631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9471f-7d08-4cb2-a5fd-2d52a0a72ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:51.351954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-37f9471f-7d08-4cb2-a5fd-2d52a0a72ff8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:51.353105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-37f9471f-7d08-4cb2-a5fd-2d52a0a72ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:51.362114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 692/1376] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:51.412267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dc515-c2f7-4b73-80ae-c97fa26f071e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:51.412602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dc515-c2f7-4b73-80ae-c97fa26f071e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:51.412937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dc515-c2f7-4b73-80ae-c97fa26f071e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:51.414762 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 685/1377] 10.222.0.32 () {54 vars in 961 bytes} [Sat Dec 25 20:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:51.420508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e124c5-37c9-4255-b538-1b6b4c6cce9a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:51.421016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e124c5-37c9-4255-b538-1b6b4c6cce9a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:51.421447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e124c5-37c9-4255-b538-1b6b4c6cce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:51.443511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d6e124c5-37c9-4255-b538-1b6b4c6cce9a None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:51.444692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d6e124c5-37c9-4255-b538-1b6b4c6cce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:51.454605 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 693/1378] 10.222.0.32 () {58 vars in 1058 bytes} [Sat Dec 25 20:57:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:51.462717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dc515-c2f7-4b73-80ae-c97fa26f071e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:51.480226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dc515-c2f7-4b73-80ae-c97fa26f071e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:51.487322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8068c-0722-4f4c-8bba-8dbfb46fa25f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:51.488101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8068c-0722-4f4c-8bba-8dbfb46fa25f service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:51.490357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8068c-0722-4f4c-8bba-8dbfb46fa25f service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:51.491225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8068c-0722-4f4c-8bba-8dbfb46fa25f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:51.503186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8068c-0722-4f4c-8bba-8dbfb46fa25f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:51.505060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8068c-0722-4f4c-8bba-8dbfb46fa25f service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:51.515561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 686/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:54.451917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363538-64cc-4d40-97fe-413b9b276325 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:54.452787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363538-64cc-4d40-97fe-413b9b276325 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:54.453332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34363538-64cc-4d40-97fe-413b9b276325 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:54.461472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99382748-70b5-4502-8255-a90c9edd37c2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:54.462232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99382748-70b5-4502-8255-a90c9edd37c2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:54.462661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99382748-70b5-4502-8255-a90c9edd37c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:54.466615 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 694/1380] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:54 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:54.481823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-99382748-70b5-4502-8255-a90c9edd37c2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:54.483208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-99382748-70b5-4502-8255-a90c9edd37c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:54.505223 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 687/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:57:54.540143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363538-64cc-4d40-97fe-413b9b276325 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:54.555304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34363538-64cc-4d40-97fe-413b9b276325 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:54.561029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec768-4878-4ae1-9fdd-6b422f62358f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:54.561833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec768-4878-4ae1-9fdd-6b422f62358f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:54.562294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec768-4878-4ae1-9fdd-6b422f62358f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:54.563250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec768-4878-4ae1-9fdd-6b422f62358f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:54.572104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec768-4878-4ae1-9fdd-6b422f62358f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:54.573889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec768-4878-4ae1-9fdd-6b422f62358f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:54.595949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 695/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:57.431608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368ecb-5d84-48ac-b690-ea55d399029d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.432169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368ecb-5d84-48ac-b690-ea55d399029d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.432169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368ecb-5d84-48ac-b690-ea55d399029d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.433872 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 688/1383] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:57.436809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c10f-2952-46ee-a6b3-7785114ae8d1 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.438480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c10f-2952-46ee-a6b3-7785114ae8d1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.439066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c10f-2952-46ee-a6b3-7785114ae8d1 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.441186 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 696/1384] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:57:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:57:57.442763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f70b2-4fd0-4cf8-9ea8-faddae178c03 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.443053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f70b2-4fd0-4cf8-9ea8-faddae178c03 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.443331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f70b2-4fd0-4cf8-9ea8-faddae178c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.446800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb37c7-7b13-45eb-a20b-51ed02e278ca None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.447304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb37c7-7b13-45eb-a20b-51ed02e278ca None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.447648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb37c7-7b13-45eb-a20b-51ed02e278ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.462936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ba6f70b2-4fd0-4cf8-9ea8-faddae178c03 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:57.464622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ba6f70b2-4fd0-4cf8-9ea8-faddae178c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:57.465950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-78fb37c7-7b13-45eb-a20b-51ed02e278ca None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:57.467170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-78fb37c7-7b13-45eb-a20b-51ed02e278ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:57.473828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 689/1385] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:57.480931 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 697/1386] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:57:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:57:57.521926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f70b2-4fd0-4cf8-9ea8-faddae178c03 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:57.533227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93455b-3e02-42e9-864d-a663682722dc None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.538682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93455b-3e02-42e9-864d-a663682722dc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.538682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93455b-3e02-42e9-864d-a663682722dc None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.538682 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 698/1387] 10.222.0.32 () {54 vars in 963 bytes} [Sat Dec 25 20:57:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:57:57.538963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f70b2-4fd0-4cf8-9ea8-faddae178c03 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:57.541331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4e78-d352-47fe-a155-9b268d40d53a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.541618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4e78-d352-47fe-a155-9b268d40d53a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.541920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4e78-d352-47fe-a155-9b268d40d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.542878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:57.543786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.544151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.544519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.553700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:57.556396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:57.568021 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 690/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:57:57.598280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-990c4e78-d352-47fe-a155-9b268d40d53a None None] MFA Rules not processed for user `0f668b27e2af43fd812f309f6908199c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:57:57.599465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-990c4e78-d352-47fe-a155-9b268d40d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:57:57.667258 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 699/1389] 10.222.0.32 () {58 vars in 1060 bytes} [Sat Dec 25 20:57:57 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:57:57.676223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:57:57.685958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea91cbb-74f9-49c0-8c29-eea9d2e7e9a4 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:57:57.689589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d33aa-74c0-4470-951b-c87b4390dd09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:57:57.690233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d33aa-74c0-4470-951b-c87b4390dd09 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:57:57.693395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d33aa-74c0-4470-951b-c87b4390dd09 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:57:57.693395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d33aa-74c0-4470-951b-c87b4390dd09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:57:57.700679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d33aa-74c0-4470-951b-c87b4390dd09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:57:57.702133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d33aa-74c0-4470-951b-c87b4390dd09 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:57:57.713902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 691/1390] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:57:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:58:00.196378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee68d64-1458-4387-b523-17f046d72fbd None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:00.196865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee68d64-1458-4387-b523-17f046d72fbd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:00.196865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee68d64-1458-4387-b523-17f046d72fbd None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:00.198706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 700/1391] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:00.204419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18dd3-d970-4759-a10b-c42839e69fa7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:00.204844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18dd3-d970-4759-a10b-c42839e69fa7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:00.205176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d18dd3-d970-4759-a10b-c42839e69fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:00.223058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-01d18dd3-d970-4759-a10b-c42839e69fa7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:00.224229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-01d18dd3-d970-4759-a10b-c42839e69fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:00.232292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 692/1392] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:00.279816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee68d64-1458-4387-b523-17f046d72fbd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:00.294455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee68d64-1458-4387-b523-17f046d72fbd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:00.300480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee1a9-befd-47e9-9fe0-3565d780e2c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:00.316159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee1a9-befd-47e9-9fe0-3565d780e2c1 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:00.316159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee1a9-befd-47e9-9fe0-3565d780e2c1 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:00.316159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee1a9-befd-47e9-9fe0-3565d780e2c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:00.316159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afee1a9-befd-47e9-9fe0-3565d780e2c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:00.316159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afee1a9-befd-47e9-9fe0-3565d780e2c1 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:00.320727 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 701/1393] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:03.050870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ff6d-cfd1-4f8f-bc5c-3bd94ce2f8bd None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:03.051424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ff6d-cfd1-4f8f-bc5c-3bd94ce2f8bd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:03.051665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ff6d-cfd1-4f8f-bc5c-3bd94ce2f8bd None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:03.053894 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 693/1394] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:03.060343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0f17-140e-4fdf-b60b-7697f5131969 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:03.060806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0f17-140e-4fdf-b60b-7697f5131969 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:03.061083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc0f17-140e-4fdf-b60b-7697f5131969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:03.082028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cdfc0f17-140e-4fdf-b60b-7697f5131969 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:03.083397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cdfc0f17-140e-4fdf-b60b-7697f5131969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:03.092860 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 702/1395] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:03.142808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ff6d-cfd1-4f8f-bc5c-3bd94ce2f8bd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:03.158084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ff6d-cfd1-4f8f-bc5c-3bd94ce2f8bd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:03.164716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449831b-f4ad-468c-8159-c51f11b60074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:03.165550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449831b-f4ad-468c-8159-c51f11b60074 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:03.165935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449831b-f4ad-468c-8159-c51f11b60074 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:03.166317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449831b-f4ad-468c-8159-c51f11b60074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:03.176434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449831b-f4ad-468c-8159-c51f11b60074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:03.178294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449831b-f4ad-468c-8159-c51f11b60074 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:03.191002 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 694/1396] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:05.744694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7724-91be-4d3b-936a-e5f3d9f7b04a None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:05.745419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7724-91be-4d3b-936a-e5f3d9f7b04a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:05.745419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7724-91be-4d3b-936a-e5f3d9f7b04a None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:05.747567 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 703/1397] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:05.754520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9db7b-be8a-43cf-a02a-cdf87f4da707 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:05.757810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9db7b-be8a-43cf-a02a-cdf87f4da707 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:05.757810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9db7b-be8a-43cf-a02a-cdf87f4da707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:05.778162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-24b9db7b-be8a-43cf-a02a-cdf87f4da707 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:05.779644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-24b9db7b-be8a-43cf-a02a-cdf87f4da707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:05.789555 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 695/1398] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:05.839277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7724-91be-4d3b-936a-e5f3d9f7b04a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:05.854543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7724-91be-4d3b-936a-e5f3d9f7b04a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:05.861086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837535b-5d6c-4053-b93a-9a5ba6131dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:05.861762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837535b-5d6c-4053-b93a-9a5ba6131dd2 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:05.862056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837535b-5d6c-4053-b93a-9a5ba6131dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:05.862367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837535b-5d6c-4053-b93a-9a5ba6131dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:05.871336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837535b-5d6c-4053-b93a-9a5ba6131dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:05.872982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837535b-5d6c-4053-b93a-9a5ba6131dd2 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:05.883655 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 704/1399] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:09.585025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47b0ab-9417-452a-b3bc-ba70f658f5e9 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:09.585672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47b0ab-9417-452a-b3bc-ba70f658f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:09.585672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47b0ab-9417-452a-b3bc-ba70f658f5e9 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:09.588333 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 696/1400] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:58:09.596009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b86b-36e1-4f43-bd4c-d06baba035f0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:09.596707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b86b-36e1-4f43-bd4c-d06baba035f0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:09.596707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b86b-36e1-4f43-bd4c-d06baba035f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:09.620892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d377b86b-36e1-4f43-bd4c-d06baba035f0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:09.623140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d377b86b-36e1-4f43-bd4c-d06baba035f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:09.630185 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 705/1401] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:58:09.679168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47b0ab-9417-452a-b3bc-ba70f658f5e9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:09.694179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47b0ab-9417-452a-b3bc-ba70f658f5e9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:09.699930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45074fd9-ebf0-4ed2-ac35-463adb80b443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:09.700571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074fd9-ebf0-4ed2-ac35-463adb80b443 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:09.700896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074fd9-ebf0-4ed2-ac35-463adb80b443 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:09.701190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074fd9-ebf0-4ed2-ac35-463adb80b443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:09.710678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45074fd9-ebf0-4ed2-ac35-463adb80b443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:09.714568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45074fd9-ebf0-4ed2-ac35-463adb80b443 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:09.722861 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 697/1402] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:12.524981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e2dab-3ae3-490d-8aae-a7eccfab4512 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:12.525539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e2dab-3ae3-490d-8aae-a7eccfab4512 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:12.525539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e2dab-3ae3-490d-8aae-a7eccfab4512 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:12.527352 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 706/1403] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:12.533112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182115b7-cafb-401a-86cb-cec1c1a469a7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:12.533563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182115b7-cafb-401a-86cb-cec1c1a469a7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:12.533676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182115b7-cafb-401a-86cb-cec1c1a469a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:12.551708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-182115b7-cafb-401a-86cb-cec1c1a469a7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:12.552909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-182115b7-cafb-401a-86cb-cec1c1a469a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:12.560715 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 698/1404] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:12.607764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e2dab-3ae3-490d-8aae-a7eccfab4512 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:12.622215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e2dab-3ae3-490d-8aae-a7eccfab4512 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:12.628065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157861b-d474-4000-9e80-1766d20e68dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:12.628818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157861b-d474-4000-9e80-1766d20e68dc service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:12.629136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157861b-d474-4000-9e80-1766d20e68dc service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:12.629409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157861b-d474-4000-9e80-1766d20e68dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:12.637664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157861b-d474-4000-9e80-1766d20e68dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:12.639358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157861b-d474-4000-9e80-1766d20e68dc service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:12.651208 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 707/1405] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:13.712035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1febb6d-179e-439e-99cd-ef7bf942d7ac None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:13.712634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1febb6d-179e-439e-99cd-ef7bf942d7ac None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:13.712634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1febb6d-179e-439e-99cd-ef7bf942d7ac None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:13.714750 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 699/1406] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:13.721311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd28d-09f2-45be-9532-8f9599bfe03b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:13.726557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd28d-09f2-45be-9532-8f9599bfe03b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:13.726557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd28d-09f2-45be-9532-8f9599bfe03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:13.739869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-508bd28d-09f2-45be-9532-8f9599bfe03b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:13.741086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-508bd28d-09f2-45be-9532-8f9599bfe03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:13.749045 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 708/1407] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:13.808223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91725eeb-96c7-4ffa-8d5f-b3cf1e7963bb None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:13.808504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91725eeb-96c7-4ffa-8d5f-b3cf1e7963bb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:13.808780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91725eeb-96c7-4ffa-8d5f-b3cf1e7963bb None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:13.810581 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 700/1408] 10.222.0.32 () {54 vars in 962 bytes} [Sat Dec 25 20:58:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:13.816952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154997f7-8475-4aaa-9da1-a32f35ba09a7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:13.817345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154997f7-8475-4aaa-9da1-a32f35ba09a7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:13.817689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154997f7-8475-4aaa-9da1-a32f35ba09a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:13.866615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-154997f7-8475-4aaa-9da1-a32f35ba09a7 None None] MFA Rules not processed for user `94e4b61a62d24f6c9274c0f46d514656`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:13.867847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-154997f7-8475-4aaa-9da1-a32f35ba09a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:13.925496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 709/1409] 10.222.0.32 () {58 vars in 1059 bytes} [Sat Dec 25 20:58:13 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:13.933722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91725eeb-96c7-4ffa-8d5f-b3cf1e7963bb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:13.944448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91725eeb-96c7-4ffa-8d5f-b3cf1e7963bb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:13.948146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16d03-c5e1-45cf-ac9f-2bd037cf0595 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:13.948783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16d03-c5e1-45cf-ac9f-2bd037cf0595 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:13.949094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16d03-c5e1-45cf-ac9f-2bd037cf0595 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:13.949368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16d03-c5e1-45cf-ac9f-2bd037cf0595 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:13.959367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16d03-c5e1-45cf-ac9f-2bd037cf0595 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:13.960790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16d03-c5e1-45cf-ac9f-2bd037cf0595 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:13.971930 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 701/1410] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:14.518230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb181-a036-408e-beeb-1b08fe4eef9b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:14.518744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb181-a036-408e-beeb-1b08fe4eef9b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:14.518959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bb181-a036-408e-beeb-1b08fe4eef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:14.567238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1b6bb181-a036-408e-beeb-1b08fe4eef9b None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:14.568429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b6bb181-a036-408e-beeb-1b08fe4eef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:14.629841 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 710/1411] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 20:58:14 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:14.676680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5607-ed2f-441c-970a-40885544092e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:14.677018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5607-ed2f-441c-970a-40885544092e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:14.677302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5607-ed2f-441c-970a-40885544092e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:14.679144 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 702/1412] 10.222.0.32 () {54 vars in 942 bytes} [Sat Dec 25 20:58:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:58:14.685871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7849f5-730c-46e0-8475-f94071215b00 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:14.686160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7849f5-730c-46e0-8475-f94071215b00 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:14.687048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7849f5-730c-46e0-8475-f94071215b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:14.734697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ad7849f5-730c-46e0-8475-f94071215b00 None None] MFA Rules not processed for user `eea4089e93f04fc5893b3e86954ead79`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:14.735881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ad7849f5-730c-46e0-8475-f94071215b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:14.804396 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 711/1413] 10.222.0.32 () {58 vars in 1039 bytes} [Sat Dec 25 20:58:14 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:14.815349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5607-ed2f-441c-970a-40885544092e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:14.828418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5607-ed2f-441c-970a-40885544092e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:14.833358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f49e9f-b225-4906-93cd-53aa424c8343 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:14.833994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f49e9f-b225-4906-93cd-53aa424c8343 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:14.834276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f49e9f-b225-4906-93cd-53aa424c8343 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:14.834552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f49e9f-b225-4906-93cd-53aa424c8343 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:14.843354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f49e9f-b225-4906-93cd-53aa424c8343 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:14.844952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f49e9f-b225-4906-93cd-53aa424c8343 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:14.853064 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 703/1414] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 20:58:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 20:58:15.291980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20b8a8-60d9-4277-98c3-31019dd79b85 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:15.292270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20b8a8-60d9-4277-98c3-31019dd79b85 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:15.292552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20b8a8-60d9-4277-98c3-31019dd79b85 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:15.294375 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 712/1415] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:15.305354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288373f-5a07-495c-9139-76aa2c2485a9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:15.306004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288373f-5a07-495c-9139-76aa2c2485a9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:15.306528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288373f-5a07-495c-9139-76aa2c2485a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:15.325949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b288373f-5a07-495c-9139-76aa2c2485a9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:15.327813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b288373f-5a07-495c-9139-76aa2c2485a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:15.339089 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 704/1416] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:15.386038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20b8a8-60d9-4277-98c3-31019dd79b85 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:15.403043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20b8a8-60d9-4277-98c3-31019dd79b85 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:15.409373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fdcac-124b-4550-a1dc-6f44b7e61709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:15.410012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fdcac-124b-4550-a1dc-6f44b7e61709 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:15.410291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fdcac-124b-4550-a1dc-6f44b7e61709 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:15.410559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fdcac-124b-4550-a1dc-6f44b7e61709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:15.418930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fdcac-124b-4550-a1dc-6f44b7e61709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:15.420560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fdcac-124b-4550-a1dc-6f44b7e61709 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:15.431680 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 713/1417] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:18.206918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1fe57-95e3-4bc2-bdf0-59d8d4a5e1ae None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:18.208403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1fe57-95e3-4bc2-bdf0-59d8d4a5e1ae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:18.208896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1fe57-95e3-4bc2-bdf0-59d8d4a5e1ae None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:18.211044 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 705/1418] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:58:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:18.217380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04e6a-3f58-4bdb-b4df-608bfa8823a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:18.218452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04e6a-3f58-4bdb-b4df-608bfa8823a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:18.218557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04e6a-3f58-4bdb-b4df-608bfa8823a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:18.243270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-aea04e6a-3f58-4bdb-b4df-608bfa8823a3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:18.249724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aea04e6a-3f58-4bdb-b4df-608bfa8823a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:18.255673 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 714/1419] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:58:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:18.306736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1fe57-95e3-4bc2-bdf0-59d8d4a5e1ae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:18.321944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1fe57-95e3-4bc2-bdf0-59d8d4a5e1ae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:18.328740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd8ad8-9218-491a-aca9-183c87483813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:18.329513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8ad8-9218-491a-aca9-183c87483813 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:18.329896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8ad8-9218-491a-aca9-183c87483813 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:18.330245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8ad8-9218-491a-aca9-183c87483813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:18.339640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd8ad8-9218-491a-aca9-183c87483813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:18.341564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd8ad8-9218-491a-aca9-183c87483813 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:18.357218 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 706/1420] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:40.458676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4b2c-7508-47da-b8b7-93f9fd7cdaf4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:40.459288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4b2c-7508-47da-b8b7-93f9fd7cdaf4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:40.459288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb4b2c-7508-47da-b8b7-93f9fd7cdaf4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:40.461038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 715/1421] 10.222.0.32 () {54 vars in 918 bytes} [Sat Dec 25 20:58:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:40.467827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5344-abc4-4420-980c-cb0f35b620c8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:40.468275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5344-abc4-4420-980c-cb0f35b620c8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:40.468369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca5344-abc4-4420-980c-cb0f35b620c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:40.488231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-74ca5344-abc4-4420-980c-cb0f35b620c8 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:40.489515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-74ca5344-abc4-4420-980c-cb0f35b620c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:40.498203 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 707/1422] 10.222.0.32 () {58 vars in 1015 bytes} [Sat Dec 25 20:58:40 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:40.514481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d89a2-36da-4348-b3ce-5f17f4519ed4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:40.514767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d89a2-36da-4348-b3ce-5f17f4519ed4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:40.515043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d89a2-36da-4348-b3ce-5f17f4519ed4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:40.516820 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 716/1423] 10.222.0.32 () {54 vars in 918 bytes} [Sat Dec 25 20:58:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:40.522544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260373e-ae3c-4152-a4fe-b4f99c4e00e1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:40.522852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260373e-ae3c-4152-a4fe-b4f99c4e00e1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:40.523128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260373e-ae3c-4152-a4fe-b4f99c4e00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:40.541519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6260373e-ae3c-4152-a4fe-b4f99c4e00e1 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:40.542696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6260373e-ae3c-4152-a4fe-b4f99c4e00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:40.551808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 708/1424] 10.222.0.32 () {58 vars in 1015 bytes} [Sat Dec 25 20:58:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:58:43.394761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669b09e-7e42-400c-a02d-51d6382899fb None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:43.395323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669b09e-7e42-400c-a02d-51d6382899fb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:43.395323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669b09e-7e42-400c-a02d-51d6382899fb None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:43.397104 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 717/1425] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:58:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:43.403125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467de9-2c64-48c9-a78d-2e80b71d12d1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:43.403571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467de9-2c64-48c9-a78d-2e80b71d12d1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:43.403673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467de9-2c64-48c9-a78d-2e80b71d12d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:43.422901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6b467de9-2c64-48c9-a78d-2e80b71d12d1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:43.424075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6b467de9-2c64-48c9-a78d-2e80b71d12d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:43.432086 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 709/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:58:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:43.477639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669b09e-7e42-400c-a02d-51d6382899fb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:43.491829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669b09e-7e42-400c-a02d-51d6382899fb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:43.497148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c761bb-ecbe-4877-aec8-56b808818458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:43.497777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c761bb-ecbe-4877-aec8-56b808818458 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:43.498048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c761bb-ecbe-4877-aec8-56b808818458 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:43.498337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c761bb-ecbe-4877-aec8-56b808818458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:43.506250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c761bb-ecbe-4877-aec8-56b808818458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:43.507802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c761bb-ecbe-4877-aec8-56b808818458 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:43.517434 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 718/1427] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:45.166161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bde2-38e4-4c43-88eb-2b9ca56d36dc None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:45.166731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bde2-38e4-4c43-88eb-2b9ca56d36dc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:45.166731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bde2-38e4-4c43-88eb-2b9ca56d36dc None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:45.168470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 710/1428] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:45.173880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede6e-db03-44ca-846f-fcc2808f0d21 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:45.174328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede6e-db03-44ca-846f-fcc2808f0d21 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:45.174427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede6e-db03-44ca-846f-fcc2808f0d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:45.192042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a3dede6e-db03-44ca-846f-fcc2808f0d21 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:45.193259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3dede6e-db03-44ca-846f-fcc2808f0d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:45.201262 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 719/1429] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:45.382933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bde2-38e4-4c43-88eb-2b9ca56d36dc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:45.397252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bde2-38e4-4c43-88eb-2b9ca56d36dc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:45.402502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6030-d380-4ba5-9764-e75991dd6e28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:45.403121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6030-d380-4ba5-9764-e75991dd6e28 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:45.403397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6030-d380-4ba5-9764-e75991dd6e28 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:45.403665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6030-d380-4ba5-9764-e75991dd6e28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:45.412074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6030-d380-4ba5-9764-e75991dd6e28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:45.413746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6030-d380-4ba5-9764-e75991dd6e28 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:45.423342 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 711/1430] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:47.011393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45fc7e-32e1-4aef-b7fa-4e484fa61673 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:47.011939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45fc7e-32e1-4aef-b7fa-4e484fa61673 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:47.011939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45fc7e-32e1-4aef-b7fa-4e484fa61673 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:47.014392 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 720/1431] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:47.019859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f6d2-7330-4608-9941-284817b6e33e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:47.020274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f6d2-7330-4608-9941-284817b6e33e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:47.020393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f6d2-7330-4608-9941-284817b6e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:47.037972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b3b2f6d2-7330-4608-9941-284817b6e33e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:47.039155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b3b2f6d2-7330-4608-9941-284817b6e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:47.046923 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 712/1432] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:47.209781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45fc7e-32e1-4aef-b7fa-4e484fa61673 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:47.224090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45fc7e-32e1-4aef-b7fa-4e484fa61673 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:47.229417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb8dec-d4d6-4806-a857-926ffa3fce24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:47.230035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb8dec-d4d6-4806-a857-926ffa3fce24 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:47.230312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb8dec-d4d6-4806-a857-926ffa3fce24 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:47.230582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb8dec-d4d6-4806-a857-926ffa3fce24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:47.239037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb8dec-d4d6-4806-a857-926ffa3fce24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:47.240581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb8dec-d4d6-4806-a857-926ffa3fce24 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:47.250346 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 721/1433] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:48.830203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6875a7a-4ba9-4bbf-a6fb-99ea5637e6e4 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:48.830781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6875a7a-4ba9-4bbf-a6fb-99ea5637e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:48.830781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6875a7a-4ba9-4bbf-a6fb-99ea5637e6e4 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:48.832561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 713/1434] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:48.838415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611ec0-2194-4609-b635-d6004769dc8e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:48.838836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611ec0-2194-4609-b635-d6004769dc8e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:48.838949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611ec0-2194-4609-b635-d6004769dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:48.856435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-39611ec0-2194-4609-b635-d6004769dc8e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:48.858131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-39611ec0-2194-4609-b635-d6004769dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:48.865755 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 722/1435] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:49.026407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6875a7a-4ba9-4bbf-a6fb-99ea5637e6e4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:49.041170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6875a7a-4ba9-4bbf-a6fb-99ea5637e6e4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:49.047089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94af6-c626-43b3-8f4c-38acf7fc9669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:49.047719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94af6-c626-43b3-8f4c-38acf7fc9669 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:49.047997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94af6-c626-43b3-8f4c-38acf7fc9669 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:49.048271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94af6-c626-43b3-8f4c-38acf7fc9669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:49.056118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94af6-c626-43b3-8f4c-38acf7fc9669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:49.057704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94af6-c626-43b3-8f4c-38acf7fc9669 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:49.066958 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 714/1436] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:50.638005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e760dc-3a22-4a80-90e7-2773d3f58984 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:50.638570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e760dc-3a22-4a80-90e7-2773d3f58984 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:50.638570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e760dc-3a22-4a80-90e7-2773d3f58984 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:50.640226 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 723/1437] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:50.645763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e8b0-3b5e-4b00-b17f-521c5a7821a8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:50.646165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e8b0-3b5e-4b00-b17f-521c5a7821a8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:50.646351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e8b0-3b5e-4b00-b17f-521c5a7821a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:50.664468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6e80e8b0-3b5e-4b00-b17f-521c5a7821a8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:50.665675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6e80e8b0-3b5e-4b00-b17f-521c5a7821a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:50.674330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 715/1438] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:50.834837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e760dc-3a22-4a80-90e7-2773d3f58984 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:50.849182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e760dc-3a22-4a80-90e7-2773d3f58984 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:50.854477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961b703-36c5-42b6-aa76-a22a86da6a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:50.855101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b703-36c5-42b6-aa76-a22a86da6a23 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:50.855384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b703-36c5-42b6-aa76-a22a86da6a23 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:50.855659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b703-36c5-42b6-aa76-a22a86da6a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:50.863518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961b703-36c5-42b6-aa76-a22a86da6a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:50.865101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961b703-36c5-42b6-aa76-a22a86da6a23 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:50.874724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 724/1439] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:52.470112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db383a-66d0-4b72-afaa-6ca5440ac762 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:52.470663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db383a-66d0-4b72-afaa-6ca5440ac762 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:52.470772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db383a-66d0-4b72-afaa-6ca5440ac762 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:52.472472 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 716/1440] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:52.477954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee231-7c5d-4bf4-ad49-84ba02533bc9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:52.478390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee231-7c5d-4bf4-ad49-84ba02533bc9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:52.478517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee231-7c5d-4bf4-ad49-84ba02533bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:52.496538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-942ee231-7c5d-4bf4-ad49-84ba02533bc9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:52.497799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-942ee231-7c5d-4bf4-ad49-84ba02533bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:52.505464 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 725/1441] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:52.666819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db383a-66d0-4b72-afaa-6ca5440ac762 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:52.680987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db383a-66d0-4b72-afaa-6ca5440ac762 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:52.686317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39a383-e497-48a5-9564-120abbb02e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:52.686943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a383-e497-48a5-9564-120abbb02e8d service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:52.687227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a383-e497-48a5-9564-120abbb02e8d service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:52.687505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39a383-e497-48a5-9564-120abbb02e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:52.695454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39a383-e497-48a5-9564-120abbb02e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:52.697048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39a383-e497-48a5-9564-120abbb02e8d service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:52.706764 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 717/1442] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:54.298314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14500c8-1d60-4716-a2ce-a24812e5ae83 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:54.298751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14500c8-1d60-4716-a2ce-a24812e5ae83 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:54.298875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14500c8-1d60-4716-a2ce-a24812e5ae83 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:54.300651 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 726/1443] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:54.306035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebee163-a706-4b08-b023-0b2be749b59e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:54.306481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebee163-a706-4b08-b023-0b2be749b59e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:54.306578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebee163-a706-4b08-b023-0b2be749b59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:54.324051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2ebee163-a706-4b08-b023-0b2be749b59e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:54.325306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2ebee163-a706-4b08-b023-0b2be749b59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:54.332913 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 718/1444] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:54.494292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14500c8-1d60-4716-a2ce-a24812e5ae83 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:54.508311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14500c8-1d60-4716-a2ce-a24812e5ae83 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:54.513592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046da99-c01b-4fb4-9f8f-2058ebf1cc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:54.514230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046da99-c01b-4fb4-9f8f-2058ebf1cc2d service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:54.514529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046da99-c01b-4fb4-9f8f-2058ebf1cc2d service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:54.514803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046da99-c01b-4fb4-9f8f-2058ebf1cc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:54.522935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046da99-c01b-4fb4-9f8f-2058ebf1cc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:54.525497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046da99-c01b-4fb4-9f8f-2058ebf1cc2d service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:54.534331 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 727/1445] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:56.121210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40554ed3-7117-4340-8ce8-d171a6e1ec6a None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:56.121733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40554ed3-7117-4340-8ce8-d171a6e1ec6a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:56.121828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40554ed3-7117-4340-8ce8-d171a6e1ec6a None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:56.123561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 719/1446] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:56.129109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59036-b7ed-4f83-a1ad-23bf37dce0be None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:56.129536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59036-b7ed-4f83-a1ad-23bf37dce0be None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:56.129642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59036-b7ed-4f83-a1ad-23bf37dce0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:56.148388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-83b59036-b7ed-4f83-a1ad-23bf37dce0be None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:56.149595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-83b59036-b7ed-4f83-a1ad-23bf37dce0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:56.157815 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 728/1447] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:56.317825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40554ed3-7117-4340-8ce8-d171a6e1ec6a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:56.333503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40554ed3-7117-4340-8ce8-d171a6e1ec6a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:56.339117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b37ee-7206-4f2e-af6a-96c9b2f9bb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:56.339748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b37ee-7206-4f2e-af6a-96c9b2f9bb0e service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:56.340024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b37ee-7206-4f2e-af6a-96c9b2f9bb0e service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:56.340294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b37ee-7206-4f2e-af6a-96c9b2f9bb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:56.348601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b37ee-7206-4f2e-af6a-96c9b2f9bb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:56.350187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b37ee-7206-4f2e-af6a-96c9b2f9bb0e service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:56.359219 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 720/1448] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:57.975815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868a79e-bb5d-40fa-ae09-62151dc55532 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:57.980740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868a79e-bb5d-40fa-ae09-62151dc55532 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:57.980740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868a79e-bb5d-40fa-ae09-62151dc55532 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:57.980740 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 729/1449] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 20:58:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:58:57.983797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caabf3-077b-4db0-849c-6d9311b469b0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:57.984230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caabf3-077b-4db0-849c-6d9311b469b0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:57.984337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caabf3-077b-4db0-849c-6d9311b469b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:58.002552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-28caabf3-077b-4db0-849c-6d9311b469b0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:58:58.003724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-28caabf3-077b-4db0-849c-6d9311b469b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:58:58.011515 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 721/1450] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 20:58:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:58:58.173770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868a79e-bb5d-40fa-ae09-62151dc55532 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:58:58.188464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868a79e-bb5d-40fa-ae09-62151dc55532 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:58:58.193768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50ab69-d6d4-48a1-b2c4-1123c1e53787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:58:58.194395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ab69-d6d4-48a1-b2c4-1123c1e53787 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:58:58.194673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ab69-d6d4-48a1-b2c4-1123c1e53787 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:58:58.194976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ab69-d6d4-48a1-b2c4-1123c1e53787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:58:58.203833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50ab69-d6d4-48a1-b2c4-1123c1e53787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:58:58.205464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50ab69-d6d4-48a1-b2c4-1123c1e53787 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:58:58.215724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 730/1451] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:58:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:00.506744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711f7f5-d52e-48d7-a526-24e39deb691b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:00.507328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711f7f5-d52e-48d7-a526-24e39deb691b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:00.507328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711f7f5-d52e-48d7-a526-24e39deb691b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:00.509167 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 722/1452] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:00.515469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72893-eec3-4a74-8bc7-5b7fa8e402af None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:00.515882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72893-eec3-4a74-8bc7-5b7fa8e402af None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:00.516008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72893-eec3-4a74-8bc7-5b7fa8e402af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:00.533347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9ae72893-eec3-4a74-8bc7-5b7fa8e402af None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:00.534506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9ae72893-eec3-4a74-8bc7-5b7fa8e402af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:00.542089 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 731/1453] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:00.582673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711f7f5-d52e-48d7-a526-24e39deb691b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:00.593436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711f7f5-d52e-48d7-a526-24e39deb691b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:00.596915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e29a24-a4ed-46cd-82fc-c9bc74387bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:00.597528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e29a24-a4ed-46cd-82fc-c9bc74387bbf service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:00.597806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e29a24-a4ed-46cd-82fc-c9bc74387bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:00.598079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e29a24-a4ed-46cd-82fc-c9bc74387bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:00.606687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e29a24-a4ed-46cd-82fc-c9bc74387bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:00.608093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e29a24-a4ed-46cd-82fc-c9bc74387bbf service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:00.617529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 723/1454] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:59:03.189711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76d8c-92a3-4607-93a0-abd5c4c9cee6 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:03.190275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76d8c-92a3-4607-93a0-abd5c4c9cee6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:03.190275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76d8c-92a3-4607-93a0-abd5c4c9cee6 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:03.192039 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 732/1455] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:03.198277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76ec8-93d4-4d52-b941-da1dbbfc8cbf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:03.198669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76ec8-93d4-4d52-b941-da1dbbfc8cbf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:03.198836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76ec8-93d4-4d52-b941-da1dbbfc8cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:03.216865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-98c76ec8-93d4-4d52-b941-da1dbbfc8cbf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:03.218062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-98c76ec8-93d4-4d52-b941-da1dbbfc8cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:03.225933 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 724/1456] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:03.266444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76d8c-92a3-4607-93a0-abd5c4c9cee6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:03.276933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76d8c-92a3-4607-93a0-abd5c4c9cee6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:03.281084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb3854-8ed4-4d88-aebc-37d3338bd5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:03.281711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3854-8ed4-4d88-aebc-37d3338bd5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:03.281994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3854-8ed4-4d88-aebc-37d3338bd5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:03.282268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3854-8ed4-4d88-aebc-37d3338bd5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:03.290833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb3854-8ed4-4d88-aebc-37d3338bd5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:03.292244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb3854-8ed4-4d88-aebc-37d3338bd5a0 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:03.302105 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 733/1457] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:59:06.133127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fcb2-bbff-4f4e-bed1-a8772c9b7443 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:06.133683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fcb2-bbff-4f4e-bed1-a8772c9b7443 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:06.133683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424fcb2-bbff-4f4e-bed1-a8772c9b7443 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:06.135431 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 725/1458] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:06.141461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5208e-f6de-478b-a1eb-5b911ab306e7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:06.141888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5208e-f6de-478b-a1eb-5b911ab306e7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:06.142005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5208e-f6de-478b-a1eb-5b911ab306e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:06.159284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ebc5208e-f6de-478b-a1eb-5b911ab306e7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:06.160457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ebc5208e-f6de-478b-a1eb-5b911ab306e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:06.168036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 734/1459] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:06.208802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424fcb2-bbff-4f4e-bed1-a8772c9b7443 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:06.219636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424fcb2-bbff-4f4e-bed1-a8772c9b7443 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:06.223018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82d47-5b83-408f-8907-94710f03e5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:06.223648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82d47-5b83-408f-8907-94710f03e5aa service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:06.223919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82d47-5b83-408f-8907-94710f03e5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:06.224186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82d47-5b83-408f-8907-94710f03e5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:06.233283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82d47-5b83-408f-8907-94710f03e5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:06.234773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82d47-5b83-408f-8907-94710f03e5aa service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:06.243826 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 726/1460] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:08.762997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234cf7-b384-43a8-a867-3f33bce28b32 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:08.763554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234cf7-b384-43a8-a867-3f33bce28b32 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:08.763554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2234cf7-b384-43a8-a867-3f33bce28b32 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:08.765365 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 735/1461] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 20:59:08.771186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1ef9-f0e7-4ad9-afd7-084ea4e6efd8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:08.771622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1ef9-f0e7-4ad9-afd7-084ea4e6efd8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:08.771718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1ef9-f0e7-4ad9-afd7-084ea4e6efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:08.790984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eb1f1ef9-f0e7-4ad9-afd7-084ea4e6efd8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:08.792163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eb1f1ef9-f0e7-4ad9-afd7-084ea4e6efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:08.800757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 727/1462] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:08.840855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234cf7-b384-43a8-a867-3f33bce28b32 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:08.851412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2234cf7-b384-43a8-a867-3f33bce28b32 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:08.855005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a528-0e7d-4549-a0e6-a5fbb26a72b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:08.856360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a528-0e7d-4549-a0e6-a5fbb26a72b7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:08.856648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a528-0e7d-4549-a0e6-a5fbb26a72b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:08.856953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a528-0e7d-4549-a0e6-a5fbb26a72b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:08.865668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a528-0e7d-4549-a0e6-a5fbb26a72b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:08.867105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447a528-0e7d-4549-a0e6-a5fbb26a72b7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:08.876313 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 736/1463] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:11.322940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248dbb7-8e04-4324-9125-fb247c282462 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:11.323520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248dbb7-8e04-4324-9125-fb247c282462 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:11.323520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248dbb7-8e04-4324-9125-fb247c282462 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:11.325599 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 728/1464] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:11.331625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691db7-0c1f-4711-89ce-565058acc51e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:11.332116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691db7-0c1f-4711-89ce-565058acc51e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:11.332228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691db7-0c1f-4711-89ce-565058acc51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:11.350033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-44691db7-0c1f-4711-89ce-565058acc51e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:11.351236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-44691db7-0c1f-4711-89ce-565058acc51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:11.359417 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 737/1465] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:11.399465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248dbb7-8e04-4324-9125-fb247c282462 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:11.409835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248dbb7-8e04-4324-9125-fb247c282462 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:11.413295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab97dc-772b-4925-96b8-a555a5339367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:11.413912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab97dc-772b-4925-96b8-a555a5339367 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:11.414211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab97dc-772b-4925-96b8-a555a5339367 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:11.414483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab97dc-772b-4925-96b8-a555a5339367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:11.423491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab97dc-772b-4925-96b8-a555a5339367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:11.424955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab97dc-772b-4925-96b8-a555a5339367 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:11.434589 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 729/1466] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:59:13.979391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10f46-a4b3-4939-a38b-aad5fe788fbf None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:13.979813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10f46-a4b3-4939-a38b-aad5fe788fbf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:13.979930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e10f46-a4b3-4939-a38b-aad5fe788fbf None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:13.981779 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 738/1467] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:13.987852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfda05-f37c-4bcb-9fe5-2f6f4965d042 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:13.988318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfda05-f37c-4bcb-9fe5-2f6f4965d042 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:13.988425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfda05-f37c-4bcb-9fe5-2f6f4965d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:14.007224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-23cfda05-f37c-4bcb-9fe5-2f6f4965d042 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:14.008423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23cfda05-f37c-4bcb-9fe5-2f6f4965d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:14.016729 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 730/1468] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:14.055988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10f46-a4b3-4939-a38b-aad5fe788fbf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:14.067291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e10f46-a4b3-4939-a38b-aad5fe788fbf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:14.070850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57796185-ca6a-43fd-a31b-03a21581c31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:14.075348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796185-ca6a-43fd-a31b-03a21581c31d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:14.075348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796185-ca6a-43fd-a31b-03a21581c31d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:14.075348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57796185-ca6a-43fd-a31b-03a21581c31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:14.081425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57796185-ca6a-43fd-a31b-03a21581c31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:14.082969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57796185-ca6a-43fd-a31b-03a21581c31d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:14.092442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 739/1469] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:16.563482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267024c-4676-4962-8e8f-1076674557de None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:16.564070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267024c-4676-4962-8e8f-1076674557de None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:16.564070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267024c-4676-4962-8e8f-1076674557de None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:16.565815 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 731/1470] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:16.571867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dcaae-acef-4714-a6f2-f4b26fa8a0bb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:16.572288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dcaae-acef-4714-a6f2-f4b26fa8a0bb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:16.572404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dcaae-acef-4714-a6f2-f4b26fa8a0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:16.591193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-247dcaae-acef-4714-a6f2-f4b26fa8a0bb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:16.592357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-247dcaae-acef-4714-a6f2-f4b26fa8a0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:16.600090 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 740/1471] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:16.639083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267024c-4676-4962-8e8f-1076674557de None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:16.649553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267024c-4676-4962-8e8f-1076674557de None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:16.653735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b1a95-394a-4864-b25e-68b931280e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:16.654363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b1a95-394a-4864-b25e-68b931280e86 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:16.654646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b1a95-394a-4864-b25e-68b931280e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:16.654920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b1a95-394a-4864-b25e-68b931280e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:16.663655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b1a95-394a-4864-b25e-68b931280e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:16.665105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b1a95-394a-4864-b25e-68b931280e86 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:16.674320 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 732/1472] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:19.118573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a543-cc17-4e55-9921-9095c92cacca None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:19.119097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a543-cc17-4e55-9921-9095c92cacca None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:19.119194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a543-cc17-4e55-9921-9095c92cacca None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:19.121456 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 741/1473] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:19.127564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8bdf5-6bb5-498e-955c-e07dc8476111 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:19.127988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8bdf5-6bb5-498e-955c-e07dc8476111 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:19.128127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8bdf5-6bb5-498e-955c-e07dc8476111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:19.146135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9ba8bdf5-6bb5-498e-955c-e07dc8476111 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:19.147308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9ba8bdf5-6bb5-498e-955c-e07dc8476111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:19.155023 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 733/1474] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:19.193882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a543-cc17-4e55-9921-9095c92cacca None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:19.204932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7a543-cc17-4e55-9921-9095c92cacca None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:19.209221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385621e-a334-4276-b00c-67e79befbae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:19.210131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385621e-a334-4276-b00c-67e79befbae5 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:19.210411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385621e-a334-4276-b00c-67e79befbae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:19.210687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385621e-a334-4276-b00c-67e79befbae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:19.224417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385621e-a334-4276-b00c-67e79befbae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:19.227861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385621e-a334-4276-b00c-67e79befbae5 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:19.237350 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 742/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:21.680508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79707-e474-422d-903e-90d8316f0072 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:21.681112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79707-e474-422d-903e-90d8316f0072 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:21.681112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e79707-e474-422d-903e-90d8316f0072 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:21.683031 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 734/1476] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:21.689411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933fb5-af7b-4c20-9da1-2df8de03ef7b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:21.689818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933fb5-af7b-4c20-9da1-2df8de03ef7b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:21.689962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91933fb5-af7b-4c20-9da1-2df8de03ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:21.707385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-91933fb5-af7b-4c20-9da1-2df8de03ef7b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:21.708549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91933fb5-af7b-4c20-9da1-2df8de03ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:21.716462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 743/1477] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:21.755219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e79707-e474-422d-903e-90d8316f0072 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:21.765710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e79707-e474-422d-903e-90d8316f0072 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:21.769197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e98a-ccd2-416d-97cb-46371280f1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:21.769821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e98a-ccd2-416d-97cb-46371280f1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:21.770098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e98a-ccd2-416d-97cb-46371280f1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:21.770369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e98a-ccd2-416d-97cb-46371280f1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:21.779134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582e98a-ccd2-416d-97cb-46371280f1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:21.780543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582e98a-ccd2-416d-97cb-46371280f1e8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:21.789694 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 735/1478] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:24.210840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d048c70-8283-44e7-bff0-ca879005ae63 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:24.211399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d048c70-8283-44e7-bff0-ca879005ae63 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:24.211399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d048c70-8283-44e7-bff0-ca879005ae63 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:24.213216 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 744/1479] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 20:59:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:24.219801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df5b1-3e0a-402d-83e8-c7efaa89ebc2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:24.220183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df5b1-3e0a-402d-83e8-c7efaa89ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:24.220353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95df5b1-3e0a-402d-83e8-c7efaa89ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:24.237724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d95df5b1-3e0a-402d-83e8-c7efaa89ebc2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:24.238900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d95df5b1-3e0a-402d-83e8-c7efaa89ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:24.246613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 736/1480] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 20:59:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 20:59:24.285398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d048c70-8283-44e7-bff0-ca879005ae63 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:24.295884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d048c70-8283-44e7-bff0-ca879005ae63 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:24.299438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf29fef-4a53-45a8-92ef-1eea81a88374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:24.300068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf29fef-4a53-45a8-92ef-1eea81a88374 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:24.300347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf29fef-4a53-45a8-92ef-1eea81a88374 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:24.300625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf29fef-4a53-45a8-92ef-1eea81a88374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:24.310072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf29fef-4a53-45a8-92ef-1eea81a88374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:24.311492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf29fef-4a53-45a8-92ef-1eea81a88374 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:24.320968 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 745/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:42.432753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4d4ca-2dec-41c9-98a4-338e3787b85f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:42.433493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4d4ca-2dec-41c9-98a4-338e3787b85f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:42.433493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4d4ca-2dec-41c9-98a4-338e3787b85f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:42.435187 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 737/1482] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:59:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:42.440899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f04e-43fb-403b-829b-86286f21cb4f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:42.441336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f04e-43fb-403b-829b-86286f21cb4f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:42.441474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5f04e-43fb-403b-829b-86286f21cb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:42.459115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-81c5f04e-43fb-403b-829b-86286f21cb4f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:42.460289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-81c5f04e-43fb-403b-829b-86286f21cb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:42.468586 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 746/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:59:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:42.518082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780155d-d8fb-4b98-9a3a-c175934cc3f1 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:42.518368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780155d-d8fb-4b98-9a3a-c175934cc3f1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:42.518642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780155d-d8fb-4b98-9a3a-c175934cc3f1 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:42.520375 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 738/1484] 10.222.0.32 () {54 vars in 962 bytes} [Sat Dec 25 20:59:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:42.526359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1790-1f7d-41ee-9501-9135a7a58692 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:42.526647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1790-1f7d-41ee-9501-9135a7a58692 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:42.526926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1790-1f7d-41ee-9501-9135a7a58692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:42.545586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0ebe1790-1f7d-41ee-9501-9135a7a58692 None None] MFA Rules not processed for user `94e4b61a62d24f6c9274c0f46d514656`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:42.546703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ebe1790-1f7d-41ee-9501-9135a7a58692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:42.553156 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 747/1485] 10.222.0.32 () {58 vars in 1059 bytes} [Sat Dec 25 20:59:42 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:42.560806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780155d-d8fb-4b98-9a3a-c175934cc3f1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:42.571098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780155d-d8fb-4b98-9a3a-c175934cc3f1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:42.574563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84041e52-5bcb-4e3a-b814-0f1b7d591abb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:42.575183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041e52-5bcb-4e3a-b814-0f1b7d591abb service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:42.575463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041e52-5bcb-4e3a-b814-0f1b7d591abb service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:42.575732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84041e52-5bcb-4e3a-b814-0f1b7d591abb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:42.584678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84041e52-5bcb-4e3a-b814-0f1b7d591abb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:42.586109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84041e52-5bcb-4e3a-b814-0f1b7d591abb service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:42.595662 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 739/1486] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:45.113677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db764620-9f6e-4719-979b-f0b7b6a00e09 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:45.114226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db764620-9f6e-4719-979b-f0b7b6a00e09 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:45.114226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db764620-9f6e-4719-979b-f0b7b6a00e09 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:45.115962 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 748/1487] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:59:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:45.122033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d8106-1a30-4131-b66f-99d8c5a24ad9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:45.122441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d8106-1a30-4131-b66f-99d8c5a24ad9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:45.122637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d8106-1a30-4131-b66f-99d8c5a24ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:45.140800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0f7d8106-1a30-4131-b66f-99d8c5a24ad9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:45.142010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0f7d8106-1a30-4131-b66f-99d8c5a24ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:45.149777 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 740/1488] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:59:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:45.175250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db764620-9f6e-4719-979b-f0b7b6a00e09 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:45.187500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db764620-9f6e-4719-979b-f0b7b6a00e09 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:45.191857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf5a9d-ec7b-400a-897f-9a163328dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:45.192487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf5a9d-ec7b-400a-897f-9a163328dd83 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:45.192762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf5a9d-ec7b-400a-897f-9a163328dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:45.193070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf5a9d-ec7b-400a-897f-9a163328dd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:45.193796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf5a9d-ec7b-400a-897f-9a163328dd83 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:45.195603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf5a9d-ec7b-400a-897f-9a163328dd83 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:45.209525 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 749/1489] 10.222.0.32 () {56 vars in 1108 bytes} [Sat Dec 25 20:59:45 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 20:59:47.615178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b170898-4693-4ffb-a696-4bf7c6535e3f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:47.615738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b170898-4693-4ffb-a696-4bf7c6535e3f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:47.615738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b170898-4693-4ffb-a696-4bf7c6535e3f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:47.617512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 741/1490] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:59:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:47.623705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64bba5-cb4f-4dd8-a4ce-32b9aef51c9e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:47.626859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64bba5-cb4f-4dd8-a4ce-32b9aef51c9e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:47.626859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64bba5-cb4f-4dd8-a4ce-32b9aef51c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:47.642304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1a64bba5-cb4f-4dd8-a4ce-32b9aef51c9e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:47.643504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1a64bba5-cb4f-4dd8-a4ce-32b9aef51c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:47.651163 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 750/1491] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:59:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:47.694782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b170898-4693-4ffb-a696-4bf7c6535e3f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:47.709877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b170898-4693-4ffb-a696-4bf7c6535e3f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:47.715354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22227d66-8637-4004-ad36-8e473cc4aae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:47.716599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22227d66-8637-4004-ad36-8e473cc4aae1 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:47.716599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22227d66-8637-4004-ad36-8e473cc4aae1 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:47.716599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22227d66-8637-4004-ad36-8e473cc4aae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:47.724956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22227d66-8637-4004-ad36-8e473cc4aae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:47.726528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22227d66-8637-4004-ad36-8e473cc4aae1 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:47.735857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 742/1492] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:50.382291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed8e1c-98d6-4dd9-bf9b-fc87a6c34770 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:50.382820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed8e1c-98d6-4dd9-bf9b-fc87a6c34770 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:50.382820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed8e1c-98d6-4dd9-bf9b-fc87a6c34770 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:50.385158 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 751/1493] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:59:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:50.390843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f915-7b57-478f-b822-238b5a53d508 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:50.391243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f915-7b57-478f-b822-238b5a53d508 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:50.391388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f915-7b57-478f-b822-238b5a53d508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:50.409182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3b35f915-7b57-478f-b822-238b5a53d508 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:50.410633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3b35f915-7b57-478f-b822-238b5a53d508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:50.418214 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 743/1494] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:50.455804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed8e1c-98d6-4dd9-bf9b-fc87a6c34770 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:50.467258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed8e1c-98d6-4dd9-bf9b-fc87a6c34770 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:50.470756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f2b25-38f2-43a7-b38b-1c68706c8715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:50.471371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f2b25-38f2-43a7-b38b-1c68706c8715 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:50.471647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f2b25-38f2-43a7-b38b-1c68706c8715 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:50.471917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f2b25-38f2-43a7-b38b-1c68706c8715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:50.480427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f2b25-38f2-43a7-b38b-1c68706c8715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:50.481870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f2b25-38f2-43a7-b38b-1c68706c8715 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:50.491192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 752/1495] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:52.953996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2a04f-5001-4efa-8122-bc569cda6ef9 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:52.954556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2a04f-5001-4efa-8122-bc569cda6ef9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:52.954556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2a04f-5001-4efa-8122-bc569cda6ef9 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:52.956325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 744/1496] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:59:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:52.962343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7f429-4fa6-4fc6-bb65-bddc9c4e6440 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:52.963322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7f429-4fa6-4fc6-bb65-bddc9c4e6440 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:52.963560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7f429-4fa6-4fc6-bb65-bddc9c4e6440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:52.982067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-82b7f429-4fa6-4fc6-bb65-bddc9c4e6440 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:52.983239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-82b7f429-4fa6-4fc6-bb65-bddc9c4e6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:52.990902 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 753/1497] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:59:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:53.030956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2a04f-5001-4efa-8122-bc569cda6ef9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:53.042292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2a04f-5001-4efa-8122-bc569cda6ef9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:53.045806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112fd5d-fe1b-423e-8b41-fcd6fe658e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:53.046437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fd5d-fe1b-423e-8b41-fcd6fe658e14 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:53.046720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fd5d-fe1b-423e-8b41-fcd6fe658e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:53.047005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fd5d-fe1b-423e-8b41-fcd6fe658e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:53.055750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112fd5d-fe1b-423e-8b41-fcd6fe658e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:53.057194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112fd5d-fe1b-423e-8b41-fcd6fe658e14 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:53.066352 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 745/1498] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 20:59:55.548639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810358c-7d08-4a0a-a02c-d7bfdee2416a None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:55.549254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810358c-7d08-4a0a-a02c-d7bfdee2416a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:55.549254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810358c-7d08-4a0a-a02c-d7bfdee2416a None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:55.551104 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 754/1499] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:59:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:55.557557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05f5a-cc54-4c34-8a97-d543a1218e54 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:55.557990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05f5a-cc54-4c34-8a97-d543a1218e54 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:55.558094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05f5a-cc54-4c34-8a97-d543a1218e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:55.575626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fca05f5a-cc54-4c34-8a97-d543a1218e54 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:55.576824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fca05f5a-cc54-4c34-8a97-d543a1218e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:55.584775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 746/1500] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:59:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:55.622468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810358c-7d08-4a0a-a02c-d7bfdee2416a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:55.634914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810358c-7d08-4a0a-a02c-d7bfdee2416a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:55.639429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692546c-7dde-4461-95a5-eeda93ab4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:55.641526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692546c-7dde-4461-95a5-eeda93ab4611 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:55.641526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692546c-7dde-4461-95a5-eeda93ab4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:55.641526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692546c-7dde-4461-95a5-eeda93ab4611 admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:55.642041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692546c-7dde-4461-95a5-eeda93ab4611 admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:55.643800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692546c-7dde-4461-95a5-eeda93ab4611 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:55.645467 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 755/1501] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:59:55 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:59:55.657762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca05f5a-cc54-4c34-8a97-d543a1218e54 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:55.667698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca05f5a-cc54-4c34-8a97-d543a1218e54 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:55.671215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd169cbd-0c9f-4dd4-873a-c0c53d5b4447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:55.671838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd169cbd-0c9f-4dd4-873a-c0c53d5b4447 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:55.672113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd169cbd-0c9f-4dd4-873a-c0c53d5b4447 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:55.672386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd169cbd-0c9f-4dd4-873a-c0c53d5b4447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:55.680943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd169cbd-0c9f-4dd4-873a-c0c53d5b4447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:55.682964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd169cbd-0c9f-4dd4-873a-c0c53d5b4447 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:55.692029 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 747/1502] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 20:59:58.395082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77fec0-3f3b-4993-b0e8-00e9bcae60f4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:58.395630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77fec0-3f3b-4993-b0e8-00e9bcae60f4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:58.395630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77fec0-3f3b-4993-b0e8-00e9bcae60f4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:58.397409 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 756/1503] 10.222.0.32 () {54 vars in 926 bytes} [Sat Dec 25 20:59:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 20:59:58.403897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d248c7-7091-45cc-892c-086b079d60d1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:58.404398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d248c7-7091-45cc-892c-086b079d60d1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:58.404496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d248c7-7091-45cc-892c-086b079d60d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:58.422208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-55d248c7-7091-45cc-892c-086b079d60d1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 20:59:58.423371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-55d248c7-7091-45cc-892c-086b079d60d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 20:59:58.430986 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 748/1504] 10.222.0.32 () {58 vars in 1023 bytes} [Sat Dec 25 20:59:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 20:59:58.467221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77fec0-3f3b-4993-b0e8-00e9bcae60f4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:58.479497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77fec0-3f3b-4993-b0e8-00e9bcae60f4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:58.483926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85257c3c-1199-47bc-815e-aeca46f1d63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:58.484753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257c3c-1199-47bc-815e-aeca46f1d63e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:58.485072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257c3c-1199-47bc-815e-aeca46f1d63e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:58.485344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85257c3c-1199-47bc-815e-aeca46f1d63e admin admin] PATH_INFO: `/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:58.486626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85257c3c-1199-47bc-815e-aeca46f1d63e admin admin] RBAC: Authorizing `identity:get_project(project_id=41b3685f056e42a38cb9ec18c9d20fa2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:58.488488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85257c3c-1199-47bc-815e-aeca46f1d63e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:58.490457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 757/1505] 10.222.0.32 () {56 vars in 1207 bytes} [Sat Dec 25 20:59:58 2021] GET /identity/v3/projects/41b3685f056e42a38cb9ec18c9d20fa2 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 20:59:58.502085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d248c7-7091-45cc-892c-086b079d60d1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 20:59:58.511716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d248c7-7091-45cc-892c-086b079d60d1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 20:59:58.515208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af425245-2ff0-4060-ba31-a92f2ac05681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 20:59:58.515828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425245-2ff0-4060-ba31-a92f2ac05681 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 20:59:58.516102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425245-2ff0-4060-ba31-a92f2ac05681 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 20:59:58.516369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425245-2ff0-4060-ba31-a92f2ac05681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 20:59:58.525716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af425245-2ff0-4060-ba31-a92f2ac05681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 20:59:58.527116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af425245-2ff0-4060-ba31-a92f2ac05681 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 20:59:58.536279 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 749/1506] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 20:59:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:01:20.517651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee53b40-6de1-4879-98c2-81edbc858fff None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:20.519401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee53b40-6de1-4879-98c2-81edbc858fff None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:20.519401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee53b40-6de1-4879-98c2-81edbc858fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:20.536622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fee53b40-6de1-4879-98c2-81edbc858fff None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:01:20.537880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fee53b40-6de1-4879-98c2-81edbc858fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:01:20.545832 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 758/1507] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:01:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:01:20.557682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaa11c-8c59-4bf4-badd-d3d14aed47a4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:20.558164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaa11c-8c59-4bf4-badd-d3d14aed47a4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:20.558269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aaa11c-8c59-4bf4-badd-d3d14aed47a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:20.576295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-19aaa11c-8c59-4bf4-badd-d3d14aed47a4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:01:20.577507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-19aaa11c-8c59-4bf4-badd-d3d14aed47a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:01:20.585585 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 750/1508] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:01:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:01:20.590058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee53b40-6de1-4879-98c2-81edbc858fff None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:20.599579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee53b40-6de1-4879-98c2-81edbc858fff None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:20.604046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:20.604688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:20.605005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:20.605281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:20.606001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:01:20.606310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:20.607887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:20.619552 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 759/1509] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:01:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:01:20.627492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaa11c-8c59-4bf4-badd-d3d14aed47a4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:20.637045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aaa11c-8c59-4bf4-badd-d3d14aed47a4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:20.641585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:20.642226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:20.642520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:20.642795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:20.643490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:20.645390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:20.784511 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 751/1510] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:01:20 2021] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:01:20.793696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:20.803408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb3a7-e8c5-4980-b569-410c9c3b1ad5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:20.856424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:20.857036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:20.857318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:20.857612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:20.858288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:20.860163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:20.968014 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 760/1511] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:01:20 2021] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:01:20.972075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:20.982217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2e153-27bb-46a5-a332-853b41f277d1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:20.986763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:20.987404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:20.987680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:20.987950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:20.988667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:20.990367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:21.002676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 752/1512] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:01:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:01:21.007116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:21.016800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e60886-54b1-4572-84d4-5b3e1096cbda admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:21.021304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841ba5-997c-4eb7-9a01-ae84aa940fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:21.022535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841ba5-997c-4eb7-9a01-ae84aa940fef admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:21.022851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841ba5-997c-4eb7-9a01-ae84aa940fef admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:21.023129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841ba5-997c-4eb7-9a01-ae84aa940fef admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:21.023853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4841ba5-997c-4eb7-9a01-ae84aa940fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:21.025458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4841ba5-997c-4eb7-9a01-ae84aa940fef admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:21.039919 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 761/1513] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:01:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:01:21.044178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:21.054097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440ff9e-a23b-4ebf-a802-d2ec4c0f6d3d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:21.058624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:21.059482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:21.059756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:21.060023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] PATH_INFO: `/v3/projects/4b5645a2754744328895036a547573a8/users/cb87982c8b93460493c0fcd472b2ed65/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:21.074664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5645a2754744328895036a547573a8, user_id=cb87982c8b93460493c0fcd472b2ed65, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:21.077302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:21.171994 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 753/1514] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:01:21 2021] PUT /identity/v3/projects/4b5645a2754744328895036a547573a8/users/cb87982c8b93460493c0fcd472b2ed65/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:01:21.183137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c122-b3ae-4ab1-ad84-f07d7f985677 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:21.183420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c122-b3ae-4ab1-ad84-f07d7f985677 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:21.183696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c122-b3ae-4ab1-ad84-f07d7f985677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:21.210114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b445c122-b3ae-4ab1-ad84-f07d7f985677 None None] MFA Rules not processed for user `cb87982c8b93460493c0fcd472b2ed65`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:01:21.211286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b445c122-b3ae-4ab1-ad84-f07d7f985677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:01:21.271239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 762/1515] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:01:21 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:01:21.284372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:21.350233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3929-ad49-4251-bd70-8078d7fcd145 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:21.355567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:21.356216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:21.356475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:21.356747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:21.364588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:21.366721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:21.375303 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 754/1516] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:01:21 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:01:21.444656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61391dd-f4dc-4210-b93c-dd1ef0b71edb None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:21.444967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61391dd-f4dc-4210-b93c-dd1ef0b71edb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:21.445244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61391dd-f4dc-4210-b93c-dd1ef0b71edb None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:21.446958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 763/1517] 10.222.0.32 () {52 vars in 829 bytes} [Sat Dec 25 21:01:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:01:21.450562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:21.510519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55971bd5-ddd2-4d4d-a5ff-018ec7c6086a service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:21.515130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:21.516011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:21.516291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:21.516563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] PATH_INFO: `/v3/users/cb87982c8b93460493c0fcd472b2ed65` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:21.517784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb87982c8b93460493c0fcd472b2ed65)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:21.518821 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:01:21.518821 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:01:21.518821 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:01:21.520038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:21.761703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb87982c8b93460493c0fcd472b2ed65'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:21.774437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb87982c8b93460493c0fcd472b2ed65'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:21.794660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb87982c8b93460493c0fcd472b2ed65'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:21.795421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb87982c8b93460493c0fcd472b2ed65'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:21.796149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb87982c8b93460493c0fcd472b2ed65'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:21.904434 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 755/1518] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:01:21 2021] DELETE /identity/v3/users/cb87982c8b93460493c0fcd472b2ed65 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:01:21.908851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:21.909366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:21.909474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:21.926400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:01:21.927587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:01:21.985835 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 764/1519] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:01:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:01:21.995625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:21.997072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:01:22.051082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0239299-8d8b-45fd-858e-f20d65625819 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:22.055069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922e6f9-ced3-49da-b6fa-dcd8d6ebd729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:22.055699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e6f9-ced3-49da-b6fa-dcd8d6ebd729 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:22.055974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e6f9-ced3-49da-b6fa-dcd8d6ebd729 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:22.056242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e6f9-ced3-49da-b6fa-dcd8d6ebd729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:22.064863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922e6f9-ced3-49da-b6fa-dcd8d6ebd729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:22.066326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922e6f9-ced3-49da-b6fa-dcd8d6ebd729 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:22.075929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 756/1520] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:01:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:01:22.930255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:01:22.931667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:01:22.943710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545d9fe-00e8-4e97-96a9-627052012b44 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:01:22.954145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:01:22.954145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:01:22.954145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:01:22.954145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] PATH_INFO: `/v3/projects/4b5645a2754744328895036a547573a8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:01:22.955676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5645a2754744328895036a547573a8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:01:22.957571 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:01:22.957571 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:01:22.957571 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:01:22.959852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:01:23.076381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5645a2754744328895036a547573a8', 'request_id': 'req-61ee617f-10d1-43f5-b7ff-f03fb54961b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:23.183676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5645a2754744328895036a547573a8', 'request_id': 'req-61ee617f-10d1-43f5-b7ff-f03fb54961b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:23.197058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5645a2754744328895036a547573a8', 'request_id': 'req-61ee617f-10d1-43f5-b7ff-f03fb54961b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:23.208077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] The token cache is being invalidate because project 4b5645a2754744328895036a547573a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:01:23.208362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:23.209019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-61ee617f-10d1-43f5-b7ff-f03fb54961b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:01:23.210627 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 765/1521] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:01:22 2021] DELETE /identity/v3/projects/4b5645a2754744328895036a547573a8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:04:35.356928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041f9ca-6c06-4111-9017-e9e2d36b95f8 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:35.357558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041f9ca-6c06-4111-9017-e9e2d36b95f8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:35.357558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041f9ca-6c06-4111-9017-e9e2d36b95f8 None None] PATH_INFO: `/v3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:35.358787 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 757/1522] 10.222.0.31 () {54 vars in 925 bytes} [Sat Dec 25 21:04:35 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:04:35.366226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef18e61-b2f9-47bc-b735-86a91e5824fc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:35.366665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef18e61-b2f9-47bc-b735-86a91e5824fc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:35.366778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef18e61-b2f9-47bc-b735-86a91e5824fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:35.384487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cef18e61-b2f9-47bc-b735-86a91e5824fc None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:04:35.385702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cef18e61-b2f9-47bc-b735-86a91e5824fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:04:35.444969 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 766/1523] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 25 21:04:35 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:04:38.647956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae839b7-74cf-4b77-9d46-bb0b42380c76 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:38.648492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae839b7-74cf-4b77-9d46-bb0b42380c76 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:38.648492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae839b7-74cf-4b77-9d46-bb0b42380c76 None None] PATH_INFO: `/v3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:38.649729 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 758/1524] 10.222.0.37 () {54 vars in 925 bytes} [Sat Dec 25 21:04:38 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:04:38.656528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321782c-f760-4e7e-aa09-5ff33a495a75 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:38.656975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321782c-f760-4e7e-aa09-5ff33a495a75 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:38.657188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321782c-f760-4e7e-aa09-5ff33a495a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:38.674874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6321782c-f760-4e7e-aa09-5ff33a495a75 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:04:38.676098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6321782c-f760-4e7e-aa09-5ff33a495a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:04:38.687434 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 767/1525] 10.222.0.37 () {58 vars in 1015 bytes} [Sat Dec 25 21:04:38 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:04:39.342125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d006dc2-802e-4815-b5f7-81be97be56df None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:39.342125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d006dc2-802e-4815-b5f7-81be97be56df None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:39.342457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d006dc2-802e-4815-b5f7-81be97be56df None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:39.344204 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 759/1526] 10.222.0.32 () {54 vars in 960 bytes} [Sat Dec 25 21:04:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:04:39.350324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012ca1-3f33-4dfa-9f21-589e3d34a15e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:39.350608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012ca1-3f33-4dfa-9f21-589e3d34a15e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:39.350886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58012ca1-3f33-4dfa-9f21-589e3d34a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:39.369186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-58012ca1-3f33-4dfa-9f21-589e3d34a15e None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:04:39.370368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-58012ca1-3f33-4dfa-9f21-589e3d34a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:04:39.378740 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 768/1527] 10.222.0.32 () {58 vars in 1057 bytes} [Sat Dec 25 21:04:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:04:39.386777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d006dc2-802e-4815-b5f7-81be97be56df None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:04:39.400074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d006dc2-802e-4815-b5f7-81be97be56df None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:04:39.404941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f087a-d180-4cc3-b3f2-9a492078d8fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:04:39.405564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f087a-d180-4cc3-b3f2-9a492078d8fc service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:39.405934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f087a-d180-4cc3-b3f2-9a492078d8fc service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:39.406212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f087a-d180-4cc3-b3f2-9a492078d8fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:39.414781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f087a-d180-4cc3-b3f2-9a492078d8fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:04:39.416338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f087a-d180-4cc3-b3f2-9a492078d8fc service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:04:39.426427 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 760/1528] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:04:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:04:42.633963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8c74-b229-4c7b-a8ee-e8f40af1f9ed None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:42.634401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8c74-b229-4c7b-a8ee-e8f40af1f9ed None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:42.634513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8c74-b229-4c7b-a8ee-e8f40af1f9ed None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:42.636313 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 769/1529] 10.222.0.32 () {54 vars in 960 bytes} [Sat Dec 25 21:04:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:04:42.641999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df2c5-bdff-4bf6-9f18-132402c0b476 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:42.648206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df2c5-bdff-4bf6-9f18-132402c0b476 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:42.648206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df2c5-bdff-4bf6-9f18-132402c0b476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:42.665200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-362df2c5-bdff-4bf6-9f18-132402c0b476 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:04:42.666401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-362df2c5-bdff-4bf6-9f18-132402c0b476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:04:42.674840 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 761/1530] 10.222.0.32 () {58 vars in 1057 bytes} [Sat Dec 25 21:04:42 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:04:42.751743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8c74-b229-4c7b-a8ee-e8f40af1f9ed None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:04:42.765433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8c74-b229-4c7b-a8ee-e8f40af1f9ed None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:04:42.770299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52849782-7d29-484f-9bd1-a463c773a139 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:04:42.770923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849782-7d29-484f-9bd1-a463c773a139 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:04:42.771201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849782-7d29-484f-9bd1-a463c773a139 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:04:42.771475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849782-7d29-484f-9bd1-a463c773a139 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:04:42.779487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52849782-7d29-484f-9bd1-a463c773a139 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:04:42.781092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52849782-7d29-484f-9bd1-a463c773a139 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:04:42.790452 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 770/1531] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:04:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:05:19.342324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ff3d-a7c2-4d55-9e6c-4c791bd796db None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:19.342901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ff3d-a7c2-4d55-9e6c-4c791bd796db None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:19.342901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ff3d-a7c2-4d55-9e6c-4c791bd796db None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:19.344633 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 762/1532] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 21:05:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:05:19.349936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e67006-d70f-4eb6-a571-e37180fdfa9d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:19.350372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e67006-d70f-4eb6-a571-e37180fdfa9d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:19.350522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e67006-d70f-4eb6-a571-e37180fdfa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:19.370494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a6e67006-d70f-4eb6-a571-e37180fdfa9d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:05:19.371695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a6e67006-d70f-4eb6-a571-e37180fdfa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:05:19.427467 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 771/1533] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 21:05:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:05:19.593390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ff3d-a7c2-4d55-9e6c-4c791bd796db None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:05:19.595000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-95c1ff3d-a7c2-4d55-9e6c-4c791bd796db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:05:19.668130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ff3d-a7c2-4d55-9e6c-4c791bd796db None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:05:19.673423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d52f59-4932-42f3-891f-4120ec2d399d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:05:19.674056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52f59-4932-42f3-891f-4120ec2d399d service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:19.674337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52f59-4932-42f3-891f-4120ec2d399d service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:19.674612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d52f59-4932-42f3-891f-4120ec2d399d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:19.682615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d52f59-4932-42f3-891f-4120ec2d399d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:05:19.684195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d52f59-4932-42f3-891f-4120ec2d399d service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:05:19.693493 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 763/1534] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:05:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:05:21.243270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa882d-cdc9-4b38-b935-2c7c16887300 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:21.243810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa882d-cdc9-4b38-b935-2c7c16887300 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:21.243904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa882d-cdc9-4b38-b935-2c7c16887300 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:21.245672 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 772/1535] 127.0.0.1 () {54 vars in 901 bytes} [Sat Dec 25 21:05:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:05:21.250852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb294ba-71bf-482d-9266-443284c36dbc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:21.251266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb294ba-71bf-482d-9266-443284c36dbc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:21.251374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb294ba-71bf-482d-9266-443284c36dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:21.269638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3cb294ba-71bf-482d-9266-443284c36dbc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:05:21.274797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3cb294ba-71bf-482d-9266-443284c36dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:05:21.279167 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 764/1536] 127.0.0.1 () {58 vars in 998 bytes} [Sat Dec 25 21:05:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:05:21.437835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa882d-cdc9-4b38-b935-2c7c16887300 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:05:21.453138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa882d-cdc9-4b38-b935-2c7c16887300 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:05:21.458549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511f150-8556-4598-852d-fa606b28a056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:05:21.459180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f150-8556-4598-852d-fa606b28a056 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:21.459461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f150-8556-4598-852d-fa606b28a056 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:21.459736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f150-8556-4598-852d-fa606b28a056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:21.468418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511f150-8556-4598-852d-fa606b28a056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:05:21.470033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511f150-8556-4598-852d-fa606b28a056 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:05:21.479201 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 773/1537] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:05:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:05:25.691567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5ed6-1fd3-4eb0-8c75-5b0362f839ac None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:25.692146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5ed6-1fd3-4eb0-8c75-5b0362f839ac None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:25.692146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5ed6-1fd3-4eb0-8c75-5b0362f839ac None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:25.693940 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 765/1538] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 21:05:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:05:25.700236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f42a-bc8d-4864-98e5-6145d2aeaff4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:25.700722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f42a-bc8d-4864-98e5-6145d2aeaff4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:25.700818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16f42a-bc8d-4864-98e5-6145d2aeaff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:25.719798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bc16f42a-bc8d-4864-98e5-6145d2aeaff4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:05:25.721039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bc16f42a-bc8d-4864-98e5-6145d2aeaff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:05:25.729029 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 774/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 21:05:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:05:25.773787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a82cf-112a-446e-a31e-0175eb368e0e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:25.774076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a82cf-112a-446e-a31e-0175eb368e0e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:25.774356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a82cf-112a-446e-a31e-0175eb368e0e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:25.776156 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 766/1540] 10.222.0.32 () {54 vars in 964 bytes} [Sat Dec 25 21:05:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:05:25.782000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb603b9-d20f-41de-923b-3334007bd9a8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:25.782284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb603b9-d20f-41de-923b-3334007bd9a8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:25.782557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb603b9-d20f-41de-923b-3334007bd9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:25.818001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1fb603b9-d20f-41de-923b-3334007bd9a8 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:05:25.819773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1fb603b9-d20f-41de-923b-3334007bd9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:05:25.867552 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 775/1541] 10.222.0.32 () {58 vars in 1061 bytes} [Sat Dec 25 21:05:25 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:05:25.875994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a82cf-112a-446e-a31e-0175eb368e0e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:05:25.886860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a82cf-112a-446e-a31e-0175eb368e0e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:05:25.890527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0d306-f506-4de3-9a81-e60c58b61537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:05:25.891198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d306-f506-4de3-9a81-e60c58b61537 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:25.891494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d306-f506-4de3-9a81-e60c58b61537 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:25.891763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0d306-f506-4de3-9a81-e60c58b61537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:25.901109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0d306-f506-4de3-9a81-e60c58b61537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:05:25.902507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0d306-f506-4de3-9a81-e60c58b61537 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:05:25.911591 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 767/1542] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:05:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:05:28.278772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9467-1b17-4e40-873e-39d033b267da None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:28.279324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9467-1b17-4e40-873e-39d033b267da None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:28.279324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9467-1b17-4e40-873e-39d033b267da None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:28.281175 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 776/1543] 127.0.0.1 () {54 vars in 916 bytes} [Sat Dec 25 21:05:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:05:28.286894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695306f4-84dc-4eb1-bc52-0b499934ea29 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:28.287311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695306f4-84dc-4eb1-bc52-0b499934ea29 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:28.287444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695306f4-84dc-4eb1-bc52-0b499934ea29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:28.305558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-695306f4-84dc-4eb1-bc52-0b499934ea29 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:05:28.306748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-695306f4-84dc-4eb1-bc52-0b499934ea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:05:28.314647 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 768/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Dec 25 21:05:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:05:28.353132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9467-1b17-4e40-873e-39d033b267da None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:05:28.355974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e64f9467-1b17-4e40-873e-39d033b267da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:05:28.368024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9467-1b17-4e40-873e-39d033b267da None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:05:28.371533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa4089-f61f-4503-b7e9-f576b940a407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:05:28.372157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa4089-f61f-4503-b7e9-f576b940a407 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:05:28.372465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa4089-f61f-4503-b7e9-f576b940a407 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:05:28.372740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa4089-f61f-4503-b7e9-f576b940a407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:05:28.381580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa4089-f61f-4503-b7e9-f576b940a407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:05:28.383554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa4089-f61f-4503-b7e9-f576b940a407 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:05:28.393379 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 777/1545] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:05:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:20.486299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7b115-140b-4607-b8e5-ab06a938478a None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:20.486299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7b115-140b-4607-b8e5-ab06a938478a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:20.486830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7b115-140b-4607-b8e5-ab06a938478a None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:20.488286 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 769/1546] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:06:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:06:20.493533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25696-e3e1-4e65-934c-919db4e41776 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:20.493991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25696-e3e1-4e65-934c-919db4e41776 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:20.494256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25696-e3e1-4e65-934c-919db4e41776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:20.513951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c4c25696-e3e1-4e65-934c-919db4e41776 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:20.515172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c4c25696-e3e1-4e65-934c-919db4e41776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:20.524463 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 778/1547] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:06:20 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.053800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197315-cec3-46e2-9b09-43dc3638682c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.054790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197315-cec3-46e2-9b09-43dc3638682c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.055270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197315-cec3-46e2-9b09-43dc3638682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.079182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c4197315-cec3-46e2-9b09-43dc3638682c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.081027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c4197315-cec3-46e2-9b09-43dc3638682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.089285 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 770/1548] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.097812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce389a6-4595-4973-9873-7869d0abd3ac None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.098337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce389a6-4595-4973-9873-7869d0abd3ac None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.098337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce389a6-4595-4973-9873-7869d0abd3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.127114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6ce389a6-4595-4973-9873-7869d0abd3ac None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.128316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6ce389a6-4595-4973-9873-7869d0abd3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.139964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 779/1549] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.144743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197315-cec3-46e2-9b09-43dc3638682c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.158818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197315-cec3-46e2-9b09-43dc3638682c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.168628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d95da-9dfa-45fb-a773-23076d15a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.169330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d95da-9dfa-45fb-a773-23076d15a75d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.169604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d95da-9dfa-45fb-a773-23076d15a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.169894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d95da-9dfa-45fb-a773-23076d15a75d admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.170604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d95da-9dfa-45fb-a773-23076d15a75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:50.170904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d95da-9dfa-45fb-a773-23076d15a75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.172505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d95da-9dfa-45fb-a773-23076d15a75d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.185528 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 771/1550] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:50.193623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce389a6-4595-4973-9873-7869d0abd3ac None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.210122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce389a6-4595-4973-9873-7869d0abd3ac None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.219092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.219695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.219978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.220250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.221005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.222912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.313692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77dfc-ce33-4199-a4ca-760f460f0d1b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.314001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77dfc-ce33-4199-a4ca-760f460f0d1b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.314258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77dfc-ce33-4199-a4ca-760f460f0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.341890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-01f77dfc-ce33-4199-a4ca-760f460f0d1b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.343289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-01f77dfc-ce33-4199-a4ca-760f460f0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.351807 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 772/1551] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.377237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae6a2-65b7-415a-a43a-70ee69f8a13b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.377561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae6a2-65b7-415a-a43a-70ee69f8a13b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.377842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae6a2-65b7-415a-a43a-70ee69f8a13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.403166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c31ae6a2-65b7-415a-a43a-70ee69f8a13b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.404419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c31ae6a2-65b7-415a-a43a-70ee69f8a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.409963 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 780/1552] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:50.414048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.421533 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 773/1553] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:06:50.431634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae6a2-65b7-415a-a43a-70ee69f8a13b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.448501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae6a2-65b7-415a-a43a-70ee69f8a13b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.547514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f23db-c7c5-4f8b-9ae5-dd2245a8e793 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.548433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.549310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.549722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.550150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.551008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:50.551440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.553199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.563036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19032f91-52dc-4ba7-9d70-33bb19238b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.563709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032f91-52dc-4ba7-9d70-33bb19238b5b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.563988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032f91-52dc-4ba7-9d70-33bb19238b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.564260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19032f91-52dc-4ba7-9d70-33bb19238b5b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.565044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19032f91-52dc-4ba7-9d70-33bb19238b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.567146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19032f91-52dc-4ba7-9d70-33bb19238b5b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.574066 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 774/1554] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:50.581978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.593938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fc1de-89f4-4ee4-9fe4-f56e0302969b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.607687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.608573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.609053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.609456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.610289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.614324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.693716 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 781/1555] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:50.695106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b8c91-6858-42a4-8911-b60913845f3b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.695391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b8c91-6858-42a4-8911-b60913845f3b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.695762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b8c91-6858-42a4-8911-b60913845f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.721146 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 775/1556] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/projects => generated 401 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:06:50.722263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.740907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6e2b8c91-6858-42a4-8911-b60913845f3b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.740907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e2b8c91-6858-42a4-8911-b60913845f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.796182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef356d-b614-4f95-bdf0-037386538a0b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.801974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732b033-7efd-453a-888c-e424b86f7daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.802539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732b033-7efd-453a-888c-e424b86f7daf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.802732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732b033-7efd-453a-888c-e424b86f7daf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.803000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732b033-7efd-453a-888c-e424b86f7daf admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.803730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732b033-7efd-453a-888c-e424b86f7daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.805592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732b033-7efd-453a-888c-e424b86f7daf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.812990 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 782/1557] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.813938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b8c91-6858-42a4-8911-b60913845f3b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.819531 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 776/1558] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:50 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:50.824062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bcbc-01b5-480a-b2ef-15c36950b5b5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.824062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bcbc-01b5-480a-b2ef-15c36950b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.824062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bcbc-01b5-480a-b2ef-15c36950b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.827066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b8c91-6858-42a4-8911-b60913845f3b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.832080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8c741-87c8-415b-8d2b-2a4abe2ebd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.832920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c741-87c8-415b-8d2b-2a4abe2ebd48 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.833211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c741-87c8-415b-8d2b-2a4abe2ebd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.833836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8c741-87c8-415b-8d2b-2a4abe2ebd48 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.834161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8c741-87c8-415b-8d2b-2a4abe2ebd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.836268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8c741-87c8-415b-8d2b-2a4abe2ebd48 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.839962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b292bcbc-01b5-480a-b2ef-15c36950b5b5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.841152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b292bcbc-01b5-480a-b2ef-15c36950b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.850111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 777/1559] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.851451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2c46-5686-4a5e-ad94-a13bf3bd5ee1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.851740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2c46-5686-4a5e-ad94-a13bf3bd5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.852009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e2c46-5686-4a5e-ad94-a13bf3bd5ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.870439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-401e2c46-5686-4a5e-ad94-a13bf3bd5ee1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.871607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-401e2c46-5686-4a5e-ad94-a13bf3bd5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.880076 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 778/1560] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.881292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e2d8-c6ef-4a02-be53-21eac72068ea None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.881579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e2d8-c6ef-4a02-be53-21eac72068ea None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.881850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e2d8-c6ef-4a02-be53-21eac72068ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.900039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9aa5e2d8-c6ef-4a02-be53-21eac72068ea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.901792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9aa5e2d8-c6ef-4a02-be53-21eac72068ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.910137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 779/1561] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.911539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b186e-f217-487b-af6c-05fe6165b3bd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.911898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b186e-f217-487b-af6c-05fe6165b3bd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.912174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b186e-f217-487b-af6c-05fe6165b3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.930865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-746b186e-f217-487b-af6c-05fe6165b3bd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.932042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-746b186e-f217-487b-af6c-05fe6165b3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.937215 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 783/1562] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/users => generated 301 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:50.938971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f64a2-868f-4b36-9a03-977da2ebbcb7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.939502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f64a2-868f-4b36-9a03-977da2ebbcb7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.939984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f64a2-868f-4b36-9a03-977da2ebbcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.940088 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 780/1563] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.940995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b186e-f217-487b-af6c-05fe6165b3bd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:50.953340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b186e-f217-487b-af6c-05fe6165b3bd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:50.959152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4875b3f-e724-43c8-acb3-2e697d9042e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:50.959858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4875b3f-e724-43c8-acb3-2e697d9042e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.960170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4875b3f-e724-43c8-acb3-2e697d9042e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.960447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4875b3f-e724-43c8-acb3-2e697d9042e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.961231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4875b3f-e724-43c8-acb3-2e697d9042e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:50.963949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4875b3f-e724-43c8-acb3-2e697d9042e6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:50.965425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-521f64a2-868f-4b36-9a03-977da2ebbcb7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:50.966642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-521f64a2-868f-4b36-9a03-977da2ebbcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:50.974370 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 781/1564] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:50 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:50.975631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e25ae-cf17-423a-a899-66fe8ba183bb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.976125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e25ae-cf17-423a-a899-66fe8ba183bb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.976461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e25ae-cf17-423a-a899-66fe8ba183bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:50.980270 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 784/1565] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:50.981884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ed57-e219-4ea8-b7ee-aa42647a05a2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:50.982314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ed57-e219-4ea8-b7ee-aa42647a05a2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:50.982593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ed57-e219-4ea8-b7ee-aa42647a05a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.002397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-436e25ae-cf17-423a-a899-66fe8ba183bb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:51.003533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fc25ed57-e219-4ea8-b7ee-aa42647a05a2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:51.003684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-436e25ae-cf17-423a-a899-66fe8ba183bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:51.005060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc25ed57-e219-4ea8-b7ee-aa42647a05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:51.011900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 782/1566] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:51.013153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805207-8171-464f-bcf7-91bdf7fb1796 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.013443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805207-8171-464f-bcf7-91bdf7fb1796 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.013807 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 785/1567] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:51.014899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a9c6-8822-4dc9-afc3-0c8d4b14e60c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.015181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a9c6-8822-4dc9-afc3-0c8d4b14e60c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.015469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a9c6-8822-4dc9-afc3-0c8d4b14e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.017099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805207-8171-464f-bcf7-91bdf7fb1796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.034486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5c68a9c6-8822-4dc9-afc3-0c8d4b14e60c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:51.034877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c3805207-8171-464f-bcf7-91bdf7fb1796 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:51.035651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5c68a9c6-8822-4dc9-afc3-0c8d4b14e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:51.036108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c3805207-8171-464f-bcf7-91bdf7fb1796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:51.044525 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 786/1568] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:51.045091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a9c6-8822-4dc9-afc3-0c8d4b14e60c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.048429 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 783/1569] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:51.049642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72aaa2-5da2-41cc-b1e3-339d1bd001d1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.049927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72aaa2-5da2-41cc-b1e3-339d1bd001d1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.050200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72aaa2-5da2-41cc-b1e3-339d1bd001d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.059181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a9c6-8822-4dc9-afc3-0c8d4b14e60c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.064034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c17b8b-0d62-4a37-a755-9dd08de2c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.064679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c17b8b-0d62-4a37-a755-9dd08de2c50a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.064993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c17b8b-0d62-4a37-a755-9dd08de2c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.065267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c17b8b-0d62-4a37-a755-9dd08de2c50a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.066014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c17b8b-0d62-4a37-a755-9dd08de2c50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.067594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c17b8b-0d62-4a37-a755-9dd08de2c50a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.067935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8f72aaa2-5da2-41cc-b1e3-339d1bd001d1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:51.069307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8f72aaa2-5da2-41cc-b1e3-339d1bd001d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:51.078370 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 784/1570] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:51.078495 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 787/1571] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:51.079638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960bb8-ef7a-4a27-b9f0-ee5c7ae225f1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.080063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960bb8-ef7a-4a27-b9f0-ee5c7ae225f1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.080338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960bb8-ef7a-4a27-b9f0-ee5c7ae225f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.082346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72aaa2-5da2-41cc-b1e3-339d1bd001d1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.092113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72aaa2-5da2-41cc-b1e3-339d1bd001d1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.096670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.097572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.097846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.098114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] PATH_INFO: `/v3/projects/5d0329a925504927b16f57dd01af289f/users/2a23eb2282d440bf8cbda939ddf9a94d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.099313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-61960bb8-ef7a-4a27-b9f0-ee5c7ae225f1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:51.100496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-61960bb8-ef7a-4a27-b9f0-ee5c7ae225f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:51.108413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 788/1572] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:51.109214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61960bb8-ef7a-4a27-b9f0-ee5c7ae225f1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.113503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0329a925504927b16f57dd01af289f, user_id=2a23eb2282d440bf8cbda939ddf9a94d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.116136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.118411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61960bb8-ef7a-4a27-b9f0-ee5c7ae225f1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.123014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.123672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.123953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.124225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.125008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:51.125344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.126935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.138679 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 789/1573] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:51.139444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.148592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5e01a-d1ec-4574-bd61-f02c568f2213 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.153763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.154370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.154649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.154923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.155619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:51.155922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.157513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.168764 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 790/1574] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:51.169545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.178455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50643-2933-4571-a284-feb1945dc671 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.183063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.183662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.183946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.184226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.184969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:51.185255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.186801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.189880 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 785/1575] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:51 2021] PUT /identity/v3/projects/5d0329a925504927b16f57dd01af289f/users/2a23eb2282d440bf8cbda939ddf9a94d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:51.197154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.198565 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 791/1576] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:51.199369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.208826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbcbdc-0ac2-4696-8e24-e4a3b5e36f57 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.263451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd9660-e251-4547-b322-a246179cec74 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.268204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.268860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.269148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.269416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.269716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.270131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:51.270377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.270569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.270647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.270920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.271650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.272192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.273260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.283211 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 792/1577] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:51.284013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.285390 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 786/1578] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:51.286475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.293873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194111-1f40-4f0f-99aa-d91bcf1efb9f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.298408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2e84b-33e7-49d4-96aa-44c7485b51d3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.298658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.299375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.299661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.299934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.300767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:51.301052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.302651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.303370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.304194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.304358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.304641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.305406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:06:51.305711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.307887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.315690 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 793/1579] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:51.316577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.320230 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 787/1580] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:06:51.320839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.326530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f13a93-5de0-445e-b56f-ba8ff96fc6c6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.330573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8245a69-2c53-4613-a9d7-387ec52ea2d5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.332797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92afff1-b96a-44c8-8e46-32cb469fa478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.333470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92afff1-b96a-44c8-8e46-32cb469fa478 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.333785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92afff1-b96a-44c8-8e46-32cb469fa478 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.334045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92afff1-b96a-44c8-8e46-32cb469fa478 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.334734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92afff1-b96a-44c8-8e46-32cb469fa478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.335375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.336034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.336315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.336588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.336681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92afff1-b96a-44c8-8e46-32cb469fa478 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.337328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.339268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.441028 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 794/1581] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/projects => generated 397 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:51.442360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145b09-2620-4e46-9c42-d6a7c95abfac None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.442652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145b09-2620-4e46-9c42-d6a7c95abfac None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.442928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f145b09-2620-4e46-9c42-d6a7c95abfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.468963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3f145b09-2620-4e46-9c42-d6a7c95abfac None None] MFA Rules not processed for user `2a23eb2282d440bf8cbda939ddf9a94d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:51.469839 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 788/1582] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:51.470152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3f145b09-2620-4e46-9c42-d6a7c95abfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:51.470721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.532618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b290ba-f1a8-4e08-a92f-451b2cc6f473 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.533414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 795/1583] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:51.534220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f145b09-2620-4e46-9c42-d6a7c95abfac None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.537780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.538444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.538723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.539002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.539697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.542240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.545911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f145b09-2620-4e46-9c42-d6a7c95abfac None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.550537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.551348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.551628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.551904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] PATH_INFO: `/v3/projects/185bf792f42c4ef18599568f8f685bab/users/c885c1e9e3a449ba9971e3ef91e71150/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.566274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] RBAC: Authorizing `identity:create_grant(project_id=185bf792f42c4ef18599568f8f685bab, user_id=c885c1e9e3a449ba9971e3ef91e71150, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.574220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.681722 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 789/1584] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:51.681722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.691890 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 796/1585] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:51 2021] PUT /identity/v3/projects/185bf792f42c4ef18599568f8f685bab/users/c885c1e9e3a449ba9971e3ef91e71150/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:51.692910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.740703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec56cc0-ed0e-445e-8f2a-c38ceb518aa0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.752005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cb927-c3b1-420b-9daf-b671714a651e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.756827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.757506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.757784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.758080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.758776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.760746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.793788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.794438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.794717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.794988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.795671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.797582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.873581 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 797/1586] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:51.873581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.899248 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 790/1587] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:51.900158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:51.933784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9a70-0fcc-4cc9-ab0f-e6fb8c5c67cf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.964236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b29ef8-7464-40c4-82ab-6d5dbc519d58 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:51.969326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.969993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.970276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.970550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.971259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.973201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:51.992311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:51.993000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:51.993280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:51.993554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:51.994234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:51.996103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.046004 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 791/1588] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.046827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.055875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a146-62e6-4d3b-92e6-7180bc2de232 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.060276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.060916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.061198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.061468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.062134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.064011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.082626 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 798/1589] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:51 2021] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.083430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.142555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9414c-4fcf-4597-bddc-af74502172c0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.143590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 792/1590] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.147395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.148178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96863f9b-ecaf-4160-a08a-2d651a116761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.148826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863f9b-ecaf-4160-a08a-2d651a116761 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.149136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863f9b-ecaf-4160-a08a-2d651a116761 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.149406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863f9b-ecaf-4160-a08a-2d651a116761 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.150086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96863f9b-ecaf-4160-a08a-2d651a116761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.152652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96863f9b-ecaf-4160-a08a-2d651a116761 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.157706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773e86c-aa19-420c-a033-fe76cef28af8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.162577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.163316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.163616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.163889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.164570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.166520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.259060 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 799/1591] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.261234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de13ed1-acd6-4072-bf1c-4db2653c7afa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.261522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de13ed1-acd6-4072-bf1c-4db2653c7afa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.261800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de13ed1-acd6-4072-bf1c-4db2653c7afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.281228 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 793/1592] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.282083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.287316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8de13ed1-acd6-4072-bf1c-4db2653c7afa None None] MFA Rules not processed for user `c885c1e9e3a449ba9971e3ef91e71150`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:52.288519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8de13ed1-acd6-4072-bf1c-4db2653c7afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:52.292793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e877-6e78-48ba-84af-6e41370ca224 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.347728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.348395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.348675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.348983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.349678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.350944 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 800/1593] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:52.351574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.351737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de13ed1-acd6-4072-bf1c-4db2653c7afa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.362190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de13ed1-acd6-4072-bf1c-4db2653c7afa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.366918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.367556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.367836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.368104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.368784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.371284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.478976 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 794/1594] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.479955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.489136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018cb62-d2bb-4ec9-91ab-2d70cdd3b775 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.490053 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 801/1595] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.490824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.494174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.495339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.495719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.495886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.499829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.499829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.500717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68847cb8-4805-4e49-aa20-deb28545adea admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.505344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.505976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.506254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.506528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.507675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.509158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.511834 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 795/1596] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.512715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.522083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7624a8-e98b-453e-8471-1caa13b59821 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.526886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.527537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.527819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.528098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.528866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.530496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.540829 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 796/1597] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.542109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.551397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55652f98-1d19-42ec-8c8e-73b986cbb016 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.556053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.556716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.557643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.557920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.558590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.560479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.599202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 802/1598] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.600027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.609855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046a8e-faca-4693-9d00-fc06e896549f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.614540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.615164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.615444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.615720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.616487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.618105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.628688 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 803/1599] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.629468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.638478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294d2c4-ca22-4993-888b-4621b7814f89 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.643079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.643669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.643951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.644226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.644948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.646753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.681146 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 797/1600] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.681995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.691569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d57f0-9d7e-490d-81e8-e939dc2164d8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.696049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.696667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.696992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.697271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.697979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.699539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.709255 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 798/1601] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.710002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.718897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23306d4-b6d5-4b2d-88d3-124421e8522c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.723353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.723938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.724218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.724491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.725211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.726686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.736834 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 799/1602] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.737587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.746893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08082775-a25e-4c81-a1ee-f06f60cde84c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.751363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.751950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.752229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.752504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.753223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.755002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.763087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 804/1603] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:52.765680 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 800/1604] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.765680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.766184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.774812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd0ae-8b41-403a-9a14-b39407d04d45 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.825860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12568ee-f0ad-406d-be5b-40e686fcc4e2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.829633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.830296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.830457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.830557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.830831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.831107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.831389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.831545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.831666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.832391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.833191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.834088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.842710 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 801/1605] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.843514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.847475 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 805/1606] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.847475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.852671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991da22-316c-4a02-b6b9-dff25784f980 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.855586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33440c6-cb9a-45d9-95bb-03ad5f7c3414 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.857823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.858461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.858744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.859099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.859750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.860269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.860927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.861214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.861331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.861490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.862232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.863986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.871416 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 802/1607] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.872195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.877749 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 806/1608] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.877749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.881531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994a85-1d9b-45c4-9f7c-d18d1abb4c3e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.884765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c60674-2fee-4cdd-8745-b5d01a068a97 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.886285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.886917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.887196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.887489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.888182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.889519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.889762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.890142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.890422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.890695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.891436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.893008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.899516 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 803/1609] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.900352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.906458 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 807/1610] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:52.906458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:52.910371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609efecc-adfd-41f6-a45a-31e92a6d7a7f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.914956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.915468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c408460-45e2-4e9e-afe4-449562c42f69 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:52.915847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.916125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.916930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] PATH_INFO: `/v3/projects/45c9d7948afa49e5bc0261e1f17180f7/users/cadb0831770246a49a9aac30067fa14f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.920687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:52.921359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:52.921640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:52.921916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:52.922597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.924478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:52.931139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c9d7948afa49e5bc0261e1f17180f7, user_id=cadb0831770246a49a9aac30067fa14f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:52.934384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.017878 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 808/1611] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:52 2021] POST /identity/v3/users => generated 307 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:53.017878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.027501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831c14-6c14-4c1c-b649-611e469c5e97 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.032150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.032772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.033073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.033346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.034057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.035620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.046088 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 809/1612] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:53.047994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.048085 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 804/1613] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:52 2021] PUT /identity/v3/projects/45c9d7948afa49e5bc0261e1f17180f7/users/cadb0831770246a49a9aac30067fa14f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:53.048427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.064861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675c713-bc7d-4df2-9285-d15633c02c19 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.108552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003c881-095b-4ad5-b75e-931732320757 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.113354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.114229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.114507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.114773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] PATH_INFO: `/v3/projects/82cb1dfb58a1493b8193ad0024840486/users/d98ab3d372a343daaeef8435bdba83c0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.121423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.122324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.122598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.122867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] PATH_INFO: `/v3/projects/6ade260ba10a4e4b9fa70c615ecc3145/users/42d43dabdeb84b5a82d838591749d3e7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.129572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cb1dfb58a1493b8193ad0024840486, user_id=d98ab3d372a343daaeef8435bdba83c0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.132212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.137120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ade260ba10a4e4b9fa70c615ecc3145, user_id=42d43dabdeb84b5a82d838591749d3e7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.139847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.235413 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 805/1614] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:53 2021] PUT /identity/v3/projects/82cb1dfb58a1493b8193ad0024840486/users/d98ab3d372a343daaeef8435bdba83c0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:53.236227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.262033 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 810/1615] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:53 2021] PUT /identity/v3/projects/6ade260ba10a4e4b9fa70c615ecc3145/users/42d43dabdeb84b5a82d838591749d3e7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:53.263102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.298114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc5ab8-134d-476b-842a-5eda34f4c7fe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.324158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fdde0-d75a-47ca-a6f8-2f100c3177ca admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.329418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.330302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.330588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.330966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] PATH_INFO: `/v3/projects/b68bba8707314955b0bd0b2a10ddb399/users/fcc69726d27f4a3c96e0edd0e47a5a17/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.345688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68bba8707314955b0bd0b2a10ddb399, user_id=fcc69726d27f4a3c96e0edd0e47a5a17, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.348403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.353617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.354577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.354880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.355151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] PATH_INFO: `/v3/projects/64a48245e8b247f78ccbc9bacca837d4/users/8ef7d8ca2bf541c38018257bbb4584b4/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.368629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a48245e8b247f78ccbc9bacca837d4, user_id=8ef7d8ca2bf541c38018257bbb4584b4, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.371455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.452510 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 811/1616] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:53 2021] PUT /identity/v3/projects/b68bba8707314955b0bd0b2a10ddb399/users/fcc69726d27f4a3c96e0edd0e47a5a17/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:53.453339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.469855 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 806/1617] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:53 2021] PUT /identity/v3/projects/64a48245e8b247f78ccbc9bacca837d4/users/8ef7d8ca2bf541c38018257bbb4584b4/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:53.470921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.517111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c5637-9731-4cbb-aefc-d09833e7e40c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.531074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f07374-3fbf-4b02-96f9-41811a9a7c64 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.535661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.536348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.536636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.536934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.537662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.539241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.548943 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 807/1618] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:53 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:53.549736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.559036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858bdfc-b6b4-4be4-ace4-a9bebce8a2be admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.563634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd94ba-7918-4bb2-ae6e-72754e248da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.564481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd94ba-7918-4bb2-ae6e-72754e248da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.564757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd94ba-7918-4bb2-ae6e-72754e248da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.565070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd94ba-7918-4bb2-ae6e-72754e248da9 admin admin] PATH_INFO: `/v3/projects/9697a905274848f580547bda94732a8c/users/794e95912b7b498d8759122f2e84757b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.571343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d123a-f1a2-4b07-8f7d-b1565962e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.572220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d123a-f1a2-4b07-8f7d-b1565962e15d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.573051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d123a-f1a2-4b07-8f7d-b1565962e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.573331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d123a-f1a2-4b07-8f7d-b1565962e15d admin admin] PATH_INFO: `/v3/projects/0ca49aabf0d9478bac3dd6b25768e759/users/0885953ad3984efaa5557eab321ed6f5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.579954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd94ba-7918-4bb2-ae6e-72754e248da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9697a905274848f580547bda94732a8c, user_id=794e95912b7b498d8759122f2e84757b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.582606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd94ba-7918-4bb2-ae6e-72754e248da9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.587016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d123a-f1a2-4b07-8f7d-b1565962e15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca49aabf0d9478bac3dd6b25768e759, user_id=0885953ad3984efaa5557eab321ed6f5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.590247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d123a-f1a2-4b07-8f7d-b1565962e15d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.686987 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 808/1619] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:53 2021] PUT /identity/v3/projects/9697a905274848f580547bda94732a8c/users/794e95912b7b498d8759122f2e84757b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:53.688438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8b8a-bfc4-4b35-a5e6-0016c657cd16 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.688713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8b8a-bfc4-4b35-a5e6-0016c657cd16 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.689022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e8b8a-bfc4-4b35-a5e6-0016c657cd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.699007 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 812/1620] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:53 2021] PUT /identity/v3/projects/0ca49aabf0d9478bac3dd6b25768e759/users/0885953ad3984efaa5557eab321ed6f5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:53.700330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0808-c72a-4cdc-b1df-97a71370098f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.700625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0808-c72a-4cdc-b1df-97a71370098f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.701092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0808-c72a-4cdc-b1df-97a71370098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.717262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9e6e8b8a-bfc4-4b35-a5e6-0016c657cd16 None None] MFA Rules not processed for user `cadb0831770246a49a9aac30067fa14f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:53.718459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9e6e8b8a-bfc4-4b35-a5e6-0016c657cd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:53.728305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-efaa0808-c72a-4cdc-b1df-97a71370098f None None] MFA Rules not processed for user `d98ab3d372a343daaeef8435bdba83c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:53.729575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-efaa0808-c72a-4cdc-b1df-97a71370098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:53.780453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 809/1621] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:53.781995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7bc3-6b7d-47fe-81e5-26e18d37043d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.782281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7bc3-6b7d-47fe-81e5-26e18d37043d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.782556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7bc3-6b7d-47fe-81e5-26e18d37043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.795261 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 813/1622] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:53 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:53.796647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995242c-034c-4c45-ace5-4126caf5acf3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.796971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995242c-034c-4c45-ace5-4126caf5acf3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.797250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995242c-034c-4c45-ace5-4126caf5acf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.812677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4d6b7bc3-6b7d-47fe-81e5-26e18d37043d None None] MFA Rules not processed for user `42d43dabdeb84b5a82d838591749d3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:53.813893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d6b7bc3-6b7d-47fe-81e5-26e18d37043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:53.824144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8995242c-034c-4c45-ace5-4126caf5acf3 None None] MFA Rules not processed for user `fcc69726d27f4a3c96e0edd0e47a5a17`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:53.825603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8995242c-034c-4c45-ace5-4126caf5acf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:53.877414 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 810/1623] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:53 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:53.878576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7bc3-6b7d-47fe-81e5-26e18d37043d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.889191 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 814/1624] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:53 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:53.890015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995242c-034c-4c45-ace5-4126caf5acf3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:53.944195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7bc3-6b7d-47fe-81e5-26e18d37043d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.950212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f35ee-3ec0-4d86-a397-2f081849dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.950888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f35ee-3ec0-4d86-a397-2f081849dca1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.951168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f35ee-3ec0-4d86-a397-2f081849dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.951442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f35ee-3ec0-4d86-a397-2f081849dca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.952210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f35ee-3ec0-4d86-a397-2f081849dca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.952364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995242c-034c-4c45-ace5-4126caf5acf3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:53.953869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f35ee-3ec0-4d86-a397-2f081849dca1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.957220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:53.960320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.960320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.960320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] PATH_INFO: `/v3/projects/36195ceeec6e46a6bd637a70ef4f949b/users/179997c9b0c4420ab7db6bfdcbf0e861/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.964992 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 811/1625] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:53 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:53.966286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028de7d-2e46-4b57-a972-e778e6a549a4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:53.966576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028de7d-2e46-4b57-a972-e778e6a549a4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:53.966852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028de7d-2e46-4b57-a972-e778e6a549a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:53.974112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36195ceeec6e46a6bd637a70ef4f949b, user_id=179997c9b0c4420ab7db6bfdcbf0e861, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:53.976761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:53.992465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6028de7d-2e46-4b57-a972-e778e6a549a4 None None] MFA Rules not processed for user `794e95912b7b498d8759122f2e84757b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:53.993844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6028de7d-2e46-4b57-a972-e778e6a549a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:54.054737 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 812/1626] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:54.056150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439114c0-bba2-40c5-a411-9b81ae1f568c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.056437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439114c0-bba2-40c5-a411-9b81ae1f568c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.056710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439114c0-bba2-40c5-a411-9b81ae1f568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.069004 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 815/1627] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:53 2021] PUT /identity/v3/projects/36195ceeec6e46a6bd637a70ef4f949b/users/179997c9b0c4420ab7db6bfdcbf0e861/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:54.069898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.084097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-439114c0-bba2-40c5-a411-9b81ae1f568c None None] MFA Rules not processed for user `0885953ad3984efaa5557eab321ed6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:54.085412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-439114c0-bba2-40c5-a411-9b81ae1f568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:54.130327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac926b-47b5-487e-b22d-c716960ab169 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.135015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.135667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.136059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.136340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.137061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.138949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.147011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 813/1628] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:54.150523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439114c0-bba2-40c5-a411-9b81ae1f568c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.158604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439114c0-bba2-40c5-a411-9b81ae1f568c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.163159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.163874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.178463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.178463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.178463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.178463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.282007 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 816/1629] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/projects => generated 399 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:54.282820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.309195 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 814/1630] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:54.310020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.348626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0efc9f-917d-4e81-a789-62e7c301663e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.370060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1e6af-0735-4247-8709-dff402626864 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.375020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.379026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.379026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.379026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.379026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.379026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.402615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.403296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.403578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.403845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.407293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.407293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.502187 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 815/1631] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:54.502187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.530704 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 817/1632] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/projects => generated 391 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:54.530704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.559554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0851f7-e54e-4b4e-83da-ceb1738cfb77 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.587996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d09b05-aeaa-4a81-9c76-f7784a92d474 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.593222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.593881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.594163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.594441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.595143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.597139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.614841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.615660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.615962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.616252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] PATH_INFO: `/v3/projects/64a48245e8b247f78ccbc9bacca837d4/users/8ef7d8ca2bf541c38018257bbb4584b4/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.618193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a48245e8b247f78ccbc9bacca837d4, user_id=8ef7d8ca2bf541c38018257bbb4584b4, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.620927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.630776 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 816/1633] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:54 2021] PUT /identity/v3/projects/64a48245e8b247f78ccbc9bacca837d4/users/8ef7d8ca2bf541c38018257bbb4584b4/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:54.631538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.690104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae4f94-774f-4a7a-8b87-dc26699964ba admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.693662 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 818/1634] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:54.694283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.694716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.695366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.695643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.695915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.696638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.698292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.708207 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 817/1635] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:54 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:54.709023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.718857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6660ac-f381-46af-bb8a-3c229997c80d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.754696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acd183-daac-41a3-99cd-994d3795d953 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.759275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.760033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.760312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.760582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.761293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.763156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.771359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.772017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.772300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.772575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.773288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.775183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.876282 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 819/1636] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:54.877052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.911954 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 818/1637] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/users => generated 306 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:54.911954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:54.919958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26c930-ebdc-4eff-9ef5-6dcedcd4299e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.938036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccf4d0-7e91-433f-a8b2-a5751b19b3b5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:54.942881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.943550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.943831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.944104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.944803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.946799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:54.977416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1e23b-e05e-447a-ad99-66fd9af5554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:54.978086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e23b-e05e-447a-ad99-66fd9af5554c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:54.978372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e23b-e05e-447a-ad99-66fd9af5554c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:54.978643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1e23b-e05e-447a-ad99-66fd9af5554c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:54.979408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1e23b-e05e-447a-ad99-66fd9af5554c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:54.981326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1e23b-e05e-447a-ad99-66fd9af5554c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.102075 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 820/1638] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:55.102877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.112030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581b8c1-af8e-4e98-9ebd-9699903442a1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.116647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.117332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.117586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.117859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.118538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.122033 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 819/1639] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:54 2021] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:55.122033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91953b6-3c61-4bec-b3ea-9add1c33c4dc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.122222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.122301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91953b6-3c61-4bec-b3ea-9add1c33c4dc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.122301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91953b6-3c61-4bec-b3ea-9add1c33c4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.147198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e91953b6-3c61-4bec-b3ea-9add1c33c4dc None None] MFA Rules not processed for user `8ef7d8ca2bf541c38018257bbb4584b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:55.148154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e91953b6-3c61-4bec-b3ea-9add1c33c4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:55.213031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 821/1640] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:55 2021] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:55.214272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.219948 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 820/1641] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:55 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:55.220763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91953b6-3c61-4bec-b3ea-9add1c33c4dc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.227037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb8647-e301-4bc2-82a1-e8b015ffa7dc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.231080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91953b6-3c61-4bec-b3ea-9add1c33c4dc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.233186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.233992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.234286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.234619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.235327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.235944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.236819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.237129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.237400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] PATH_INFO: `/v3/projects/36195ceeec6e46a6bd637a70ef4f949b/users/179997c9b0c4420ab7db6bfdcbf0e861/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.237921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.239586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=36195ceeec6e46a6bd637a70ef4f949b, user_id=179997c9b0c4420ab7db6bfdcbf0e861, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.242162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.253868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 821/1642] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:55 2021] PUT /identity/v3/projects/36195ceeec6e46a6bd637a70ef4f949b/users/179997c9b0c4420ab7db6bfdcbf0e861/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:55.254969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.320202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c4886-7842-416e-b449-2a177ab0e32c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.325873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.326532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.326844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.327215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.327916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.329859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.344499 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 822/1643] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:55 2021] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:55.346998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.356498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23486d-447a-4d0d-81c0-fc5749f36da3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.363350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.364190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.364571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.364985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.365852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.367712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.383148 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 823/1644] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:55.383148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.392475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21cac-b46d-4a2c-9159-b7452921bb4d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.397481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.398114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.398404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.398672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.399431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.401065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.411604 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 824/1645] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:55.413014 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 822/1646] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:06:55 2021] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:06:55.413145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.413525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.424613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9372b-9d38-48f9-8829-ef0bf2717d84 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.426425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6fd3a-767e-4d9f-817b-bfef5a054a41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.430925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fa79c-fc23-481c-8dcb-2e4ae2b43d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.431707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa79c-fc23-481c-8dcb-2e4ae2b43d65 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.432432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81845963-3cd6-4397-ac51-e343c300a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.432713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa79c-fc23-481c-8dcb-2e4ae2b43d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.433131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa79c-fc23-481c-8dcb-2e4ae2b43d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.433600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845963-3cd6-4397-ac51-e343c300a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.434032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845963-3cd6-4397-ac51-e343c300a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.434193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fa79c-fc23-481c-8dcb-2e4ae2b43d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.434570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81845963-3cd6-4397-ac51-e343c300a7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.435729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81845963-3cd6-4397-ac51-e343c300a7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.436416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fa79c-fc23-481c-8dcb-2e4ae2b43d65 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.438089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81845963-3cd6-4397-ac51-e343c300a7f4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.448817 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 825/1647] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:55.453290 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 823/1648] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:55.453290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dce47-0685-4d0c-a778-cf003a0306f4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.453290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dce47-0685-4d0c-a778-cf003a0306f4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.453290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dce47-0685-4d0c-a778-cf003a0306f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.454069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222f68-9e7a-4dfb-8d19-1a056fc49db3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.454364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222f68-9e7a-4dfb-8d19-1a056fc49db3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.454646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222f68-9e7a-4dfb-8d19-1a056fc49db3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.456580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 826/1649] 10.222.0.32 () {54 vars in 961 bytes} [Sat Dec 25 21:06:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:06:55.457327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222f68-9e7a-4dfb-8d19-1a056fc49db3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.470067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222f68-9e7a-4dfb-8d19-1a056fc49db3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.474656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.475329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.475610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.475882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.481364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.481364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.481515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3c5dce47-0685-4d0c-a778-cf003a0306f4 None None] MFA Rules not processed for user `179997c9b0c4420ab7db6bfdcbf0e861`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:55.482040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3c5dce47-0685-4d0c-a778-cf003a0306f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:55.488483 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 827/1650] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:55.489557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.500264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d96cd-1259-4ab4-9572-90bfff3e9b16 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.505930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.506804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.507085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.507366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] PATH_INFO: `/v3/projects/7fe465dc44884fe29de639a5a4321b40/users/ff1d2254deea40079db6f1d0adcd4a6a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.523768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe465dc44884fe29de639a5a4321b40, user_id=ff1d2254deea40079db6f1d0adcd4a6a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.526697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.551051 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 824/1651] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:55 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:55.551866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dce47-0685-4d0c-a778-cf003a0306f4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.562084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dce47-0685-4d0c-a778-cf003a0306f4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.566771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.567766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.568044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.568342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] PATH_INFO: `/v3/projects/3f9ad080a6ad4b21bf8e3793877cd698/users/adaa21f2f245434685ff2553544c10e3/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.583019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9ad080a6ad4b21bf8e3793877cd698, user_id=adaa21f2f245434685ff2553544c10e3, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.585675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.639101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 828/1652] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:55 2021] PUT /identity/v3/projects/7fe465dc44884fe29de639a5a4321b40/users/ff1d2254deea40079db6f1d0adcd4a6a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:55.639865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.702876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf650c-64e4-4b41-b988-bc0c6c3a09f7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.707655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.708369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.708657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.708946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.709675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.711280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.721148 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 829/1653] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:55.721899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.731568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e63645-3fb8-4182-a7ff-5afd1be18e0d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.736150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce026c92-a66b-40c3-8630-17360a57eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.737044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce026c92-a66b-40c3-8630-17360a57eb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.737324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce026c92-a66b-40c3-8630-17360a57eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.737599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce026c92-a66b-40c3-8630-17360a57eb64 admin admin] PATH_INFO: `/v3/projects/5f001dd67c394bbea95d0bc03b16edf2/users/99c1799f88684e9c968424929cd6d723/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.748102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 825/1654] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:55 2021] PUT /identity/v3/projects/3f9ad080a6ad4b21bf8e3793877cd698/users/adaa21f2f245434685ff2553544c10e3/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:55.748948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.753677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce026c92-a66b-40c3-8630-17360a57eb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f001dd67c394bbea95d0bc03b16edf2, user_id=99c1799f88684e9c968424929cd6d723, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.756319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce026c92-a66b-40c3-8630-17360a57eb64 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.806193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e608-d543-443c-a422-debc01fdaada admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.811483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.812362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.812642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.812946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] PATH_INFO: `/v3/projects/cbf63a1f23b443e383490121b7be9d58/users/64b29248a08c4574800bfc7f8cc3d405/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.826777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf63a1f23b443e383490121b7be9d58, user_id=64b29248a08c4574800bfc7f8cc3d405, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.829456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:55.878900 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 830/1655] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:55 2021] PUT /identity/v3/projects/5f001dd67c394bbea95d0bc03b16edf2/users/99c1799f88684e9c968424929cd6d723/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:55.880215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2079ce-9b89-426a-9bd2-1dd388d5a190 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.880484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2079ce-9b89-426a-9bd2-1dd388d5a190 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.880760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2079ce-9b89-426a-9bd2-1dd388d5a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.898470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6d2079ce-9b89-426a-9bd2-1dd388d5a190 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:55.899651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6d2079ce-9b89-426a-9bd2-1dd388d5a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:55.909180 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 826/1656] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:55 2021] PUT /identity/v3/projects/cbf63a1f23b443e383490121b7be9d58/users/64b29248a08c4574800bfc7f8cc3d405/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:55.910130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.969202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 831/1657] 10.222.0.32 () {58 vars in 1058 bytes} [Sat Dec 25 21:06:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:55.970704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ca68-f8ed-4332-9819-fffa024b0318 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.970941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ca68-f8ed-4332-9819-fffa024b0318 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.971221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ca68-f8ed-4332-9819-fffa024b0318 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.973043 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 832/1658] 10.222.0.32 () {54 vars in 961 bytes} [Sat Dec 25 21:06:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:06:55.973614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ca68-f8ed-4332-9819-fffa024b0318 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:55.977402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49e9f8-894a-4cfb-8794-8c9348638122 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.983136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.984048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.984424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.984695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] PATH_INFO: `/v3/projects/d00d8ea258804fb5a933e1b5b0371e7f/users/c08edeb29c954c83807b5d02cd9c4d10/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.986856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ca68-f8ed-4332-9819-fffa024b0318 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:55.991507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:55.992177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:55.999730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:55.999730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:55.999730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:55.999730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.000016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00d8ea258804fb5a933e1b5b0371e7f, user_id=c08edeb29c954c83807b5d02cd9c4d10, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.002800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.008065 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 833/1659] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:56.008065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.015360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c944dc-01b8-46eb-8969-7043b049e77e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.020080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.021001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.021306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.021602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] PATH_INFO: `/v3/projects/676d37fca6df4ddfa48bd8dde46d0828/users/2ad340400aa84cbabe8b4b5998b6ca62/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.036860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676d37fca6df4ddfa48bd8dde46d0828, user_id=2ad340400aa84cbabe8b4b5998b6ca62, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.039573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.092692 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 827/1660] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:55 2021] PUT /identity/v3/projects/d00d8ea258804fb5a933e1b5b0371e7f/users/c08edeb29c954c83807b5d02cd9c4d10/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.093618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.121340 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 834/1661] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:56 2021] PUT /identity/v3/projects/676d37fca6df4ddfa48bd8dde46d0828/users/2ad340400aa84cbabe8b4b5998b6ca62/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.122159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.163445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27becbb7-6008-4f07-ac08-838f4cdc05db admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.188184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210762-a0bd-4f2f-866b-8bffeb26d1d8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.192859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.193560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.193832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.194109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.194827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.196409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.206587 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 835/1662] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:56.207511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.217705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3fae1-54c6-4c76-aae7-007ced8abd89 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.217851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.218421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.218713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.218985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.219714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.221326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.222561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40449863-3111-4e98-922c-debdb2651c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.223198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40449863-3111-4e98-922c-debdb2651c3b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.223481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40449863-3111-4e98-922c-debdb2651c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.223759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40449863-3111-4e98-922c-debdb2651c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.224481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40449863-3111-4e98-922c-debdb2651c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.226073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40449863-3111-4e98-922c-debdb2651c3b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.231769 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 828/1663] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:56.232701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.236415 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 836/1664] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:56.237621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec3f4c-8146-48f6-90cc-b1271d0a0b26 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.237909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec3f4c-8146-48f6-90cc-b1271d0a0b26 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.238186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec3f4c-8146-48f6-90cc-b1271d0a0b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.256414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b0ec3f4c-8146-48f6-90cc-b1271d0a0b26 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:56.257657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0ec3f4c-8146-48f6-90cc-b1271d0a0b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:56.300390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4544-a2fc-4d18-bbbc-05e05c418d0b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.305872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.306511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.306800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.307080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.321825 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 837/1665] 10.222.0.32 () {58 vars in 1058 bytes} [Sat Dec 25 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:56.323172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec3f4c-8146-48f6-90cc-b1271d0a0b26 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.333055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec3f4c-8146-48f6-90cc-b1271d0a0b26 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.337667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.339077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.339359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.339636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] PATH_INFO: `/v3/projects/7fe465dc44884fe29de639a5a4321b40/users/ff1d2254deea40079db6f1d0adcd4a6a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.341647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe465dc44884fe29de639a5a4321b40, user_id=ff1d2254deea40079db6f1d0adcd4a6a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.344286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.354357 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 838/1666] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:56 2021] PUT /identity/v3/projects/7fe465dc44884fe29de639a5a4321b40/users/ff1d2254deea40079db6f1d0adcd4a6a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.355154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.365723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.367289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.376609 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 829/1667] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:56 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:56.377519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.387708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a3a3-bdbf-485d-84e4-739134c046d1 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.419246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114942-dbbc-4f2a-9247-6e1ea628d11a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.424718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.425397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.432137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.432137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.432137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.432137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.442252 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 839/1668] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:56.442252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.446228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.446899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.447182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.447968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.448696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.450720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.452315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfb4d2-e87e-4465-902e-2ab77d6273cd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.457588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.458636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.458930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.459212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] PATH_INFO: `/v3/projects/5f001dd67c394bbea95d0bc03b16edf2/users/99c1799f88684e9c968424929cd6d723/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.460710 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 830/1669] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:06:56.461294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.461453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f001dd67c394bbea95d0bc03b16edf2, user_id=99c1799f88684e9c968424929cd6d723, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.465726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.472655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fae78-ad9b-4958-b4d0-a86979b8bced admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.486003 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 840/1670] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:56 2021] PUT /identity/v3/projects/5f001dd67c394bbea95d0bc03b16edf2/users/99c1799f88684e9c968424929cd6d723/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.486003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.545843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.546729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.547010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.547308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] PATH_INFO: `/v3/projects/3f9ad080a6ad4b21bf8e3793877cd698/users/adaa21f2f245434685ff2553544c10e3/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.549324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9ad080a6ad4b21bf8e3793877cd698, user_id=adaa21f2f245434685ff2553544c10e3, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.551934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.557050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142a0e-5d6b-40a0-9817-ee9867b16d54 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.562205 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 831/1671] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:56 2021] PUT /identity/v3/projects/3f9ad080a6ad4b21bf8e3793877cd698/users/adaa21f2f245434685ff2553544c10e3/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.562878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.622706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd669341-1240-4f48-8058-6a6a1272d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.623708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669341-1240-4f48-8058-6a6a1272d9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.624052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669341-1240-4f48-8058-6a6a1272d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.624415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd669341-1240-4f48-8058-6a6a1272d9e2 admin admin] PATH_INFO: `/v3/projects/cbf63a1f23b443e383490121b7be9d58/users/64b29248a08c4574800bfc7f8cc3d405/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.626481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd669341-1240-4f48-8058-6a6a1272d9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf63a1f23b443e383490121b7be9d58, user_id=64b29248a08c4574800bfc7f8cc3d405, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.629893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd669341-1240-4f48-8058-6a6a1272d9e2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.635670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640c023-00fa-4150-af65-8ca0de839074 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.641349 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 841/1672] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:56 2021] PUT /identity/v3/projects/cbf63a1f23b443e383490121b7be9d58/users/64b29248a08c4574800bfc7f8cc3d405/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.642596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604ded-9871-410d-9e86-9f676a992d5d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.642886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604ded-9871-410d-9e86-9f676a992d5d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.643152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604ded-9871-410d-9e86-9f676a992d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.672729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9c604ded-9871-410d-9e86-9f676a992d5d None None] MFA Rules not processed for user `ff1d2254deea40079db6f1d0adcd4a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:56.673950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c604ded-9871-410d-9e86-9f676a992d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:56.711538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.712190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.712472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.712748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.746197 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 842/1673] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:56.747048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604ded-9871-410d-9e86-9f676a992d5d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.770479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.772155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.781989 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 832/1674] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:56 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:56.782769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:56.806467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c604ded-9871-410d-9e86-9f676a992d5d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.812059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592741fc-566c-4ded-a1fd-7383133bf5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.813010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592741fc-566c-4ded-a1fd-7383133bf5af admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.813301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592741fc-566c-4ded-a1fd-7383133bf5af admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.813576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592741fc-566c-4ded-a1fd-7383133bf5af admin admin] PATH_INFO: `/v3/projects/d00d8ea258804fb5a933e1b5b0371e7f/users/c08edeb29c954c83807b5d02cd9c4d10/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.815621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592741fc-566c-4ded-a1fd-7383133bf5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00d8ea258804fb5a933e1b5b0371e7f, user_id=c08edeb29c954c83807b5d02cd9c4d10, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.818274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592741fc-566c-4ded-a1fd-7383133bf5af admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.829311 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 843/1675] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:56 2021] PUT /identity/v3/projects/d00d8ea258804fb5a933e1b5b0371e7f/users/c08edeb29c954c83807b5d02cd9c4d10/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.830366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2327-763c-462b-9e8d-88658405eb60 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.830667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2327-763c-462b-9e8d-88658405eb60 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.830932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2327-763c-462b-9e8d-88658405eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.845903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef71b8a-8c0c-4141-967a-17f3efe9d785 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:56.856040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8ece2327-763c-462b-9e8d-88658405eb60 None None] MFA Rules not processed for user `99c1799f88684e9c968424929cd6d723`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:56.857272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ece2327-763c-462b-9e8d-88658405eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:56.902678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717392e6-533a-4b81-85c0-dc7d5f4fc94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:56.903572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717392e6-533a-4b81-85c0-dc7d5f4fc94b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.903858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717392e6-533a-4b81-85c0-dc7d5f4fc94b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.904137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717392e6-533a-4b81-85c0-dc7d5f4fc94b admin admin] PATH_INFO: `/v3/projects/676d37fca6df4ddfa48bd8dde46d0828/users/2ad340400aa84cbabe8b4b5998b6ca62/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.906247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717392e6-533a-4b81-85c0-dc7d5f4fc94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=676d37fca6df4ddfa48bd8dde46d0828, user_id=2ad340400aa84cbabe8b4b5998b6ca62, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:56.908940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717392e6-533a-4b81-85c0-dc7d5f4fc94b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:56.922386 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 833/1676] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:06:56 2021] PUT /identity/v3/projects/676d37fca6df4ddfa48bd8dde46d0828/users/2ad340400aa84cbabe8b4b5998b6ca62/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:56.924149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964043-6cc1-4cd0-be66-853313a401a9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.924863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964043-6cc1-4cd0-be66-853313a401a9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.925564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe964043-6cc1-4cd0-be66-853313a401a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.933246 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 844/1677] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:56.934769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab31f10-d0e5-410f-acf2-de5e28dfe260 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:56.935239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab31f10-d0e5-410f-acf2-de5e28dfe260 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:56.935748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab31f10-d0e5-410f-acf2-de5e28dfe260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:56.965265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fab31f10-d0e5-410f-acf2-de5e28dfe260 None None] MFA Rules not processed for user `64b29248a08c4574800bfc7f8cc3d405`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:56.965823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fe964043-6cc1-4cd0-be66-853313a401a9 None None] MFA Rules not processed for user `adaa21f2f245434685ff2553544c10e3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:56.966655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fab31f10-d0e5-410f-acf2-de5e28dfe260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:56.967004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fe964043-6cc1-4cd0-be66-853313a401a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.036350 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 834/1678] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:57.037300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe964043-6cc1-4cd0-be66-853313a401a9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.042436 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 845/1679] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:56 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:57.043782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab31f10-d0e5-410f-acf2-de5e28dfe260 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.100948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe964043-6cc1-4cd0-be66-853313a401a9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.106176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.107152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.107575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.107853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] PATH_INFO: `/v3/users/2a23eb2282d440bf8cbda939ddf9a94d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.109098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a23eb2282d440bf8cbda939ddf9a94d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.111010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.113498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab31f10-d0e5-410f-acf2-de5e28dfe260 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.120515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0019b2-de36-4d7b-9f82-2f2dac89d954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.121191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0019b2-de36-4d7b-9f82-2f2dac89d954 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.121472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0019b2-de36-4d7b-9f82-2f2dac89d954 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.121745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0019b2-de36-4d7b-9f82-2f2dac89d954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.189514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0019b2-de36-4d7b-9f82-2f2dac89d954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.191109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0019b2-de36-4d7b-9f82-2f2dac89d954 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.200703 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 846/1680] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:57.201983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52524-f8f3-4e9d-88d1-bda27fb6fc7c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.202271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52524-f8f3-4e9d-88d1-bda27fb6fc7c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.202567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52524-f8f3-4e9d-88d1-bda27fb6fc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.227694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-27f52524-f8f3-4e9d-88d1-bda27fb6fc7c None None] MFA Rules not processed for user `c08edeb29c954c83807b5d02cd9c4d10`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:57.229431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-27f52524-f8f3-4e9d-88d1-bda27fb6fc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.295448 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 847/1681] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:57 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:57.296681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02cd28-3822-4073-9f75-4fe6e066aa7b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.297004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02cd28-3822-4073-9f75-4fe6e066aa7b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.297282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02cd28-3822-4073-9f75-4fe6e066aa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.323624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0c02cd28-3822-4073-9f75-4fe6e066aa7b None None] MFA Rules not processed for user `2ad340400aa84cbabe8b4b5998b6ca62`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:57.325128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0c02cd28-3822-4073-9f75-4fe6e066aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.372046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a23eb2282d440bf8cbda939ddf9a94d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:57.378861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a23eb2282d440bf8cbda939ddf9a94d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:57.390126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a23eb2282d440bf8cbda939ddf9a94d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:57.390254 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 848/1682] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:57 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:57.391017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02cd28-3822-4073-9f75-4fe6e066aa7b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.391521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a23eb2282d440bf8cbda939ddf9a94d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:57.392120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a23eb2282d440bf8cbda939ddf9a94d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:57.405934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02cd28-3822-4073-9f75-4fe6e066aa7b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.411582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa2a96-52ff-4b6d-a2cd-a40c71cf7822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.412194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2a96-52ff-4b6d-a2cd-a40c71cf7822 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.412478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2a96-52ff-4b6d-a2cd-a40c71cf7822 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.412756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2a96-52ff-4b6d-a2cd-a40c71cf7822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.414553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-16aa2a96-52ff-4b6d-a2cd-a40c71cf7822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.462872 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 835/1683] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:06:57 2021] DELETE /identity/v3/users/2a23eb2282d440bf8cbda939ddf9a94d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:57.464258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.465643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.475837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa2a96-52ff-4b6d-a2cd-a40c71cf7822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.477479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa2a96-52ff-4b6d-a2cd-a40c71cf7822 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.487530 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 849/1684] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:57.488991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.489285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.489598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.506638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:57.507823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.538813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c039a-f83b-45bd-8474-e5adee2e8c72 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.545351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.549658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.549658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.549658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.549658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.566528 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 850/1685] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:57.582979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.584472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.621655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.623248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.633215 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 836/1686] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:57.634052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.635367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.641939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff43845-8f4b-4640-b862-203e4ec8af5b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.646123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.646928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.647210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.647508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.650153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271f79-3ee8-4fd7-894d-1a530af39bf4 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.657127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.657735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.657834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.658037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.658309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.659200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.660046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.672098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 851/1687] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:57.709387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.722394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83688c68-bf22-4e73-9210-ff0efd00052f service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.728255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.729545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.729855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.730133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.732821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.742560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.744136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.754187 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 837/1688] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:57.795412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.797072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.806247 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 852/1689] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:57.850098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:57.860981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb2de2-05ed-4af6-8e0e-4d4b8c1c345a service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:57.866591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:57.867230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:57.867522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:57.867811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:57.870318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:57.938583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:57.940164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:57.953408 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 838/1690] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:57 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:58.004325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.018283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782776-4264-4224-b77c-f66558dbc1da service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.024858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.026130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.026409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.026685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.032324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.092731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.094258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.103070 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 853/1691] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:58 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:58.117818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.119194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.132764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee990a-783f-4f66-8f22-cc323c322de0 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.138248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.139113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.139379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.139676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] PATH_INFO: `/v3/users/0885953ad3984efaa5557eab321ed6f5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.140867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0885953ad3984efaa5557eab321ed6f5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.142932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.162766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.165930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.180792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40cff0-21e1-4e9c-8c6c-30108b0a2a34 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.188575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.189894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.189894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.190199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] PATH_INFO: `/v3/projects/5d0329a925504927b16f57dd01af289f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.191605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0329a925504927b16f57dd01af289f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.194406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.408496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0885953ad3984efaa5557eab321ed6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.409497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0329a925504927b16f57dd01af289f', 'request_id': 'req-fc3f8eaf-2301-452f-bf65-69223c78f6df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.415204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0885953ad3984efaa5557eab321ed6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.426566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0885953ad3984efaa5557eab321ed6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.427216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0885953ad3984efaa5557eab321ed6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.427815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-428bcf7d-70dd-400e-af0f-44b37f3d6b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0885953ad3984efaa5557eab321ed6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.497575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0329a925504927b16f57dd01af289f', 'request_id': 'req-fc3f8eaf-2301-452f-bf65-69223c78f6df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.504296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0329a925504927b16f57dd01af289f', 'request_id': 'req-fc3f8eaf-2301-452f-bf65-69223c78f6df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.515478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] The token cache is being invalidate because project 5d0329a925504927b16f57dd01af289f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:06:58.515764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.516906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.521954 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 854/1692] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:06:58 2021] DELETE /identity/v3/projects/5d0329a925504927b16f57dd01af289f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:06:58.523409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.524846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.595414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f8eaf-2301-452f-bf65-69223c78f6df admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.600040 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 839/1693] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:06:58 2021] DELETE /identity/v3/users/0885953ad3984efaa5557eab321ed6f5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:58.603165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba7ab1-696e-4004-95d5-fd969415cbd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.603277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd5ed-3ed5-436f-a507-a5b2c745c0c2 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.603348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba7ab1-696e-4004-95d5-fd969415cbd5 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.603412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd5ed-3ed5-436f-a507-a5b2c745c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.603493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba7ab1-696e-4004-95d5-fd969415cbd5 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.603561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd5ed-3ed5-436f-a507-a5b2c745c0c2 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.604135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba7ab1-696e-4004-95d5-fd969415cbd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.604200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 840/1694] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:06:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:06:58.604586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bdba7ab1-696e-4004-95d5-fd969415cbd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.604846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bd5ed-3ed5-436f-a507-a5b2c745c0c2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.606448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-972bd5ed-3ed5-436f-a507-a5b2c745c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.661687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba7ab1-696e-4004-95d5-fd969415cbd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.663180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba7ab1-696e-4004-95d5-fd969415cbd5 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.671257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bd5ed-3ed5-436f-a507-a5b2c745c0c2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.672610 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 855/1695] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:58.674158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df812-ebfa-4235-92b3-0bb842428fa1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.674584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df812-ebfa-4235-92b3-0bb842428fa1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.674871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09df812-ebfa-4235-92b3-0bb842428fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.676321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.677207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.677493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.677789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] PATH_INFO: `/v3/users/8ef7d8ca2bf541c38018257bbb4584b4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.678983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef7d8ca2bf541c38018257bbb4584b4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.680944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.695520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c09df812-ebfa-4235-92b3-0bb842428fa1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:58.696686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c09df812-ebfa-4235-92b3-0bb842428fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.705852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 856/1696] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:58.707625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.707625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.707810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.726518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:58.727703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.787865 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 857/1697] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:06:58 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:06:58.788763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.790146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.844958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e5169-806e-491b-ba25-54414be7af0f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.849391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.850030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.850309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.850583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.860385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.862093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.872547 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 858/1698] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:58.873201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.874507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.889490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8572-6241-4656-a639-3e05b61960a9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.894777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.895563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.895848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.896236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.905625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.907403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.921083 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 859/1699] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:58.921881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:58.923251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:58.939946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1339-9ad7-442a-8d56-0e277a539744 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:58.947393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:58.947393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:58.947393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:58.947393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] PATH_INFO: `/v3/users/42d43dabdeb84b5a82d838591749d3e7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:58.947761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef7d8ca2bf541c38018257bbb4584b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.948020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d43dabdeb84b5a82d838591749d3e7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:58.949261 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.949261 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:06:58.949261 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:06:58.950670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:58.962074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef7d8ca2bf541c38018257bbb4584b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.980686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef7d8ca2bf541c38018257bbb4584b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.981458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef7d8ca2bf541c38018257bbb4584b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:58.982537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c3ac44b-811d-43d8-a63b-b3538ce79a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef7d8ca2bf541c38018257bbb4584b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.116453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 841/1700] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:06:58 2021] DELETE /identity/v3/users/8ef7d8ca2bf541c38018257bbb4584b4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:59.250067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d43dabdeb84b5a82d838591749d3e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.261464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d43dabdeb84b5a82d838591749d3e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.280004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d43dabdeb84b5a82d838591749d3e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.280739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d43dabdeb84b5a82d838591749d3e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.404739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d43dabdeb84b5a82d838591749d3e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.418399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 860/1701] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:06:58 2021] DELETE /identity/v3/users/42d43dabdeb84b5a82d838591749d3e7 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:59.420638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:59.421079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:59.421231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:59.443674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:06:59.444933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:59.485983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:59.487504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:59.517677 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 842/1702] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:06:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:06:59.518558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:59.520101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:59.545187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05183bdd-4cf0-49b0-8cec-41af6bf287bf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:59.563283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:59.564262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:59.564548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:59.564948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] PATH_INFO: `/v3/projects/0ca49aabf0d9478bac3dd6b25768e759` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:59.566359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca49aabf0d9478bac3dd6b25768e759)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:59.567419 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.567419 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:06:59.567419 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:06:59.568976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:59.592287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519f1ef-f662-446d-a6b2-93d9555b4b8d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:59.599258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:59.600248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:59.600616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:59.600986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] PATH_INFO: `/v3/users/c885c1e9e3a449ba9971e3ef91e71150` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:59.602343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c885c1e9e3a449ba9971e3ef91e71150)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:06:59.604341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:06:59.733393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca49aabf0d9478bac3dd6b25768e759', 'request_id': 'req-ce2de39d-a477-425e-9830-75554ebff26a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.747151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca49aabf0d9478bac3dd6b25768e759', 'request_id': 'req-ce2de39d-a477-425e-9830-75554ebff26a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.897973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca49aabf0d9478bac3dd6b25768e759', 'request_id': 'req-ce2de39d-a477-425e-9830-75554ebff26a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.909949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] The token cache is being invalidate because project 0ca49aabf0d9478bac3dd6b25768e759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:06:59.910231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.910875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.911688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c885c1e9e3a449ba9971e3ef91e71150'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.912427 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 843/1703] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:06:59 2021] DELETE /identity/v3/projects/0ca49aabf0d9478bac3dd6b25768e759 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:06:59.913242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:06:59.914487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:59.918748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c885c1e9e3a449ba9971e3ef91e71150'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.930843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c885c1e9e3a449ba9971e3ef91e71150'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.932202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c885c1e9e3a449ba9971e3ef91e71150'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:06:59.970364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2de39d-a477-425e-9830-75554ebff26a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:06:59.974077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:06:59.976289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:06:59.976289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:06:59.976289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:06:59.977577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:06:59.997795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b31a10d-44e8-44f1-bd57-26728db7f258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c885c1e9e3a449ba9971e3ef91e71150'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.003072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 861/1704] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:06:59 2021] DELETE /identity/v3/users/c885c1e9e3a449ba9971e3ef91e71150 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:00.004383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e7bc-6def-4544-a696-5b847c981c2d None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.004670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e7bc-6def-4544-a696-5b847c981c2d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.004973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e7bc-6def-4544-a696-5b847c981c2d None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.006658 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 862/1705] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:00.007377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e7bc-6def-4544-a696-5b847c981c2d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:00.008972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a153e7bc-6def-4544-a696-5b847c981c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.041632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:00.043065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:00.052938 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 844/1706] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:06:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:00.053745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:00.055055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.067535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16faf1-3f25-4225-b0c8-09090bb8324b service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:00.072807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:00.073649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.073953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.074234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] PATH_INFO: `/v3/users/fcc69726d27f4a3c96e0edd0e47a5a17` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.075723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc69726d27f4a3c96e0edd0e47a5a17)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:00.077684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:00.079589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e7bc-6def-4544-a696-5b847c981c2d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:00.086313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:00.087543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.088186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.088474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] PATH_INFO: `/v3/projects/64a48245e8b247f78ccbc9bacca837d4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.089923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a48245e8b247f78ccbc9bacca837d4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:00.092742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:00.255970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a48245e8b247f78ccbc9bacca837d4', 'request_id': 'req-b1340769-f8d0-4d8f-93b7-d30e48534823'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.261809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc69726d27f4a3c96e0edd0e47a5a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.268863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc69726d27f4a3c96e0edd0e47a5a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.280690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc69726d27f4a3c96e0edd0e47a5a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.281545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc69726d27f4a3c96e0edd0e47a5a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.282231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-acdcfd18-e460-47d4-bd44-f2596ee73395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc69726d27f4a3c96e0edd0e47a5a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.318812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a48245e8b247f78ccbc9bacca837d4', 'request_id': 'req-b1340769-f8d0-4d8f-93b7-d30e48534823'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.325785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a48245e8b247f78ccbc9bacca837d4', 'request_id': 'req-b1340769-f8d0-4d8f-93b7-d30e48534823'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.336180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] The token cache is being invalidate because project 64a48245e8b247f78ccbc9bacca837d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:00.336465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.337143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.338704 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 863/1707] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:00 2021] DELETE /identity/v3/projects/64a48245e8b247f78ccbc9bacca837d4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:00.339459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:00.340714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.403203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340769-f8d0-4d8f-93b7-d30e48534823 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:00.407776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:00.408728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.409038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.409306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] PATH_INFO: `/v3/users/2ad340400aa84cbabe8b4b5998b6ca62` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.410504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad340400aa84cbabe8b4b5998b6ca62)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:00.412397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:00.415933 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 845/1708] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:00 2021] DELETE /identity/v3/users/fcc69726d27f4a3c96e0edd0e47a5a17 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:00.420667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82288d1-6a78-4219-9225-73c76a7240cf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.421267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82288d1-6a78-4219-9225-73c76a7240cf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.421267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82288d1-6a78-4219-9225-73c76a7240cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.439046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f82288d1-6a78-4219-9225-73c76a7240cf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:00.440240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f82288d1-6a78-4219-9225-73c76a7240cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.499243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 846/1709] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:00.500478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61103130-9034-405e-8d59-0853c8be6a13 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.500899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61103130-9034-405e-8d59-0853c8be6a13 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.501196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61103130-9034-405e-8d59-0853c8be6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.521626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-61103130-9034-405e-8d59-0853c8be6a13 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:00.522804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-61103130-9034-405e-8d59-0853c8be6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.583455 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 847/1710] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:00.584785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564ae11-5aba-4fe9-a8cd-246c92845e95 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.585102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564ae11-5aba-4fe9-a8cd-246c92845e95 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.585374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564ae11-5aba-4fe9-a8cd-246c92845e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.604343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c564ae11-5aba-4fe9-a8cd-246c92845e95 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:00.605595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c564ae11-5aba-4fe9-a8cd-246c92845e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.613596 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 848/1711] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:00.614798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.615078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.615349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.632314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:00.635328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.637124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad340400aa84cbabe8b4b5998b6ca62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.641610 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 849/1712] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:00.642211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:00.643418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.644864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad340400aa84cbabe8b4b5998b6ca62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.655392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937bf86-72e7-44fd-ac1a-86860b9e4cb6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:00.657506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad340400aa84cbabe8b4b5998b6ca62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.658363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad340400aa84cbabe8b4b5998b6ca62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.660466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:00.661338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.661618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.661888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] PATH_INFO: `/v3/projects/6ade260ba10a4e4b9fa70c615ecc3145` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.663063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ade260ba10a4e4b9fa70c615ecc3145)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:00.665000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:00.749345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad340400aa84cbabe8b4b5998b6ca62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.755631 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 864/1713] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:00 2021] DELETE /identity/v3/users/2ad340400aa84cbabe8b4b5998b6ca62 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:00.756562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:00.757958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.814677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c8abf-ec3c-48fe-bc01-11ac5b5c6d80 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:00.818942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ade260ba10a4e4b9fa70c615ecc3145', 'request_id': 'req-1df58dea-e44d-4382-a1c8-3102db5c4ccb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.826342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ade260ba10a4e4b9fa70c615ecc3145', 'request_id': 'req-1df58dea-e44d-4382-a1c8-3102db5c4ccb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.862635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9f7e9-882a-4b26-90d3-1fbbd4df1d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:00.863281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f7e9-882a-4b26-90d3-1fbbd4df1d46 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.863564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f7e9-882a-4b26-90d3-1fbbd4df1d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.863835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9f7e9-882a-4b26-90d3-1fbbd4df1d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.865580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fec9f7e9-882a-4b26-90d3-1fbbd4df1d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.914902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ade260ba10a4e4b9fa70c615ecc3145', 'request_id': 'req-1df58dea-e44d-4382-a1c8-3102db5c4ccb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.925825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9f7e9-882a-4b26-90d3-1fbbd4df1d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:00.925952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] The token cache is being invalidate because project 6ade260ba10a4e4b9fa70c615ecc3145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:00.926188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.926847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:00.927294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9f7e9-882a-4b26-90d3-1fbbd4df1d46 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:00.928532 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 850/1714] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:00 2021] DELETE /identity/v3/projects/6ade260ba10a4e4b9fa70c615ecc3145 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:00.929346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:00.930682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.937421 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 865/1715] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:00.939067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.939527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.940042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.959200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:00.960417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.969668 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 866/1716] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:00.970754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:00.971906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:00.985736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7e910-35fd-48af-a878-adbd04a544ed None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:00.991286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:00.991945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:00.992218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:00.992491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:00.995006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.007905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58dea-e44d-4382-a1c8-3102db5c4ccb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.008077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.009159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.014147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.014897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.015247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.015592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.017982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.019833 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 867/1717] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:01.020501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.024534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.034632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31495fd0-14ca-4fdb-922e-ac9238126a04 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.040803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.041909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.042283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.042725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] PATH_INFO: `/v3/users/64b29248a08c4574800bfc7f8cc3d405` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.044022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b29248a08c4574800bfc7f8cc3d405)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.044178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.046419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.046536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.061364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 851/1718] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:01.062246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.075672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16069b3-f545-4729-91b9-e5f6a43bc7fc service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.081693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.082653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.082795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.083451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.091867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:01.092407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.094068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.110550 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 852/1719] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:01.114530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.128597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a0375-8916-4ca1-a368-55cbbf8128ff admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.136707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.137389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.137714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.137991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.138909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.141844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.296439 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 853/1720] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:01 2021] POST /identity/v3/projects => generated 409 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:01.297433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.299207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.305699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b29248a08c4574800bfc7f8cc3d405'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.320478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b29248a08c4574800bfc7f8cc3d405'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.348160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b29248a08c4574800bfc7f8cc3d405'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.352131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b29248a08c4574800bfc7f8cc3d405'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.399291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d1d5d-9a2b-4aa9-9567-5fce063620cb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.413835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.414825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.417581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.417868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] PATH_INFO: `/v3/projects/676d37fca6df4ddfa48bd8dde46d0828` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.420437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=676d37fca6df4ddfa48bd8dde46d0828)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.425268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.435391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b29248a08c4574800bfc7f8cc3d405'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.443387 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 868/1721] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:01 2021] DELETE /identity/v3/users/64b29248a08c4574800bfc7f8cc3d405 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:01.444471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.447189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.548686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3379-cdcf-44bd-86fe-4b26c2807f5a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.558693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.558693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.558693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.558693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.558983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.560186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.588643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676d37fca6df4ddfa48bd8dde46d0828', 'request_id': 'req-102df03d-098a-4b41-b632-42e972d9aff1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.596407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676d37fca6df4ddfa48bd8dde46d0828', 'request_id': 'req-102df03d-098a-4b41-b632-42e972d9aff1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.692130 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 869/1722] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:01 2021] POST /identity/v3/users => generated 305 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:01.692811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.694377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.706347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e3fd-b78e-402a-b138-b8bb8f671b7a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.729115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676d37fca6df4ddfa48bd8dde46d0828', 'request_id': 'req-102df03d-098a-4b41-b632-42e972d9aff1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.758419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] The token cache is being invalidate because project 676d37fca6df4ddfa48bd8dde46d0828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:01.758759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.759575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:01.761241 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 854/1723] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:01 2021] DELETE /identity/v3/projects/676d37fca6df4ddfa48bd8dde46d0828 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:01.766894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.766894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.812520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.813535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.813812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.814127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] PATH_INFO: `/v3/projects/b68bba8707314955b0bd0b2a10ddb399` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.815529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68bba8707314955b0bd0b2a10ddb399)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.819682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.855858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df03d-098a-4b41-b632-42e972d9aff1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.860580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.861285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.861600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.861893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.862636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.864248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.875330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 855/1724] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:01 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:01.876149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:01.877800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:01.889727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34e563-039e-4b3b-aceb-3f561e759577 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:01.894455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:01.896865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:01.896865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:01.896865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] PATH_INFO: `/v3/projects/185bf792f42c4ef18599568f8f685bab` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:01.897129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185bf792f42c4ef18599568f8f685bab)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:01.898983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:01.960335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68bba8707314955b0bd0b2a10ddb399', 'request_id': 'req-263757e5-c850-46b7-9f3f-1cfc88dd4d89'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.005913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185bf792f42c4ef18599568f8f685bab', 'request_id': 'req-5317ed99-dd32-4c97-bf37-ad98fd9dff60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.013198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185bf792f42c4ef18599568f8f685bab', 'request_id': 'req-5317ed99-dd32-4c97-bf37-ad98fd9dff60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.040846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68bba8707314955b0bd0b2a10ddb399', 'request_id': 'req-263757e5-c850-46b7-9f3f-1cfc88dd4d89'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.048456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68bba8707314955b0bd0b2a10ddb399', 'request_id': 'req-263757e5-c850-46b7-9f3f-1cfc88dd4d89'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.059449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] The token cache is being invalidate because project b68bba8707314955b0bd0b2a10ddb399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:02.059740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.060840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.062417 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 870/1725] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:01 2021] DELETE /identity/v3/projects/b68bba8707314955b0bd0b2a10ddb399 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:02.063331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:02.064639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.124733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185bf792f42c4ef18599568f8f685bab', 'request_id': 'req-5317ed99-dd32-4c97-bf37-ad98fd9dff60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.137893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] The token cache is being invalidate because project 185bf792f42c4ef18599568f8f685bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:02.138275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.138719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263757e5-c850-46b7-9f3f-1cfc88dd4d89 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:02.139192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5317ed99-dd32-4c97-bf37-ad98fd9dff60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.141101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 856/1726] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:01 2021] DELETE /identity/v3/projects/185bf792f42c4ef18599568f8f685bab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:02.142302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.142664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.143018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.165081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:02.167059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.227951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:02.229568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.229568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.229840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.234154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.243560 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 857/1727] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:02.244443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:02.245840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.258977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493eb98-5a01-4d9c-a3b8-7422086cba35 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:02.265216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:02.266483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.266698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.267025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.267864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:02.269569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:02.284864 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 858/1728] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:02.284864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:02.284864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.299641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da504d74-1973-498e-9a02-60289b777fdd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:02.300175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:02.301872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:02.304440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:02.305347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.305629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.305930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] PATH_INFO: `/v3/users/99c1799f88684e9c968424929cd6d723` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.307204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c1799f88684e9c968424929cd6d723)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:02.309133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:02.311007 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 871/1729] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:02.311746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:02.312997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.326788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e93b-640d-4080-8383-2cdf451ccef0 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:02.332010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:02.333477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.334007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.334007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] PATH_INFO: `/v3/users/179997c9b0c4420ab7db6bfdcbf0e861` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.335506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179997c9b0c4420ab7db6bfdcbf0e861)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:02.337387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:02.487269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c1799f88684e9c968424929cd6d723'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.493885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c1799f88684e9c968424929cd6d723'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.505385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c1799f88684e9c968424929cd6d723'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.506069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c1799f88684e9c968424929cd6d723'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.506682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b20a52d4-11f2-4f7e-9961-caa4ec7d29ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c1799f88684e9c968424929cd6d723'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.522661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179997c9b0c4420ab7db6bfdcbf0e861'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.530549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179997c9b0c4420ab7db6bfdcbf0e861'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.545062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179997c9b0c4420ab7db6bfdcbf0e861'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.545803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179997c9b0c4420ab7db6bfdcbf0e861'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.617629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 859/1730] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:02 2021] DELETE /identity/v3/users/99c1799f88684e9c968424929cd6d723 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:02.617629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.617629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.617629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.641545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] MFA Rules not processed for user `d98ab3d372a343daaeef8435bdba83c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:02.642680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.698544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179997c9b0c4420ab7db6bfdcbf0e861'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.699386 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 860/1731] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:02.700476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:02.703018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.707559 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 872/1732] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:02 2021] DELETE /identity/v3/users/179997c9b0c4420ab7db6bfdcbf0e861 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:02.711465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:02.713493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.782236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb31e31-36fb-43d4-b6e9-0848c8dab1f1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:02.787491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3965ef6-a628-4f13-b3e9-8948f60cc869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:02.788429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3965ef6-a628-4f13-b3e9-8948f60cc869 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.788716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3965ef6-a628-4f13-b3e9-8948f60cc869 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.789057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3965ef6-a628-4f13-b3e9-8948f60cc869 admin admin] PATH_INFO: `/v3/projects/78470108d2d148278d770784261a48cb/users/fff29e4bfbf645a5a5e572bcca7ab123/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.798534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f7444-92cc-40d1-b4b6-ac121a39c2d0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:02.805512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:02.807222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.807609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.807933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3965ef6-a628-4f13-b3e9-8948f60cc869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78470108d2d148278d770784261a48cb, user_id=fff29e4bfbf645a5a5e572bcca7ab123, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:02.808241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] PATH_INFO: `/v3/projects/cbf63a1f23b443e383490121b7be9d58` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.809919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf63a1f23b443e383490121b7be9d58)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:02.810741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3965ef6-a628-4f13-b3e9-8948f60cc869 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:02.812822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:02.893523 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 873/1733] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:02 2021] PUT /identity/v3/projects/78470108d2d148278d770784261a48cb/users/fff29e4bfbf645a5a5e572bcca7ab123/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:02.894807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:02.895177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:02.895363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:02.918495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:02.920957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:02.950546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf63a1f23b443e383490121b7be9d58', 'request_id': 'req-6abb5839-e240-4d60-99bd-86013102455b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.964587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf63a1f23b443e383490121b7be9d58', 'request_id': 'req-6abb5839-e240-4d60-99bd-86013102455b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:02.994650 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 874/1734] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:02.998464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:02.999877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.077609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fb95d-5952-4fe0-809e-4a55fceaa0ea None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:03.089725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf63a1f23b443e383490121b7be9d58', 'request_id': 'req-6abb5839-e240-4d60-99bd-86013102455b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.101449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] The token cache is being invalidate because project cbf63a1f23b443e383490121b7be9d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:03.101739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.102398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6abb5839-e240-4d60-99bd-86013102455b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.104732 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 861/1735] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:02 2021] DELETE /identity/v3/projects/cbf63a1f23b443e383490121b7be9d58 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:03.105961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.106250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.106525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.141094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] MFA Rules not processed for user `fff29e4bfbf645a5a5e572bcca7ab123`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:03.142965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.153893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d63f1b-76ec-4066-9f79-01d4f1a3160b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:03.154694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63f1b-76ec-4066-9f79-01d4f1a3160b service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.155053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63f1b-76ec-4066-9f79-01d4f1a3160b service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.155587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d63f1b-76ec-4066-9f79-01d4f1a3160b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.157612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e9d63f1b-76ec-4066-9f79-01d4f1a3160b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.225800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d63f1b-76ec-4066-9f79-01d4f1a3160b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:03.227490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d63f1b-76ec-4066-9f79-01d4f1a3160b service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:03.237532 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 875/1736] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:02 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:03.237749 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 862/1737] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:03.238657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:03.239618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.240007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.240164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.240418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.268801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:03.270655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.340054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36feb5-a17c-426a-844d-6f08e8dda1af None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:03.344910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:03.345745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.346030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.346300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.347033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:03.347338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:03.348978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:03.368298 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 863/1738] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:03.368298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:03.370235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.371211 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 876/1739] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:03.372247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:03.373594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.389364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b8844-0dc1-4233-b20e-0df37a4a9060 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:03.392345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6886-2a48-4873-a2ed-266c029d803e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:03.396147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:03.396956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.397249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.397524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.398230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:03.398783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:03.399679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.399963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.400241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] PATH_INFO: `/v3/projects/5f001dd67c394bbea95d0bc03b16edf2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.400968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:03.401502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f001dd67c394bbea95d0bc03b16edf2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:03.403413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:03.540934 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 877/1740] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/projects => generated 411 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:03.540934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:03.540934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.567572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f001dd67c394bbea95d0bc03b16edf2', 'request_id': 'req-17705e25-a012-40ca-844c-954c8c58e9da'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.575306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f001dd67c394bbea95d0bc03b16edf2', 'request_id': 'req-17705e25-a012-40ca-844c-954c8c58e9da'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.609188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91479e57-13a3-41c7-b806-32cefe6cada3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:03.661662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:03.662442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.662722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.662994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] PATH_INFO: `/v3/projects/36195ceeec6e46a6bd637a70ef4f949b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.664187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36195ceeec6e46a6bd637a70ef4f949b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:03.666713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:03.669032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f001dd67c394bbea95d0bc03b16edf2', 'request_id': 'req-17705e25-a012-40ca-844c-954c8c58e9da'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.680787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] The token cache is being invalidate because project 5f001dd67c394bbea95d0bc03b16edf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:03.681895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.691223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17705e25-a012-40ca-844c-954c8c58e9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.691223 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 864/1741] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:03 2021] DELETE /identity/v3/projects/5f001dd67c394bbea95d0bc03b16edf2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:03.691223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b0bf-1973-4df9-b0b3-d9d25a48a61c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.691223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b0bf-1973-4df9-b0b3-d9d25a48a61c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.691223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b0bf-1973-4df9-b0b3-d9d25a48a61c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.691223 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 865/1742] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:03.692266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9b0bf-1973-4df9-b0b3-d9d25a48a61c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:03.695153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5ec9b0bf-1973-4df9-b0b3-d9d25a48a61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.715981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9b0bf-1973-4df9-b0b3-d9d25a48a61c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:03.721233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bf797-ecc5-4410-a49e-220935dd6923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:03.721896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bf797-ecc5-4410-a49e-220935dd6923 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.722170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bf797-ecc5-4410-a49e-220935dd6923 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.722440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bf797-ecc5-4410-a49e-220935dd6923 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.723144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bf797-ecc5-4410-a49e-220935dd6923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:03.725061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bf797-ecc5-4410-a49e-220935dd6923 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:03.789430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36195ceeec6e46a6bd637a70ef4f949b', 'request_id': 'req-6c587285-26f7-4d77-a75e-013583601be3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.807310 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 866/1743] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:03.808616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.809002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.809286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.827437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:03.828631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.883518 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 867/1744] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:03.884313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:03.886137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.897382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4660a-9797-4b0d-b98f-1e60bebdd991 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:03.902604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:03.903234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.903516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.903792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.904469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:03.906428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:03.907260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36195ceeec6e46a6bd637a70ef4f949b', 'request_id': 'req-6c587285-26f7-4d77-a75e-013583601be3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.914187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36195ceeec6e46a6bd637a70ef4f949b', 'request_id': 'req-6c587285-26f7-4d77-a75e-013583601be3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.924470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] The token cache is being invalidate because project 36195ceeec6e46a6bd637a70ef4f949b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:03.924753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.925490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c587285-26f7-4d77-a75e-013583601be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:03.927083 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 878/1745] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:03 2021] DELETE /identity/v3/projects/36195ceeec6e46a6bd637a70ef4f949b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:03.928386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4985b-95b7-4fa6-a294-fac7c1dcd12a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.928790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4985b-95b7-4fa6-a294-fac7c1dcd12a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.940310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4985b-95b7-4fa6-a294-fac7c1dcd12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.947000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4cc4985b-95b7-4fa6-a294-fac7c1dcd12a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:03.948701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4cc4985b-95b7-4fa6-a294-fac7c1dcd12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:03.956924 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 879/1746] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:03.958197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:03.958488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:03.958852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:03.979853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:03.981126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.020008 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 868/1747] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/users => generated 312 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:04.020008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.020008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.032461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec8e3b-2574-4b53-b872-2ac3edd3922d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.037080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.037724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.038001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.038273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.038986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.040829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.050919 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 880/1748] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:04.051886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.053182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.066110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1452eb2-2b69-42ef-b131-35068e51d491 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.070991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393d583-915b-422d-97a3-814bad7c1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.073136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393d583-915b-422d-97a3-814bad7c1f9b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.073136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393d583-915b-422d-97a3-814bad7c1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.073136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393d583-915b-422d-97a3-814bad7c1f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.073582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393d583-915b-422d-97a3-814bad7c1f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:04.073887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393d583-915b-422d-97a3-814bad7c1f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.076124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393d583-915b-422d-97a3-814bad7c1f9b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.087335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 881/1749] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:04.092583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69ae9-d805-4d8a-9ec9-e274ccc5d2c7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.092869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69ae9-d805-4d8a-9ec9-e274ccc5d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.093192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69ae9-d805-4d8a-9ec9-e274ccc5d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.111269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e3a69ae9-d805-4d8a-9ec9-e274ccc5d2c7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:04.112449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e3a69ae9-d805-4d8a-9ec9-e274ccc5d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.120229 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 882/1750] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:04.121407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.121688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.121963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.142279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:04.143305 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 869/1751] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:04.143503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.147491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.149215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.153120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 883/1752] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:04.157096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.158767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.163787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d99b0-dddb-4dbb-8164-df556c0b06b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.169970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.170575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.170862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.171139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.171887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.173537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.184591 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 870/1753] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:04.188499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.198347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60bcca-8a95-42fc-8a07-dffea111ab8b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.203233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc7eb-1c54-45a2-a99a-39e7b2d220ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.203861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc7eb-1c54-45a2-a99a-39e7b2d220ba admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.204141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc7eb-1c54-45a2-a99a-39e7b2d220ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.204418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc7eb-1c54-45a2-a99a-39e7b2d220ba admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.205142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcc7eb-1c54-45a2-a99a-39e7b2d220ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.206992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcc7eb-1c54-45a2-a99a-39e7b2d220ba admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.215314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb211-ac27-4fcc-a4a2-a2500e02ce42 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.218897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.219564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.219845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.220122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.230384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.231842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.242501 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 884/1754] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:04.243275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.253234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1282a03-12b4-47ad-a54e-f9ae472d49d1 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.258264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.258897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.259181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.260440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.260866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.262522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.273205 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 885/1755] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:04.274179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.285170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b754f-499e-45bb-adc1-4af0bf0ac61a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.293054 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 871/1756] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:04.293054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc5cd5-ae1f-4ce4-a13a-94bed3cb0692 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.293054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc5cd5-ae1f-4ce4-a13a-94bed3cb0692 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.293054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc5cd5-ae1f-4ce4-a13a-94bed3cb0692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.293390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.293390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.293390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.293390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.293705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:04.293705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.295071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.309639 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 886/1757] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:04.310531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.314232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-55dc5cd5-ae1f-4ce4-a13a-94bed3cb0692 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:04.315456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-55dc5cd5-ae1f-4ce4-a13a-94bed3cb0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.325362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfefafc-bcc4-480e-9750-527ee2fd1cee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.378181 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 872/1758] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:04.379418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc5cd5-ae1f-4ce4-a13a-94bed3cb0692 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.383049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.383949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.384234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.384509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] PATH_INFO: `/v3/projects/54ffc09521cf4873ac0dadc7100f8a88/users/f808f95fd3834c219b1a2dc4e9265dcb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.389939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc5cd5-ae1f-4ce4-a13a-94bed3cb0692 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.394547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.395202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.395481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.395754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.396480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.398103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.400496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ffc09521cf4873ac0dadc7100f8a88, user_id=f808f95fd3834c219b1a2dc4e9265dcb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.403289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.408073 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 873/1759] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:04.409171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.418718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c609c-3958-48ef-81d2-a561495eb155 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.432157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.432157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.432157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.432157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.432566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.432566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.490352 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 887/1760] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:04 2021] PUT /identity/v3/projects/54ffc09521cf4873ac0dadc7100f8a88/users/f808f95fd3834c219b1a2dc4e9265dcb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:04.491273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.528141 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 874/1761] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:04.533861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.554489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac6f9-281c-46e1-99ad-95efb6074a0c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.558531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c4ea4-9c55-4deb-a490-b0ab0b6e8246 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.564136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.565373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.565503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.566116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.566445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.566686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.566792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.567248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.567427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.568526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:04.569430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.569643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.571610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.591166 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 875/1762] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:04.591166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.600867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7fc2-9959-46d2-a6a4-5060fdc7860a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.606224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.607123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.607403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.607666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] PATH_INFO: `/v3/projects/01f0a5964e27483495133541ea779fe8/users/4818322c5cf34533a81172980d535036/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.623931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f0a5964e27483495133541ea779fe8, user_id=4818322c5cf34533a81172980d535036, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.626480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.691789 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 888/1763] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:04.692689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.720458 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 876/1764] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:04 2021] PUT /identity/v3/projects/01f0a5964e27483495133541ea779fe8/users/4818322c5cf34533a81172980d535036/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:04.721586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.759794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd9ddc-dca1-4eb9-ae14-50ab495eb64b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.795425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd3d8-c2de-4931-85cd-0eb4b266003b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.800526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.801223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.801507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.801786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.802525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.804113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.817586 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 877/1765] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:04.817586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.817827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.817827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.817827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.817827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.818452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.819146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.825535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83afdea-e1eb-4f09-9ef0-d8a585bc5acf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.829714 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 889/1766] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:04.830223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946eb1-f210-4cee-b7f3-6877dd921536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.830489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.830927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946eb1-f210-4cee-b7f3-6877dd921536 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.831216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946eb1-f210-4cee-b7f3-6877dd921536 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.831490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946eb1-f210-4cee-b7f3-6877dd921536 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.832172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946eb1-f210-4cee-b7f3-6877dd921536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.834278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946eb1-f210-4cee-b7f3-6877dd921536 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.840303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896cbe-d616-4dd5-9614-fefafc71d5a3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:04.844956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:04.845592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.845872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.846144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.846818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:04.848675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:04.908958 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 878/1767] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:04.911743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003193-bda8-46f7-9322-3ff86e55577c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:04.912052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003193-bda8-46f7-9322-3ff86e55577c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:04.912313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003193-bda8-46f7-9322-3ff86e55577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:04.949905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6d003193-bda8-46f7-9322-3ff86e55577c None None] MFA Rules not processed for user `4818322c5cf34533a81172980d535036`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:04.951129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d003193-bda8-46f7-9322-3ff86e55577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:04.972744 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 890/1768] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:04.974104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:04.985065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe6575-5483-43d9-80dc-341d24e89c9d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.018838 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 879/1769] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:04 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:05.019759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d003193-bda8-46f7-9322-3ff86e55577c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.039694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.040670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.041529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.041818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.042549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.044169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.053842 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 891/1770] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:05.057496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.066923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a921fc-3ebf-41ed-abef-1424126d9a2f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.071582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.072241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.072520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.072799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.073544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.075682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.081194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d003193-bda8-46f7-9322-3ff86e55577c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.085860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c95b-b176-41a9-8871-93f0c6cfafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.086784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c95b-b176-41a9-8871-93f0c6cfafd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.087068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c95b-b176-41a9-8871-93f0c6cfafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.087342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c95b-b176-41a9-8871-93f0c6cfafd5 admin admin] PATH_INFO: `/v3/projects/54ffc09521cf4873ac0dadc7100f8a88/users/f808f95fd3834c219b1a2dc4e9265dcb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.089999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44c95b-b176-41a9-8871-93f0c6cfafd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ffc09521cf4873ac0dadc7100f8a88, user_id=f808f95fd3834c219b1a2dc4e9265dcb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.092676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44c95b-b176-41a9-8871-93f0c6cfafd5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.102843 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 880/1771] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:05 2021] PUT /identity/v3/projects/54ffc09521cf4873ac0dadc7100f8a88/users/f808f95fd3834c219b1a2dc4e9265dcb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:05.104748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42205fa-109f-4cc8-b39b-ee3867689a80 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.105071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42205fa-109f-4cc8-b39b-ee3867689a80 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.105351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42205fa-109f-4cc8-b39b-ee3867689a80 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.106987 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 881/1772] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:05.111456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42205fa-109f-4cc8-b39b-ee3867689a80 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.113138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a42205fa-109f-4cc8-b39b-ee3867689a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:05.180656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42205fa-109f-4cc8-b39b-ee3867689a80 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.184700 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 892/1773] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:05 2021] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:05.184700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.186093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.186728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.187008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.187279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.189285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:05.192194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4baf5-5926-4116-920a-903b6d533552 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.200992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.202522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.212039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 882/1774] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:05.213389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.251258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.251926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.252211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.252748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.253279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.254874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.268260 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 893/1775] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:05.268260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.275109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2a44-dc9f-4f99-a033-e0236fcbc71b service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.277750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01535df3-7ce7-41bd-a172-c45d9143e749 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.281360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e5b7a-d22b-4e45-8fcc-317270aa8272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.282019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5b7a-d22b-4e45-8fcc-317270aa8272 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.282312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5b7a-d22b-4e45-8fcc-317270aa8272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.282577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5b7a-d22b-4e45-8fcc-317270aa8272 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.282869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a71daf-7b88-4f1a-8659-629fe4efd2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.283269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e5b7a-d22b-4e45-8fcc-317270aa8272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.283743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71daf-7b88-4f1a-8659-629fe4efd2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.284021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71daf-7b88-4f1a-8659-629fe4efd2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.284291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71daf-7b88-4f1a-8659-629fe4efd2a5 admin admin] PATH_INFO: `/v3/projects/ea8fe0b0a0054e8a923f2f7833eb1b10/users/c764a9e9aea0473f9033d69ddccec1db/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.285158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e5b7a-d22b-4e45-8fcc-317270aa8272 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.302475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a71daf-7b88-4f1a-8659-629fe4efd2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8fe0b0a0054e8a923f2f7833eb1b10, user_id=c764a9e9aea0473f9033d69ddccec1db, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.305227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a71daf-7b88-4f1a-8659-629fe4efd2a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.377941 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 883/1776] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:05 2021] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:05.379434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227b95-12e6-4650-94f3-0d75e03cd5ed None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.379728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227b95-12e6-4650-94f3-0d75e03cd5ed None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.380008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227b95-12e6-4650-94f3-0d75e03cd5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.399804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6e227b95-12e6-4650-94f3-0d75e03cd5ed None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:05.401577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6e227b95-12e6-4650-94f3-0d75e03cd5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:05.417852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 894/1777] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:05 2021] PUT /identity/v3/projects/ea8fe0b0a0054e8a923f2f7833eb1b10/users/c764a9e9aea0473f9033d69ddccec1db/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:05.417852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05158ba-a415-4ccf-94dd-63ffa1d9e875 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.417852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05158ba-a415-4ccf-94dd-63ffa1d9e875 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.417852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05158ba-a415-4ccf-94dd-63ffa1d9e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.448634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e05158ba-a415-4ccf-94dd-63ffa1d9e875 None None] MFA Rules not processed for user `f808f95fd3834c219b1a2dc4e9265dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:05.450242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e05158ba-a415-4ccf-94dd-63ffa1d9e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:05.480746 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 884/1778] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:05 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:05.481720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e227b95-12e6-4650-94f3-0d75e03cd5ed None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.518064 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 895/1779] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:05 2021] POST /identity/v3/auth/tokens => generated 3345 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:05.519360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05158ba-a415-4ccf-94dd-63ffa1d9e875 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.545782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e227b95-12e6-4650-94f3-0d75e03cd5ed None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.582146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05158ba-a415-4ccf-94dd-63ffa1d9e875 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.587001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.587659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.588534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.588813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.589583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.591255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.600932 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 896/1780] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:05.601863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.604601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e980c0e-7bce-453f-8abd-a33c0e7fb91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.605312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e980c0e-7bce-453f-8abd-a33c0e7fb91a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.605592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e980c0e-7bce-453f-8abd-a33c0e7fb91a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.605863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e980c0e-7bce-453f-8abd-a33c0e7fb91a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.606608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e980c0e-7bce-453f-8abd-a33c0e7fb91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.608213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e980c0e-7bce-453f-8abd-a33c0e7fb91a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.611199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adf351-17d3-4580-84af-d112d9216e58 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.615708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.616339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.616615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.616968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.617572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.619294 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 885/1781] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:05.619294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.619548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.619642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.622363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.646494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] MFA Rules not processed for user `c764a9e9aea0473f9033d69ddccec1db`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:05.649018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:05.709418 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 897/1782] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:05 2021] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:05.710931 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 886/1783] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:05 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:05.713742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.714388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.715080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:05.716075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:05.774265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efab98-c285-4812-ad9c-634ddc8cbaef admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.779727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.779727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.779727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.779727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.795283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08822361-4925-46f5-ae4f-bde150db3bbd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.800856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.801514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.801801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.802081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.810681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.812240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.821611 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 887/1784] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/auth/tokens => generated 3345 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:05.822933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.832928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca46ad-8ca2-4fb0-b774-df1b6a7f5e06 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.838858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.839804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.844490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.844490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] PATH_INFO: `/v3/projects/b188f1ccc2ff4da88228c12468f76c63/users/1076f0adc9b34772928d6b55a8ef06da/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.857478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.858021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b188f1ccc2ff4da88228c12468f76c63, user_id=1076f0adc9b34772928d6b55a8ef06da, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.858935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.860526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.871489 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 898/1785] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:05.872997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.883573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62ce59-796e-49da-b02d-6dd0d017c75b service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.889768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.890668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.891081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.891366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.892254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.894293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.906599 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 899/1786] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:05.906765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.919801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ad3c1-255a-4fa4-8609-f5bfff106d15 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:05.923558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:05.924220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:05.924499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:05.924866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:05.925758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:05.927838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:05.934097 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 888/1787] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:05 2021] PUT /identity/v3/projects/b188f1ccc2ff4da88228c12468f76c63/users/1076f0adc9b34772928d6b55a8ef06da/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:05.934878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.955303 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 900/1788] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:05.955303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:05.967382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec318-dd1d-409a-a0d7-870c0b56e78c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.007875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85934-f24f-454f-ba23-8e99096f3066 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.012324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.012989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.013272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.013545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.029794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f75abf-2d4f-4d97-8f66-eecd1fbabc45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.030902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75abf-2d4f-4d97-8f66-eecd1fbabc45 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.031011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75abf-2d4f-4d97-8f66-eecd1fbabc45 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.031260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f75abf-2d4f-4d97-8f66-eecd1fbabc45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.033463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-59f75abf-2d4f-4d97-8f66-eecd1fbabc45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:06.071212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.072681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.082088 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 889/1789] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:06.082867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:06.095583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f75abf-2d4f-4d97-8f66-eecd1fbabc45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.097581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f75abf-2d4f-4d97-8f66-eecd1fbabc45 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.107869 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 901/1790] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:05 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:06.109159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928103a1-c125-48f5-af9d-b8a24d30b2b8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.109449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928103a1-c125-48f5-af9d-b8a24d30b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.109723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928103a1-c125-48f5-af9d-b8a24d30b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.141078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-928103a1-c125-48f5-af9d-b8a24d30b2b8 None None] MFA Rules not processed for user `1076f0adc9b34772928d6b55a8ef06da`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:06.142394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-928103a1-c125-48f5-af9d-b8a24d30b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:06.147158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b523b8-a31b-4f0b-95c4-91413a4ad618 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.151731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.152636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.152940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.153218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] PATH_INFO: `/v3/projects/86ddee7278a14ed4bfb3b116a63b9901/users/6d7e69ccbe614802b71c01c999f47f83/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.168709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ddee7278a14ed4bfb3b116a63b9901, user_id=6d7e69ccbe614802b71c01c999f47f83, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.171380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.207997 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 902/1791] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:06.208820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928103a1-c125-48f5-af9d-b8a24d30b2b8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:06.219332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928103a1-c125-48f5-af9d-b8a24d30b2b8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.224179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.225095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.225420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.225691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] PATH_INFO: `/v3/projects/0f667cda87f246b482e155e340b0fc27/users/2a1a475b02684d70be16ffbcfa74ba19/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.240597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f667cda87f246b482e155e340b0fc27, user_id=2a1a475b02684d70be16ffbcfa74ba19, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.243285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.280677 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 890/1792] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:06 2021] PUT /identity/v3/projects/86ddee7278a14ed4bfb3b116a63b9901/users/6d7e69ccbe614802b71c01c999f47f83/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:06.281560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:06.344003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fad9c-f59f-43bc-bb80-c01efc82d29c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.349343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.361513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.361513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.361513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] PATH_INFO: `/v3/users/fff29e4bfbf645a5a5e572bcca7ab123` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.361513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff29e4bfbf645a5a5e572bcca7ab123)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.361513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.406242 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 903/1793] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:06 2021] PUT /identity/v3/projects/0f667cda87f246b482e155e340b0fc27/users/2a1a475b02684d70be16ffbcfa74ba19/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:06.407132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:06.466297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901059c5-b81a-4cec-a3e9-a10cceddc761 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.470988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23545644-e7ce-48ba-b26e-fe718b6460ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.471681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545644-e7ce-48ba-b26e-fe718b6460ce admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.471960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545644-e7ce-48ba-b26e-fe718b6460ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.472237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23545644-e7ce-48ba-b26e-fe718b6460ce admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.472971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23545644-e7ce-48ba-b26e-fe718b6460ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.474854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23545644-e7ce-48ba-b26e-fe718b6460ce admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.652086 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 904/1794] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:06 2021] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:06.653413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337227d-93a3-43a0-acd4-2fad2706174a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.653745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337227d-93a3-43a0-acd4-2fad2706174a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.654017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337227d-93a3-43a0-acd4-2fad2706174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.679097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d337227d-93a3-43a0-acd4-2fad2706174a None None] MFA Rules not processed for user `6d7e69ccbe614802b71c01c999f47f83`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:06.680366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d337227d-93a3-43a0-acd4-2fad2706174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:06.700844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff29e4bfbf645a5a5e572bcca7ab123'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:06.708408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff29e4bfbf645a5a5e572bcca7ab123'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:06.720448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff29e4bfbf645a5a5e572bcca7ab123'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:06.721166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff29e4bfbf645a5a5e572bcca7ab123'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:06.721778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff29e4bfbf645a5a5e572bcca7ab123'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:06.745243 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 905/1795] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:06 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:06.746528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.746817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.747093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.763948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:06.765172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:06.818214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 906/1796] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:06.819117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:06.820452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:06.873111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 891/1797] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:06 2021] DELETE /identity/v3/users/fff29e4bfbf645a5a5e572bcca7ab123 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:06.874033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:06.875406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:06.886704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306562b-95d3-47a3-ad40-e327852257c5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.938590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138367e4-eaec-4498-8d30-511ce1a7d97b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.941790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.942463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.942744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.943020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.943452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324ab63-b916-4ba5-8349-53929c1b15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.943781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.948793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324ab63-b916-4ba5-8349-53929c1b15a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.948793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324ab63-b916-4ba5-8349-53929c1b15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.948793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324ab63-b916-4ba5-8349-53929c1b15a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.949080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.949181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324ab63-b916-4ba5-8349-53929c1b15a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.949181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324ab63-b916-4ba5-8349-53929c1b15a3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:06.956977 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 907/1798] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:06.957981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:06.963330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:06.976104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd05952-49fc-4327-91cb-54ec23cdfcd4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:06.980983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:06.981642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:06.981923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:06.982199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:06.983060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:06.985083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.076735 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 892/1799] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:06 2021] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:07.078413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524346-7d6f-4a37-aeaf-9c394f78fd75 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.079824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524346-7d6f-4a37-aeaf-9c394f78fd75 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.080282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524346-7d6f-4a37-aeaf-9c394f78fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.098935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e0524346-7d6f-4a37-aeaf-9c394f78fd75 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:07.099881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e0524346-7d6f-4a37-aeaf-9c394f78fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:07.107968 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 893/1800] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:07.109302 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 908/1801] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:06 2021] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:07.109993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.111697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0524346-7d6f-4a37-aeaf-9c394f78fd75 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.122070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0524346-7d6f-4a37-aeaf-9c394f78fd75 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.184483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69ba0b-851b-4e5d-82d0-214c2285731b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.189536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.192404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.192404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.192404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.192628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.192738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.192822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.192822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.192822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] PATH_INFO: `/v3/projects/0f667cda87f246b482e155e340b0fc27/users/2a1a475b02684d70be16ffbcfa74ba19/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.193344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.194471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f667cda87f246b482e155e340b0fc27, user_id=2a1a475b02684d70be16ffbcfa74ba19, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.197854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.204630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 909/1802] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:07 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:07.205469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.208965 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 894/1803] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:07 2021] PUT /identity/v3/projects/0f667cda87f246b482e155e340b0fc27/users/2a1a475b02684d70be16ffbcfa74ba19/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:07.209824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.211441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:07.215465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1150c-fbdc-4969-86b6-3443bd26d17f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.271202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.271874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.272158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.272481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.272702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33411-ce57-47c5-9a81-f49425ed4b3c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.273169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.275242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.276655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.277327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.277608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.278006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.287988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.289475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.299179 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 895/1804] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:07.299999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.301336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:07.363989 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 910/1805] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:07 2021] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:07.363989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.374279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9db1f-416f-48bb-9951-c7eb4fa7cdac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.377548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476a9f-052a-4645-964e-d0c11b5bd512 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.379338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.380226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.380506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.380778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] PATH_INFO: `/v3/projects/e998a49bfb17421ab89e8b348e7c2cd8/users/9144e1a8d8d947649fadc3e45ccac373/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.385297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af166729-560a-4951-a08a-a95036192f13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.393136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166729-560a-4951-a08a-a95036192f13 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.393136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166729-560a-4951-a08a-a95036192f13 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.393136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af166729-560a-4951-a08a-a95036192f13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.400533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e998a49bfb17421ab89e8b348e7c2cd8, user_id=9144e1a8d8d947649fadc3e45ccac373, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.403214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.442899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af166729-560a-4951-a08a-a95036192f13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.444480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af166729-560a-4951-a08a-a95036192f13 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.453434 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 896/1806] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:07:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:07.454910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c91f-7f54-4f83-83fa-521bd5ab6181 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.455184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c91f-7f54-4f83-83fa-521bd5ab6181 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.455512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c91f-7f54-4f83-83fa-521bd5ab6181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.485272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-52e8c91f-7f54-4f83-83fa-521bd5ab6181 None None] MFA Rules not processed for user `2a1a475b02684d70be16ffbcfa74ba19`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:07.486807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-52e8c91f-7f54-4f83-83fa-521bd5ab6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:07.536819 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 911/1807] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:07 2021] PUT /identity/v3/projects/e998a49bfb17421ab89e8b348e7c2cd8/users/9144e1a8d8d947649fadc3e45ccac373/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:07.537926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.558467 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 897/1808] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:07 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:07.559387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c91f-7f54-4f83-83fa-521bd5ab6181 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.580287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c91f-7f54-4f83-83fa-521bd5ab6181 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.614823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd255-f34c-47b9-b482-03ca2711fc84 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.621796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.622632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.623034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.625470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.625470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.626081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.637871 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 912/1809] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:07 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:07.638734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.642249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:07.649934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.650732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.651021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.654084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.654084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.654084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.668496 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 898/1810] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:07 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:07.668496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.680204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f598d-c5e4-43f3-ae4f-792dcc5dfbec admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.691550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.692940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.693472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.693921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] PATH_INFO: `/v3/projects/c93791c93ded46d0bc91e690b224a9e7/users/a9f8028ff9a8418e83c7c9212557185d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.709893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93791c93ded46d0bc91e690b224a9e7, user_id=a9f8028ff9a8418e83c7c9212557185d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.712892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.723084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf728d-9392-4a26-8e04-0a0a8a44ddc4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.729320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.730107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.730401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.730681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.808742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.814250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.814629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 899/1811] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:07 2021] PUT /identity/v3/projects/c93791c93ded46d0bc91e690b224a9e7/users/a9f8028ff9a8418e83c7c9212557185d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:07.814629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.823079 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 913/1812] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:07 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:07.823935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:07.825687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:07.845383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e77cc-79fe-4861-8eb1-2c8ab08c6a4a service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.916629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.917600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.918061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.918340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] PATH_INFO: `/v3/projects/78470108d2d148278d770784261a48cb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.919558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78470108d2d148278d770784261a48cb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.921848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.958059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17cebf-6fb4-4acd-87b1-2eb65ebd91e7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:07.964076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:07.965100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:07.965573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:07.965858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] PATH_INFO: `/v3/projects/e998a49bfb17421ab89e8b348e7c2cd8/users/9144e1a8d8d947649fadc3e45ccac373/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:07.968337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e998a49bfb17421ab89e8b348e7c2cd8, user_id=9144e1a8d8d947649fadc3e45ccac373, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:07.971404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:07.989214 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 900/1813] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:07 2021] PUT /identity/v3/projects/e998a49bfb17421ab89e8b348e7c2cd8/users/9144e1a8d8d947649fadc3e45ccac373/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:07.989214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:08.048623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a61dc2-81c3-426b-a81d-a6a047cfdc74 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:08.053413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4e75c-fc66-4c8e-a06a-d63e6b050d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:08.059831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e75c-fc66-4c8e-a06a-d63e6b050d4d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.059831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e75c-fc66-4c8e-a06a-d63e6b050d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.059831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4e75c-fc66-4c8e-a06a-d63e6b050d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.059831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4e75c-fc66-4c8e-a06a-d63e6b050d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:08.059831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4e75c-fc66-4c8e-a06a-d63e6b050d4d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:08.070923 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 901/1814] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:07 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:08.071053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78470108d2d148278d770784261a48cb', 'request_id': 'req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.071153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f555-aa5b-436f-955d-ab02a198c3a8 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.071153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f555-aa5b-436f-955d-ab02a198c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.071153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8f555-aa5b-436f-955d-ab02a198c3a8 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.073504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 902/1815] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:08.074702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862fc6-9135-4f10-8f77-c70c6e327886 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.075004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862fc6-9135-4f10-8f77-c70c6e327886 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.075272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862fc6-9135-4f10-8f77-c70c6e327886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.101300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-81862fc6-9135-4f10-8f77-c70c6e327886 None None] MFA Rules not processed for user `9144e1a8d8d947649fadc3e45ccac373`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:08.102685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-81862fc6-9135-4f10-8f77-c70c6e327886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:08.168773 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 903/1816] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:08 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:08.169621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862fc6-9135-4f10-8f77-c70c6e327886 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:08.187184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78470108d2d148278d770784261a48cb', 'request_id': 'req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.193996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78470108d2d148278d770784261a48cb', 'request_id': 'req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.205885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] The token cache is being invalidate because project 78470108d2d148278d770784261a48cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:08.206414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.207231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.209196 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 914/1817] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:07 2021] DELETE /identity/v3/projects/78470108d2d148278d770784261a48cb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:08.210366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:08.211858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:08.237544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862fc6-9135-4f10-8f77-c70c6e327886 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:08.242267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:08.243169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.243451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.243725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] PATH_INFO: `/v3/projects/c93791c93ded46d0bc91e690b224a9e7/users/a9f8028ff9a8418e83c7c9212557185d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.245827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93791c93ded46d0bc91e690b224a9e7, user_id=a9f8028ff9a8418e83c7c9212557185d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:08.248460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:08.261010 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 904/1818] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:08 2021] PUT /identity/v3/projects/c93791c93ded46d0bc91e690b224a9e7/users/a9f8028ff9a8418e83c7c9212557185d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:08.261010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:08.267173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:08.298634 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 25 21:07:08.298925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:08.300178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:08.336417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b457d-a97c-419a-b353-846c74638459 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:08.344143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:08.345061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.345439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.345641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] PATH_INFO: `/v3/users/f808f95fd3834c219b1a2dc4e9265dcb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.347163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f808f95fd3834c219b1a2dc4e9265dcb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:08.349281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:08.380175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb486-13e0-4d49-8faa-23f4ec72eb18 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:08.440420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f95731-7683-4ed0-b053-e354ab73120b tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a1a475b02684d70be16ffbcfa74ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f667cda87f246b482e155e340b0fc27', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:08.441253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f95731-7683-4ed0-b053-e354ab73120b tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.441540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f95731-7683-4ed0-b053-e354ab73120b tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.441954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f95731-7683-4ed0-b053-e354ab73120b tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] PATH_INFO: `/v3/projects/01f0a5964e27483495133541ea779fe8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.444328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f95731-7683-4ed0-b053-e354ab73120b tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] RBAC: Authorizing `identity:get_project(project_id=01f0a5964e27483495133541ea779fe8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:08.446581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f95731-7683-4ed0-b053-e354ab73120b tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:08.454600 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 915/1819] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:08 2021] GET /identity/v3/projects/01f0a5964e27483495133541ea779fe8 => generated 377 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:08.464016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.464317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.464599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.495218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] MFA Rules not processed for user `a9f8028ff9a8418e83c7c9212557185d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:08.496403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:08.564112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 916/1820] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:08 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:08.565226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:08.566540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:08.630601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f808f95fd3834c219b1a2dc4e9265dcb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.643461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f808f95fd3834c219b1a2dc4e9265dcb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.645802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed9b10-0daa-42de-b0bd-e90170a66e5d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:08.654179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:08.654912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.655258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.655601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.657499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f808f95fd3834c219b1a2dc4e9265dcb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.658195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f808f95fd3834c219b1a2dc4e9265dcb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.658624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:08.659026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f21824ae-00ed-4151-9183-bc20c90fb1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f808f95fd3834c219b1a2dc4e9265dcb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:08.723365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:08.725220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:08.738916 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 917/1821] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:08 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:08.753569 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 905/1822] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:08 2021] DELETE /identity/v3/users/f808f95fd3834c219b1a2dc4e9265dcb => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:08.862805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:08.906050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ea4e2-e0f3-47ff-9422-fc46eb35c573 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:08.980979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:08.981656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:08.981911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:08.982222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:08.984168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.069288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.070045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.070547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.077437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:09.079283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:09.090831 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 918/1823] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:08 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:09.091705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:09.093154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.094142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:09.095534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.131944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc5a2d-20c6-4871-83c8-2d5e4f638141 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:09.147700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:09.148363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.148644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.148950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.150941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.182078 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 906/1824] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:09.183186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:09.184549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.200279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6401d-4dc3-4f60-a917-a3853c5e459e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:09.206305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:09.207171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.207275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.207557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.209366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.219281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:09.220912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:09.230938 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 919/1825] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:09 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:09.231753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:09.233167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.277904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:09.280471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:09.311349 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 907/1826] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:09 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:09.320679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d227af-7dd3-4ee6-b87b-dc20a071e8b3 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:09.327749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f942a2-8ed3-4026-8a38-9ba51722dd13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:09.328350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f942a2-8ed3-4026-8a38-9ba51722dd13 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.328912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f942a2-8ed3-4026-8a38-9ba51722dd13 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.329209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f942a2-8ed3-4026-8a38-9ba51722dd13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.330224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:09.341363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f942a2-8ed3-4026-8a38-9ba51722dd13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:09.343085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f942a2-8ed3-4026-8a38-9ba51722dd13 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:09.352118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31592b93-b0b7-47b9-a70b-966989a7fb25 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:09.357107 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 920/1827] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:07:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:09.362956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b1305-d1f8-4dff-967c-848ff17e8cb0 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.363249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b1305-d1f8-4dff-967c-848ff17e8cb0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.363526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b1305-d1f8-4dff-967c-848ff17e8cb0 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.366112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 921/1828] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:07:09.373336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b1305-d1f8-4dff-967c-848ff17e8cb0 None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:09.374921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa3a57-97ea-456b-9a26-605d0d52da25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:09.375246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3a57-97ea-456b-9a26-605d0d52da25 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.375529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3a57-97ea-456b-9a26-605d0d52da25 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.375958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa3a57-97ea-456b-9a26-605d0d52da25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.379032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fdaa3a57-97ea-456b-9a26-605d0d52da25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.403847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b1305-d1f8-4dff-967c-848ff17e8cb0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:09.409193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f4b1305-d1f8-4dff-967c-848ff17e8cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.514375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b1305-d1f8-4dff-967c-848ff17e8cb0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:09.522371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a1a475b02684d70be16ffbcfa74ba19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f667cda87f246b482e155e340b0fc27', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:09.523988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.524420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.524826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] PATH_INFO: `/v3/projects/01f0a5964e27483495133541ea779fe8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.526914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] RBAC: Authorizing `identity:get_project(project_id=01f0a5964e27483495133541ea779fe8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:09.530151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:09.535978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa3a57-97ea-456b-9a26-605d0d52da25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:09.536916 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 922/1829] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:09 2021] GET /identity/v3/projects/01f0a5964e27483495133541ea779fe8 => generated 377 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:09.538808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa3a57-97ea-456b-9a26-605d0d52da25 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:09.550591 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 908/1830] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:09 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:07:09.674709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:09.676643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:09.934275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921967d-d006-4d04-9847-c5af8865f217 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:09.941186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:09.948066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:09.948401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:09.956932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] PATH_INFO: `/v3/projects/54ffc09521cf4873ac0dadc7100f8a88` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:09.956932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ffc09521cf4873ac0dadc7100f8a88)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:09.956932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:10.207371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ffc09521cf4873ac0dadc7100f8a88', 'request_id': 'req-925565ca-6802-4639-80aa-d2d2f1eca725'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:10.558601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ffc09521cf4873ac0dadc7100f8a88', 'request_id': 'req-925565ca-6802-4639-80aa-d2d2f1eca725'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:10.579957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ffc09521cf4873ac0dadc7100f8a88', 'request_id': 'req-925565ca-6802-4639-80aa-d2d2f1eca725'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:10.592818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] The token cache is being invalidate because project 54ffc09521cf4873ac0dadc7100f8a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:10.593174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:10.594006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-925565ca-6802-4639-80aa-d2d2f1eca725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:10.595590 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 923/1831] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:09 2021] DELETE /identity/v3/projects/54ffc09521cf4873ac0dadc7100f8a88 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:10.603643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e962f1-d278-412e-ab07-341b83dcc8c7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:10.604204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e962f1-d278-412e-ab07-341b83dcc8c7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:10.604204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e962f1-d278-412e-ab07-341b83dcc8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:10.687003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-40e962f1-d278-412e-ab07-341b83dcc8c7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:10.688298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-40e962f1-d278-412e-ab07-341b83dcc8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:10.762285 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 909/1832] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:10.776747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398bfc0-8edc-4ecc-838d-765fcdb829c5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:10.777040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398bfc0-8edc-4ecc-838d-765fcdb829c5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:10.777531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398bfc0-8edc-4ecc-838d-765fcdb829c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:10.800003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c398bfc0-8edc-4ecc-838d-765fcdb829c5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:10.801387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c398bfc0-8edc-4ecc-838d-765fcdb829c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:10.809800 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 924/1833] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:10.814280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e962f1-d278-412e-ab07-341b83dcc8c7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:10.824668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e962f1-d278-412e-ab07-341b83dcc8c7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:10.829730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:10.830725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:10.831112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:10.831426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:10.832165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:10.832471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:10.834114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:10.850587 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 910/1834] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:10.859142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398bfc0-8edc-4ecc-838d-765fcdb829c5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:10.869252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398bfc0-8edc-4ecc-838d-765fcdb829c5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:10.874658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:10.875758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:10.876265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:10.876769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:10.878168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:10.881022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:11.090420 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 925/1835] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:10 2021] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:11.094978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:11.117192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:11.126086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:11.126334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d367825-0b43-44b8-b5a9-ece11a15d1b5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:11.306400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:11.307375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:11.307671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:11.307949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:11.308673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:11.310660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:11.316574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba75718-dd31-4fa6-b63c-8da7fc009760 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:11.334964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:11.338407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:11.338407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:11.338407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] PATH_INFO: `/v3/users/1076f0adc9b34772928d6b55a8ef06da` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:11.344529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1076f0adc9b34772928d6b55a8ef06da)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:11.346695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:11.436714 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 911/1836] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:11 2021] POST /identity/v3/users => generated 281 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:11.442119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:11.456597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9534f02-d8dc-4377-bd1d-985611114ae3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:11.463280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:11.464024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:11.464304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:11.464692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:11.467404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:11.470118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:11.488999 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 912/1837] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:11 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:11.490997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:11.526183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b37276-69db-4e80-b623-704c21b36a9e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:11.547374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:11.550512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:11.551211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:11.551834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:11.553521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:11.556608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:11.594619 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 913/1838] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:11 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:11.596555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:11.633047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a46d3-6a87-488b-b226-019227540415 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:11.652397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1076f0adc9b34772928d6b55a8ef06da'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:11.657940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584df9e6-03bf-45fa-93af-b9a7ebf7c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:11.658983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584df9e6-03bf-45fa-93af-b9a7ebf7c130 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:11.659329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584df9e6-03bf-45fa-93af-b9a7ebf7c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:11.659687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584df9e6-03bf-45fa-93af-b9a7ebf7c130 admin admin] PATH_INFO: `/v3/projects/a8441194c1564636b3cef6c8df9fbb87/users/3286f12496e94859a40367822aa4c8ef/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:11.672284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1076f0adc9b34772928d6b55a8ef06da'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:11.690871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584df9e6-03bf-45fa-93af-b9a7ebf7c130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8441194c1564636b3cef6c8df9fbb87, user_id=3286f12496e94859a40367822aa4c8ef, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:11.693399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584df9e6-03bf-45fa-93af-b9a7ebf7c130 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:11.711159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1076f0adc9b34772928d6b55a8ef06da'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:11.713547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1076f0adc9b34772928d6b55a8ef06da'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:11.788527 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 914/1839] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:11 2021] PUT /identity/v3/projects/a8441194c1564636b3cef6c8df9fbb87/users/3286f12496e94859a40367822aa4c8ef/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:11.807218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:11.807218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:11.807218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:11.839465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d45ba6c-58c7-4b90-81de-5a86e9f5f830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1076f0adc9b34772928d6b55a8ef06da'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:11.854085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] MFA Rules not processed for user `3286f12496e94859a40367822aa4c8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:11.855407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:11.859388 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 926/1840] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:11 2021] DELETE /identity/v3/users/1076f0adc9b34772928d6b55a8ef06da => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:11.864488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:11.865064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:11.865413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:11.904538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:11.904538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:11.994731 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 915/1841] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:11 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:11.995606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:11.997139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.047794 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 927/1842] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:12.048851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.050276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.073923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7783ae-9749-4f71-9225-34e478f4f47f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:12.083669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:12.084483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.084778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.086483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.087311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:12.090154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:12.110241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9fd85-8971-459a-97e9-9619d1fcdd5f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:12.115174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:12.116546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.117036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.117366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] PATH_INFO: `/v3/users/4818322c5cf34533a81172980d535036` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.119290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4818322c5cf34533a81172980d535036)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:12.121582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:12.210234 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 928/1843] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:12 2021] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:12.210234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.210759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.277086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2d0d4-f639-4400-b9f9-b081a4628f1b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:12.282069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:12.283236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.283591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.283934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] PATH_INFO: `/v3/users/6d7e69ccbe614802b71c01c999f47f83` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.285221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7e69ccbe614802b71c01c999f47f83)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:12.287239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:12.439922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4818322c5cf34533a81172980d535036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.446691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4818322c5cf34533a81172980d535036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.458835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4818322c5cf34533a81172980d535036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.463585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4818322c5cf34533a81172980d535036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.464479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4818322c5cf34533a81172980d535036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.521627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7e69ccbe614802b71c01c999f47f83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.530508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7e69ccbe614802b71c01c999f47f83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.544371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7e69ccbe614802b71c01c999f47f83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.545147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7e69ccbe614802b71c01c999f47f83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.557638 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 916/1844] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:11 2021] DELETE /identity/v3/users/4818322c5cf34533a81172980d535036 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:12.558607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.559943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.635099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7e69ccbe614802b71c01c999f47f83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:12.643319 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 929/1845] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:12 2021] DELETE /identity/v3/users/6d7e69ccbe614802b71c01c999f47f83 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:12.644350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.652278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.655414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650d758-e26a-4fc8-9b13-4deb2ab8ce65 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:12.754431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae53e2f-97b8-4e2f-a562-fd5af2de6118 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:12.760540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:12.761332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.761680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.761962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.762679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:12.764730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:12.767196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f1aa8-57a3-4c42-96d5-331c5e8a8745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:12.768499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1aa8-57a3-4c42-96d5-331c5e8a8745 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.769041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1aa8-57a3-4c42-96d5-331c5e8a8745 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.770247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f1aa8-57a3-4c42-96d5-331c5e8a8745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.779579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5e5f1aa8-57a3-4c42-96d5-331c5e8a8745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.798977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f1aa8-57a3-4c42-96d5-331c5e8a8745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:12.800442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f1aa8-57a3-4c42-96d5-331c5e8a8745 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:12.811879 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 917/1846] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:12.813548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb16b4d-7fd6-40df-803e-70831e945b59 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.814173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb16b4d-7fd6-40df-803e-70831e945b59 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.814671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb16b4d-7fd6-40df-803e-70831e945b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.835654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5eb16b4d-7fd6-40df-803e-70831e945b59 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:12.837450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5eb16b4d-7fd6-40df-803e-70831e945b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.855559 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 918/1847] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:12.858688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b27f-9384-4963-977c-08a08809b924 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.858688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b27f-9384-4963-977c-08a08809b924 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.858688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b27f-9384-4963-977c-08a08809b924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.892808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1026b27f-9384-4963-977c-08a08809b924 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:12.893979 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 930/1848] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:12 2021] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:12.894540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1026b27f-9384-4963-977c-08a08809b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.894828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.901139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:12.908590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 919/1849] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:12.910121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026b27f-9384-4963-977c-08a08809b924 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.926656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28753fa-0125-4a82-973f-bea6874084b0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:12.930418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:12.931198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.931511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.931966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.935441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026b27f-9384-4963-977c-08a08809b924 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:12.951705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:12.953839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:12.954789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:12.955261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:12.956287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:12.958639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:12.972106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:12.973750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:12.985536 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 931/1850] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:12.986724 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 920/1851] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:12 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:12.986847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.990977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:12.995516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113735e-ad3b-4c90-922a-40e3c6c293f8 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:13.000388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:13.001086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.001370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.001646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.017231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b536-fb59-4735-bce8-8155f3789d8a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:13.025869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:13.027356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:13.029391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:13.035120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.035654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.036167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] PATH_INFO: `/v3/projects/a376fb502e314f8892698f24d6cc56e3/users/4243537c593641ce9d468e37ad68c5f5/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.044855 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 932/1852] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:13.071065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a376fb502e314f8892698f24d6cc56e3, user_id=4243537c593641ce9d468e37ad68c5f5, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:13.074636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:13.197272 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 921/1853] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:12 2021] PUT /identity/v3/projects/a376fb502e314f8892698f24d6cc56e3/users/4243537c593641ce9d468e37ad68c5f5/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:13.204079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:13.218682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef77ec1-02c5-4567-9b0c-bf8e45eed9b3 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:13.385255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:13.385944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.386225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.386498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.387251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:13.389189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:13.416720 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 933/1854] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:13 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:13.421184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:13.439774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfd564-3ff9-4e1b-a682-b57bcab27452 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:13.452213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:13.457738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:13.473181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c264e4-575b-45a1-8aec-c5e5bf5f6c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:13.482130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c264e4-575b-45a1-8aec-c5e5bf5f6c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.482470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c264e4-575b-45a1-8aec-c5e5bf5f6c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.483177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c264e4-575b-45a1-8aec-c5e5bf5f6c2a admin admin] PATH_INFO: `/v3/projects/a376fb502e314f8892698f24d6cc56e3/users/4243537c593641ce9d468e37ad68c5f5/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.489284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c264e4-575b-45a1-8aec-c5e5bf5f6c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a376fb502e314f8892698f24d6cc56e3, user_id=4243537c593641ce9d468e37ad68c5f5, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:13.501795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c264e4-575b-45a1-8aec-c5e5bf5f6c2a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:13.515066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e583f-a832-45c8-b87f-ed8e343122a4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:13.532785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:13.544028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.544949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.545706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] PATH_INFO: `/v3/projects/b188f1ccc2ff4da88228c12468f76c63` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.548971 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 922/1855] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:13 2021] PUT /identity/v3/projects/a376fb502e314f8892698f24d6cc56e3/users/4243537c593641ce9d468e37ad68c5f5/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:13.549089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b188f1ccc2ff4da88228c12468f76c63)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:13.551175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:13.560373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.560373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.560666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.601465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] MFA Rules not processed for user `4243537c593641ce9d468e37ad68c5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:13.602731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:13.706533 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 923/1856] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:13 2021] POST /identity/v3/auth/tokens => generated 3293 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:13.709915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:13.711552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:13.748444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b188f1ccc2ff4da88228c12468f76c63', 'request_id': 'req-bbd9556e-6149-4ac6-ac28-d941f9ecf241'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:13.823399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef00a15-e921-41c5-9323-b9693a974a09 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:13.856370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b188f1ccc2ff4da88228c12468f76c63', 'request_id': 'req-bbd9556e-6149-4ac6-ac28-d941f9ecf241'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:13.863366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b188f1ccc2ff4da88228c12468f76c63', 'request_id': 'req-bbd9556e-6149-4ac6-ac28-d941f9ecf241'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:13.880503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] The token cache is being invalidate because project b188f1ccc2ff4da88228c12468f76c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:13.880843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:13.882080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:13.886444 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 934/1857] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:13 2021] DELETE /identity/v3/projects/b188f1ccc2ff4da88228c12468f76c63 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:13.888537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:13.894034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:13.898658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:13.899560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.899914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.900841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] PATH_INFO: `/v3/projects/01f0a5964e27483495133541ea779fe8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.902301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f0a5964e27483495133541ea779fe8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:13.904438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:13.980303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9556e-6149-4ac6-ac28-d941f9ecf241 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:13.990644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:13.991425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:13.991835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:13.992180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:13.996047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:14.079027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:14.081284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:14.092557 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 935/1858] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:13 2021] GET /identity/v3/auth/tokens => generated 3293 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:14.093552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:14.094818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:14.098829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f0a5964e27483495133541ea779fe8', 'request_id': 'req-cda512ca-dba5-473b-a95c-a83630739326'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.105543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f0a5964e27483495133541ea779fe8', 'request_id': 'req-cda512ca-dba5-473b-a95c-a83630739326'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.113719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6126a94-972c-4188-a97b-9dca62863a06 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:14.171653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f0a5964e27483495133541ea779fe8', 'request_id': 'req-cda512ca-dba5-473b-a95c-a83630739326'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.194641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] The token cache is being invalidate because project 01f0a5964e27483495133541ea779fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:14.195249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.196573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.198845 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 924/1859] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:13 2021] DELETE /identity/v3/projects/01f0a5964e27483495133541ea779fe8 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:14.203171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:14.203507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:14.204380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:14.204710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:14.204821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:14.205070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] PATH_INFO: `/v3/projects/86ddee7278a14ed4bfb3b116a63b9901` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:14.206378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ddee7278a14ed4bfb3b116a63b9901)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:14.208391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:14.224612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda512ca-dba5-473b-a95c-a83630739326 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:14.241446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:14.242340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:14.242621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:14.242892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] PATH_INFO: `/v3/users/9144e1a8d8d947649fadc3e45ccac373` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:14.244687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9144e1a8d8d947649fadc3e45ccac373)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:14.248917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:14.379865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ddee7278a14ed4bfb3b116a63b9901', 'request_id': 'req-ef85c334-2ace-4b33-8897-19015958ca23'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.446259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ddee7278a14ed4bfb3b116a63b9901', 'request_id': 'req-ef85c334-2ace-4b33-8897-19015958ca23'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.454660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ddee7278a14ed4bfb3b116a63b9901', 'request_id': 'req-ef85c334-2ace-4b33-8897-19015958ca23'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.481647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] The token cache is being invalidate because project 86ddee7278a14ed4bfb3b116a63b9901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:14.481944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.484717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.486386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 936/1860] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:14 2021] DELETE /identity/v3/projects/86ddee7278a14ed4bfb3b116a63b9901 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:14.487723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:14.496376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:14.526593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9144e1a8d8d947649fadc3e45ccac373'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.572232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9144e1a8d8d947649fadc3e45ccac373'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.604080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9144e1a8d8d947649fadc3e45ccac373'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.607603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9144e1a8d8d947649fadc3e45ccac373'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.611672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9144e1a8d8d947649fadc3e45ccac373'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.621626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85c334-2ace-4b33-8897-19015958ca23 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:14.630368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:14.631470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:14.631823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:14.632175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] PATH_INFO: `/v3/users/2a1a475b02684d70be16ffbcfa74ba19` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:14.633587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1a475b02684d70be16ffbcfa74ba19)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:14.635942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:14.682011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 925/1861] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:14 2021] DELETE /identity/v3/users/9144e1a8d8d947649fadc3e45ccac373 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:14.682011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:14.687770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:14.780350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c773-895d-4cd0-9c37-9f7c14777194 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:14.794608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:14.796374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:14.797343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:14.802618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] PATH_INFO: `/v3/users/a9f8028ff9a8418e83c7c9212557185d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:14.802618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f8028ff9a8418e83c7c9212557185d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:14.806314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:14.873929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1a475b02684d70be16ffbcfa74ba19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.886002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1a475b02684d70be16ffbcfa74ba19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.898794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1a475b02684d70be16ffbcfa74ba19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:14.899691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1a475b02684d70be16ffbcfa74ba19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.011948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1a475b02684d70be16ffbcfa74ba19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.022964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 937/1862] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:14 2021] DELETE /identity/v3/users/2a1a475b02684d70be16ffbcfa74ba19 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:15.024265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:15.030915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:15.077081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f8028ff9a8418e83c7c9212557185d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.096562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f8028ff9a8418e83c7c9212557185d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.120323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f8028ff9a8418e83c7c9212557185d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.123223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f8028ff9a8418e83c7c9212557185d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.124332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f8028ff9a8418e83c7c9212557185d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.180969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52484d8-2af1-4998-a42a-dc2091611f14 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:15.190250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:15.191641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:15.192096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:15.192624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] PATH_INFO: `/v3/users/3286f12496e94859a40367822aa4c8ef` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:15.194964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3286f12496e94859a40367822aa4c8ef)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:15.198065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:15.230206 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 926/1863] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:14 2021] DELETE /identity/v3/users/a9f8028ff9a8418e83c7c9212557185d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:15.265459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:15.268225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:15.395822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37917033-d6a5-4a40-bf57-2cd58c631ec3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:15.404449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:15.407805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:15.407805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:15.407805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] PATH_INFO: `/v3/projects/e998a49bfb17421ab89e8b348e7c2cd8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:15.421535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e998a49bfb17421ab89e8b348e7c2cd8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:15.426902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:15.451347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3286f12496e94859a40367822aa4c8ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.466427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3286f12496e94859a40367822aa4c8ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.489617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3286f12496e94859a40367822aa4c8ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.497235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3286f12496e94859a40367822aa4c8ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.576501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e998a49bfb17421ab89e8b348e7c2cd8', 'request_id': 'req-d8edc602-6faa-41f9-a983-cc7c80f633c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.582982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-81fd3c9f-57da-4899-a670-c3c89a652c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3286f12496e94859a40367822aa4c8ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.591181 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 938/1864] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:15 2021] DELETE /identity/v3/users/3286f12496e94859a40367822aa4c8ef => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:15.604655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e998a49bfb17421ab89e8b348e7c2cd8', 'request_id': 'req-d8edc602-6faa-41f9-a983-cc7c80f633c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.609069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369119aa-eb28-443e-9a0f-c701fb8be5f1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:15.609467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369119aa-eb28-443e-9a0f-c701fb8be5f1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:15.613087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369119aa-eb28-443e-9a0f-c701fb8be5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:15.647467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-369119aa-eb28-443e-9a0f-c701fb8be5f1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:15.647467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-369119aa-eb28-443e-9a0f-c701fb8be5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:15.716400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e998a49bfb17421ab89e8b348e7c2cd8', 'request_id': 'req-d8edc602-6faa-41f9-a983-cc7c80f633c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.727864 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 939/1865] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:15.731049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] The token cache is being invalidate because project e998a49bfb17421ab89e8b348e7c2cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:15.731452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.732476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:15.734855 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 927/1866] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:15 2021] DELETE /identity/v3/projects/e998a49bfb17421ab89e8b348e7c2cd8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:15.743599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:15.744045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:15.744395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:15.750407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:15.753767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:15.772715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:15.774042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:15.794247 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 940/1867] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:15.795456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:15.797229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:15.831833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1f42a-41ed-42bf-b0ba-372fe1f5809f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:15.840270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:15.863706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:15.864104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:15.864277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] PATH_INFO: `/v3/projects/0f667cda87f246b482e155e340b0fc27` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:15.866230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f667cda87f246b482e155e340b0fc27)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:15.882144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:15.891676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc602-6faa-41f9-a983-cc7c80f633c9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:15.964389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874c95b-987c-4b2d-9135-51bfc96fc7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:15.965463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874c95b-987c-4b2d-9135-51bfc96fc7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:15.966304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874c95b-987c-4b2d-9135-51bfc96fc7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:15.966304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874c95b-987c-4b2d-9135-51bfc96fc7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:15.968086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e874c95b-987c-4b2d-9135-51bfc96fc7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:15.982593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874c95b-987c-4b2d-9135-51bfc96fc7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:15.984073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874c95b-987c-4b2d-9135-51bfc96fc7f2 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:16.000357 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 928/1868] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:16.001867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.002205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.002721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.039936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f667cda87f246b482e155e340b0fc27', 'request_id': 'req-94a5297d-28b5-4f6c-a516-095ef0368663'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.048686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:16.049970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.120278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 929/1869] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:16.120278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:16.120278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.126568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f667cda87f246b482e155e340b0fc27', 'request_id': 'req-94a5297d-28b5-4f6c-a516-095ef0368663'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.135191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f667cda87f246b482e155e340b0fc27', 'request_id': 'req-94a5297d-28b5-4f6c-a516-095ef0368663'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.136558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4f08e-e698-4dbf-9f69-fdf7962060d7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:16.142607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:16.143472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.143953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.144301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] PATH_INFO: `/v3/projects/c93791c93ded46d0bc91e690b224a9e7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.145538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93791c93ded46d0bc91e690b224a9e7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:16.147054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] The token cache is being invalidate because project 0f667cda87f246b482e155e340b0fc27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:16.147307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.147538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:16.148038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-94a5297d-28b5-4f6c-a516-095ef0368663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.157807 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 941/1870] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:15 2021] DELETE /identity/v3/projects/0f667cda87f246b482e155e340b0fc27 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:16.165354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.165354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.165354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.186210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:16.187464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.258293 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 942/1871] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:16.262098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:16.263255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.290238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b19cc2-5bf0-42ce-8beb-296bb7bfcb03 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:16.313987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93791c93ded46d0bc91e690b224a9e7', 'request_id': 'req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.323906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93791c93ded46d0bc91e690b224a9e7', 'request_id': 'req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.385773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e381c0-fb42-4a39-9552-6e9374c4f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:16.386457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e381c0-fb42-4a39-9552-6e9374c4f14d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.386753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e381c0-fb42-4a39-9552-6e9374c4f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.387012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e381c0-fb42-4a39-9552-6e9374c4f14d admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.387803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e381c0-fb42-4a39-9552-6e9374c4f14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:16.388118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e381c0-fb42-4a39-9552-6e9374c4f14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:16.392866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e381c0-fb42-4a39-9552-6e9374c4f14d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:16.393045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93791c93ded46d0bc91e690b224a9e7', 'request_id': 'req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.409929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] The token cache is being invalidate because project c93791c93ded46d0bc91e690b224a9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:16.410568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.411375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.415492 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 943/1872] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:16.416040 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 930/1873] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:16 2021] DELETE /identity/v3/projects/c93791c93ded46d0bc91e690b224a9e7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:16.418464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.418605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:16.419024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.420831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.422462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.450266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:16.451482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.461097 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 944/1874] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:16.462060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:16.463393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.476348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3144a9-a5ca-4925-90eb-eeaf7d7f59e8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:16.486844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c54e-a946-4603-bdca-9aba454c71ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:16.486844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c54e-a946-4603-bdca-9aba454c71ee admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.486844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c54e-a946-4603-bdca-9aba454c71ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.486844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c54e-a946-4603-bdca-9aba454c71ee admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.487220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c54e-a946-4603-bdca-9aba454c71ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:16.487220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c54e-a946-4603-bdca-9aba454c71ee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:16.533074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19403d-9d5c-4ce6-aeb5-2e398c73fb70 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:16.541184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d45c-91b3-4b86-bb50-e26fcaabac81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:16.541854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d45c-91b3-4b86-bb50-e26fcaabac81 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.542135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d45c-91b3-4b86-bb50-e26fcaabac81 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.542410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d45c-91b3-4b86-bb50-e26fcaabac81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.544282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bfd2d45c-91b3-4b86-bb50-e26fcaabac81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.611100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d45c-91b3-4b86-bb50-e26fcaabac81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:16.612905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d45c-91b3-4b86-bb50-e26fcaabac81 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:16.625043 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 931/1875] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:07:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:16.627244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.628003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.650399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.663870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:16.665354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.681766 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 945/1876] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/projects => generated 391 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:16.686469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc146-83a5-4c8f-91c5-ee08c49ec5f3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.687204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc146-83a5-4c8f-91c5-ee08c49ec5f3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.687493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbc146-83a5-4c8f-91c5-ee08c49ec5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.688320 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 932/1877] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:16.689890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:16.691396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.708092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7dbbc146-83a5-4c8f-91c5-ee08c49ec5f3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:16.710503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7dbbc146-83a5-4c8f-91c5-ee08c49ec5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:16.710640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41aae7b-ca2f-460c-ac8e-ab26844364d7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:16.773163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:16.774201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.774318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 946/1878] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:16.774510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.774781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] PATH_INFO: `/v3/projects/a8441194c1564636b3cef6c8df9fbb87` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.775934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc146-83a5-4c8f-91c5-ee08c49ec5f3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:16.776147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8441194c1564636b3cef6c8df9fbb87)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:16.778028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:16.786138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbc146-83a5-4c8f-91c5-ee08c49ec5f3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:16.792622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500af96-3a0c-428e-a3a6-971c54e34a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:16.794860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500af96-3a0c-428e-a3a6-971c54e34a46 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.795157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500af96-3a0c-428e-a3a6-971c54e34a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.795436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500af96-3a0c-428e-a3a6-971c54e34a46 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.796153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500af96-3a0c-428e-a3a6-971c54e34a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:16.798117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500af96-3a0c-428e-a3a6-971c54e34a46 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:16.928671 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 947/1879] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:16.933981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8441194c1564636b3cef6c8df9fbb87', 'request_id': 'req-417244bd-0908-462e-8588-77b0d71b8ad0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.934522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19156283-a2bd-4ff3-827f-8377c66bc4fa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:16.934665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19156283-a2bd-4ff3-827f-8377c66bc4fa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:16.934917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19156283-a2bd-4ff3-827f-8377c66bc4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:16.941544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8441194c1564636b3cef6c8df9fbb87', 'request_id': 'req-417244bd-0908-462e-8588-77b0d71b8ad0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:16.958965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-19156283-a2bd-4ff3-827f-8377c66bc4fa None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:16.960193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-19156283-a2bd-4ff3-827f-8377c66bc4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.046599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8441194c1564636b3cef6c8df9fbb87', 'request_id': 'req-417244bd-0908-462e-8588-77b0d71b8ad0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.059650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] The token cache is being invalidate because project a8441194c1564636b3cef6c8df9fbb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:17.063120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.063249 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 948/1880] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:17.063353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.063623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19156283-a2bd-4ff3-827f-8377c66bc4fa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.063714 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 933/1881] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:16 2021] DELETE /identity/v3/projects/a8441194c1564636b3cef6c8df9fbb87 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:17.063714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.067054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.075282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19156283-a2bd-4ff3-827f-8377c66bc4fa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.088997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.089941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.090423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.090669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417244bd-0908-462e-8588-77b0d71b8ad0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.090995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.091883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:17.092192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.093883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.100200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.100967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.101254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.101533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.102321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.104719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.108415 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 949/1882] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:17.109408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.111632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.123902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 934/1883] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:17 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:17.125245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.126388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fb1be-f7cd-4bf2-bd20-45e3647b683f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.128749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.133792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.141092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.141092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.141092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.141092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:17.141092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.141092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.143987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bed26-7f75-4699-8315-a7fdff0cd091 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.149535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.151122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.151403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.151674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] PATH_INFO: `/v3/users/4243537c593641ce9d468e37ad68c5f5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.151943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 950/1884] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:17.152840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.152987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4243537c593641ce9d468e37ad68c5f5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.155458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.158818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.173446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9ef91-65c5-44c1-a039-c95c195e707b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.190816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.191500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.191781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.192052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.192757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.194696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.289926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 951/1885] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:17 2021] POST /identity/v3/projects => generated 409 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:17.291806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.352061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4243537c593641ce9d468e37ad68c5f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.359364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4243537c593641ce9d468e37ad68c5f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.363353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f686e9-8452-4a6e-a7e0-7ace2ac08f14 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.370186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.371236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.371668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.372561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.373620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.373781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4243537c593641ce9d468e37ad68c5f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.374467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4243537c593641ce9d468e37ad68c5f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.375110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4243537c593641ce9d468e37ad68c5f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.375347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.386327 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 952/1886] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:17 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:17.387125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.388813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.402666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf36e-bc4c-44aa-9d40-3c906beed8d1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.407950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.408695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.409086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.409423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.410189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.412480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.445985 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 935/1887] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:17 2021] DELETE /identity/v3/users/4243537c593641ce9d468e37ad68c5f5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:17.447713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.456797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.505597 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 953/1888] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:17 2021] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:17.506674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.508416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.555686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef010-1b32-4b42-981d-ebe75046eaaf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.620151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.621575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.622354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.622774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] PATH_INFO: `/v3/users/c764a9e9aea0473f9033d69ddccec1db` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.625454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c764a9e9aea0473f9033d69ddccec1db)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.628036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.628641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d33be-d23d-4c6a-b5c2-9d62e2a02030 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.638151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.639194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.639585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.639968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.640755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.642866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.745348 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 954/1889] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:17 2021] POST /identity/v3/users => generated 305 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:17.746167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.748000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.761623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e601-4a8a-41e0-9b8f-7207008f37c6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:17.770649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:17.771556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:17.771835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:17.772106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] PATH_INFO: `/v3/projects/2f409950a08e4254aa18c5d4d6e291eb/users/b4b2473656214d16a0e433e62a7ad264/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:17.787699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f409950a08e4254aa18c5d4d6e291eb, user_id=b4b2473656214d16a0e433e62a7ad264, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:17.790481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:17.823724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c764a9e9aea0473f9033d69ddccec1db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.831007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c764a9e9aea0473f9033d69ddccec1db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.845809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c764a9e9aea0473f9033d69ddccec1db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.846570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c764a9e9aea0473f9033d69ddccec1db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.847177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c764a9e9aea0473f9033d69ddccec1db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:17.898369 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 955/1890] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:17 2021] PUT /identity/v3/projects/2f409950a08e4254aa18c5d4d6e291eb/users/b4b2473656214d16a0e433e62a7ad264/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:17.899253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.902066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:17.924429 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 936/1891] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:17 2021] DELETE /identity/v3/users/c764a9e9aea0473f9033d69ddccec1db => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:17.928756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:17.928756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.007743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6cc58-b447-4b3a-818f-77c2a88f5b01 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.031436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ea7f-191b-4e00-a70a-37940fbc405e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.036331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dae41-8d92-4d1f-8fd5-ece9c0a94d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.037040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dae41-8d92-4d1f-8fd5-ece9c0a94d34 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.037325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dae41-8d92-4d1f-8fd5-ece9c0a94d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.037600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dae41-8d92-4d1f-8fd5-ece9c0a94d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.038341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dae41-8d92-4d1f-8fd5-ece9c0a94d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.042642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dae41-8d92-4d1f-8fd5-ece9c0a94d34 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.051781 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 937/1892] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:17 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:18.053174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.053463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.053737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.079278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8400334-f797-478e-92f7-027646956bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.079948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8400334-f797-478e-92f7-027646956bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.080220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8400334-f797-478e-92f7-027646956bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.080489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8400334-f797-478e-92f7-027646956bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.081217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8400334-f797-478e-92f7-027646956bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.083102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8400334-f797-478e-92f7-027646956bf7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.086628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] MFA Rules not processed for user `b4b2473656214d16a0e433e62a7ad264`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:18.087841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.168356 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 956/1893] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:17 2021] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:18.169841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec295-9fc7-4f39-9507-9f34a18808e1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.170128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec295-9fc7-4f39-9507-9f34a18808e1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.170466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec295-9fc7-4f39-9507-9f34a18808e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.192469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d1dec295-9fc7-4f39-9507-9f34a18808e1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:18.193783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d1dec295-9fc7-4f39-9507-9f34a18808e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.199494 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 938/1894] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:18 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:18.200373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.201738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.203225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 957/1895] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:18.207358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dec295-9fc7-4f39-9507-9f34a18808e1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.216394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6bbb6-12f7-44a6-8428-cd5f00e795a5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.219572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dec295-9fc7-4f39-9507-9f34a18808e1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.221318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.222230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.222511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.222777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] PATH_INFO: `/v3/projects/a376fb502e314f8892698f24d6cc56e3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.223968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a376fb502e314f8892698f24d6cc56e3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.225159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.225694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.225970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.226069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.226408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.229336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.231754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.248146 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 958/1896] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:18 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:18.249340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.260782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017d9f-e8eb-4a23-9168-bf6e1f48c1e7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.265707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.266659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.266942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.267220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.267959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.269754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.280408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 959/1897] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:18.281251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.283609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.296858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d3a7-1a8e-4823-9f7d-e259d2c0b0e7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.303444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.304533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.304819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.305130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.305847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.309467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.365322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a376fb502e314f8892698f24d6cc56e3', 'request_id': 'req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:18.372670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a376fb502e314f8892698f24d6cc56e3', 'request_id': 'req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:18.440926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 960/1898] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:18 2021] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:18.441792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.443543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.468990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a376fb502e314f8892698f24d6cc56e3', 'request_id': 'req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:18.480197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] The token cache is being invalidate because project a376fb502e314f8892698f24d6cc56e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:18.480510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:18.481189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:18.482789 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 939/1899] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:18 2021] DELETE /identity/v3/projects/a376fb502e314f8892698f24d6cc56e3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:18.489087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.490719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.502956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671062d-53c4-448c-b2ab-f12b2437e971 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.507218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.507989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.508279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.508601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.510617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.568805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5f5a8-76e4-4e31-97e1-4f8d6c774ad9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.599478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.601115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.617083 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 961/1900] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:18.618655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.622428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.640458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a18d5-655e-4f27-9e23-7925b732548a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.645532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.646204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.646766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.647037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.648281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.650627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.669786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da95c1-d04e-4fb2-84df-317aed381cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.670734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da95c1-d04e-4fb2-84df-317aed381cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.671001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da95c1-d04e-4fb2-84df-317aed381cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.671281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da95c1-d04e-4fb2-84df-317aed381cf5 admin admin] PATH_INFO: `/v3/projects/9010e8b2da054f6eaae106843dfdca7e/users/2c849558feaf4cae8a7c5832e154809b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.682803 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 962/1901] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:18 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:18.687934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:18.687934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:18.688139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da95c1-d04e-4fb2-84df-317aed381cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9010e8b2da054f6eaae106843dfdca7e, user_id=2c849558feaf4cae8a7c5832e154809b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.690075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da95c1-d04e-4fb2-84df-317aed381cf5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:18.716750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f114b3-d1c0-42b7-a0c0-5c4fc7fc99d0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:18.722356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:18.723028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:18.723458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:18.723734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:18.724435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:18.726408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.040840 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 940/1902] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:18 2021] PUT /identity/v3/projects/9010e8b2da054f6eaae106843dfdca7e/users/2c849558feaf4cae8a7c5832e154809b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:19.043050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1277e-58a0-4bac-9912-3f98345f7070 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.043338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1277e-58a0-4bac-9912-3f98345f7070 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.043614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1277e-58a0-4bac-9912-3f98345f7070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.062198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fca1277e-58a0-4bac-9912-3f98345f7070 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:19.063447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fca1277e-58a0-4bac-9912-3f98345f7070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:19.105035 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 963/1903] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:18 2021] POST /identity/v3/users => generated 302 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:19.105891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.121539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebe187-f317-4418-810a-1be88ee924ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.156053 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 941/1904] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:19.157535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff60344-340f-4c20-b6df-f65b6ffc34ce None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.157833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff60344-340f-4c20-b6df-f65b6ffc34ce None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.158097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff60344-340f-4c20-b6df-f65b6ffc34ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.201862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dff60344-340f-4c20-b6df-f65b6ffc34ce None None] MFA Rules not processed for user `2c849558feaf4cae8a7c5832e154809b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:19.203180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dff60344-340f-4c20-b6df-f65b6ffc34ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:19.246334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.247253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.247530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.247806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] PATH_INFO: `/v3/projects/d8669387db2d48d591bf4d8eadc4fa2e/users/e4cf908942c645258e20aa371b1adae5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.268707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8669387db2d48d591bf4d8eadc4fa2e, user_id=e4cf908942c645258e20aa371b1adae5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.274386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.314946 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 942/1905] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:19 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:19.314946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff60344-340f-4c20-b6df-f65b6ffc34ce None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.320522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff60344-340f-4c20-b6df-f65b6ffc34ce None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.326771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6a370-0721-41ad-a1e5-180c5a8d3221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.327545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a370-0721-41ad-a1e5-180c5a8d3221 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.327840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a370-0721-41ad-a1e5-180c5a8d3221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.328121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a370-0721-41ad-a1e5-180c5a8d3221 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.328892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6a370-0721-41ad-a1e5-180c5a8d3221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.330523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6a370-0721-41ad-a1e5-180c5a8d3221 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.341915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 943/1906] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:19.349438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb049-fc7c-402e-a8c4-91f55fd6835c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.349438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb049-fc7c-402e-a8c4-91f55fd6835c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.349438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdb049-fc7c-402e-a8c4-91f55fd6835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.363995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9bfdb049-fc7c-402e-a8c4-91f55fd6835c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:19.365276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9bfdb049-fc7c-402e-a8c4-91f55fd6835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:19.374001 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 944/1907] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:19.377827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdb049-fc7c-402e-a8c4-91f55fd6835c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.388336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdb049-fc7c-402e-a8c4-91f55fd6835c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.394135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.395016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.395341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.395655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.396699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.398658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.441308 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 964/1908] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:19 2021] PUT /identity/v3/projects/d8669387db2d48d591bf4d8eadc4fa2e/users/e4cf908942c645258e20aa371b1adae5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:19.448456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.527964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0fb2-1d89-4851-8fe1-5d04912b0e9d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.533222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.534179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.534378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.534671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] PATH_INFO: `/v3/projects/952357152b7648b0a2babd2bc2b405d0/users/ced971f291894602aacf14fa4474a9b8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.544394 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 945/1909] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:19 2021] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:19.544394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.553165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952357152b7648b0a2babd2bc2b405d0, user_id=ced971f291894602aacf14fa4474a9b8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.557437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.610672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba45354-9fd6-4013-9b70-03b55f65c9c2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.615394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f9271-a47b-4a4e-9f39-d6419c3a95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.616079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9271-a47b-4a4e-9f39-d6419c3a95f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.616358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9271-a47b-4a4e-9f39-d6419c3a95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.616634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f9271-a47b-4a4e-9f39-d6419c3a95f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.617436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9271-a47b-4a4e-9f39-d6419c3a95f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:19.617746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9271-a47b-4a4e-9f39-d6419c3a95f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.619973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f9271-a47b-4a4e-9f39-d6419c3a95f5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.631124 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 946/1910] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:19.632305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24daa9-0c56-4a23-a32e-fe6efdffa806 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.632590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24daa9-0c56-4a23-a32e-fe6efdffa806 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.632900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24daa9-0c56-4a23-a32e-fe6efdffa806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.642158 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 965/1911] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:19 2021] PUT /identity/v3/projects/952357152b7648b0a2babd2bc2b405d0/users/ced971f291894602aacf14fa4474a9b8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:19.643215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.645000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:19.661255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7b24daa9-0c56-4a23-a32e-fe6efdffa806 None None] MFA Rules not processed for user `e4cf908942c645258e20aa371b1adae5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:19.662509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7b24daa9-0c56-4a23-a32e-fe6efdffa806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:19.713686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3012ac4-6db7-4091-9ee8-28b40a781da2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.718763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.719660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.719943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.720218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] PATH_INFO: `/v3/projects/ea8fe0b0a0054e8a923f2f7833eb1b10` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.721508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8fe0b0a0054e8a923f2f7833eb1b10)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.723409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.727499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 947/1912] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:19 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:19.728829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24daa9-0c56-4a23-a32e-fe6efdffa806 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.739656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24daa9-0c56-4a23-a32e-fe6efdffa806 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.745634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.746389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.746743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.747085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.747844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.749788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:19.927687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 948/1913] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:19 2021] POST /identity/v3/users => generated 310 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:19.927687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:19.934891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3c33f-ca4b-464f-82a2-10c4971ebf0f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:19.935646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8fe0b0a0054e8a923f2f7833eb1b10', 'request_id': 'req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:19.994423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:19.998156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:19.998156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:19.998156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:19.998156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:19.998471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.149074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8fe0b0a0054e8a923f2f7833eb1b10', 'request_id': 'req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:20.156225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8fe0b0a0054e8a923f2f7833eb1b10', 'request_id': 'req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:20.166178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] The token cache is being invalidate because project ea8fe0b0a0054e8a923f2f7833eb1b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:20.166465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:20.167091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:20.169278 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 966/1914] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:19 2021] DELETE /identity/v3/projects/ea8fe0b0a0054e8a923f2f7833eb1b10 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:20.170110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.171402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.184045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ca3b-4791-4ffb-9a5b-8197c8635827 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.188494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.189169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.189450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.189727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.190448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.192036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.205390 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 949/1915] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:19 2021] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:20.205390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.206018 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 967/1916] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:20.206018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.206959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.207935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.219541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c613e7-8b02-4292-9070-539863369730 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.270634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1af5-d62d-4f5d-9ae0-0355b3a096be admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.274420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12274b-3701-448c-b980-ee09a8985e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.275085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12274b-3701-448c-b980-ee09a8985e4d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.275197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.275364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12274b-3701-448c-b980-ee09a8985e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.275636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12274b-3701-448c-b980-ee09a8985e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.275842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.276125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.276358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12274b-3701-448c-b980-ee09a8985e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.276454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.277820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.278607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12274b-3701-448c-b980-ee09a8985e4d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.279720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.288324 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 968/1917] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:20 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:20.290003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab835e-280a-43cf-b749-d16fa0a1dbbc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.290294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab835e-280a-43cf-b749-d16fa0a1dbbc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.290569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab835e-280a-43cf-b749-d16fa0a1dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.309455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-23ab835e-280a-43cf-b749-d16fa0a1dbbc None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:20.310631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23ab835e-280a-43cf-b749-d16fa0a1dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.359918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 969/1918] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 25 21:07:20 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:20.361207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804452-922c-4385-9b3e-f33427aeb335 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.361495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804452-922c-4385-9b3e-f33427aeb335 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.361770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804452-922c-4385-9b3e-f33427aeb335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.401163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 950/1919] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:20 2021] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:20.401966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.404194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.420682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e3804452-922c-4385-9b3e-f33427aeb335 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:20.422195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e3804452-922c-4385-9b3e-f33427aeb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.464444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74087d9-907e-47a5-ac1a-3a751453211f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.469668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.470326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.470604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.470878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.471572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.473533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.477916 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 970/1920] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:20.478804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804452-922c-4385-9b3e-f33427aeb335 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.488041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804452-922c-4385-9b3e-f33427aeb335 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.492800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.493700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.498636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.498636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] PATH_INFO: `/v3/projects/952357152b7648b0a2babd2bc2b405d0/users/ced971f291894602aacf14fa4474a9b8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.498636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952357152b7648b0a2babd2bc2b405d0, user_id=ced971f291894602aacf14fa4474a9b8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.498881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.508865 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 971/1921] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:20 2021] PUT /identity/v3/projects/952357152b7648b0a2babd2bc2b405d0/users/ced971f291894602aacf14fa4474a9b8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:20.509634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.556295 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 951/1922] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:20 2021] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:20.556295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.558682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.580853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb2be-576f-4057-bbaf-c8774f438d89 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.586251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.587163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.587444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.587725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] PATH_INFO: `/v3/projects/4ab01f6421af4c23afdf920fc3de99f6/users/c3155083ee2d4f52936b338f5ea5bc7d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.604930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab01f6421af4c23afdf920fc3de99f6, user_id=c3155083ee2d4f52936b338f5ea5bc7d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.607961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.624414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1a2ba-212c-474a-b631-abde7668cd8c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.676827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccff1fe-8558-4445-a469-0c49de7d9328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.677641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccff1fe-8558-4445-a469-0c49de7d9328 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.677846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccff1fe-8558-4445-a469-0c49de7d9328 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.678130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccff1fe-8558-4445-a469-0c49de7d9328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.687684 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 972/1923] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:20 2021] PUT /identity/v3/projects/4ab01f6421af4c23afdf920fc3de99f6/users/c3155083ee2d4f52936b338f5ea5bc7d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:20.687684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.689230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccff1fe-8558-4445-a469-0c49de7d9328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.690776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccff1fe-8558-4445-a469-0c49de7d9328 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.700900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 952/1924] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:20.702288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a0b3-8d4d-4642-91ba-076bd664246c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.702695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a0b3-8d4d-4642-91ba-076bd664246c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.702984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67a0b3-8d4d-4642-91ba-076bd664246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.721323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fc67a0b3-8d4d-4642-91ba-076bd664246c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:20.722590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fc67a0b3-8d4d-4642-91ba-076bd664246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.778051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6576-1f0c-45eb-9530-595a6d358a17 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.784710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.785565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.785855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.786130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.787313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.789086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.792089 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 953/1925] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:20.794261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf302-1938-452b-b5c6-7d33d30d3f75 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.794712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf302-1938-452b-b5c6-7d33d30d3f75 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.795129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaf302-1938-452b-b5c6-7d33d30d3f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.823546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3aaaf302-1938-452b-b5c6-7d33d30d3f75 None None] MFA Rules not processed for user `ced971f291894602aacf14fa4474a9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:20.825543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3aaaf302-1938-452b-b5c6-7d33d30d3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:20.893125 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 954/1926] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:20 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:20.894110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf302-1938-452b-b5c6-7d33d30d3f75 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.910821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 973/1927] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:20 2021] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:20.911734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.914882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaf302-1938-452b-b5c6-7d33d30d3f75 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.920651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.921380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.921658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.922057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.922748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921711-4a82-4aef-b4d6-148c3428d241 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.922947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.924560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.928229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.929018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.929338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.929688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.930566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.932264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.935480 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 955/1928] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:20 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:20.936364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.947057 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 974/1929] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:20 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:20.947972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:20.952856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df72228-4d5d-48d7-977a-f14fe86c1ed0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.958961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffef2b-ef2b-4f86-8d45-77dc2702aa0f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:20.963868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.964968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:20.965445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.965727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.965833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:20.965980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] PATH_INFO: `/v3/users/b4b2473656214d16a0e433e62a7ad264` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.966088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:20.966315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:20.967326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:20.967414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b2473656214d16a0e433e62a7ad264)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.967504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:20.969005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.969226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:20.988331 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 956/1930] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:20.989494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.000449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e5372-da11-447e-a46b-3d42469f53d8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.005927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.009610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.009898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.010304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.011078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.013604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.024459 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 957/1931] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:21.025427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.036150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4294-95cd-4de1-8618-7b4829a99fa6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.041308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.041991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.042274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.042573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.043513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.045301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.055978 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 958/1932] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:21.056917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.068911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9614b3-f13b-4660-876f-c3af255d52a6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.074673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.075559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.075838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.076107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] PATH_INFO: `/v3/projects/4ab01f6421af4c23afdf920fc3de99f6/users/c3155083ee2d4f52936b338f5ea5bc7d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.078104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab01f6421af4c23afdf920fc3de99f6, user_id=c3155083ee2d4f52936b338f5ea5bc7d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.080852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.092544 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 959/1933] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:21 2021] PUT /identity/v3/projects/4ab01f6421af4c23afdf920fc3de99f6/users/c3155083ee2d4f52936b338f5ea5bc7d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:21.093585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.154998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe635caa-092d-4010-962c-a094ffcc6286 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.160508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.163778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.163778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.163778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.163778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.164324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.196380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b2473656214d16a0e433e62a7ad264'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:21.203943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b2473656214d16a0e433e62a7ad264'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:21.216174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b2473656214d16a0e433e62a7ad264'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:21.216867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b2473656214d16a0e433e62a7ad264'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:21.236593 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 960/1934] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:21 2021] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:21.238224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.285776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b2473656214d16a0e433e62a7ad264'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:21.292026 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 975/1935] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:20 2021] DELETE /identity/v3/users/b4b2473656214d16a0e433e62a7ad264 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:21.292896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.294222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.305330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5989-2abe-4c46-8986-a608a25a70df admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.357954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db9fea-af33-4571-a2f6-df79d78deb93 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.360350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.361270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.361555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.361831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] PATH_INFO: `/v3/projects/5b8384d3682348ec80110315f774ace0/users/6768c77823e2472ab27b74cb4373871c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.362733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff4045-5cd7-4710-9307-2ec4a8f937ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.363647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff4045-5cd7-4710-9307-2ec4a8f937ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.363937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff4045-5cd7-4710-9307-2ec4a8f937ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.364241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff4045-5cd7-4710-9307-2ec4a8f937ea admin admin] PATH_INFO: `/v3/projects/23e193382c4b432e88b5f1aedd95be4c/users/d1f549341d2241c3bdc2c7db0996de7f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.376503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8384d3682348ec80110315f774ace0, user_id=6768c77823e2472ab27b74cb4373871c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.382390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.382651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff4045-5cd7-4710-9307-2ec4a8f937ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e193382c4b432e88b5f1aedd95be4c, user_id=d1f549341d2241c3bdc2c7db0996de7f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.382651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff4045-5cd7-4710-9307-2ec4a8f937ea admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.520702 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 976/1936] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:21 2021] PUT /identity/v3/projects/23e193382c4b432e88b5f1aedd95be4c/users/d1f549341d2241c3bdc2c7db0996de7f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:21.522129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afc88-685e-4eea-af7e-d988aa58211f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.522416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afc88-685e-4eea-af7e-d988aa58211f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.522700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afc88-685e-4eea-af7e-d988aa58211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.549030 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 961/1937] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:21 2021] PUT /identity/v3/projects/5b8384d3682348ec80110315f774ace0/users/6768c77823e2472ab27b74cb4373871c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:21.553072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.554094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0d1afc88-685e-4eea-af7e-d988aa58211f None None] MFA Rules not processed for user `c3155083ee2d4f52936b338f5ea5bc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:21.555001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.555360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0d1afc88-685e-4eea-af7e-d988aa58211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.622740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1437f88-529d-4df7-916c-6904c4d57137 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.627558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.628221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.628501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.628767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.629497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.631391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.634780 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 977/1938] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:21 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:21.636140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c159-3fd3-4800-b3ee-239495b89ef6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.637098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c159-3fd3-4800-b3ee-239495b89ef6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.637442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c159-3fd3-4800-b3ee-239495b89ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.657480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1ea0c159-3fd3-4800-b3ee-239495b89ef6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:21.658684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1ea0c159-3fd3-4800-b3ee-239495b89ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.666317 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 978/1939] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:21.667594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.667881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.668153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.695216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] MFA Rules not processed for user `d1f549341d2241c3bdc2c7db0996de7f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:21.697362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.764461 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 962/1940] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:21 2021] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:21.765051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.768299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.777774 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 979/1941] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:21.778735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.780214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.783905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7110-9fc3-4384-8597-e2f8f8a22f88 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.789542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.791066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.791066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.791804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.793307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.795045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.811630 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 963/1942] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:21.811630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.816004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:21.892220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604baf88-59a4-454b-9bd0-51a0e247df18 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.899329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.900183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.900503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.900898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.908227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31562ec-8539-4104-89d6-75aa1bab3f1e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.910190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.911928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.915517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed87af-04f8-4a4d-8455-5c17620ce528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.916794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed87af-04f8-4a4d-8455-5c17620ce528 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.917258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed87af-04f8-4a4d-8455-5c17620ce528 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.919099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed87af-04f8-4a4d-8455-5c17620ce528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.926719 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 980/1943] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:21 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:21.930534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.932662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed87af-04f8-4a4d-8455-5c17620ce528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.937152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed87af-04f8-4a4d-8455-5c17620ce528 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.948352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54fff2-3952-408c-bb00-81862262dc02 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.953810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.954615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.955007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.955408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.956252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:21.963582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:21.968176 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 964/1944] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:21.969967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c797cd-edb7-4d52-8cbd-552d506cd505 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.970329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c797cd-edb7-4d52-8cbd-552d506cd505 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.970519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c797cd-edb7-4d52-8cbd-552d506cd505 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:21.973901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 965/1945] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:07:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:21.974637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c797cd-edb7-4d52-8cbd-552d506cd505 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.984685 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 981/1946] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:21.984685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:21.992527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c797cd-edb7-4d52-8cbd-552d506cd505 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.994913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdea11a-7a25-406e-a4b2-575a64616bd7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:21.998103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682e34e-e893-4432-bad3-0c4650f68bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:21.999405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682e34e-e893-4432-bad3-0c4650f68bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:21.999698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682e34e-e893-4432-bad3-0c4650f68bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:21.999976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682e34e-e893-4432-bad3-0c4650f68bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.000965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682e34e-e893-4432-bad3-0c4650f68bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.002399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.003297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682e34e-e893-4432-bad3-0c4650f68bc1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.006280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.006787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.007421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] PATH_INFO: `/v3/projects/5b8384d3682348ec80110315f774ace0/users/6768c77823e2472ab27b74cb4373871c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.012131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8384d3682348ec80110315f774ace0, user_id=6768c77823e2472ab27b74cb4373871c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.016640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.030218 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 982/1947] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:21 2021] PUT /identity/v3/projects/5b8384d3682348ec80110315f774ace0/users/6768c77823e2472ab27b74cb4373871c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:22.043117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.102782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006ceb-b175-4c55-92f5-953fb18cfa4c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.103231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 966/1948] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:21 2021] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:22.108329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d179bc-7deb-46e3-bade-2c2c4574cd14 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.108620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d179bc-7deb-46e3-bade-2c2c4574cd14 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.108907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d179bc-7deb-46e3-bade-2c2c4574cd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.134939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b1d179bc-7deb-46e3-bade-2c2c4574cd14 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:22.136623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1d179bc-7deb-46e3-bade-2c2c4574cd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:22.189187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f52929-5e1c-4a01-a5fb-b973d1cb0b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.190062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f52929-5e1c-4a01-a5fb-b973d1cb0b95 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.190453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f52929-5e1c-4a01-a5fb-b973d1cb0b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.190830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f52929-5e1c-4a01-a5fb-b973d1cb0b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.191641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f52929-5e1c-4a01-a5fb-b973d1cb0b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.193359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f52929-5e1c-4a01-a5fb-b973d1cb0b95 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.205018 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 983/1949] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:22 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:22.207160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f22c-2309-42a4-983c-576fb0104fc8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.207450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f22c-2309-42a4-983c-576fb0104fc8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.207758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441f22c-2309-42a4-983c-576fb0104fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.226542 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 967/1950] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:07:22 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:22.227687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d179bc-7deb-46e3-bade-2c2c4574cd14 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.236287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9441f22c-2309-42a4-983c-576fb0104fc8 None None] MFA Rules not processed for user `6768c77823e2472ab27b74cb4373871c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:22.237977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9441f22c-2309-42a4-983c-576fb0104fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:22.240439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d179bc-7deb-46e3-bade-2c2c4574cd14 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.246817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.249330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.249330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.249330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.250730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:22.314247 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 984/1951] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:22 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:22.318216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f22c-2309-42a4-983c-576fb0104fc8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.318356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.319489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.326552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441f22c-2309-42a4-983c-576fb0104fc8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.331999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.332736 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 968/1952] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:22 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:22.332977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.333336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.333783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.334187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.334689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.336765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.348985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aa05c-f014-40da-a0cb-8b2bfb67677e service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.354411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.355933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.356219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.356492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] PATH_INFO: `/v3/projects/1cbb59dcbd544ccfbcbb709c6fe1201a/users/90d14ca3dbcf46d799645c342fc39b0e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.373329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbb59dcbd544ccfbcbb709c6fe1201a, user_id=90d14ca3dbcf46d799645c342fc39b0e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.376166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.486121 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 985/1953] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:22 2021] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:22.487278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.489326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:22.515111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 969/1954] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:22 2021] PUT /identity/v3/projects/1cbb59dcbd544ccfbcbb709c6fe1201a/users/90d14ca3dbcf46d799645c342fc39b0e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:22.515111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.515416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43c7d-a905-440e-b53d-27b14391117d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.578712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.579316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.579601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.579878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.582486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b343-667c-4246-880f-fb6d5bc52654 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.588035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ced6bb-c504-492a-a37e-4792d04d5c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.588678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced6bb-c504-492a-a37e-4792d04d5c2d service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.589051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced6bb-c504-492a-a37e-4792d04d5c2d service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.589349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced6bb-c504-492a-a37e-4792d04d5c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.592907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.594611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.605378 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 986/1955] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:22.606181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.656330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ced6bb-c504-492a-a37e-4792d04d5c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.658192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ced6bb-c504-492a-a37e-4792d04d5c2d service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.683894 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 970/1956] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:22 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:22.685705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b77b8-653e-4c0e-937c-078099447a41 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.686003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b77b8-653e-4c0e-937c-078099447a41 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.686315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b77b8-653e-4c0e-937c-078099447a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.690837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d879b3-b443-40d5-90ac-e23cfd71bf5f service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.697079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.698086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.698355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.698633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.700244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.702867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.722257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-789b77b8-653e-4c0e-937c-078099447a41 None None] MFA Rules not processed for user `90d14ca3dbcf46d799645c342fc39b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:22.722457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 987/1957] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:22 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:22.723340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.724153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-789b77b8-653e-4c0e-937c-078099447a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:22.725239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:22.738982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991648e-dd40-410c-adc6-c0a935894cbf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.744823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.745844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.746203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.746553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] PATH_INFO: `/v3/projects/2f409950a08e4254aa18c5d4d6e291eb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.747860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f409950a08e4254aa18c5d4d6e291eb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.749944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.837055 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 971/1958] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:22 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:22.837055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b77b8-653e-4c0e-937c-078099447a41 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.853948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b77b8-653e-4c0e-937c-078099447a41 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:22.872867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f409950a08e4254aa18c5d4d6e291eb', 'request_id': 'req-fb0c693f-ef5f-4f28-8058-91b045ab5a42'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:22.925351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fdb6f-cb9f-4167-bde6-9b34894b6feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:22.926255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fdb6f-cb9f-4167-bde6-9b34894b6feb admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:22.926536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fdb6f-cb9f-4167-bde6-9b34894b6feb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:22.926808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fdb6f-cb9f-4167-bde6-9b34894b6feb admin admin] PATH_INFO: `/v3/projects/44b6ac9cd65a4182801ef4b028a2dd00/users/8fad2166425045789dbb14eff24b5d84/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:22.943624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fdb6f-cb9f-4167-bde6-9b34894b6feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b6ac9cd65a4182801ef4b028a2dd00, user_id=8fad2166425045789dbb14eff24b5d84, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:22.944606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f409950a08e4254aa18c5d4d6e291eb', 'request_id': 'req-fb0c693f-ef5f-4f28-8058-91b045ab5a42'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:22.946565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fdb6f-cb9f-4167-bde6-9b34894b6feb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:22.955706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f409950a08e4254aa18c5d4d6e291eb', 'request_id': 'req-fb0c693f-ef5f-4f28-8058-91b045ab5a42'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:22.975576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] The token cache is being invalidate because project 2f409950a08e4254aa18c5d4d6e291eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:22.976307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:22.976785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:22.982139 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 988/1959] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:22 2021] DELETE /identity/v3/projects/2f409950a08e4254aa18c5d4d6e291eb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:22.982139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:22.982139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:22.995646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c693f-ef5f-4f28-8058-91b045ab5a42 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.001127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.002137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.002515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.002863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] PATH_INFO: `/v3/users/2c849558feaf4cae8a7c5832e154809b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.004257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c849558feaf4cae8a7c5832e154809b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.006526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.022352 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 972/1960] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:22 2021] PUT /identity/v3/projects/44b6ac9cd65a4182801ef4b028a2dd00/users/8fad2166425045789dbb14eff24b5d84/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:23.022352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.022352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.022352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.048519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] MFA Rules not processed for user `90d14ca3dbcf46d799645c342fc39b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:23.049944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.119392 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 973/1961] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:23 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:23.120564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:23.122067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.202597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c849558feaf4cae8a7c5832e154809b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.211827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c849558feaf4cae8a7c5832e154809b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.212653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc98d7-ca33-4e55-8266-ecb482ac16ac None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.218840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.220158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.220545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.220966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] PATH_INFO: `/v3/users/ced971f291894602aacf14fa4474a9b8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.222916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced971f291894602aacf14fa4474a9b8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.226134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.227087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c849558feaf4cae8a7c5832e154809b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.228302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c849558feaf4cae8a7c5832e154809b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.303608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c849558feaf4cae8a7c5832e154809b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.314739 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 989/1962] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:22 2021] DELETE /identity/v3/users/2c849558feaf4cae8a7c5832e154809b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:23.315807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:23.317647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.406567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e445d08-c6e4-480d-b6d7-c6b1434d9014 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.411401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.412063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.412374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.412609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.413379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.414969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.427753 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 990/1963] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:23 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:23.427753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:23.429458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.475731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced971f291894602aacf14fa4474a9b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.482726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced971f291894602aacf14fa4474a9b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.494182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced971f291894602aacf14fa4474a9b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.494833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced971f291894602aacf14fa4474a9b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.495424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced971f291894602aacf14fa4474a9b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:23.504525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194179-ceb5-477d-8655-5d9bc8856237 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.510049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e1467-816d-4162-b99d-743dbb061458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.510699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e1467-816d-4162-b99d-743dbb061458 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.510959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e1467-816d-4162-b99d-743dbb061458 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.512023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e1467-816d-4162-b99d-743dbb061458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.513793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-012e1467-816d-4162-b99d-743dbb061458 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.571162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e1467-816d-4162-b99d-743dbb061458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.572799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e1467-816d-4162-b99d-743dbb061458 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.582063 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 991/1964] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:23 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:23.583337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.583590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.583863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.593530 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 974/1965] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:23 2021] DELETE /identity/v3/users/ced971f291894602aacf14fa4474a9b8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:23.597340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:23.599297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.602940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:23.604124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.669022 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 992/1966] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:23.671380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:23.674920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.679293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c5efe-5dac-4264-afd1-c6ab98a909aa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.689190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.690465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c6653-203c-4a58-bb3e-75bc3384d25d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.690600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.691149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.691509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] PATH_INFO: `/v3/projects/44b6ac9cd65a4182801ef4b028a2dd00/users/8fad2166425045789dbb14eff24b5d84/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.694921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b6ac9cd65a4182801ef4b028a2dd00, user_id=8fad2166425045789dbb14eff24b5d84, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.697341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.698201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.699646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.700090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.700503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] PATH_INFO: `/v3/users/e4cf908942c645258e20aa371b1adae5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.702550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cf908942c645258e20aa371b1adae5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.705877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.711143 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 975/1967] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:23 2021] PUT /identity/v3/projects/44b6ac9cd65a4182801ef4b028a2dd00/users/8fad2166425045789dbb14eff24b5d84/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:23.712207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:23.733147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.781797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0260-7aee-4531-9f60-9751939a83fe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.785506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e798-fbe6-4253-9883-43aae5585969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.786143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e798-fbe6-4253-9883-43aae5585969 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.786425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e798-fbe6-4253-9883-43aae5585969 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.786721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e798-fbe6-4253-9883-43aae5585969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.846367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2e798-fbe6-4253-9883-43aae5585969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.847701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2e798-fbe6-4253-9883-43aae5585969 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.858106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 976/1968] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:23.859472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f608a-a824-4bd1-ac90-dc803155224a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.859865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f608a-a824-4bd1-ac90-dc803155224a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.860092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f608a-a824-4bd1-ac90-dc803155224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.888576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-073f608a-a824-4bd1-ac90-dc803155224a None None] MFA Rules not processed for user `8fad2166425045789dbb14eff24b5d84`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:23.889997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-073f608a-a824-4bd1-ac90-dc803155224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:23.962231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 977/1969] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:23 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:23.969409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f608a-a824-4bd1-ac90-dc803155224a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:23.978050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f608a-a824-4bd1-ac90-dc803155224a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:23.983328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:23.983983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:23.984256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:23.984555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:23.985337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:23.985647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:23.987488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:23.999980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 978/1970] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:07:24.004213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:24.013947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b803ac-998d-4f05-b099-59eec3c70756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:24.018706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:24.019334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:24.019620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:24.019899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:24.020585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:24.022509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:24.757439 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 979/1971] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:24 2021] POST /identity/v3/projects => generated 371 bytes in 754 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:24.761464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:24.884070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cf908942c645258e20aa371b1adae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:24.896562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cf908942c645258e20aa371b1adae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:24.904206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cf908942c645258e20aa371b1adae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:24.905091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cf908942c645258e20aa371b1adae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:24.909795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd41bb-5073-4627-a3cd-7ed689cffc13 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:24.914824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:24.915522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:24.915939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:24.916224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:24.917551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:24.925536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:24.925536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:24.937080 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 980/1972] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:24.937080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:24.941408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:24.986680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cf908942c645258e20aa371b1adae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:24.993235 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 993/1973] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:23 2021] DELETE /identity/v3/users/e4cf908942c645258e20aa371b1adae5 => generated 0 bytes in 1323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:24.994103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:24.995440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.032005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892c9b1-a900-497c-bb0e-3ac5455b0f5b tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.085552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.089164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.089164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.089164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] PATH_INFO: `/v3/projects/952357152b7648b0a2babd2bc2b405d0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.090206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc206c53-b2be-462d-bf7c-e16a1a3b3953 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.090318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952357152b7648b0a2babd2bc2b405d0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.091128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.096108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c99ba-f5b5-4a6a-9017-63e47415d583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.096836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c99ba-f5b5-4a6a-9017-63e47415d583 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.097082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c99ba-f5b5-4a6a-9017-63e47415d583 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.097361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c99ba-f5b5-4a6a-9017-63e47415d583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.099620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ab8c99ba-f5b5-4a6a-9017-63e47415d583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.166283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c99ba-f5b5-4a6a-9017-63e47415d583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.168440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c99ba-f5b5-4a6a-9017-63e47415d583 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.178010 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 994/1974] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:24 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:25.179422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.180752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.180752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.197717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:25.199235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.207403 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 995/1975] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:25.208186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:25.209425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.221510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5bcbd-1446-4929-a87f-a8133ad38334 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.226259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.227141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.227428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.227701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] PATH_INFO: `/v3/projects/9010e8b2da054f6eaae106843dfdca7e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.228957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9010e8b2da054f6eaae106843dfdca7e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.231484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.251713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952357152b7648b0a2babd2bc2b405d0', 'request_id': 'req-f2520bc0-d1a8-4228-b629-16fa325ba234'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.257878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952357152b7648b0a2babd2bc2b405d0', 'request_id': 'req-f2520bc0-d1a8-4228-b629-16fa325ba234'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.360634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9010e8b2da054f6eaae106843dfdca7e', 'request_id': 'req-0322aa15-eed3-49ac-999a-1a7589af1fcb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.388570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952357152b7648b0a2babd2bc2b405d0', 'request_id': 'req-f2520bc0-d1a8-4228-b629-16fa325ba234'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.399335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] The token cache is being invalidate because project 952357152b7648b0a2babd2bc2b405d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:25.399626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.400284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2520bc0-d1a8-4228-b629-16fa325ba234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.401872 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 981/1976] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:24 2021] DELETE /identity/v3/projects/952357152b7648b0a2babd2bc2b405d0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:25.403648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb1e1-e7dc-4b0c-8a98-a2d56895e67b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.403934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb1e1-e7dc-4b0c-8a98-a2d56895e67b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.404213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb1e1-e7dc-4b0c-8a98-a2d56895e67b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.405966 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 982/1977] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:25.406682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddb1e1-e7dc-4b0c-8a98-a2d56895e67b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:25.408316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e2ddb1e1-e7dc-4b0c-8a98-a2d56895e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.468949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9010e8b2da054f6eaae106843dfdca7e', 'request_id': 'req-0322aa15-eed3-49ac-999a-1a7589af1fcb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.469889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddb1e1-e7dc-4b0c-8a98-a2d56895e67b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.473822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.478732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.478732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.478732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.478959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9010e8b2da054f6eaae106843dfdca7e', 'request_id': 'req-0322aa15-eed3-49ac-999a-1a7589af1fcb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.479057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.486787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] The token cache is being invalidate because project 9010e8b2da054f6eaae106843dfdca7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:25.487070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.487734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0322aa15-eed3-49ac-999a-1a7589af1fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:25.489327 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 996/1978] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:25 2021] DELETE /identity/v3/projects/9010e8b2da054f6eaae106843dfdca7e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:25.490667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.490955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.491359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.513420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:25.513802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.546016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.548292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.564738 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 983/1979] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:25.565742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:25.567132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.587382 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 997/1980] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:25.588448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:25.590948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.610600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bb3fc-81a6-4c87-a4a0-34c837be31f2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.617814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.619124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.619900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.620299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] PATH_INFO: `/v3/users/c3155083ee2d4f52936b338f5ea5bc7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.622276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3155083ee2d4f52936b338f5ea5bc7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.624938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.673638 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 25 21:07:25.673885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:25.675369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.739408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d4d6-e699-442f-9ba8-23bb3ee1feca service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.744845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc0788-1c20-4d13-aae8-a2c3017dddff tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.745753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc0788-1c20-4d13-aae8-a2c3017dddff tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.746072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc0788-1c20-4d13-aae8-a2c3017dddff tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.746559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc0788-1c20-4d13-aae8-a2c3017dddff tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/projects/97a893144c7741b1b5fc3cf85aba03f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.748654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc0788-1c20-4d13-aae8-a2c3017dddff tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:get_project(project_id=97a893144c7741b1b5fc3cf85aba03f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.750886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc0788-1c20-4d13-aae8-a2c3017dddff tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.753058 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 984/1981] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:25 2021] GET /identity/v3/projects/97a893144c7741b1b5fc3cf85aba03f8 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:25.753816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5fb3b-f169-4988-a6fe-fc74c4ed4f9f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.756619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5fb3b-f169-4988-a6fe-fc74c4ed4f9f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.756619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5fb3b-f169-4988-a6fe-fc74c4ed4f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.775830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c3f5fb3b-f169-4988-a6fe-fc74c4ed4f9f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:25.777082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c3f5fb3b-f169-4988-a6fe-fc74c4ed4f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:25.785727 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 985/1982] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:25.789820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5fb3b-f169-4988-a6fe-fc74c4ed4f9f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:25.798691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5fb3b-f169-4988-a6fe-fc74c4ed4f9f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.804315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.805001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.805281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.805564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.806335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:25.810026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.810026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.821390 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 986/1983] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:07:25.826446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:25.837972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b707f-27a5-4180-aab7-f31447e67a95 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:25.843607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:25.844269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:25.860022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:25.860022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:25.860022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:25.860022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:25.997323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3155083ee2d4f52936b338f5ea5bc7d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.004098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3155083ee2d4f52936b338f5ea5bc7d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.015597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3155083ee2d4f52936b338f5ea5bc7d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.016293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3155083ee2d4f52936b338f5ea5bc7d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.093349 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 987/1984] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:25 2021] POST /identity/v3/projects => generated 397 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:26.102206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.177378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8baac6b-90f2-4d29-869c-e3e658250859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3155083ee2d4f52936b338f5ea5bc7d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.185274 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 998/1985] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:25 2021] DELETE /identity/v3/users/c3155083ee2d4f52936b338f5ea5bc7d => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:26.185802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ba7e4-342e-4a96-9b98-0f9c31dc4ed7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.186555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047b846-9ea4-4d70-9822-bfccbe0bb8f5 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.186954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047b846-9ea4-4d70-9822-bfccbe0bb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.187238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047b846-9ea4-4d70-9822-bfccbe0bb8f5 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.194658 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 999/1986] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:26 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:26.195548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047b846-9ea4-4d70-9822-bfccbe0bb8f5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.197457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c047b846-9ea4-4d70-9822-bfccbe0bb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.253047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.253868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.254156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.254432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.255128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.257136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.282553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047b846-9ea4-4d70-9822-bfccbe0bb8f5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.287732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.288472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.288752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.289059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] PATH_INFO: `/v3/projects/d8669387db2d48d591bf4d8eadc4fa2e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.290257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8669387db2d48d591bf4d8eadc4fa2e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.292147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.366163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 988/1987] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:26 2021] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:26.367200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:26.368743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.442403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8669387db2d48d591bf4d8eadc4fa2e', 'request_id': 'req-9417a254-692a-4c84-9bf4-62dc3a742937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.454254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.455563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.523012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d94a9f-1313-4d69-93cc-21e2f1c0a764 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.579766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.580631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.580945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.581338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/projects/97a893144c7741b1b5fc3cf85aba03f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.582739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:get_project(project_id=97a893144c7741b1b5fc3cf85aba03f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.583051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8669387db2d48d591bf4d8eadc4fa2e', 'request_id': 'req-9417a254-692a-4c84-9bf4-62dc3a742937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.584937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.586838 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 989/1988] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:26 2021] GET /identity/v3/projects/97a893144c7741b1b5fc3cf85aba03f8 => generated 371 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:26.587538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.589430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.594247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8669387db2d48d591bf4d8eadc4fa2e', 'request_id': 'req-9417a254-692a-4c84-9bf4-62dc3a742937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.603647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] The token cache is being invalidate because project d8669387db2d48d591bf4d8eadc4fa2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:26.604036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.604822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.606836 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1000/1989] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:26 2021] DELETE /identity/v3/projects/d8669387db2d48d591bf4d8eadc4fa2e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:26.615882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.617627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.657546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c162b-520d-4ea5-9da2-e6f203927832 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.662261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.662932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.663214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.663492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.664235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.665862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.675735 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 990/1990] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:26.676586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.678258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.682938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417a254-692a-4c84-9bf4-62dc3a742937 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.689002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.689953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.690298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.690676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] PATH_INFO: `/v3/users/6768c77823e2472ab27b74cb4373871c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.691969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6768c77823e2472ab27b74cb4373871c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.693706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21597df3-35e9-4ec6-bf20-672a43ce6e99 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.694072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.700529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.706204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.706204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.706204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.706204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:26.706204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.706791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.719810 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 991/1991] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:26.720905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.722826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.736300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5bb89-f1e0-4115-a85a-f6a1eae155ae tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.741253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.741915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.742280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.742612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.743312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.744907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.756585 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 992/1992] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:26 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:26.757592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:26.760779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:26.773957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae13d44-dec2-4917-bba5-2857114e2efd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:26.778805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:26.779651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:26.779944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:26.780203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] PATH_INFO: `/v3/projects/4ab01f6421af4c23afdf920fc3de99f6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:26.781820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab01f6421af4c23afdf920fc3de99f6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:26.783700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:26.894507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6768c77823e2472ab27b74cb4373871c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.901877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6768c77823e2472ab27b74cb4373871c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.916244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6768c77823e2472ab27b74cb4373871c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.917298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6768c77823e2472ab27b74cb4373871c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.934770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab01f6421af4c23afdf920fc3de99f6', 'request_id': 'req-08ea09a4-e175-4a69-bbf7-d277153eb534'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.941574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab01f6421af4c23afdf920fc3de99f6', 'request_id': 'req-08ea09a4-e175-4a69-bbf7-d277153eb534'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.989049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6768c77823e2472ab27b74cb4373871c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:26.999513 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1001/1993] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:26 2021] DELETE /identity/v3/users/6768c77823e2472ab27b74cb4373871c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:27.001310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.014334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.041026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab01f6421af4c23afdf920fc3de99f6', 'request_id': 'req-08ea09a4-e175-4a69-bbf7-d277153eb534'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:27.053473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] The token cache is being invalidate because project 4ab01f6421af4c23afdf920fc3de99f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:27.053897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:27.054678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:27.056512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 993/1994] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:26 2021] DELETE /identity/v3/projects/4ab01f6421af4c23afdf920fc3de99f6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:27.057443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.059521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.099736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19e91-a502-41c3-9b06-79a837aa4338 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.108229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6b905-f09e-4dc2-90af-b91c2144d27d tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.109052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6b905-f09e-4dc2-90af-b91c2144d27d tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.109403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6b905-f09e-4dc2-90af-b91c2144d27d tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.109843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6b905-f09e-4dc2-90af-b91c2144d27d tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.110701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6b905-f09e-4dc2-90af-b91c2144d27d tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.113008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6b905-f09e-4dc2-90af-b91c2144d27d tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.163125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea09a4-e175-4a69-bbf7-d277153eb534 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.222265 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1002/1995] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:27 2021] POST /identity/v3/users => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:27.222265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.222265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.222265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.239750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.240941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.241367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.244195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] PATH_INFO: `/v3/projects/276a36e6a97d46a78b7e483daa26cc2e/users/2cb2a59c7c9b4a13964c78ff0fb1a8f4/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.250666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:27.252136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.260249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276a36e6a97d46a78b7e483daa26cc2e, user_id=2cb2a59c7c9b4a13964c78ff0fb1a8f4, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.263110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.270101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1003/1996] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:27.271166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.272562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.286091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6763-ef2e-455e-bcc6-7f32a42b871c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.290673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f45ea-b816-46a6-b3fa-20ec3dbbe48a tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.291328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f45ea-b816-46a6-b3fa-20ec3dbbe48a tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.291609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f45ea-b816-46a6-b3fa-20ec3dbbe48a tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.291897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f45ea-b816-46a6-b3fa-20ec3dbbe48a tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.292608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f45ea-b816-46a6-b3fa-20ec3dbbe48a tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:27.293484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f45ea-b816-46a6-b3fa-20ec3dbbe48a tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.295073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f45ea-b816-46a6-b3fa-20ec3dbbe48a tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.307455 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1004/1997] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:27.309318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb50dde-ae96-4dc7-a47a-f8d8411d991b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.309605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb50dde-ae96-4dc7-a47a-f8d8411d991b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.312557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb50dde-ae96-4dc7-a47a-f8d8411d991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.328634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2bb50dde-ae96-4dc7-a47a-f8d8411d991b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:27.329976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2bb50dde-ae96-4dc7-a47a-f8d8411d991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.338127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1005/1998] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:27.340984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e16b-36ac-4ea7-a7c3-66d1b771e2fa None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.340984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e16b-36ac-4ea7-a7c3-66d1b771e2fa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.340984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e16b-36ac-4ea7-a7c3-66d1b771e2fa None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.342429 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1006/1999] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:27.343729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e16b-36ac-4ea7-a7c3-66d1b771e2fa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.356467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e16b-36ac-4ea7-a7c3-66d1b771e2fa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.361062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.361659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.361940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.362214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.362921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:27.363223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.364792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.376005 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1007/2000] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:27.376764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:27.378380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.410527 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 994/2001] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:27 2021] PUT /identity/v3/projects/276a36e6a97d46a78b7e483daa26cc2e/users/2cb2a59c7c9b4a13964c78ff0fb1a8f4/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:27.411407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.455663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.469018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353337e8-0b23-4f83-aefb-8ce3ad17c2ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.491786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc5041-06f1-4ba0-ab01-3d9cd1fc5371 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.497809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.498556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.498991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.499327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.500096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.502276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.580005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f08a0a-74a6-42ed-8c6c-7ceb33ebf61c tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.583938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f08a0a-74a6-42ed-8c6c-7ceb33ebf61c tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.583938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f08a0a-74a6-42ed-8c6c-7ceb33ebf61c tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.584234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f08a0a-74a6-42ed-8c6c-7ceb33ebf61c tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/projects/97a893144c7741b1b5fc3cf85aba03f8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.586556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f08a0a-74a6-42ed-8c6c-7ceb33ebf61c tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:get_project(project_id=97a893144c7741b1b5fc3cf85aba03f8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.590867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f08a0a-74a6-42ed-8c6c-7ceb33ebf61c tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.600976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1008/2002] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:27 2021] GET /identity/v3/projects/97a893144c7741b1b5fc3cf85aba03f8 => generated 371 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:27.603387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.603792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.604170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.640946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:27.644027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.653406 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 995/2003] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:27 2021] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:27.654365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.720108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1009/2004] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:27.730153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.732172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.739729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699e605-6ad9-426b-8995-d895b1cfe2e7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.744476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839d52-6d15-4a15-901b-0c282b002999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.745182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839d52-6d15-4a15-901b-0c282b002999 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.745465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839d52-6d15-4a15-901b-0c282b002999 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.745740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839d52-6d15-4a15-901b-0c282b002999 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.747010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839d52-6d15-4a15-901b-0c282b002999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.748927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839d52-6d15-4a15-901b-0c282b002999 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.794793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf0b88-44f9-49b2-8566-629c13877278 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.798589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.799224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.799500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.799771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.810126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.812664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.821609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1010/2005] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:07:27.822496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.823760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:27.836444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25643-520f-4071-bce0-542b072c3d4c service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.842516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.843906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.844013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.844326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] PATH_INFO: `/v3/projects/5b8384d3682348ec80110315f774ace0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.845663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8384d3682348ec80110315f774ace0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.847779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.904297 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 996/2006] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:27 2021] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:27.905726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd0d9-5fe4-4778-b136-3336ae466324 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.906014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd0d9-5fe4-4778-b136-3336ae466324 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.906313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd0d9-5fe4-4778-b136-3336ae466324 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.908059 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 997/2007] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:27.908738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd0d9-5fe4-4778-b136-3336ae466324 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:27.922567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd0d9-5fe4-4778-b136-3336ae466324 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:27.929632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:27.930301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:27.930590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:27.930858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:27.935929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:27.935929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:27.947519 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 998/2008] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:27 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:27.947519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:27.949518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.011188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8384d3682348ec80110315f774ace0', 'request_id': 'req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.025903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:28.083562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8384d3682348ec80110315f774ace0', 'request_id': 'req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.092759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8384d3682348ec80110315f774ace0', 'request_id': 'req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.097200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e2d40-4539-4a2c-8fa7-11ef74f2b779 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:28.115010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] The token cache is being invalidate because project 5b8384d3682348ec80110315f774ace0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:28.116957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.118180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.122131 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1011/2009] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:27 2021] DELETE /identity/v3/projects/5b8384d3682348ec80110315f774ace0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:28.123790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:28.130117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.192161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe363b4-b434-443e-a3d9-1c5927502756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:28.193064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe363b4-b434-443e-a3d9-1c5927502756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.193368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe363b4-b434-443e-a3d9-1c5927502756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.193669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe363b4-b434-443e-a3d9-1c5927502756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/projects/97a893144c7741b1b5fc3cf85aba03f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.196178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe363b4-b434-443e-a3d9-1c5927502756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:get_project(project_id=97a893144c7741b1b5fc3cf85aba03f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:28.199286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe363b4-b434-443e-a3d9-1c5927502756 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:28.203083 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 999/2010] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:27 2021] GET /identity/v3/projects/97a893144c7741b1b5fc3cf85aba03f8 => generated 371 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:28.204768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37281bd5-eba8-4909-8c92-930209cfa22d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.205298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37281bd5-eba8-4909-8c92-930209cfa22d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.205946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37281bd5-eba8-4909-8c92-930209cfa22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.226093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-37281bd5-eba8-4909-8c92-930209cfa22d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:28.227672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-37281bd5-eba8-4909-8c92-930209cfa22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.286280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8353a2-1e3e-4dfc-ab1d-60baa514e96c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:28.295219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:28.295925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.296209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.296487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.297299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:28.298919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:28.317632 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1012/2011] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:28 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:28.317632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:28.318630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.322683 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1000/2012] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:28.323522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37281bd5-eba8-4909-8c92-930209cfa22d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:28.336632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e707-7bd9-4410-ac94-4899f59b926b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:28.340083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37281bd5-eba8-4909-8c92-930209cfa22d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:28.342077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:28.343055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.343408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.343767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/users/ce0644480d484e74943f963b68f17773` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.346352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6b5ec-d4a5-4d27-bebd-c67916b9aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:28.347486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b5ec-d4a5-4d27-bebd-c67916b9aaf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.347917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b5ec-d4a5-4d27-bebd-c67916b9aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.348347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6b5ec-d4a5-4d27-bebd-c67916b9aaf8 admin admin] PATH_INFO: `/v3/projects/19a16dcc3c214ac2a218d3758e551792/users/491f06d5a64145919a6e4a9ec0fa9171/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.359211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ce0644480d484e74943f963b68f17773)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:28.361376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:28.365819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6b5ec-d4a5-4d27-bebd-c67916b9aaf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a16dcc3c214ac2a218d3758e551792, user_id=491f06d5a64145919a6e4a9ec0fa9171, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:28.369727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6b5ec-d4a5-4d27-bebd-c67916b9aaf8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:28.481820 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1001/2013] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:28 2021] PUT /identity/v3/projects/19a16dcc3c214ac2a218d3758e551792/users/491f06d5a64145919a6e4a9ec0fa9171/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:28.483297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996e6bd-1dfb-497c-af66-6994fbfd8a3b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.483582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996e6bd-1dfb-497c-af66-6994fbfd8a3b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.483865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996e6bd-1dfb-497c-af66-6994fbfd8a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.510642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6996e6bd-1dfb-497c-af66-6994fbfd8a3b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:28.512726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6996e6bd-1dfb-497c-af66-6994fbfd8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.516901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0644480d484e74943f963b68f17773'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.525667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0644480d484e74943f963b68f17773'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.546285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0644480d484e74943f963b68f17773'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.547229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0644480d484e74943f963b68f17773'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.578947 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1002/2014] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:28.579908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.580286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.580459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.611420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] MFA Rules not processed for user `491f06d5a64145919a6e4a9ec0fa9171`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:28.613086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.649270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0644480d484e74943f963b68f17773'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:28.665859 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1013/2015] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:28 2021] DELETE /identity/v3/users/ce0644480d484e74943f963b68f17773 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:28.666714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:28.673939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.724979 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1003/2016] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:28 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:28.724979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:28.726149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.776672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f7b01-6d51-4161-9eeb-6c6d67df17d5 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:28.781837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:28.782498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.782783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.783058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.783784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:28.784261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:28.785750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:28.799894 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1014/2017] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:28.800208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dfc25-77d2-41d0-a32e-352396260dd8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:28.800583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:28.809205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:28.824577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597ff95-470e-49d8-86af-dfaab1a4b970 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:28.828622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:28.829364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.829707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.830010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.830704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:28.832675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:28.892849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fad2166425045789dbb14eff24b5d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44b6ac9cd65a4182801ef4b028a2dd00', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:28.893773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:28.894679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:28.894966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] PATH_INFO: `/v3/projects/97a893144c7741b1b5fc3cf85aba03f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:28.896214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97a893144c7741b1b5fc3cf85aba03f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:28.898197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:29.003295 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1015/2018] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:28 2021] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:29.005230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:29.072614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a893144c7741b1b5fc3cf85aba03f8', 'request_id': 'req-824bb789-b76b-47d5-81df-1b019eb30ebc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:29.089209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a893144c7741b1b5fc3cf85aba03f8', 'request_id': 'req-824bb789-b76b-47d5-81df-1b019eb30ebc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:29.177692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a893144c7741b1b5fc3cf85aba03f8', 'request_id': 'req-824bb789-b76b-47d5-81df-1b019eb30ebc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:29.181643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d408e2-9aee-40d9-b913-416049f290a8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:29.194310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] The token cache is being invalidate because project 97a893144c7741b1b5fc3cf85aba03f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:29.194612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:29.195713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:29.206500 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1004/2019] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:28 2021] DELETE /identity/v3/projects/97a893144c7741b1b5fc3cf85aba03f8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:29.207538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:29.213984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:29.321651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89287b4-8711-48e8-9387-6f12ca5b270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:29.322268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89287b4-8711-48e8-9387-6f12ca5b270c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:29.324565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89287b4-8711-48e8-9387-6f12ca5b270c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:29.324565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89287b4-8711-48e8-9387-6f12ca5b270c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:29.324565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89287b4-8711-48e8-9387-6f12ca5b270c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:29.330314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89287b4-8711-48e8-9387-6f12ca5b270c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:29.334143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb789-b76b-47d5-81df-1b019eb30ebc tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:29.342450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:29.343241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:29.343664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:29.344042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:29.344842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:29.347131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:29.460721 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1005/2020] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:29 2021] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:29.460721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:29.465778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:29.468320 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1016/2021] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:29 2021] POST /identity/v3/projects => generated 383 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:29.470764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0cd3-9e1a-4a72-ab15-a8f002354043 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:29.472335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0cd3-9e1a-4a72-ab15-a8f002354043 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:29.477063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0cd3-9e1a-4a72-ab15-a8f002354043 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:29.482812 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1017/2022] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:07:29 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:29.483761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b0cd3-9e1a-4a72-ab15-a8f002354043 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:29.494431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd7ab8-7328-42cd-9631-727fc35fc945 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:29.641773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b0cd3-9e1a-4a72-ab15-a8f002354043 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:29.648569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:29.649676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:29.649965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:29.650286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:29.652626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:29.654304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:29.667196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:29.669545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:29.669545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:29.669545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] PATH_INFO: `/v3/users/d1f549341d2241c3bdc2c7db0996de7f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:29.671694 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1018/2023] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:29 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:29.672910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:29.674812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f549341d2241c3bdc2c7db0996de7f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:29.676592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:29.676975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:29.697030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915819d-3413-4708-9d45-0d30266cf888 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:29.703554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d81a-8b5b-4077-a369-09072dd924f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:29.704357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d81a-8b5b-4077-a369-09072dd924f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:29.704670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d81a-8b5b-4077-a369-09072dd924f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:29.704977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d81a-8b5b-4077-a369-09072dd924f3 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:29.705681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d81a-8b5b-4077-a369-09072dd924f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:29.707977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d81a-8b5b-4077-a369-09072dd924f3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:29.884209 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1019/2024] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:29 2021] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:29.884209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e321d-aca6-415c-bebb-67a33d66ef85 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:29.884209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e321d-aca6-415c-bebb-67a33d66ef85 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:29.884209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e321d-aca6-415c-bebb-67a33d66ef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:29.904727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fe0e321d-aca6-415c-bebb-67a33d66ef85 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:29.905966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fe0e321d-aca6-415c-bebb-67a33d66ef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:29.982746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1020/2025] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:07:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:29.983603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e321d-aca6-415c-bebb-67a33d66ef85 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:29.994100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e321d-aca6-415c-bebb-67a33d66ef85 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.002692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.002692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.002692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.002692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] PATH_INFO: `/v3/projects/d7258f2fc0e444fcb4f21e0eeb5d5190/users/a7350f5675474375a12edae74b625bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.022396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7258f2fc0e444fcb4f21e0eeb5d5190, user_id=a7350f5675474375a12edae74b625bb6, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.025279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.045063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f549341d2241c3bdc2c7db0996de7f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:30.052699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f549341d2241c3bdc2c7db0996de7f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:30.066719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f549341d2241c3bdc2c7db0996de7f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:30.067484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f549341d2241c3bdc2c7db0996de7f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:30.068742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53d15cfa-316a-4cd7-bcb5-504d338908fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f549341d2241c3bdc2c7db0996de7f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:30.141367 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1021/2026] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:29 2021] PUT /identity/v3/projects/d7258f2fc0e444fcb4f21e0eeb5d5190/users/a7350f5675474375a12edae74b625bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:30.142196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.144145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.170291 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1006/2027] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:29 2021] DELETE /identity/v3/users/d1f549341d2241c3bdc2c7db0996de7f => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:30.172222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.172681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.173144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.201935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] MFA Rules not processed for user `2cb2a59c7c9b4a13964c78ff0fb1a8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:30.203152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.218831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5ba27-bc64-4dc5-8672-6e30a5e8e389 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.275852 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1007/2028] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:30.277146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.278502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.281534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.282206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.282515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.282798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.283522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.285157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.298074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1022/2029] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:30.298074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.299945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.313705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0cffc-2219-475b-906a-0379e63133d6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.318451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20494c2-3322-4383-a946-aefcc789f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.319053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20494c2-3322-4383-a946-aefcc789f74b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.319337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20494c2-3322-4383-a946-aefcc789f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.319607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20494c2-3322-4383-a946-aefcc789f74b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.320333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20494c2-3322-4383-a946-aefcc789f74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.321951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20494c2-3322-4383-a946-aefcc789f74b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.332284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1023/2030] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:30.333926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.334043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.334238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.354345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:30.354675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa74024-89ce-4e93-992c-87a01c6bd3e2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.356146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.361160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.361974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.362119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.362397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.364021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1024/2031] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:30.364196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.364787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.366158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.379180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a444f7-27dc-45b9-aefd-49f0a921d8ea None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.382458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.384410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.385496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.386552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.386841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.387121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.387841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.389746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.396439 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1008/2032] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:30.397350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.407866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d824b0-916f-45b8-98aa-29550030914b service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.412621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.413307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.413593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.413870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.414603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.416394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.430060 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1009/2033] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:30.430932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.441180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e21e-e83b-43ce-a1ee-1a641fb110d3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.445942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.446837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.447119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.447419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] PATH_INFO: `/v3/projects/d7258f2fc0e444fcb4f21e0eeb5d5190/users/a7350f5675474375a12edae74b625bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.449776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7258f2fc0e444fcb4f21e0eeb5d5190, user_id=a7350f5675474375a12edae74b625bb6, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.452413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.465602 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1010/2034] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:30 2021] PUT /identity/v3/projects/d7258f2fc0e444fcb4f21e0eeb5d5190/users/a7350f5675474375a12edae74b625bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:30.466746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.468757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.527548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc2d5-dea8-47d7-bd08-d6975b166b32 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.531568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34036d40-5d5c-433e-9815-d747955a5714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.532375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036d40-5d5c-433e-9815-d747955a5714 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.532690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036d40-5d5c-433e-9815-d747955a5714 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.533138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34036d40-5d5c-433e-9815-d747955a5714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.595361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1025/2035] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:30 2021] POST /identity/v3/projects => generated 395 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:30.596693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.627616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34036d40-5d5c-433e-9815-d747955a5714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.629694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34036d40-5d5c-433e-9815-d747955a5714 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.643213 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1011/2036] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:30.644596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85820cd-7496-4410-a78a-8bd1ac182518 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.645025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85820cd-7496-4410-a78a-8bd1ac182518 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.645533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85820cd-7496-4410-a78a-8bd1ac182518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.690359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e555a-9036-409c-97a9-edc919712257 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.693642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b85820cd-7496-4410-a78a-8bd1ac182518 None None] MFA Rules not processed for user `a7350f5675474375a12edae74b625bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:30.695540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b85820cd-7496-4410-a78a-8bd1ac182518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.696495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c54642-e808-441e-b5d0-eafaf1c413b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.697561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54642-e808-441e-b5d0-eafaf1c413b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.701722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54642-e808-441e-b5d0-eafaf1c413b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.701722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54642-e808-441e-b5d0-eafaf1c413b8 admin admin] PATH_INFO: `/v3/projects/5ae48a7bfd2c426684ebd88425c0196d/users/2da9ca665ebe4438bf0ce7e8fb1fcd6f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.725658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c54642-e808-441e-b5d0-eafaf1c413b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae48a7bfd2c426684ebd88425c0196d, user_id=2da9ca665ebe4438bf0ce7e8fb1fcd6f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.728362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c54642-e808-441e-b5d0-eafaf1c413b8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.803668 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1012/2037] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:30.805194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85820cd-7496-4410-a78a-8bd1ac182518 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:30.816639 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1026/2038] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:30 2021] PUT /identity/v3/projects/5ae48a7bfd2c426684ebd88425c0196d/users/2da9ca665ebe4438bf0ce7e8fb1fcd6f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:30.818000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6bbc-c33c-484e-976e-01eaa753d248 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.818285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6bbc-c33c-484e-976e-01eaa753d248 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.818559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6bbc-c33c-484e-976e-01eaa753d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.819717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85820cd-7496-4410-a78a-8bd1ac182518 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:30.845177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dc5b6bbc-c33c-484e-976e-01eaa753d248 None None] MFA Rules not processed for user `491f06d5a64145919a6e4a9ec0fa9171`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:30.846446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dc5b6bbc-c33c-484e-976e-01eaa753d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.892987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:30.893752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.894047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.894324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.896852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:30.897090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:30.919439 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1027/2039] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:30.921411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b919-263d-4e40-a126-cae14e1808b7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:30.921907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b919-263d-4e40-a126-cae14e1808b7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:30.922411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b919-263d-4e40-a126-cae14e1808b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:30.960648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-02b7b919-263d-4e40-a126-cae14e1808b7 None None] MFA Rules not processed for user `2da9ca665ebe4438bf0ce7e8fb1fcd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:30.962253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-02b7b919-263d-4e40-a126-cae14e1808b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:30.996811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1013/2040] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:30 2021] POST /identity/v3/users => generated 304 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:30.996811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.006059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:31.036805 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1028/2041] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:31.036805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b919-263d-4e40-a126-cae14e1808b7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.052789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b919-263d-4e40-a126-cae14e1808b7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.059930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.060836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.061146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.061414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.062149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.063750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.080435 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1029/2042] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:31.081666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.093015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85df67-82a1-488e-aed7-d966d2303985 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.098391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.099340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.106474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.106474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.106474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.106474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.106860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d109fe2-5850-4404-a83a-e88eb003d658 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.114587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.115252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.115656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.116069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.118332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:31.129689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.131494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.140978 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1014/2043] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:30 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:31.141841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.151757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb426337-9887-4dc6-9897-950f5664f072 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.157244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.158150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.158435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.158727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] PATH_INFO: `/v3/projects/a886b036c6ea4b869569c99d144dc3cd/users/dd3fde87c98340b49ca655f503114dd8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.175775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a886b036c6ea4b869569c99d144dc3cd, user_id=dd3fde87c98340b49ca655f503114dd8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.178647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.241867 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1030/2044] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:31 2021] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:31.243523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.246533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:31.289509 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1015/2045] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:31 2021] PUT /identity/v3/projects/a886b036c6ea4b869569c99d144dc3cd/users/dd3fde87c98340b49ca655f503114dd8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:31.290711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.319984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4c6d4-0773-40c6-86de-9c7202f19084 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.370401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205e67f-f144-46d2-92a7-7b935612dc03 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.376583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.377393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.377752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.378102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.378886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.380905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.403767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.404785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.405142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.405439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] PATH_INFO: `/v3/projects/23e193382c4b432e88b5f1aedd95be4c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.407347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e193382c4b432e88b5f1aedd95be4c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.409941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.486636 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1016/2046] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:31 2021] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:31.487644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.500418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30647d5-aa42-4f7d-8d6d-29ef629814fb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.508550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.513796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.513796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.513796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.513796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.513796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.523024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1017/2047] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:31.523834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.533729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f90b36-b32b-4e26-9d84-921a87b5b115 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.538967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.539621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.539907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.540182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.540992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.542600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.552863 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1018/2048] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:31.553695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.563229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f897b4-7dad-45ac-8bae-75c738af9755 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.571927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e193382c4b432e88b5f1aedd95be4c', 'request_id': 'req-37a06c85-2be6-490e-8854-dc6765465539'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:31.620101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.620966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.621249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.621546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] PATH_INFO: `/v3/projects/a886b036c6ea4b869569c99d144dc3cd/users/dd3fde87c98340b49ca655f503114dd8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.623514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a886b036c6ea4b869569c99d144dc3cd, user_id=dd3fde87c98340b49ca655f503114dd8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.626206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.638471 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1019/2049] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:31 2021] PUT /identity/v3/projects/a886b036c6ea4b869569c99d144dc3cd/users/dd3fde87c98340b49ca655f503114dd8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:31.640273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.668947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e193382c4b432e88b5f1aedd95be4c', 'request_id': 'req-37a06c85-2be6-490e-8854-dc6765465539'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:31.687614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e193382c4b432e88b5f1aedd95be4c', 'request_id': 'req-37a06c85-2be6-490e-8854-dc6765465539'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:31.703380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] The token cache is being invalidate because project 23e193382c4b432e88b5f1aedd95be4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:31.703890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:31.704864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:31.707324 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1031/2050] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:31 2021] DELETE /identity/v3/projects/23e193382c4b432e88b5f1aedd95be4c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:31.714106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.716138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:31.720925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45259e21-7904-4e33-b085-d3ada3453009 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.725871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.726768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.727091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.727332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] PATH_INFO: `/v3/projects/0314c05027eb463c989a6a3ff7953906/users/f98bbaeffcce4e7e9656f8aa5919c3ed/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.729257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a06c85-2be6-490e-8854-dc6765465539 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.734257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.735243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.735529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.735886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] PATH_INFO: `/v3/users/8fad2166425045789dbb14eff24b5d84` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.737129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fad2166425045789dbb14eff24b5d84)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.739225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.749955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0314c05027eb463c989a6a3ff7953906, user_id=f98bbaeffcce4e7e9656f8aa5919c3ed, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.754823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.847116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1020/2051] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:31 2021] PUT /identity/v3/projects/0314c05027eb463c989a6a3ff7953906/users/f98bbaeffcce4e7e9656f8aa5919c3ed/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:31.853966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.856065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:31.953400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456eb7e-5be3-4aff-a865-874b681e1918 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.958742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.959422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.959740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:31.960519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:31.961362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:31.966261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:31.977708 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1021/2052] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:31.981947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:31.987333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fad2166425045789dbb14eff24b5d84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:31.992331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0890-239b-4821-af83-0763143f1505 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:31.996666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fad2166425045789dbb14eff24b5d84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:31.997958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec811-ae7e-4716-b56d-9b29a7fce228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:31.998857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec811-ae7e-4716-b56d-9b29a7fce228 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:31.999142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec811-ae7e-4716-b56d-9b29a7fce228 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:32.000732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec811-ae7e-4716-b56d-9b29a7fce228 admin admin] PATH_INFO: `/v3/projects/0314c05027eb463c989a6a3ff7953906/users/f98bbaeffcce4e7e9656f8aa5919c3ed/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:32.005171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec811-ae7e-4716-b56d-9b29a7fce228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0314c05027eb463c989a6a3ff7953906, user_id=f98bbaeffcce4e7e9656f8aa5919c3ed, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:32.005850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec811-ae7e-4716-b56d-9b29a7fce228 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:32.017034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fad2166425045789dbb14eff24b5d84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.017729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fad2166425045789dbb14eff24b5d84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.020785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1022/2053] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:31 2021] PUT /identity/v3/projects/0314c05027eb463c989a6a3ff7953906/users/f98bbaeffcce4e7e9656f8aa5919c3ed/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:32.032114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:32.035134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:32.035134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:32.069472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] MFA Rules not processed for user `f98bbaeffcce4e7e9656f8aa5919c3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:32.070987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:32.078304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fad2166425045789dbb14eff24b5d84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.097492 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1032/2054] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:31 2021] DELETE /identity/v3/users/8fad2166425045789dbb14eff24b5d84 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:32.157563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1023/2055] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:32 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:32.170174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:32.171848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:32.254365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec25ff-fae4-46ce-92ab-5ae98bd4ceeb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:32.262303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:32.262978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:32.263263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:32.263548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:32.326867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:32.328507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:32.343734 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1033/2056] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:32 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:32.453464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:32.454947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:32.526606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276d39-93e6-4f16-91aa-ebc2f325204f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:32.587297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:32.588189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:32.588478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:32.588751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] PATH_INFO: `/v3/users/2da9ca665ebe4438bf0ce7e8fb1fcd6f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:32.593513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da9ca665ebe4438bf0ce7e8fb1fcd6f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:32.593513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:32.693437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:32.697467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:32.748711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ba75b-49bd-4a10-b773-6a34ec688070 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:32.755077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:32.756047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:32.756456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:32.756626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] PATH_INFO: `/v3/projects/44b6ac9cd65a4182801ef4b028a2dd00` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:32.758017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b6ac9cd65a4182801ef4b028a2dd00)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:32.760523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:32.848102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da9ca665ebe4438bf0ce7e8fb1fcd6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.855388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da9ca665ebe4438bf0ce7e8fb1fcd6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.867811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da9ca665ebe4438bf0ce7e8fb1fcd6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.868678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da9ca665ebe4438bf0ce7e8fb1fcd6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.869440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ba618f8-2889-47d8-9008-54978054e9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da9ca665ebe4438bf0ce7e8fb1fcd6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.892243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b6ac9cd65a4182801ef4b028a2dd00', 'request_id': 'req-df9c4862-e920-4c84-ac97-03fafd7ba755'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:32.975961 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1024/2057] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:32 2021] DELETE /identity/v3/users/2da9ca665ebe4438bf0ce7e8fb1fcd6f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:32.980941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:32.981621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:32.981907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.007756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:33.009054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.071309 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1025/2058] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:33.073089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b6ac9cd65a4182801ef4b028a2dd00', 'request_id': 'req-df9c4862-e920-4c84-ac97-03fafd7ba755'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:33.085348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b6ac9cd65a4182801ef4b028a2dd00', 'request_id': 'req-df9c4862-e920-4c84-ac97-03fafd7ba755'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:33.086928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.088670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.097956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] The token cache is being invalidate because project 44b6ac9cd65a4182801ef4b028a2dd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:33.098319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:33.101139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df9c4862-e920-4c84-ac97-03fafd7ba755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:33.103350 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1034/2059] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:32 2021] DELETE /identity/v3/projects/44b6ac9cd65a4182801ef4b028a2dd00 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:33.112054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b96d2-eb15-4d7a-80b5-90536ea1cff9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.112657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b96d2-eb15-4d7a-80b5-90536ea1cff9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.112977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b96d2-eb15-4d7a-80b5-90536ea1cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.145821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5b2b96d2-eb15-4d7a-80b5-90536ea1cff9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:33.150796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5b2b96d2-eb15-4d7a-80b5-90536ea1cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.175217 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1035/2060] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:33.180856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e51a5e-f813-44f6-99c9-0e16bc8d8fd9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.184104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf89b9e-5c2e-4621-9b63-e4621a8e19b7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.184943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf89b9e-5c2e-4621-9b63-e4621a8e19b7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.185402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf89b9e-5c2e-4621-9b63-e4621a8e19b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.204897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.208991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.209347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.209634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.210337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7bf89b9e-5c2e-4621-9b63-e4621a8e19b7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:33.211578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7bf89b9e-5c2e-4621-9b63-e4621a8e19b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.214574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.220456 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1036/2061] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:33.224359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf89b9e-5c2e-4621-9b63-e4621a8e19b7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.228789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.231452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.240924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf89b9e-5c2e-4621-9b63-e4621a8e19b7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.253946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb20ce5-58a2-4970-b04b-a83591f76fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.256979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20ce5-58a2-4970-b04b-a83591f76fec admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.257538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20ce5-58a2-4970-b04b-a83591f76fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.257687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb20ce5-58a2-4970-b04b-a83591f76fec admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.258477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20ce5-58a2-4970-b04b-a83591f76fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:33.260017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20ce5-58a2-4970-b04b-a83591f76fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.265425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb20ce5-58a2-4970-b04b-a83591f76fec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.283382 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1026/2062] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:33.285074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1037/2063] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:07:33.289218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.311494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b66cf9-005c-428e-9bd4-19f3c240cd02 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.321635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.322325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.322614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.322890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.323615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.325943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.353624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e814-32d2-4d95-8f70-e2da0d30803e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.353827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e814-32d2-4d95-8f70-e2da0d30803e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.354081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493e814-32d2-4d95-8f70-e2da0d30803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.387225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c493e814-32d2-4d95-8f70-e2da0d30803e None None] MFA Rules not processed for user `dd3fde87c98340b49ca655f503114dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:33.391663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c493e814-32d2-4d95-8f70-e2da0d30803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.489205 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1038/2064] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:33 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:33.504477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1027/2065] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:33 2021] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:33.506521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.506818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.507101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.508584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.537348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] MFA Rules not processed for user `2cb2a59c7c9b4a13964c78ff0fb1a8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:33.540865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.591251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d3351-4a10-4de7-96d9-735d62cbff24 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.598971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.602963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.603918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.604516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.612651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.612651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.641643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1039/2066] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:33 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:33.653853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.655475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.706141 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1028/2067] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:33 2021] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:33.710394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.721293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85829d-34a7-434c-b502-a47116ca6461 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.727480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.728186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.728526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.728788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.729525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.737799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.753073 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1029/2068] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:33 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:33.757165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.769439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dae293-7e80-447a-8a7f-97b215ee6fa1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.775252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830934ac-6948-476c-bb0c-bbae120ca2c5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.776689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.778235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.778606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.778929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.779677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.781322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.782474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.783196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.783541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.783879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.786079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.794020 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1030/2069] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:07:33.798282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.800562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.802302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.807966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130d68-12bc-497e-b93e-91a78f314e1f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.813059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4452c-1d08-489d-b03b-f177854f2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.819136 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1040/2070] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:33 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:07:33.819484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4452c-1d08-489d-b03b-f177854f2280 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.819484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4452c-1d08-489d-b03b-f177854f2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.819484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4452c-1d08-489d-b03b-f177854f2280 admin admin] PATH_INFO: `/v3/projects/fafdb9a45c974eed9b6c025b8125943c/users/c90a664bf9f54c039725194bf05b5da7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.830683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4452c-1d08-489d-b03b-f177854f2280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafdb9a45c974eed9b6c025b8125943c, user_id=c90a664bf9f54c039725194bf05b5da7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.833557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4452c-1d08-489d-b03b-f177854f2280 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.889182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:33.890790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:33.914529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d473d7e-e555-4983-93fc-4970ef957a29 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:33.920990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:33.922036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.922357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.922694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] PATH_INFO: `/v3/projects/5ae48a7bfd2c426684ebd88425c0196d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:33.924121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae48a7bfd2c426684ebd88425c0196d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:33.926400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:33.941719 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1031/2071] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:33 2021] PUT /identity/v3/projects/fafdb9a45c974eed9b6c025b8125943c/users/c90a664bf9f54c039725194bf05b5da7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:33.968167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717092-0519-4cc1-bc1e-4dd9ca7e045a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:33.968167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717092-0519-4cc1-bc1e-4dd9ca7e045a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:33.968167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717092-0519-4cc1-bc1e-4dd9ca7e045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.001727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-53717092-0519-4cc1-bc1e-4dd9ca7e045a None None] MFA Rules not processed for user `c90a664bf9f54c039725194bf05b5da7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:34.002935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-53717092-0519-4cc1-bc1e-4dd9ca7e045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:34.069159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae48a7bfd2c426684ebd88425c0196d', 'request_id': 'req-f79d43b1-0086-4928-81e4-0c6eb6f305f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.094720 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1032/2072] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:33 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:34.101731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717092-0519-4cc1-bc1e-4dd9ca7e045a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:34.171704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae48a7bfd2c426684ebd88425c0196d', 'request_id': 'req-f79d43b1-0086-4928-81e4-0c6eb6f305f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.178436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717092-0519-4cc1-bc1e-4dd9ca7e045a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:34.181750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae48a7bfd2c426684ebd88425c0196d', 'request_id': 'req-f79d43b1-0086-4928-81e4-0c6eb6f305f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.197756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] The token cache is being invalidate because project 5ae48a7bfd2c426684ebd88425c0196d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:34.198315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.202061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.207683 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1041/2073] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:33 2021] DELETE /identity/v3/projects/5ae48a7bfd2c426684ebd88425c0196d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:34.210305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:34.213812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:34.249052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02269f33-be76-4161-838f-b6f774a6b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:34.249733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269f33-be76-4161-838f-b6f774a6b879 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:34.250014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269f33-be76-4161-838f-b6f774a6b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:34.250285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02269f33-be76-4161-838f-b6f774a6b879 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.250994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02269f33-be76-4161-838f-b6f774a6b879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:34.253093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02269f33-be76-4161-838f-b6f774a6b879 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:34.288554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d43b1-0086-4928-81e4-0c6eb6f305f4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:34.305308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:34.306257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:34.306538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:34.306808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] PATH_INFO: `/v3/users/f98bbaeffcce4e7e9656f8aa5919c3ed` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.308148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98bbaeffcce4e7e9656f8aa5919c3ed)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:34.310122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:34.350373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1033/2074] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:34 2021] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:34.351801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:34.352486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:34.352486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.370569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:34.374285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:34.432967 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1034/2075] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:34 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:34.433812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:34.435111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:34.505891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8f12b-429f-479e-bfed-21761c73a9a3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:34.511177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:34.514139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:34.514139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:34.514139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.514139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:34.515528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:34.549180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98bbaeffcce4e7e9656f8aa5919c3ed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.556497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98bbaeffcce4e7e9656f8aa5919c3ed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.568529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98bbaeffcce4e7e9656f8aa5919c3ed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.569280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98bbaeffcce4e7e9656f8aa5919c3ed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.611354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1035/2076] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:34 2021] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:34.611354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:34.613645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:34.624292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bce66-b910-4842-8b04-2e66fe8bf187 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:34.628003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:34.628653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:34.628819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98bbaeffcce4e7e9656f8aa5919c3ed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:34.629096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:34.629230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.630980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:34.635235 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1042/2077] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:34 2021] DELETE /identity/v3/users/f98bbaeffcce4e7e9656f8aa5919c3ed => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:34.640927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:34.642441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:34.662449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:34.663927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:34.672431 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1036/2078] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:34.747015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57140bcb-b285-4538-8a0f-ab60f107adaf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:34.753372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:34.754041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:34.754325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:34.754652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.755395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:34.757566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:34.768927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1043/2079] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:34 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:34.773148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:34.788700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e79224-768f-4065-a3e8-7d8acfcfa849 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:34.793406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:34.812778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:34.812778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:34.812778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] PATH_INFO: `/v3/projects/d2b70faa6e084b44938f53635330cee4/users/9b2d3ffabb854957b227c9c323ad0d86/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:34.814361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b70faa6e084b44938f53635330cee4, user_id=9b2d3ffabb854957b227c9c323ad0d86, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:34.817092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:34.968664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1037/2080] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:34 2021] PUT /identity/v3/projects/d2b70faa6e084b44938f53635330cee4/users/9b2d3ffabb854957b227c9c323ad0d86/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:34.969997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:34.981083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fe8c-3841-4ce0-9d51-3f068d7a2737 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.061391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450d9f9-e176-4f87-938c-c481b169b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.065515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d9f9-e176-4f87-938c-c481b169b9bf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.066209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d9f9-e176-4f87-938c-c481b169b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.066859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d9f9-e176-4f87-938c-c481b169b9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.069265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450d9f9-e176-4f87-938c-c481b169b9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.071855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450d9f9-e176-4f87-938c-c481b169b9bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.096634 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1044/2081] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:34 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:07:35.098249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.118035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229ee59-fa79-4f8c-b62e-82a5e8d3b594 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.125069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.125963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.126243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.126639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] PATH_INFO: `/v3/projects/d2b70faa6e084b44938f53635330cee4/users/9b2d3ffabb854957b227c9c323ad0d86/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.138886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b70faa6e084b44938f53635330cee4, user_id=9b2d3ffabb854957b227c9c323ad0d86, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.138886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.152925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1038/2082] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:35 2021] PUT /identity/v3/projects/d2b70faa6e084b44938f53635330cee4/users/9b2d3ffabb854957b227c9c323ad0d86/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:35.162122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a939b-6050-44ad-8a30-e1f83a5d8655 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.162308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a939b-6050-44ad-8a30-e1f83a5d8655 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.162607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a939b-6050-44ad-8a30-e1f83a5d8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.202697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-379a939b-6050-44ad-8a30-e1f83a5d8655 None None] MFA Rules not processed for user `9b2d3ffabb854957b227c9c323ad0d86`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:35.203916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-379a939b-6050-44ad-8a30-e1f83a5d8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.280175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.282554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.292643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1045/2083] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:35 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:35.299772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d840cdc-1e74-42f5-8034-004e03060788 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.300397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d840cdc-1e74-42f5-8034-004e03060788 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.300813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d840cdc-1e74-42f5-8034-004e03060788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.351993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9d840cdc-1e74-42f5-8034-004e03060788 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:35.353222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d840cdc-1e74-42f5-8034-004e03060788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.376028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676c7d-6800-4a04-81ec-1e2795d84592 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.381041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.382027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.382955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.383906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] PATH_INFO: `/v3/projects/0314c05027eb463c989a6a3ff7953906` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.385327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0314c05027eb463c989a6a3ff7953906)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.388133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.412055 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1046/2084] 10.222.0.37 () {58 vars in 1015 bytes} [Sat Dec 25 21:07:35 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:35.413216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d840cdc-1e74-42f5-8034-004e03060788 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.424976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d840cdc-1e74-42f5-8034-004e03060788 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.429715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.430466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.430831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.431055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.431692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:35.432068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.433771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.445529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1047/2085] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:35.446345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.447983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.461006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644bc1c-2bdf-45be-a751-a22f05947766 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.465266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.465895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.466178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.466453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.473673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.475078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.482926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1048/2086] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:35.483682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.494131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c2f9c-3763-4459-ab04-93a2c5cb0b85 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.499225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.499867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.500155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.500443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.501189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.503074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.534405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0314c05027eb463c989a6a3ff7953906', 'request_id': 'req-d8e1c772-3ab1-4702-95fd-e82142a2979d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:35.540908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0314c05027eb463c989a6a3ff7953906', 'request_id': 'req-d8e1c772-3ab1-4702-95fd-e82142a2979d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:35.661325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0314c05027eb463c989a6a3ff7953906', 'request_id': 'req-d8e1c772-3ab1-4702-95fd-e82142a2979d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:35.673933 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1049/2087] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:35 2021] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:35.675019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.686056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] The token cache is being invalidate because project 0314c05027eb463c989a6a3ff7953906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:35.686587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:35.687509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8e1c772-3ab1-4702-95fd-e82142a2979d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:35.689292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1039/2088] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:35 2021] DELETE /identity/v3/projects/0314c05027eb463c989a6a3ff7953906 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:35.695075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f382-c8d2-4769-961f-a75c90cf2c6a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.695596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f382-c8d2-4769-961f-a75c90cf2c6a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.696034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f382-c8d2-4769-961f-a75c90cf2c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.726934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a058f382-c8d2-4769-961f-a75c90cf2c6a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:35.728265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a058f382-c8d2-4769-961f-a75c90cf2c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.760492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e63c5-9eba-4b6b-be39-56241c9d2f82 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.766811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.767040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.767327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.767689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.768604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:35.769149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.776019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.786064 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1050/2089] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:35.831177 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1040/2090] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:35.838416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.839095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e929f-48a1-499c-a5d5-7bc05a8aafa3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.842817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e929f-48a1-499c-a5d5-7bc05a8aafa3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.842817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e929f-48a1-499c-a5d5-7bc05a8aafa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.843334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.862624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3a7e929f-48a1-499c-a5d5-7bc05a8aafa3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:35.863902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a7e929f-48a1-499c-a5d5-7bc05a8aafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.874745 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1041/2091] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:35.879014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e929f-48a1-499c-a5d5-7bc05a8aafa3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.892455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e929f-48a1-499c-a5d5-7bc05a8aafa3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.897697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.898892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.899238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.899553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.900276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:35.900702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.902314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.928137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1042/2092] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:35.929294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46802fa-a57f-470e-9ccd-d7f34c224a72 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.930859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:35.942314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c04e6-fbca-4a9e-bde0-f0467996fc75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.942981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c04e6-fbca-4a9e-bde0-f0467996fc75 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.945797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c04e6-fbca-4a9e-bde0-f0467996fc75 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.945797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c04e6-fbca-4a9e-bde0-f0467996fc75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.946048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e76f-de23-46ae-9397-7ab9a4d19061 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:35.946467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3d6c04e6-fbca-4a9e-bde0-f0467996fc75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:35.950780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:35.951458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:35.951737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:35.952108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:35.952831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.954862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.963510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c04e6-fbca-4a9e-bde0-f0467996fc75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:35.965376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c04e6-fbca-4a9e-bde0-f0467996fc75 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:35.988309 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1051/2093] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:35 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:36.003757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bbd05-97bb-4c34-a2c4-a24ee4e0590b None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.004032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bbd05-97bb-4c34-a2c4-a24ee4e0590b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.004308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bbd05-97bb-4c34-a2c4-a24ee4e0590b None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.006106 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1052/2094] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:07:36.011795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bbd05-97bb-4c34-a2c4-a24ee4e0590b None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:36.026475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bbd05-97bb-4c34-a2c4-a24ee4e0590b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.036390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bbd05-97bb-4c34-a2c4-a24ee4e0590b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.042361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.043740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.044017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.044287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/projects/a03f809592e74ac1b7696c8ce5985320` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.045515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:get_project(project_id=a03f809592e74ac1b7696c8ce5985320)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.047534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:36.049264 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1053/2095] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:36 2021] GET /identity/v3/projects/a03f809592e74ac1b7696c8ce5985320 => generated 361 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:07:36.098067 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1043/2096] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:35 2021] POST /identity/v3/projects => generated 395 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:36.101813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.123700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626b95-194f-4272-ae81-bc6d79fdf1bb tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.223068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.223726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.224005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.224276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.225128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.227042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:36.353226 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1054/2097] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:36 2021] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:36.357150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.368490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d327-cd7b-4f94-9dfd-e9355de6815c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.374507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.375411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.375835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.376265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.377239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.379179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:36.394585 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1044/2098] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:36.396145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.417319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed482f3-7bd7-4831-a74a-0af78b76b32a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.426469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84960f-17f8-40b2-b713-18cf609686f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.428985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84960f-17f8-40b2-b713-18cf609686f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.429438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84960f-17f8-40b2-b713-18cf609686f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.429949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84960f-17f8-40b2-b713-18cf609686f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.430820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84960f-17f8-40b2-b713-18cf609686f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.435359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84960f-17f8-40b2-b713-18cf609686f2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:36.475381 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1055/2099] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:36.476435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.482538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab8a87-ac47-434f-bdee-854cb73a76a9 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.483449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab8a87-ac47-434f-bdee-854cb73a76a9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.483737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab8a87-ac47-434f-bdee-854cb73a76a9 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.485633 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1056/2100] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:36.490457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bdc8e-b740-40d3-ac20-4bf9af95df97 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.492056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab8a87-ac47-434f-bdee-854cb73a76a9 None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:36.496245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffac8b-19ef-40c2-9f52-bfa1f74fdde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.497238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffac8b-19ef-40c2-9f52-bfa1f74fdde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.497743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffac8b-19ef-40c2-9f52-bfa1f74fdde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.498095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffac8b-19ef-40c2-9f52-bfa1f74fdde0 admin admin] PATH_INFO: `/v3/projects/f398b36b788e41059edfb2ffe167686a/users/46466f06288146e0820156cca41c54e0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.523032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffac8b-19ef-40c2-9f52-bfa1f74fdde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f398b36b788e41059edfb2ffe167686a, user_id=46466f06288146e0820156cca41c54e0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.524791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffac8b-19ef-40c2-9f52-bfa1f74fdde0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:36.655881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab8a87-ac47-434f-bdee-854cb73a76a9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.680102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1045/2101] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:36 2021] PUT /identity/v3/projects/f398b36b788e41059edfb2ffe167686a/users/46466f06288146e0820156cca41c54e0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:36.693495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a264a-d942-4844-84af-fac7e4a800f3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.694106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a264a-d942-4844-84af-fac7e4a800f3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.694106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a264a-d942-4844-84af-fac7e4a800f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.750168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4a3a264a-d942-4844-84af-fac7e4a800f3 None None] MFA Rules not processed for user `46466f06288146e0820156cca41c54e0`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:36.751486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4a3a264a-d942-4844-84af-fac7e4a800f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:36.764428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab8a87-ac47-434f-bdee-854cb73a76a9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.833946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.834804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.835093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.835727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/projects/a03f809592e74ac1b7696c8ce5985320` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.836823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:get_project(project_id=a03f809592e74ac1b7696c8ce5985320)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.839072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:36.841611 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1057/2102] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:36 2021] GET /identity/v3/projects/a03f809592e74ac1b7696c8ce5985320 => generated 361 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:36.847292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1046/2103] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:36 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:36.850524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.913841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a264a-d942-4844-84af-fac7e4a800f3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.926076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a264a-d942-4844-84af-fac7e4a800f3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.930972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.931631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.931915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.932190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.933099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:36.938773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.938773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:36.972360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe1272-87b9-47d9-8ced-7ab9098c7f1f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:36.980508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1047/2104] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:36.981229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:36.985816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:36.985937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:36.985937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:36.985937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:36.985937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:36.985937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.017579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f795a-fea7-4e5d-8b0a-24e7bdacea17 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.036010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.037495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.037495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.037495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.038971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.044046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.173007 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1048/2105] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:36 2021] POST /identity/v3/users => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:37.177141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:37.178443 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1058/2106] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:36 2021] POST /identity/v3/projects => generated 395 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:37.182251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:37.190522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9bcce-c501-43c1-8c9c-cc21c00e1a3f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.301702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438820-49cf-4614-b8ca-8ea35c956185 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.301921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716a655-f2f2-4967-b775-8796b1355153 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.303520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a655-f2f2-4967-b775-8796b1355153 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.303964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a655-f2f2-4967-b775-8796b1355153 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.304492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a655-f2f2-4967-b775-8796b1355153 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.305466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716a655-f2f2-4967-b775-8796b1355153 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:37.305881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716a655-f2f2-4967-b775-8796b1355153 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.307768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716a655-f2f2-4967-b775-8796b1355153 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.310083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.310993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.311282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.311562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.312323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.314544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.325392 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1049/2107] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:37.357174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9992-2427-41e1-9637-80e3b823bd4e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.358032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9992-2427-41e1-9637-80e3b823bd4e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.358315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9992-2427-41e1-9637-80e3b823bd4e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.365919 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1050/2108] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:07:37.368563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed9992-2427-41e1-9637-80e3b823bd4e None None] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:37.371706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5aed9992-2427-41e1-9637-80e3b823bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:37.456155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed9992-2427-41e1-9637-80e3b823bd4e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:37.466046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed9992-2427-41e1-9637-80e3b823bd4e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.475917 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1059/2109] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:37 2021] POST /identity/v3/users => generated 304 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:37.479252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:37.488440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.488440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.488440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.488801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/projects/a03f809592e74ac1b7696c8ce5985320` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.488801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:get_project(project_id=a03f809592e74ac1b7696c8ce5985320)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.488801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.490275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465264-7784-4538-8c76-a058c1011967 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.491275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1051/2110] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:37 2021] GET /identity/v3/projects/a03f809592e74ac1b7696c8ce5985320 => generated 361 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:37.495337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.496625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.496940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.497229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.497967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.499654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.514036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1060/2111] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:07:37.515243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:37.541073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043e70-004d-4feb-bda6-34422a4a9533 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.550356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.551589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.552173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.568231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] PATH_INFO: `/v3/projects/59f2ae6451564e5fadef03f6c93c4972/users/ce60804ec0934f5095a0356f8880908e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.596746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f2ae6451564e5fadef03f6c93c4972, user_id=ce60804ec0934f5095a0356f8880908e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.601211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.718079 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1052/2112] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:37 2021] PUT /identity/v3/projects/59f2ae6451564e5fadef03f6c93c4972/users/ce60804ec0934f5095a0356f8880908e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:37.722051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:37.732744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922819d-bde6-4875-80f9-2c6ff615d3af admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.804410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11663e-b8fa-459e-8661-84ab0e4f349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.805117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11663e-b8fa-459e-8661-84ab0e4f349a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.805397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11663e-b8fa-459e-8661-84ab0e4f349a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.805668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11663e-b8fa-459e-8661-84ab0e4f349a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.806548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11663e-b8fa-459e-8661-84ab0e4f349a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.808904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11663e-b8fa-459e-8661-84ab0e4f349a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.828185 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1061/2113] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:37 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:37.832328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:37.865738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c84c0e-0b49-4913-9ef3-650e5b9f360f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:37.872555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5b1bd-a3f3-4daf-bb13-8a9fbe961cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:37.873820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b1bd-a3f3-4daf-bb13-8a9fbe961cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.874118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b1bd-a3f3-4daf-bb13-8a9fbe961cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.874486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b1bd-a3f3-4daf-bb13-8a9fbe961cf9 admin admin] PATH_INFO: `/v3/projects/59f2ae6451564e5fadef03f6c93c4972/users/ce60804ec0934f5095a0356f8880908e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.876574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5b1bd-a3f3-4daf-bb13-8a9fbe961cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f2ae6451564e5fadef03f6c93c4972, user_id=ce60804ec0934f5095a0356f8880908e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:37.879669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5b1bd-a3f3-4daf-bb13-8a9fbe961cf9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:37.890790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1053/2114] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:37 2021] PUT /identity/v3/projects/59f2ae6451564e5fadef03f6c93c4972/users/ce60804ec0934f5095a0356f8880908e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:37.901402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:37.902303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:37.902651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:37.931457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] MFA Rules not processed for user `ce60804ec0934f5095a0356f8880908e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:37.932672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:38.027633 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1062/2115] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:37 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:38.071468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403dd6f-fe40-48fd-9497-b4df3df3f2ae None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:38.071772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403dd6f-fe40-48fd-9497-b4df3df3f2ae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:38.072051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403dd6f-fe40-48fd-9497-b4df3df3f2ae None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:38.074317 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1054/2116] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:38.082315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:38.173615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:38.254136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db98162-d9b2-43ad-aaf5-d85b28685679 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:38.260989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:38.275327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:38.275829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:38.276316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/projects/a03f809592e74ac1b7696c8ce5985320` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:38.276737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403dd6f-fe40-48fd-9497-b4df3df3f2ae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:38.279480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:get_project(project_id=a03f809592e74ac1b7696c8ce5985320)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:38.281971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:38.284930 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1063/2117] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:38 2021] GET /identity/v3/projects/a03f809592e74ac1b7696c8ce5985320 => generated 361 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:38.296526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403dd6f-fe40-48fd-9497-b4df3df3f2ae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:38.303877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:38.305776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:38.306100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:38.306379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:38.324907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:38.337259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:38.339154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:38.344944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c590eed-dfaa-4fbe-abc9-52cf8fe9fcb6 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:38.352687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1055/2118] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:38 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:07:38.370861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:38.370861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:38.370861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:38.371605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/users/98f0ed9507fe4086aeb305c6222fa588` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:38.384802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:delete_user(user_id=98f0ed9507fe4086aeb305c6222fa588)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:38.388726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:38.578116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f0ed9507fe4086aeb305c6222fa588'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:38.604631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f0ed9507fe4086aeb305c6222fa588'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:38.639344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f0ed9507fe4086aeb305c6222fa588'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:38.645228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f0ed9507fe4086aeb305c6222fa588'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:38.837568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f0ed9507fe4086aeb305c6222fa588'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:38.848651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:38.850843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1064/2119] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:38 2021] DELETE /identity/v3/users/98f0ed9507fe4086aeb305c6222fa588 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:38.878566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3669131-20a0-4202-b346-a74272fb0165 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:38.967514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2d3ffabb854957b227c9c323ad0d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2b70faa6e084b44938f53635330cee4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:38.968398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:38.968680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:38.969029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] PATH_INFO: `/v3/projects/a03f809592e74ac1b7696c8ce5985320` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:38.973936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a03f809592e74ac1b7696c8ce5985320)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:38.975899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:39.184455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03f809592e74ac1b7696c8ce5985320', 'request_id': 'req-56c88057-e80a-4afc-b612-1bf9839eba07'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.191444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03f809592e74ac1b7696c8ce5985320', 'request_id': 'req-56c88057-e80a-4afc-b612-1bf9839eba07'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.287021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03f809592e74ac1b7696c8ce5985320', 'request_id': 'req-56c88057-e80a-4afc-b612-1bf9839eba07'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.305696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] The token cache is being invalidate because project a03f809592e74ac1b7696c8ce5985320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:39.305969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.306644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.309367 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1056/2120] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:38 2021] DELETE /identity/v3/projects/a03f809592e74ac1b7696c8ce5985320 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:39.314503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:39.316258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:39.402588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aa921-793f-42ba-be74-d88c1654e753 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:39.463880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:39.464820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:39.465114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:39.465393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] PATH_INFO: `/v3/users/c90a664bf9f54c039725194bf05b5da7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:39.467683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90a664bf9f54c039725194bf05b5da7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:39.470535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:39.516140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:39.517617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:39.613845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c88057-e80a-4afc-b612-1bf9839eba07 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:39.624179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:39.624951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:39.625307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:39.625708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:39.628190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:39.692297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:39.694057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:39.704294 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1057/2121] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:39 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:39.722625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:39.727808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:39.738497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90a664bf9f54c039725194bf05b5da7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.747024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90a664bf9f54c039725194bf05b5da7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.747947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bd640-4df3-46e1-90ed-50cf125b5b94 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:39.755134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:39.756475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:39.756762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:39.757077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] PATH_INFO: `/v3/users/46466f06288146e0820156cca41c54e0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:39.758618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46466f06288146e0820156cca41c54e0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:39.760526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:39.761529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90a664bf9f54c039725194bf05b5da7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.762238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90a664bf9f54c039725194bf05b5da7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.900450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39a24aee-ff49-40e4-b06a-dc215fb6fb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90a664bf9f54c039725194bf05b5da7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:39.912729 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1065/2122] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:39 2021] DELETE /identity/v3/users/c90a664bf9f54c039725194bf05b5da7 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:39.916862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:39.917211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:39.917984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:39.964558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:39.965894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:40.099440 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1066/2123] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:40.102718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46466f06288146e0820156cca41c54e0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:40.121230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46466f06288146e0820156cca41c54e0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:40.121320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:40.121320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:40.167814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46466f06288146e0820156cca41c54e0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:40.168598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46466f06288146e0820156cca41c54e0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:40.169208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1eefd44-77cd-4eae-95b1-6e2ddce1d1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46466f06288146e0820156cca41c54e0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:40.255187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91698d3e-ca0c-48ed-ae99-650bfbd7ad0e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:40.261745 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1058/2124] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:39 2021] DELETE /identity/v3/users/46466f06288146e0820156cca41c54e0 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:40.262758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:40.263663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:40.264146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:40.264662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:40.267101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:40.268043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d198-6d82-4cb1-8209-65075c2c1f99 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:40.268346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d198-6d82-4cb1-8209-65075c2c1f99 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:40.268629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858d198-6d82-4cb1-8209-65075c2c1f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:40.285010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:40.287436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:40.311829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c858d198-6d82-4cb1-8209-65075c2c1f99 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:40.313433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c858d198-6d82-4cb1-8209-65075c2c1f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:40.313546 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1067/2125] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:40.415784 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1059/2126] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:40.425769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:40.427308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:40.438725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361aa6-e6ed-4e9b-bdf7-8bea2e0aa2fa service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:40.513876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:40.515861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:40.516160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:40.516439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:40.522675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb100-b5d6-40a4-95d0-21c4e580b725 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:40.522970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb100-b5d6-40a4-95d0-21c4e580b725 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:40.523238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb100-b5d6-40a4-95d0-21c4e580b725 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:40.526225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1060/2127] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:07:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:40.541916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:40.541916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:40.544097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:40.544389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:40.544664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:40.582882 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1068/2128] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:40.593757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:40.611199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:40.739514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1061/2129] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:07:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:41.283635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:41.285490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:41.313615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83f4af-f356-4182-bc2c-9c7456c86ee1 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:41.320909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:41.321865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:41.322250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:41.322595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] PATH_INFO: `/v3/projects/fafdb9a45c974eed9b6c025b8125943c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:41.324988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafdb9a45c974eed9b6c025b8125943c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:41.327023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:41.352731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:41.354359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:41.388718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebf5e8-b870-4d4d-8023-7eff9a55a0a7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:41.407920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:41.408806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:41.409124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:41.409463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] PATH_INFO: `/v3/users/794e95912b7b498d8759122f2e84757b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:41.411730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=794e95912b7b498d8759122f2e84757b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:41.413864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:41.566788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafdb9a45c974eed9b6c025b8125943c', 'request_id': 'req-005673a9-325e-48a6-aae1-3729737d113d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.729124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafdb9a45c974eed9b6c025b8125943c', 'request_id': 'req-005673a9-325e-48a6-aae1-3729737d113d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.735944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafdb9a45c974eed9b6c025b8125943c', 'request_id': 'req-005673a9-325e-48a6-aae1-3729737d113d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.760981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] The token cache is being invalidate because project fafdb9a45c974eed9b6c025b8125943c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:41.761974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.762637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.765101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1069/2130] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:41 2021] DELETE /identity/v3/projects/fafdb9a45c974eed9b6c025b8125943c => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:41.765908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:41.767248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:41.771435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794e95912b7b498d8759122f2e84757b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.786112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794e95912b7b498d8759122f2e84757b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.805422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794e95912b7b498d8759122f2e84757b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.806135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794e95912b7b498d8759122f2e84757b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.806831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794e95912b7b498d8759122f2e84757b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:41.848096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005673a9-325e-48a6-aae1-3729737d113d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:41.857178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:41.858365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:41.858853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:41.859345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:41.863509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:41.877873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:41.879565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:41.890956 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1070/2131] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:41.891771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:41.893120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:41.915939 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1062/2132] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:41 2021] DELETE /identity/v3/users/794e95912b7b498d8759122f2e84757b => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:41.917150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:41.918839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:41.986561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8515-06ff-4306-bb82-e804c3ed32f3 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:42.031124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2df6-e498-4bdb-95be-d8373bd535fe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:42.035892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:42.036847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:42.037102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:42.037378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] PATH_INFO: `/v3/users/9b2d3ffabb854957b227c9c323ad0d86` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:42.038589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2d3ffabb854957b227c9c323ad0d86)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:42.040488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:42.056953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:42.058692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:42.059116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:42.059445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] PATH_INFO: `/v3/projects/f398b36b788e41059edfb2ffe167686a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:42.060974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f398b36b788e41059edfb2ffe167686a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:42.067890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:42.258741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f398b36b788e41059edfb2ffe167686a', 'request_id': 'req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.388426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f398b36b788e41059edfb2ffe167686a', 'request_id': 'req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.395271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f398b36b788e41059edfb2ffe167686a', 'request_id': 'req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.405138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2d3ffabb854957b227c9c323ad0d86'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.416553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] The token cache is being invalidate because project f398b36b788e41059edfb2ffe167686a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:42.416849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.417228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2d3ffabb854957b227c9c323ad0d86'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.418148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7f1de87-d1e1-46bc-bf6d-91eca8b6602d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.422225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1071/2133] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:41 2021] DELETE /identity/v3/projects/f398b36b788e41059edfb2ffe167686a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:42.423457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:42.423739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:42.430990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:42.433514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2d3ffabb854957b227c9c323ad0d86'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.434231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2d3ffabb854957b227c9c323ad0d86'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.434989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2d3ffabb854957b227c9c323ad0d86'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:42.450830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:42.452130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:42.526010 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1072/2134] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:42.529972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:42.531403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:42.556030 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1063/2135] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:41 2021] DELETE /identity/v3/users/9b2d3ffabb854957b227c9c323ad0d86 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:42.561143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:42.561143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:42.562681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcce2b-402d-401e-bfc0-ee040ba8c262 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:42.659086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c02aee-6b5a-4042-a6fb-e97cc13a586d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:42.669225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:42.669889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:42.670167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:42.670446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:42.706268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:42.708181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:42.716070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:42.717231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] PATH_INFO: `/v3/users/ce60804ec0934f5095a0356f8880908e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:42.720419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce60804ec0934f5095a0356f8880908e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:42.727979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:42.776127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:42.776615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:42.801102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1064/2136] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:43.002391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce60804ec0934f5095a0356f8880908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.009129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce60804ec0934f5095a0356f8880908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.021607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce60804ec0934f5095a0356f8880908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.022834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce60804ec0934f5095a0356f8880908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.128867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce60804ec0934f5095a0356f8880908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.137337 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1073/2137] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:42 2021] DELETE /identity/v3/users/ce60804ec0934f5095a0356f8880908e => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:43.436186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:43.437833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:43.457361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2e327-8358-4298-965b-22a955f7bd52 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:43.494314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:43.496531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:43.590802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:43.591764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:43.592172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:43.592540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] PATH_INFO: `/v3/projects/d2b70faa6e084b44938f53635330cee4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:43.593975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b70faa6e084b44938f53635330cee4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:43.596265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:43.640868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43408f87-1473-4602-9be1-d7aa7bca86df admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:43.648303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:43.649323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:43.649599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:43.649892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] PATH_INFO: `/v3/projects/9697a905274848f580547bda94732a8c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:43.651078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9697a905274848f580547bda94732a8c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:43.653581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:43.878794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b70faa6e084b44938f53635330cee4', 'request_id': 'req-a8ee1dd6-bbdc-453d-9019-6423c45926bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.888803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b70faa6e084b44938f53635330cee4', 'request_id': 'req-a8ee1dd6-bbdc-453d-9019-6423c45926bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.892387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9697a905274848f580547bda94732a8c', 'request_id': 'req-3a2ba02d-9236-4a8a-8896-a763c9007d3a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.974590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b70faa6e084b44938f53635330cee4', 'request_id': 'req-a8ee1dd6-bbdc-453d-9019-6423c45926bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.985198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] The token cache is being invalidate because project d2b70faa6e084b44938f53635330cee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:43.985480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.986116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:43.987784 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1065/2138] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:43 2021] DELETE /identity/v3/projects/d2b70faa6e084b44938f53635330cee4 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:43.988380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:43.989686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.054646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9697a905274848f580547bda94732a8c', 'request_id': 'req-3a2ba02d-9236-4a8a-8896-a763c9007d3a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.059612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee1dd6-bbdc-453d-9019-6423c45926bd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:44.061828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9697a905274848f580547bda94732a8c', 'request_id': 'req-3a2ba02d-9236-4a8a-8896-a763c9007d3a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.072618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] The token cache is being invalidate because project 9697a905274848f580547bda94732a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:44.073232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.074393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a2ba02d-9236-4a8a-8896-a763c9007d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.076091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1074/2139] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:43 2021] DELETE /identity/v3/projects/9697a905274848f580547bda94732a8c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:07:44.080058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e825a-929d-4348-9446-00964893c8cd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.080058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e825a-929d-4348-9446-00964893c8cd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.080377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e825a-929d-4348-9446-00964893c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.099110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-628e825a-929d-4348-9446-00964893c8cd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:44.100296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-628e825a-929d-4348-9446-00964893c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.136153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:44.137067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.137352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.137734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] PATH_INFO: `/v3/projects/59f2ae6451564e5fadef03f6c93c4972` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.138856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f2ae6451564e5fadef03f6c93c4972)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:44.140761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:44.174683 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1075/2140] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:44.174683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e825a-929d-4348-9446-00964893c8cd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:44.176836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-628e825a-929d-4348-9446-00964893c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.190184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e825a-929d-4348-9446-00964893c8cd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:44.195653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:44.196586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.196978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.197214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] PATH_INFO: `/v3/users/c08edeb29c954c83807b5d02cd9c4d10` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.198755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08edeb29c954c83807b5d02cd9c4d10)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:44.200683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:44.314600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f2ae6451564e5fadef03f6c93c4972', 'request_id': 'req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.320661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f2ae6451564e5fadef03f6c93c4972', 'request_id': 'req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.417266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f2ae6451564e5fadef03f6c93c4972', 'request_id': 'req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.434589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08edeb29c954c83807b5d02cd9c4d10'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.435813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] The token cache is being invalidate because project 59f2ae6451564e5fadef03f6c93c4972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:44.435813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.436642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bfbd67f-eac8-461d-8ef2-e8933eb5e8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.438878 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1066/2141] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:43 2021] DELETE /identity/v3/projects/59f2ae6451564e5fadef03f6c93c4972 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:44.440347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.440821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.441314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.449335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08edeb29c954c83807b5d02cd9c4d10'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.461849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08edeb29c954c83807b5d02cd9c4d10'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.462555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08edeb29c954c83807b5d02cd9c4d10'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.474954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:44.476599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.536957 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1067/2142] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:44.540145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:44.540145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.551791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c88b4b-0256-44a7-b974-97eb03c5f248 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:44.556462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:44.557364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.557645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.557940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] PATH_INFO: `/v3/users/cadb0831770246a49a9aac30067fa14f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.559244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cadb0831770246a49a9aac30067fa14f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:44.561518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:44.571145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19d37695-d2c6-4262-a431-b8c90f0c8807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08edeb29c954c83807b5d02cd9c4d10'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.580789 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1076/2143] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:44 2021] DELETE /identity/v3/users/c08edeb29c954c83807b5d02cd9c4d10 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:44.582557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.583059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.584215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.606904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:44.608078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.678740 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1077/2144] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:44.679944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:44.681347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.693486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786744b-6e81-4fe5-9167-d9aa4e7ca65b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:44.698210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d362f3-9f90-4a00-bfd9-7b4c658ba1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:44.699698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d362f3-9f90-4a00-bfd9-7b4c658ba1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.699976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d362f3-9f90-4a00-bfd9-7b4c658ba1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.700248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d362f3-9f90-4a00-bfd9-7b4c658ba1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.701008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d362f3-9f90-4a00-bfd9-7b4c658ba1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:44.701316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d362f3-9f90-4a00-bfd9-7b4c658ba1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:44.702900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d362f3-9f90-4a00-bfd9-7b4c658ba1d5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:44.714755 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1078/2145] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:44.716367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d86be-737c-4fce-98f5-6f30400a0b4c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.716660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d86be-737c-4fce-98f5-6f30400a0b4c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.716962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d86be-737c-4fce-98f5-6f30400a0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.735812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-824d86be-737c-4fce-98f5-6f30400a0b4c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:44.737090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-824d86be-737c-4fce-98f5-6f30400a0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.747434 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1079/2146] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:44.748433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d86be-737c-4fce-98f5-6f30400a0b4c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:44.751563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cadb0831770246a49a9aac30067fa14f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.759310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cadb0831770246a49a9aac30067fa14f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.760118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d86be-737c-4fce-98f5-6f30400a0b4c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:44.774147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:44.775630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cadb0831770246a49a9aac30067fa14f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.775872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:44.776361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:44.776600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cadb0831770246a49a9aac30067fa14f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.777078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:44.779020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cadb0831770246a49a9aac30067fa14f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:44.779140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:44.780094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:44.897821 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1068/2147] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:44 2021] DELETE /identity/v3/users/cadb0831770246a49a9aac30067fa14f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:44.899110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:44.899934 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1080/2148] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:44 2021] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:44.901183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:44.901445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.904198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:44.988636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6cf59-10d9-4e2f-b635-1dbdca28f5e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:44.993056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106d6c-9442-4da4-9f45-c67ef2508349 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:44.999041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ad7a4-c8fb-40a9-8db2-9b4cfb5f9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:44.999908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ad7a4-c8fb-40a9-8db2-9b4cfb5f9ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.000617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ad7a4-c8fb-40a9-8db2-9b4cfb5f9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.000703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ad7a4-c8fb-40a9-8db2-9b4cfb5f9ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.001713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ad7a4-c8fb-40a9-8db2-9b4cfb5f9ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:45.002110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ad7a4-c8fb-40a9-8db2-9b4cfb5f9ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.003106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.003938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.004284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.004738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ad7a4-c8fb-40a9-8db2-9b4cfb5f9ae2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.004861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.045597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.045597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.046216 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1069/2149] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:45.046216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cc525-adb3-4db9-908c-e88f3f93f286 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.046216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cc525-adb3-4db9-908c-e88f3f93f286 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.046216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cc525-adb3-4db9-908c-e88f3f93f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.048701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0e0cc525-adb3-4db9-908c-e88f3f93f286 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:45.050110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0e0cc525-adb3-4db9-908c-e88f3f93f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:45.063967 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1070/2150] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:45.063967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cc525-adb3-4db9-908c-e88f3f93f286 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.071183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cc525-adb3-4db9-908c-e88f3f93f286 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.077238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.077986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.078330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.078609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.079301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.081200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.178036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1081/2151] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:44 2021] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:45.180582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.180923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:45.237777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604243f-96a8-4745-b77e-5e67f4476624 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.241462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.242102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.242382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.242655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.252410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.253965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.263747 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1082/2152] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:45.264732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.266169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:45.279528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461105-9be7-4d74-8b5a-4d0517da49aa service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.284867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.285826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.286108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.286381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] PATH_INFO: `/v3/projects/d00d8ea258804fb5a933e1b5b0371e7f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.287596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00d8ea258804fb5a933e1b5b0371e7f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.289674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.507262 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1071/2153] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:45 2021] POST /identity/v3/projects => generated 371 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:45.508704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.575842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00d8ea258804fb5a933e1b5b0371e7f', 'request_id': 'req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:45.582038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5868c6-c06a-47c5-948a-872e5d7c7e09 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.665898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.666646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.667042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.668048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.669482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00d8ea258804fb5a933e1b5b0371e7f', 'request_id': 'req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:45.673363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.673363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.679441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00d8ea258804fb5a933e1b5b0371e7f', 'request_id': 'req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:45.682831 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1072/2154] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:45 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:45.683780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.694272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] The token cache is being invalidate because project d00d8ea258804fb5a933e1b5b0371e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:45.695570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46348c2-7112-4a8d-bd7c-e5210f3cdec6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.695725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:45.695725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:45.697937 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1083/2155] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:45 2021] DELETE /identity/v3/projects/d00d8ea258804fb5a933e1b5b0371e7f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:45.699509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.701898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:45.704627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea2ae0-8584-455a-a2dc-030485cbeb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.705787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2ae0-8584-455a-a2dc-030485cbeb08 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.706231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2ae0-8584-455a-a2dc-030485cbeb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.706518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea2ae0-8584-455a-a2dc-030485cbeb08 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.707490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea2ae0-8584-455a-a2dc-030485cbeb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.709618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea2ae0-8584-455a-a2dc-030485cbeb08 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.725925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f301e-ccfb-4b48-b1aa-693d5a80bb5e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.733055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad228d-2138-416a-bc51-e3f6c81dcda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.733765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad228d-2138-416a-bc51-e3f6c81dcda1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.734386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad228d-2138-416a-bc51-e3f6c81dcda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.734663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad228d-2138-416a-bc51-e3f6c81dcda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.735505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad228d-2138-416a-bc51-e3f6c81dcda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.747359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad228d-2138-416a-bc51-e3f6c81dcda1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.766758 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1084/2156] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:45 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:45.766758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c29fa-8c2e-42e8-9672-374415290de9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.766758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c29fa-8c2e-42e8-9672-374415290de9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.766758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c29fa-8c2e-42e8-9672-374415290de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.787597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ad4c29fa-8c2e-42e8-9672-374415290de9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:45.789341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ad4c29fa-8c2e-42e8-9672-374415290de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:45.803547 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1085/2157] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:45.803547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c29fa-8c2e-42e8-9672-374415290de9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.821698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c29fa-8c2e-42e8-9672-374415290de9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.841832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.843054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.843340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.843615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df/users/0b5347862d6b49aaa8c48e883187d1db/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.870630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096b5278e40e405bac0dc56dbeb706df, user_id=0b5347862d6b49aaa8c48e883187d1db, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.874130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:45.881616 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1073/2158] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:45 2021] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:45.883437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.883886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.884256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.927304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:45.928989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:45.943151 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1074/2159] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:45.950606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.950606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:45.960917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1928a9-b011-4c92-9f43-b8f44daf4279 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:45.977232 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1086/2160] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:45 2021] PUT /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df/users/0b5347862d6b49aaa8c48e883187d1db/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:45.977232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:45.991822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553084d-31b0-4f33-8061-7adff1c6e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:45.992500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553084d-31b0-4f33-8061-7adff1c6e3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:45.992777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553084d-31b0-4f33-8061-7adff1c6e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:45.993078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553084d-31b0-4f33-8061-7adff1c6e3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:45.994905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553084d-31b0-4f33-8061-7adff1c6e3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:45.998007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553084d-31b0-4f33-8061-7adff1c6e3f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.031041 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1075/2161] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:45 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:46.032425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb8297-51d6-43a5-b436-30aee7dbff70 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.043103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb8297-51d6-43a5-b436-30aee7dbff70 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.043644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb8297-51d6-43a5-b436-30aee7dbff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.079383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f7eb8297-51d6-43a5-b436-30aee7dbff70 None None] MFA Rules not processed for user `0b5347862d6b49aaa8c48e883187d1db`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:46.081110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f7eb8297-51d6-43a5-b436-30aee7dbff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:46.101833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda87bf-1706-4624-8206-2649c4e998f0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.106962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.109045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.109045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.109045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.109321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:46.109481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.111318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.127821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1087/2162] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:46.127821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.141745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faedf1-b6bc-4389-9aea-1237f6d7c477 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.158407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.159721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.160005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.160280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.161931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.163768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.173096 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1076/2163] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:46 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:46.177385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb8297-51d6-43a5-b436-30aee7dbff70 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.188675 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1088/2164] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:46.190149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.191695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:46.193708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb8297-51d6-43a5-b436-30aee7dbff70 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.206291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33dd0b-808e-4b65-99b9-a97f0ada660d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.212133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.213324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.213682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.214029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] PATH_INFO: `/v3/projects/45c9d7948afa49e5bc0261e1f17180f7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.214994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.215475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c9d7948afa49e5bc0261e1f17180f7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.217147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.217560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.217768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.218329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.219951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.222887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.315313 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1077/2165] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:46 2021] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:46.316005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.389820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ff91-86eb-4f5d-976f-93c7c6359caf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.393466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c9d7948afa49e5bc0261e1f17180f7', 'request_id': 'req-17fd9bc4-a658-447a-8187-4e1ffb8e4944'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:46.471041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.471702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.471991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.472255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.472985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.475100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.531786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c9d7948afa49e5bc0261e1f17180f7', 'request_id': 'req-17fd9bc4-a658-447a-8187-4e1ffb8e4944'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:46.540184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c9d7948afa49e5bc0261e1f17180f7', 'request_id': 'req-17fd9bc4-a658-447a-8187-4e1ffb8e4944'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:46.558956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] The token cache is being invalidate because project 45c9d7948afa49e5bc0261e1f17180f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:46.558956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:46.558956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:46.561030 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1089/2166] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:46 2021] DELETE /identity/v3/projects/45c9d7948afa49e5bc0261e1f17180f7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:46.561788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.570545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:46.586190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9bc4-a658-447a-8187-4e1ffb8e4944 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.588216 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1078/2167] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:46 2021] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:46.589128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.591114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:46.641410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.642211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.642496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.642773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] PATH_INFO: `/v3/projects/f3c8d3ddad5e4c38843bd80264bf1f45/users/ca6f71a1764d4ad5ac0c5bc34cd9db5a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.653213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669bb9-2f87-4227-8bc2-8b01405af31a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.657020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c8d3ddad5e4c38843bd80264bf1f45, user_id=ca6f71a1764d4ad5ac0c5bc34cd9db5a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.657933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.658590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.658869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.659142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.659758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.659867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.661776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.783188 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1079/2168] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:46 2021] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:46.784346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.787323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:46.794310 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1090/2169] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:46 2021] PUT /identity/v3/projects/f3c8d3ddad5e4c38843bd80264bf1f45/users/ca6f71a1764d4ad5ac0c5bc34cd9db5a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:46.795322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:46.803007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4d102-b4dd-4eac-b931-50e6f1e97705 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.804173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:46.887245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97a10-5df6-4f33-b2ef-28ef7a4f6ee5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:46.889321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.890243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.890522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.890857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] PATH_INFO: `/v3/users/ff1d2254deea40079db6f1d0adcd4a6a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.895673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1d2254deea40079db6f1d0adcd4a6a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.895836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:46.895836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:46.895836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:46.895836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:46.896119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:46.896218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:46.896218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.000963 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1091/2170] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:46 2021] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:47.000963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.010417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5870-4d3a-44bf-8a65-a19bbfd18f1a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.016306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e234b-11c6-4dd7-a947-31f9cecc9712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.024201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e234b-11c6-4dd7-a947-31f9cecc9712 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.024201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e234b-11c6-4dd7-a947-31f9cecc9712 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.024201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e234b-11c6-4dd7-a947-31f9cecc9712 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.024201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e234b-11c6-4dd7-a947-31f9cecc9712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.024201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e234b-11c6-4dd7-a947-31f9cecc9712 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.031044 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1092/2171] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:47.032298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73b0f5-a2f2-4c3a-8c2b-8d5fadc35e2c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.032585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73b0f5-a2f2-4c3a-8c2b-8d5fadc35e2c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.032862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73b0f5-a2f2-4c3a-8c2b-8d5fadc35e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.064312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-de73b0f5-a2f2-4c3a-8c2b-8d5fadc35e2c None None] MFA Rules not processed for user `ca6f71a1764d4ad5ac0c5bc34cd9db5a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:47.065761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-de73b0f5-a2f2-4c3a-8c2b-8d5fadc35e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.154098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1d2254deea40079db6f1d0adcd4a6a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:47.158542 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1093/2172] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:47.159656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73b0f5-a2f2-4c3a-8c2b-8d5fadc35e2c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.165221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1d2254deea40079db6f1d0adcd4a6a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:47.172664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73b0f5-a2f2-4c3a-8c2b-8d5fadc35e2c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.179122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.179122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.179411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.179808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.180428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1d2254deea40079db6f1d0adcd4a6a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:47.180660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.181470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1d2254deea40079db6f1d0adcd4a6a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:47.182187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1d2254deea40079db6f1d0adcd4a6a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:47.182369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.193329 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1094/2173] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:47.194228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.195909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.209514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be296de-0744-49f9-8353-6584c7dd3530 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.214161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.214876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.215160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.215435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.216167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.217784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.233130 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1095/2174] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:47.233130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.233130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.317818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1080/2175] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:46 2021] DELETE /identity/v3/users/ff1d2254deea40079db6f1d0adcd4a6a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:47.318840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.320335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.331585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d8e3-109a-4c7c-9249-9353bf0ab5c6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.411412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4053ad-1e5d-43b8-ad8f-939ecd7a80c5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.413849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.414655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.414939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.415219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.417117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.417952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.419043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.419399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.419743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] PATH_INFO: `/v3/projects/ae237d62f92243ef85f30e7ed6f6e28f/users/fce1692cfaa44fe1a210a222c4dcb347/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.438039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae237d62f92243ef85f30e7ed6f6e28f, user_id=fce1692cfaa44fe1a210a222c4dcb347, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.443191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.480476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.482104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.490914 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1096/2176] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:47 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:47.491654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.501703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651a3ac-aa3d-4b90-a53a-5e8cd1459552 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.506539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae7423-57fa-4d60-9b78-d5a5f19101e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.507467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7423-57fa-4d60-9b78-d5a5f19101e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.507756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7423-57fa-4d60-9b78-d5a5f19101e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.508054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7423-57fa-4d60-9b78-d5a5f19101e1 admin admin] PATH_INFO: `/v3/projects/f5c4f6663f4249d9b1e1875f3b365f42/users/f13cc4b5812c4a28bcc1a772679916f6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.524942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae7423-57fa-4d60-9b78-d5a5f19101e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c4f6663f4249d9b1e1875f3b365f42, user_id=f13cc4b5812c4a28bcc1a772679916f6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.527609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae7423-57fa-4d60-9b78-d5a5f19101e1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.622704 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1081/2177] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:47 2021] PUT /identity/v3/projects/ae237d62f92243ef85f30e7ed6f6e28f/users/fce1692cfaa44fe1a210a222c4dcb347/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:47.623721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.643912 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1097/2178] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:47 2021] PUT /identity/v3/projects/f5c4f6663f4249d9b1e1875f3b365f42/users/f13cc4b5812c4a28bcc1a772679916f6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:47.657284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.658008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.658008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.687307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] MFA Rules not processed for user `f13cc4b5812c4a28bcc1a772679916f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:47.688599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.690770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088481d-0507-4492-8f3f-548ba040a6c1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.783968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.784833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.785716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.785996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.786792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.789357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.797237 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1098/2179] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:47 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:47.807718 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1082/2180] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:47 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:47.811341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.812847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.816390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:47.829080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2cd1-f415-4b5f-be25-73d2589e3dff admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.834921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe306023-6e1c-4674-8e2d-d276e98f7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.837417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe306023-6e1c-4674-8e2d-d276e98f7299 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.837875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe306023-6e1c-4674-8e2d-d276e98f7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.838434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe306023-6e1c-4674-8e2d-d276e98f7299 admin admin] PATH_INFO: `/v3/projects/ae237d62f92243ef85f30e7ed6f6e28f/users/fce1692cfaa44fe1a210a222c4dcb347/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.849350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe306023-6e1c-4674-8e2d-d276e98f7299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae237d62f92243ef85f30e7ed6f6e28f, user_id=fce1692cfaa44fe1a210a222c4dcb347, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:47.849350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe306023-6e1c-4674-8e2d-d276e98f7299 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:47.863648 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1083/2181] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:47 2021] PUT /identity/v3/projects/ae237d62f92243ef85f30e7ed6f6e28f/users/fce1692cfaa44fe1a210a222c4dcb347/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:47.874949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5639-5a03-47ae-8146-3c955e722993 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.875556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5639-5a03-47ae-8146-3c955e722993 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.875840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5639-5a03-47ae-8146-3c955e722993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:47.913797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ad32d-4567-4f22-b463-8af8d988be85 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:47.920526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8a5b5639-5a03-47ae-8146-3c955e722993 None None] MFA Rules not processed for user `fce1692cfaa44fe1a210a222c4dcb347`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:47.922048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8a5b5639-5a03-47ae-8146-3c955e722993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:47.992168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:47.993160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:47.993585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:47.993968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:48.054997 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1084/2182] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:47 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:48.077427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b5639-5a03-47ae-8146-3c955e722993 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:48.096008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:48.096008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:48.108174 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1099/2183] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:47 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:48.129802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:48.136657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:48.191468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b5639-5a03-47ae-8146-3c955e722993 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:48.206234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:48.209312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:48.209781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:48.210210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:48.221235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:48.222882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:48.247024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1085/2184] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:48 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:07:48.248891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:48.253579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:48.272167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a586b-c2b1-46c7-88ab-9b7e24e63887 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:48.272329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357184d-c3d1-4cf3-882e-81eb9fbb8b72 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:48.279349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:48.279525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:48.279650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:48.279771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:48.279987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] PATH_INFO: `/v3/projects/7fe465dc44884fe29de639a5a4321b40` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:48.281501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:48.281776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:48.282199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] PATH_INFO: `/v3/users/d98ab3d372a343daaeef8435bdba83c0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:48.283525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98ab3d372a343daaeef8435bdba83c0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:48.285778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:48.287303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe465dc44884fe29de639a5a4321b40)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:48.289610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:48.504215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe465dc44884fe29de639a5a4321b40', 'request_id': 'req-a7ceacf7-d823-435b-b42a-d0f121ae58a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.506679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98ab3d372a343daaeef8435bdba83c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.515471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98ab3d372a343daaeef8435bdba83c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.527622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98ab3d372a343daaeef8435bdba83c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.528762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98ab3d372a343daaeef8435bdba83c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.529770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98ab3d372a343daaeef8435bdba83c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.600078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe465dc44884fe29de639a5a4321b40', 'request_id': 'req-a7ceacf7-d823-435b-b42a-d0f121ae58a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.606880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe465dc44884fe29de639a5a4321b40', 'request_id': 'req-a7ceacf7-d823-435b-b42a-d0f121ae58a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.617541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] The token cache is being invalidate because project 7fe465dc44884fe29de639a5a4321b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:48.617827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.618457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a7ceacf7-d823-435b-b42a-d0f121ae58a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.620067 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1100/2185] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:48 2021] DELETE /identity/v3/projects/7fe465dc44884fe29de639a5a4321b40 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:48.622042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0378-7067-45a3-9675-973e4f22d678 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:48.622323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0378-7067-45a3-9675-973e4f22d678 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:48.622601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0378-7067-45a3-9675-973e4f22d678 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:48.624260 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1101/2186] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:48.624984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa0378-7067-45a3-9675-973e4f22d678 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:48.626627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bcaa0378-7067-45a3-9675-973e4f22d678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:48.689880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa0378-7067-45a3-9675-973e4f22d678 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:48.694528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:48.695376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:48.695674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:48.695929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] PATH_INFO: `/v3/users/f13cc4b5812c4a28bcc1a772679916f6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:48.697153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13cc4b5812c4a28bcc1a772679916f6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:48.700748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:48.706763 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1086/2187] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:48 2021] DELETE /identity/v3/users/d98ab3d372a343daaeef8435bdba83c0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:48.707474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:48.709205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:48.782056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada82b8f-48f0-4b93-8228-a406d8a69a92 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:48.787626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:48.788495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:48.788775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:48.789314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] PATH_INFO: `/v3/users/ca6f71a1764d4ad5ac0c5bc34cd9db5a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:48.790533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6f71a1764d4ad5ac0c5bc34cd9db5a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:48.793525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:48.905450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13cc4b5812c4a28bcc1a772679916f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.921119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13cc4b5812c4a28bcc1a772679916f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.932943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13cc4b5812c4a28bcc1a772679916f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:48.937528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13cc4b5812c4a28bcc1a772679916f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:49.053470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6f71a1764d4ad5ac0c5bc34cd9db5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:49.060473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6f71a1764d4ad5ac0c5bc34cd9db5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:49.068096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d852436-59c2-4769-a2f3-6ebeb01531c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13cc4b5812c4a28bcc1a772679916f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:49.073049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6f71a1764d4ad5ac0c5bc34cd9db5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:49.074750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6f71a1764d4ad5ac0c5bc34cd9db5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:49.075565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0f5f206-1fa4-4995-85b7-6a9aaa5a652f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6f71a1764d4ad5ac0c5bc34cd9db5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:49.080327 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1102/2188] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:48 2021] DELETE /identity/v3/users/f13cc4b5812c4a28bcc1a772679916f6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:49.080327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.080327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.080327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.101459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:49.102742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.173003 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1103/2189] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:49.175480 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1087/2190] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:48 2021] DELETE /identity/v3/users/ca6f71a1764d4ad5ac0c5bc34cd9db5a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:49.175719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1dfa-74b0-4217-9fde-8a6b2cd0739f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.176043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1dfa-74b0-4217-9fde-8a6b2cd0739f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.176331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1dfa-74b0-4217-9fde-8a6b2cd0739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.177202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:49.179104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.203160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c1dd1dfa-74b0-4217-9fde-8a6b2cd0739f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:49.204369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c1dd1dfa-74b0-4217-9fde-8a6b2cd0739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.281286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.282593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.286091 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1088/2191] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:49.287247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cebc6-cab2-432a-bb0d-acb3ef5508da None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.287531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cebc6-cab2-432a-bb0d-acb3ef5508da None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.287802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cebc6-cab2-432a-bb0d-acb3ef5508da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.305544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-853cebc6-cab2-432a-bb0d-acb3ef5508da None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:49.306776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-853cebc6-cab2-432a-bb0d-acb3ef5508da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.315130 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1089/2192] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:49.316343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369392d-7a5f-4508-ad42-c6e70134df83 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.316627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369392d-7a5f-4508-ad42-c6e70134df83 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.316931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369392d-7a5f-4508-ad42-c6e70134df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.337011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c369392d-7a5f-4508-ad42-c6e70134df83 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:49.344644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c369392d-7a5f-4508-ad42-c6e70134df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.345900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1090/2193] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:49.347096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.347376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.347646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.366387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd67ca0-9823-4b80-a048-b7c4888f8d8c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.367504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:49.368989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.387411 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1091/2194] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:49.388802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.390667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.434653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.436542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.436542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.436542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.437695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.439714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.441743 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1104/2195] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:49 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:49.442269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.443818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.452404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941b9c-ed02-48be-a2ad-2b287f65cae6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.456295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.456752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3f9f-5b1f-4f0f-9aa4-279dad717ae8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.457034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.457315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.457607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.461083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.461704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.461979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.462250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.472985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.474496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.477912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.479681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.484863 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1105/2196] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:49.485688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.492614 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1092/2197] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:49.493706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.496088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1586a-f58a-4a5c-867c-5e4588c90217 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.505395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.505913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.506353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.506638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.507778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42f63-badd-440a-a0b2-86da2508159e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.513176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ff1a9-cdd5-424b-b030-04eecceeb034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.513905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff1a9-cdd5-424b-b030-04eecceeb034 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.514252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff1a9-cdd5-424b-b030-04eecceeb034 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.514593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff1a9-cdd5-424b-b030-04eecceeb034 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.515326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff1a9-cdd5-424b-b030-04eecceeb034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:49.515632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff1a9-cdd5-424b-b030-04eecceeb034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.517308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff1a9-cdd5-424b-b030-04eecceeb034 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.519352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.520798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.530526 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1093/2198] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:49.531574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1106/2199] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:49.531864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dec1c-3d2b-47ce-b425-5e498618e08f None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.532146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dec1c-3d2b-47ce-b425-5e498618e08f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.532418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dec1c-3d2b-47ce-b425-5e498618e08f None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.534459 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1094/2200] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:49.535830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.540039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dec1c-3d2b-47ce-b425-5e498618e08f None None] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:49.541853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9a5dec1c-3d2b-47ce-b425-5e498618e08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.547757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc47b0c-be36-4d25-b64c-2dfca95e16de service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.553763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aa57c-5f7c-41fe-a601-4777ca84e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.554420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa57c-5f7c-41fe-a601-4777ca84e41c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.554704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa57c-5f7c-41fe-a601-4777ca84e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.554974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa57c-5f7c-41fe-a601-4777ca84e41c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.555669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aa57c-5f7c-41fe-a601-4777ca84e41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.557725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aa57c-5f7c-41fe-a601-4777ca84e41c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.632652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dec1c-3d2b-47ce-b425-5e498618e08f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.644738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dec1c-3d2b-47ce-b425-5e498618e08f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.651004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.652682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.653038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.653319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.654571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.656748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.658565 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1095/2201] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:49 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:49.677388 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1107/2202] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/projects => generated 401 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:49.678984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.691036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe28e2-042e-4267-b351-9f7fee448635 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:49.753244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:49.753943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.754181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.754452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.755168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:49.758480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:49.886430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f758-e2d0-4feb-b248-6c5d57742441 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:49.887373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f758-e2d0-4feb-b248-6c5d57742441 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:49.887551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44f758-e2d0-4feb-b248-6c5d57742441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:49.910147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1b44f758-e2d0-4feb-b248-6c5d57742441 None None] MFA Rules not processed for user `0b5347862d6b49aaa8c48e883187d1db`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:49.911784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b44f758-e2d0-4feb-b248-6c5d57742441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:49.975813 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1096/2203] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/users => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:49.977301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:49.985783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:50.000616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c96c9-0078-4b2e-b0e8-fcfe6e364b61 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.005704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.006818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.007109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.007399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] PATH_INFO: `/v3/projects/82cb1dfb58a1493b8193ad0024840486` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.008733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cb1dfb58a1493b8193ad0024840486)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.010736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.020482 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1108/2204] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:49 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:50.021491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44f758-e2d0-4feb-b248-6c5d57742441 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:50.049731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44f758-e2d0-4feb-b248-6c5d57742441 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.055606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.056348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.056697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.057109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.058118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.060393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.078754 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1109/2205] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:50.078754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:50.154127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e5396-d601-4461-8d78-44bd35f98d79 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.160813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.160965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.161547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.161663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.163615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:50.172911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cb1dfb58a1493b8193ad0024840486', 'request_id': 'req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.179004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.179296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cb1dfb58a1493b8193ad0024840486', 'request_id': 'req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.180725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.190228 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1110/2206] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:50 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:50.191136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:50.201200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5b5f4-67bd-4cff-9b0b-0c18c1d59278 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.258101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.258820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.259045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.259320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.260044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.262254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.274431 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1111/2207] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:50.283781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:50.283781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:50.301820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ffbad-7ab1-4455-96ac-bb902e8b24cf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.305665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cb1dfb58a1493b8193ad0024840486', 'request_id': 'req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.312113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.313155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.313637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.314588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] PATH_INFO: `/v3/projects/f5c4f6663f4249d9b1e1875f3b365f42` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.317063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c4f6663f4249d9b1e1875f3b365f42)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.319227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.324126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] The token cache is being invalidate because project 82cb1dfb58a1493b8193ad0024840486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:50.324418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.329276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.330985 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1097/2208] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:49 2021] DELETE /identity/v3/projects/82cb1dfb58a1493b8193ad0024840486 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:50.331844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:50.334610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:50.355506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ade85-e0ba-4a94-8f5e-cd631f205e6d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.364637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.365648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.365928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.366197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] PATH_INFO: `/v3/projects/f3c8d3ddad5e4c38843bd80264bf1f45` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.367456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c8d3ddad5e4c38843bd80264bf1f45)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.369405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.497161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c4f6663f4249d9b1e1875f3b365f42', 'request_id': 'req-442f6a98-dfd1-4543-a9ec-67f10b788692'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.571287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c8d3ddad5e4c38843bd80264bf1f45', 'request_id': 'req-627258ac-5eca-4ea4-aeb1-86473820b0f2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.591263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c8d3ddad5e4c38843bd80264bf1f45', 'request_id': 'req-627258ac-5eca-4ea4-aeb1-86473820b0f2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.619964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c4f6663f4249d9b1e1875f3b365f42', 'request_id': 'req-442f6a98-dfd1-4543-a9ec-67f10b788692'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.627215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c4f6663f4249d9b1e1875f3b365f42', 'request_id': 'req-442f6a98-dfd1-4543-a9ec-67f10b788692'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.638166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] The token cache is being invalidate because project f5c4f6663f4249d9b1e1875f3b365f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:50.638705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.639404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.640972 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1112/2209] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:50 2021] DELETE /identity/v3/projects/f5c4f6663f4249d9b1e1875f3b365f42 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:50.641752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:50.643999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:50.705086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f6a98-dfd1-4543-a9ec-67f10b788692 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.759613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179e72f-f2a0-432b-9996-54b88966a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.760498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179e72f-f2a0-432b-9996-54b88966a6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.760780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179e72f-f2a0-432b-9996-54b88966a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.761701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179e72f-f2a0-432b-9996-54b88966a6c6 admin admin] PATH_INFO: `/v3/projects/e25e5a44bb7e4ef7a38e961e6203b72b/users/aa5e089e14854aec83cc6b1f9ca9fedc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.774864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179e72f-f2a0-432b-9996-54b88966a6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25e5a44bb7e4ef7a38e961e6203b72b, user_id=aa5e089e14854aec83cc6b1f9ca9fedc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.777515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179e72f-f2a0-432b-9996-54b88966a6c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.782935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c8d3ddad5e4c38843bd80264bf1f45', 'request_id': 'req-627258ac-5eca-4ea4-aeb1-86473820b0f2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.793545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] The token cache is being invalidate because project f3c8d3ddad5e4c38843bd80264bf1f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:50.794243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.794532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:50.796049 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1098/2210] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:50 2021] DELETE /identity/v3/projects/f3c8d3ddad5e4c38843bd80264bf1f45 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:50.796956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:50.798508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:50.811454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627258ac-5eca-4ea4-aeb1-86473820b0f2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:50.816047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:50.817021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.817399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.817679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] PATH_INFO: `/v3/users/adaa21f2f245434685ff2553544c10e3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.818890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaa21f2f245434685ff2553544c10e3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:50.820768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:50.890205 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1113/2211] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:50 2021] PUT /identity/v3/projects/e25e5a44bb7e4ef7a38e961e6203b72b/users/aa5e089e14854aec83cc6b1f9ca9fedc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:50.890205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f2ecf-32f8-4972-a181-42e9349c1c77 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.890205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f2ecf-32f8-4972-a181-42e9349c1c77 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.890205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f2ecf-32f8-4972-a181-42e9349c1c77 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.892163 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1114/2212] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:50.893304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483a12f-a4cf-459b-9737-f2a4f65cc50a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.893585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483a12f-a4cf-459b-9737-f2a4f65cc50a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.894075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483a12f-a4cf-459b-9737-f2a4f65cc50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.914720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a483a12f-a4cf-459b-9737-f2a4f65cc50a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:50.915996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a483a12f-a4cf-459b-9737-f2a4f65cc50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:50.982290 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1115/2213] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:50.982290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a385-dc7c-4a83-94f5-392906b6a600 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:50.982290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a385-dc7c-4a83-94f5-392906b6a600 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:50.982290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a385-dc7c-4a83-94f5-392906b6a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:50.999619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-51a6a385-dc7c-4a83-94f5-392906b6a600 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:51.000796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-51a6a385-dc7c-4a83-94f5-392906b6a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.008905 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1116/2214] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:51.010042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.010324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.010643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.031234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:51.033604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.042130 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1117/2215] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:51.046503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:51.046503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.090023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaa21f2f245434685ff2553544c10e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:51.097256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaa21f2f245434685ff2553544c10e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:51.115579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaa21f2f245434685ff2553544c10e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:51.117872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaa21f2f245434685ff2553544c10e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:51.118554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d426cac-ee15-45fa-8a65-0614f45ddebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaa21f2f245434685ff2553544c10e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:51.142559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.143812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.217242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88359eb-a59f-42d2-95a1-3c0db883b8ad None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.218010 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1099/2216] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:50 2021] DELETE /identity/v3/users/adaa21f2f245434685ff2553544c10e3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:51.222213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.222485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.222859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.243164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:51.244373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.299246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf132c-3882-4d12-941f-d2b280686b30 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.300279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf132c-3882-4d12-941f-d2b280686b30 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.300659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf132c-3882-4d12-941f-d2b280686b30 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.301072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf132c-3882-4d12-941f-d2b280686b30 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.302552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf132c-3882-4d12-941f-d2b280686b30 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.305475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf132c-3882-4d12-941f-d2b280686b30 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.307891 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1118/2217] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:51 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:51.309447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140f4b-5407-440f-98dd-12eebe88a580 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.309872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140f4b-5407-440f-98dd-12eebe88a580 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.310206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b140f4b-5407-440f-98dd-12eebe88a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.320631 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1100/2218] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:51.321675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.323104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.338195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0b140f4b-5407-440f-98dd-12eebe88a580 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:51.340175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b140f4b-5407-440f-98dd-12eebe88a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.351299 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1119/2219] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:51.354554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428b611-9f67-4158-932b-45e48337c846 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.354554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428b611-9f67-4158-932b-45e48337c846 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.354554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428b611-9f67-4158-932b-45e48337c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.376120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8428b611-9f67-4158-932b-45e48337c846 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:51.377916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8428b611-9f67-4158-932b-45e48337c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.393446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101eabf7-8fe3-48bb-b4fe-0557ee6c26e1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.397786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.398787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.398875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.399181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.401563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.416543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.418110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.429885 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1101/2220] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:51.430728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.441704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b26e-6f97-4090-9ab2-36b3094a06c6 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.447578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.448556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.449371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.449645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.450547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:51.451621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.454058 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1120/2221] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:51.454978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428b611-9f67-4158-932b-45e48337c846 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.457437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.480105 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1102/2222] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:51.480105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.480105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.481831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428b611-9f67-4158-932b-45e48337c846 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.487086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.487740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.488017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.488284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.489053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:51.489358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.490936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.503486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1121/2223] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:51.504296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.515282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66070fc-8ad6-4120-a0f0-57887a1c7f96 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.524825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.525734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.526093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.526371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.527099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.528998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.549237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32093f55-5039-4a99-9e25-d22832da395e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.554451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.555090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.555366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.555678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.564478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.566078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.575877 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1103/2224] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:07:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:51.586814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.602350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e34ed-2a9e-41f3-9afe-382ff2d364b7 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.631349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.633597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.633882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.634156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.634863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.640039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.672520 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1122/2225] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:51 2021] POST /identity/v3/projects => generated 395 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:51.672520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.677852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:51.741591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63117e7a-d770-4bc9-a187-29bd7567d143 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.746904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.751969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.751969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.751969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] PATH_INFO: `/v3/projects/3f9ad080a6ad4b21bf8e3793877cd698` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.751969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9ad080a6ad4b21bf8e3793877cd698)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.751969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.784244 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1104/2226] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:51 2021] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:51.784244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:51.909581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f27a55-4ef1-4574-a326-1bac178708a6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:51.914919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cff4cd-0321-4abf-a9b9-3b2a0201d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:51.915674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff4cd-0321-4abf-a9b9-3b2a0201d562 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:51.915961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff4cd-0321-4abf-a9b9-3b2a0201d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:51.916237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff4cd-0321-4abf-a9b9-3b2a0201d562 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:51.916979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cff4cd-0321-4abf-a9b9-3b2a0201d562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:51.919509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cff4cd-0321-4abf-a9b9-3b2a0201d562 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:51.977253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9ad080a6ad4b21bf8e3793877cd698', 'request_id': 'req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:52.074020 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1105/2227] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:51 2021] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:52.076513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12077c9-51d9-4e06-bbf3-572adb2da7c2 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.077044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12077c9-51d9-4e06-bbf3-572adb2da7c2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.077539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12077c9-51d9-4e06-bbf3-572adb2da7c2 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.080246 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1106/2228] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:52.081335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12077c9-51d9-4e06-bbf3-572adb2da7c2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.143456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9ad080a6ad4b21bf8e3793877cd698', 'request_id': 'req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:52.154543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9ad080a6ad4b21bf8e3793877cd698', 'request_id': 'req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:52.178210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] The token cache is being invalidate because project 3f9ad080a6ad4b21bf8e3793877cd698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:07:52.178507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:52.182160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:07:52.185213 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1123/2229] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:51 2021] DELETE /identity/v3/projects/3f9ad080a6ad4b21bf8e3793877cd698 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:52.186014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.190343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.208500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12077c9-51d9-4e06-bbf3-572adb2da7c2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.215302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.216054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.216347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.216619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.217431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.222657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.291981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b984fbb-e8e7-4482-aa1c-3c457904ecf2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.299364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94982856-7fdf-419b-8042-cf8da96a7de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.300074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94982856-7fdf-419b-8042-cf8da96a7de5 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.300354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94982856-7fdf-419b-8042-cf8da96a7de5 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.300568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94982856-7fdf-419b-8042-cf8da96a7de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.303479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-94982856-7fdf-419b-8042-cf8da96a7de5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.303668 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1107/2230] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:52 2021] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:52.304588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.311696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.330912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9bd20-6013-444c-b0f9-9810ec837ef1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.338391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.338977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.343101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.343101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.343101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.343101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.358236 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1108/2231] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:52.358236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:52.360055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.379462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.380923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.417890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94982856-7fdf-419b-8042-cf8da96a7de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.419763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94982856-7fdf-419b-8042-cf8da96a7de5 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.443082 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1124/2232] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:52 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:52.444650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847b76-ee71-4877-977f-4f9739e06efe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.444986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847b76-ee71-4877-977f-4f9739e06efe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.445270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847b76-ee71-4877-977f-4f9739e06efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.495053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777089e-6780-4e44-ad9b-655b6786ea17 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.528705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.595874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.595874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.595874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.595874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.596437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8f847b76-ee71-4877-977f-4f9739e06efe None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:52.596437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8f847b76-ee71-4877-977f-4f9739e06efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.596612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.596612 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1109/2233] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:52 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:52.596612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.596612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.596991 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1125/2234] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:52.596991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f847b76-ee71-4877-977f-4f9739e06efe None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.597157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eef48-f801-4686-b33f-33951b4e5594 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.597253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f847b76-ee71-4877-977f-4f9739e06efe None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.597343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc9d30-755a-4cbd-8f07-0751496ef03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.597343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc9d30-755a-4cbd-8f07-0751496ef03e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.597343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc9d30-755a-4cbd-8f07-0751496ef03e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.597343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc9d30-755a-4cbd-8f07-0751496ef03e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.597690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc9d30-755a-4cbd-8f07-0751496ef03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.597690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc9d30-755a-4cbd-8f07-0751496ef03e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.597859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.597859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.597859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.597859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.607587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.607587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.607771 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1110/2235] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:52.607771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e767e1-f339-4c17-85d9-6084dde19eab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.607771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e767e1-f339-4c17-85d9-6084dde19eab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.607771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e767e1-f339-4c17-85d9-6084dde19eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.636769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-26e767e1-f339-4c17-85d9-6084dde19eab None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:52.640847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-26e767e1-f339-4c17-85d9-6084dde19eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:52.643464 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1126/2236] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:52.646616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.658337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1111/2237] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:52.658337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e767e1-f339-4c17-85d9-6084dde19eab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.671532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a207456-ec6a-45d9-8780-8ceaf2dc5481 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.681713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e767e1-f339-4c17-85d9-6084dde19eab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.689170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.690994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.691619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.691745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.691977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.692255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.692462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.693085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.694212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] PATH_INFO: `/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4/users/8bd1919231cd43d7a4b5bdf170586892/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.694703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.716214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5666a184d9d4b14bb32e635a9b75bf4, user_id=8bd1919231cd43d7a4b5bdf170586892, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.719108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.732468 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1127/2238] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:52.733370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.750671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b9584-a2b8-4108-8b55-124f0a04964f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.755915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.756620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.757584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.757877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.759532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:07:52.759859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.762094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:52.781175 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1128/2239] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:07:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:52.782382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:52.796200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d50437-e0fd-4170-8ed4-e0821b864edb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:52.804988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9497a-996e-49e2-b92c-44c06fffb398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:52.806218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9497a-996e-49e2-b92c-44c06fffb398 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:52.806653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9497a-996e-49e2-b92c-44c06fffb398 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:52.807205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9497a-996e-49e2-b92c-44c06fffb398 admin admin] PATH_INFO: `/v3/projects/f1c9d95c0097420ba158062e91371e63/users/66b9e8144a0048a581cc606482753808/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:52.833844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9497a-996e-49e2-b92c-44c06fffb398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c9d95c0097420ba158062e91371e63, user_id=66b9e8144a0048a581cc606482753808, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:52.838501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9497a-996e-49e2-b92c-44c06fffb398 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:53.008912 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1112/2240] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:52 2021] PUT /identity/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4/users/8bd1919231cd43d7a4b5bdf170586892/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:53.021088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:53.021230 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1129/2241] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:52 2021] PUT /identity/v3/projects/f1c9d95c0097420ba158062e91371e63/users/66b9e8144a0048a581cc606482753808/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:53.021230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352db27-8c3b-40de-97a9-14947c60ffd4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.021230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352db27-8c3b-40de-97a9-14947c60ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.021230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352db27-8c3b-40de-97a9-14947c60ffd4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.021230 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1130/2242] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:53.022130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81dcb-e628-47a7-81ee-5f56aa04cacb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.022481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81dcb-e628-47a7-81ee-5f56aa04cacb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.022829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81dcb-e628-47a7-81ee-5f56aa04cacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.064478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-24b81dcb-e628-47a7-81ee-5f56aa04cacb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:53.065749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-24b81dcb-e628-47a7-81ee-5f56aa04cacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:53.152235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f369f-c169-42f8-941d-6266018d521a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:53.218186 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1131/2243] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:53.227749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.230450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.230631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.310922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] MFA Rules not processed for user `8bd1919231cd43d7a4b5bdf170586892`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:53.312854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:53.314368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:53.315040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.315326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.315599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.318495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:53.321063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:53.448068 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1132/2244] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:53 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:53.450650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:53.526832 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1113/2245] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:53 2021] POST /identity/v3/projects => generated 377 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:53.531030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:53.533053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:53.631684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:53.646772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73682-fa61-4cb7-aaa1-ca9b294f5057 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:53.651055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:53.652247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.653078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.653358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.732124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:53.733713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:53.745423 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1114/2246] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:53.746217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:53.758188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abe47a-697d-4b6b-b5e1-db59a5691f9b service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:53.767391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8b982-b340-416b-9316-08cbe11761a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:53.769983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8b982-b340-416b-9316-08cbe11761a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.769983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8b982-b340-416b-9316-08cbe11761a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.769983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8b982-b340-416b-9316-08cbe11761a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.769983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8b982-b340-416b-9316-08cbe11761a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:53.772198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8b982-b340-416b-9316-08cbe11761a1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:53.780689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dd4d1-b8f7-464d-84b7-1e5486b101f5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:53.862839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:53.863859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.864156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.864495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.865705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:53.869999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:53.881277 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1133/2247] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:53 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:53.884183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:53.922003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270e406-67a8-4532-9be4-f110e822b9f1 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:53.944189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:53.946206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.946550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.946839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:53.952353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:53.954607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:53.973091 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1115/2248] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:53 2021] POST /identity/v3/projects => generated 395 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:53.974671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783dc9e-4866-4fe5-afb9-f72a0c0e1e1a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:53.975169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783dc9e-4866-4fe5-afb9-f72a0c0e1e1a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:53.975643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783dc9e-4866-4fe5-afb9-f72a0c0e1e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.036766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3783dc9e-4866-4fe5-afb9-f72a0c0e1e1a None None] MFA Rules not processed for user `491f06d5a64145919a6e4a9ec0fa9171`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:54.036766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3783dc9e-4866-4fe5-afb9-f72a0c0e1e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:54.117024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1116/2249] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:53 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:54.117024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783dc9e-4866-4fe5-afb9-f72a0c0e1e1a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:54.150061 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1134/2250] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:53 2021] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:54.164885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:54.187157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89119aed-f54e-4d01-997a-ddd5faf869e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:54.310695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783dc9e-4866-4fe5-afb9-f72a0c0e1e1a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:54.317825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:54.318741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.319127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.319558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.320586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:54.325099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed1a2-74aa-44a8-9651-ff88295f5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:54.325779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed1a2-74aa-44a8-9651-ff88295f5267 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.326060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed1a2-74aa-44a8-9651-ff88295f5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.326332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed1a2-74aa-44a8-9651-ff88295f5267 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.327069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed1a2-74aa-44a8-9651-ff88295f5267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:54.329279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed1a2-74aa-44a8-9651-ff88295f5267 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:54.329653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:54.346980 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1135/2251] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:54.347471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474848-94c2-4500-b3e3-fd056c82b1cd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.347771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474848-94c2-4500-b3e3-fd056c82b1cd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.348054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474848-94c2-4500-b3e3-fd056c82b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.372922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-00474848-94c2-4500-b3e3-fd056c82b1cd None None] MFA Rules not processed for user `0b5347862d6b49aaa8c48e883187d1db`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:54.374344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-00474848-94c2-4500-b3e3-fd056c82b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:54.473367 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1117/2252] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:54 2021] POST /identity/v3/users => generated 304 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:54.474961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:54.520501 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1136/2253] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:54 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:54.522426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474848-94c2-4500-b3e3-fd056c82b1cd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:54.561575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474848-94c2-4500-b3e3-fd056c82b1cd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:54.579220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:54.588542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.588542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.588542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.588542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:54.588542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:54.629403 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1137/2254] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:54.629403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:54.653235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4bc4-574e-448f-9dac-bd1f2914137e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:54.654020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe5513-4982-4c86-b0f3-814b345d96fa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:54.664768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:54.670605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.670605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.670605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.670605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:54.670605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:54.671017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:54.671017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.671017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.671017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.673144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:54.688480 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1138/2255] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:54.694995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:54.712018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091035-615c-4876-a874-4ca4ba8dc246 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:54.720300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fe15c-87ff-44e8-bfe9-d89aae37134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:54.722122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe15c-87ff-44e8-bfe9-d89aae37134c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.722579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe15c-87ff-44e8-bfe9-d89aae37134c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.724910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe15c-87ff-44e8-bfe9-d89aae37134c admin admin] PATH_INFO: `/v3/projects/f0a7e7426dc44124a01d7d7479839375/users/6689f8b5d7b547a3ac63aabe8ecb8712/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.754377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fe15c-87ff-44e8-bfe9-d89aae37134c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a7e7426dc44124a01d7d7479839375, user_id=6689f8b5d7b547a3ac63aabe8ecb8712, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:54.759654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fe15c-87ff-44e8-bfe9-d89aae37134c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:54.808573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:54.810223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:54.831947 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1118/2256] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:54 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:54.839867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:54.859899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50baae-d70f-483d-97be-3127fda6427e service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:54.865340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:54.866241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.866519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.866792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] PATH_INFO: `/v3/projects/f181e0abde3e4a55a74f2abc9e764360/users/9169307b11c045848f11262b004ccfc2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.888978 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1139/2257] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:54 2021] PUT /identity/v3/projects/f0a7e7426dc44124a01d7d7479839375/users/6689f8b5d7b547a3ac63aabe8ecb8712/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:54.895383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4090-3e84-40cf-ade6-950684e06b34 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:54.895667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4090-3e84-40cf-ade6-950684e06b34 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:54.896234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4090-3e84-40cf-ade6-950684e06b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:54.925131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f181e0abde3e4a55a74f2abc9e764360, user_id=9169307b11c045848f11262b004ccfc2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:54.938664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:54.984133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-17fb4090-3e84-40cf-ade6-950684e06b34 None None] MFA Rules not processed for user `6689f8b5d7b547a3ac63aabe8ecb8712`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:54.985434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-17fb4090-3e84-40cf-ade6-950684e06b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:55.139389 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1119/2258] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:54 2021] PUT /identity/v3/projects/f181e0abde3e4a55a74f2abc9e764360/users/9169307b11c045848f11262b004ccfc2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:55.141472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1140/2259] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:54 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:55.146553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb4090-3e84-40cf-ade6-950684e06b34 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:55.146728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:55.278809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb4090-3e84-40cf-ade6-950684e06b34 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:55.411945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81465f-ca74-4ea9-93c7-7d966c2b949d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:55.421679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:55.422533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:55.422828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:55.423111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:55.423830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:55.426958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:55.450864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:55.451558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:55.451841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:55.452115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:55.465937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:55.476148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:55.517020 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1120/2260] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:55 2021] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:55.521511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:55.543444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8ecf1-c5ec-4005-91c8-b6bc07549f7f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:55.561357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad31fe7-fb73-4b2a-9143-84356b740ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:55.562562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad31fe7-fb73-4b2a-9143-84356b740ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:55.562953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad31fe7-fb73-4b2a-9143-84356b740ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:55.563336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad31fe7-fb73-4b2a-9143-84356b740ceb admin admin] PATH_INFO: `/v3/projects/f181e0abde3e4a55a74f2abc9e764360/users/9169307b11c045848f11262b004ccfc2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:55.568334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad31fe7-fb73-4b2a-9143-84356b740ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f181e0abde3e4a55a74f2abc9e764360, user_id=9169307b11c045848f11262b004ccfc2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:55.571246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad31fe7-fb73-4b2a-9143-84356b740ceb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:55.592039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1121/2261] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:55 2021] PUT /identity/v3/projects/f181e0abde3e4a55a74f2abc9e764360/users/9169307b11c045848f11262b004ccfc2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:55.602336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7114df-fdc0-4b4e-953a-8611d8631306 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:55.602702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7114df-fdc0-4b4e-953a-8611d8631306 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:55.602971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7114df-fdc0-4b4e-953a-8611d8631306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:55.659932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9c7114df-fdc0-4b4e-953a-8611d8631306 None None] MFA Rules not processed for user `9169307b11c045848f11262b004ccfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:55.661762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9c7114df-fdc0-4b4e-953a-8611d8631306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:55.718239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1141/2262] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:55 2021] POST /identity/v3/projects => generated 377 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:07:55.753108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:56.059211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1122/2263] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:55 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:56.068900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7114df-fdc0-4b4e-953a-8611d8631306 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:56.081514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488432-bdb5-414f-945b-409dc77c32f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:56.112348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1647fa-29d8-40ee-9dd0-526c9070bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:56.113137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1647fa-29d8-40ee-9dd0-526c9070bf9b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:56.115610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1647fa-29d8-40ee-9dd0-526c9070bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:56.115915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1647fa-29d8-40ee-9dd0-526c9070bf9b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:56.116646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1647fa-29d8-40ee-9dd0-526c9070bf9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:56.122662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1647fa-29d8-40ee-9dd0-526c9070bf9b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:56.260537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7114df-fdc0-4b4e-953a-8611d8631306 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:56.268758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:56.269867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:56.270546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:56.271710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:56.273077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:56.275800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:56.310810 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1142/2264] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:55 2021] POST /identity/v3/users => generated 295 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:56.319196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a762-560b-4655-870f-59fa38b4ad95 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:56.326181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a762-560b-4655-870f-59fa38b4ad95 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:56.339757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734a762-560b-4655-870f-59fa38b4ad95 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:56.339757 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1143/2265] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:56 2021] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:56.339757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a762-560b-4655-870f-59fa38b4ad95 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:56.360978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734a762-560b-4655-870f-59fa38b4ad95 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:56.381166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:56.381961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:56.382245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:56.382521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:56.383274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:56.385604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:56.407087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1144/2266] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:56.408646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:56.452338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1123/2267] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:07:56 2021] POST /identity/v3/projects => generated 393 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:56.455620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:56.653596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:56.667976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429c526-9d8d-4a07-99c4-955957983393 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:56.676471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:56.678994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:56.679285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:56.685203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] PATH_INFO: `/v3/projects/d4ee003d0ba44bcfad9af5e3d7c70837/users/1c4afd5525204e789d067abc77fc2e60/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:56.716243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ee003d0ba44bcfad9af5e3d7c70837, user_id=1c4afd5525204e789d067abc77fc2e60, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:56.718926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:56.798750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c909c-c52f-4b49-b9a6-2cd367326eac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:56.869197 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1124/2268] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:56 2021] PUT /identity/v3/projects/d4ee003d0ba44bcfad9af5e3d7c70837/users/1c4afd5525204e789d067abc77fc2e60/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:56.870039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:56.878579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:56.879823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:56.880327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:56.880767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:56.882461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:56.885155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:56.887608 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1145/2269] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:56 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:56.894854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:56.902259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d85fa-457f-4d79-acf7-81e1b233fab6 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.004755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.005562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.005920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.006903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.007316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.009263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.028008 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1146/2270] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:56 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:57.032150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:57.048614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a092ce-fcf7-49cd-a9d3-90f92dffd69b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.059363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef0667-62ec-4816-9cac-52ce2a7e0724 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.068719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.069717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.070229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.070666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.071729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.072753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6afc2-461b-44b4-b572-c0721b693baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.074949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.079290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6afc2-461b-44b4-b572-c0721b693baf admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.079290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6afc2-461b-44b4-b572-c0721b693baf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.079290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6afc2-461b-44b4-b572-c0721b693baf admin admin] PATH_INFO: `/v3/projects/d4ee003d0ba44bcfad9af5e3d7c70837/users/1c4afd5525204e789d067abc77fc2e60/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.082965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6afc2-461b-44b4-b572-c0721b693baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ee003d0ba44bcfad9af5e3d7c70837, user_id=1c4afd5525204e789d067abc77fc2e60, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.091380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6afc2-461b-44b4-b572-c0721b693baf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.115056 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1147/2271] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:57 2021] PUT /identity/v3/projects/d4ee003d0ba44bcfad9af5e3d7c70837/users/1c4afd5525204e789d067abc77fc2e60/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:57.125217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463fc5-95cb-4bc5-b8f6-7c4bec4c0dab None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.125568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463fc5-95cb-4bc5-b8f6-7c4bec4c0dab None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.125856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463fc5-95cb-4bc5-b8f6-7c4bec4c0dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.166191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3b463fc5-95cb-4bc5-b8f6-7c4bec4c0dab None None] MFA Rules not processed for user `1c4afd5525204e789d067abc77fc2e60`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:57.167590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3b463fc5-95cb-4bc5-b8f6-7c4bec4c0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:57.262260 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1125/2272] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:07:56 2021] POST /identity/v3/users => generated 297 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:07:57.268511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:57.296765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913160ec-f397-4656-bc12-8c1d38fca7dc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.297330 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1148/2273] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:57 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:57.444206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91988a-14ce-4e6b-b105-82bc729d8ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.445024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91988a-14ce-4e6b-b105-82bc729d8ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.445370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91988a-14ce-4e6b-b105-82bc729d8ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.445707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91988a-14ce-4e6b-b105-82bc729d8ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.453058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91988a-14ce-4e6b-b105-82bc729d8ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.454765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91988a-14ce-4e6b-b105-82bc729d8ea0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.477535 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1126/2274] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:57 2021] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:07:57.481383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b463fc5-95cb-4bc5-b8f6-7c4bec4c0dab None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:57.498607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b463fc5-95cb-4bc5-b8f6-7c4bec4c0dab None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.508087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6e8e-8601-4513-b397-5770f7ac4f71 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.508469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6e8e-8601-4513-b397-5770f7ac4f71 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.508819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6e8e-8601-4513-b397-5770f7ac4f71 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.509655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.510389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.511535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.511827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.511933 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1127/2275] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:07:57.512571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.513266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0433-7924-418c-8743-b09041359f1c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.513619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0433-7924-418c-8743-b09041359f1c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.513964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0433-7924-418c-8743-b09041359f1c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.515924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1128/2276] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:57.516983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.522653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb221fe-5130-4fa7-9d5f-397e47068683 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.525319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb221fe-5130-4fa7-9d5f-397e47068683 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.525319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb221fe-5130-4fa7-9d5f-397e47068683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.545386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1149/2277] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:07:57 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:07:57.546418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:57.552229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9cb221fe-5130-4fa7-9d5f-397e47068683 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:57.554105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9cb221fe-5130-4fa7-9d5f-397e47068683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:57.650838 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1129/2278] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:07:57 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:57.658460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb221fe-5130-4fa7-9d5f-397e47068683 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:57.684381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb221fe-5130-4fa7-9d5f-397e47068683 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.695042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb27a2-9978-4c73-9040-5a4bb1429fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.696034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb27a2-9978-4c73-9040-5a4bb1429fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.696374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb27a2-9978-4c73-9040-5a4bb1429fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.696650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb27a2-9978-4c73-9040-5a4bb1429fb1 admin admin] PATH_INFO: `/v3/projects/0b2cf24cb701492c91a759d2a54b35b3/users/8c93df29f3ce4f36ba6a8ba996036840/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.739919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:57.749128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb27a2-9978-4c73-9040-5a4bb1429fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2cf24cb701492c91a759d2a54b35b3, user_id=8c93df29f3ce4f36ba6a8ba996036840, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.756613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb27a2-9978-4c73-9040-5a4bb1429fb1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.826025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e1e2-f938-4dc8-afbf-1c2b395f6d1d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.832007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.833290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.833818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.834328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.835911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.838776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.850818 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1150/2279] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:57 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:07:57.856601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:57.864338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:57.888654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1a570-5cf6-4e34-a9dd-8d9e8857e7bc tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.894929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.895814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.896335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.896860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.907514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:57.909329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:57.931184 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1151/2280] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:57.941559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:57.974141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb4e6f-aebc-4732-9c89-35c876240dcd service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:57.986490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c10ed-c24a-4018-8b88-aad0e879d0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:57.987775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c10ed-c24a-4018-8b88-aad0e879d0fa service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:57.988424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c10ed-c24a-4018-8b88-aad0e879d0fa service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:57.989167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c10ed-c24a-4018-8b88-aad0e879d0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:57.996104 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1130/2281] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:07:57 2021] PUT /identity/v3/projects/0b2cf24cb701492c91a759d2a54b35b3/users/8c93df29f3ce4f36ba6a8ba996036840/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:07:58.006355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30c33-bc5e-4616-a2d8-973646a51b91 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:58.006801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30c33-bc5e-4616-a2d8-973646a51b91 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:58.007219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30c33-bc5e-4616-a2d8-973646a51b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:58.017059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c10ed-c24a-4018-8b88-aad0e879d0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:58.020217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c10ed-c24a-4018-8b88-aad0e879d0fa service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:58.053442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1152/2282] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:57 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:58.091618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-09f30c33-bc5e-4616-a2d8-973646a51b91 None None] MFA Rules not processed for user `8c93df29f3ce4f36ba6a8ba996036840`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:58.094265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-09f30c33-bc5e-4616-a2d8-973646a51b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:58.215340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caee97-3365-4b89-b433-bafb5a43cac1 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:58.215683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caee97-3365-4b89-b433-bafb5a43cac1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:58.215908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caee97-3365-4b89-b433-bafb5a43cac1 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:58.218494 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1153/2283] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:07:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:07:58.231282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caee97-3365-4b89-b433-bafb5a43cac1 None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:07:58.290902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1131/2284] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:58 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:07:58.377655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caee97-3365-4b89-b433-bafb5a43cac1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:58.565161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caee97-3365-4b89-b433-bafb5a43cac1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:58.592691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:58.594906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:58.595484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:58.596006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:58.599646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:58.602086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:58.609179 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1154/2285] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:07:58 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:07:59.067968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e94d-d109-4334-a609-86d82581468d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:59.068260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e94d-d109-4334-a609-86d82581468d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:59.068541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132e94d-d109-4334-a609-86d82581468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:59.103655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5132e94d-d109-4334-a609-86d82581468d None None] MFA Rules not processed for user `0b5347862d6b49aaa8c48e883187d1db`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:59.104993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5132e94d-d109-4334-a609-86d82581468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:59.232483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1132/2286] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:07:59 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:59.252793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:59.272839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edfd34-1d3f-4aed-bebe-92170a71c05b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:59.302465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec657b-bec4-4ab1-bad9-b157deadf00f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:59.303432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec657b-bec4-4ab1-bad9-b157deadf00f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:59.303816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec657b-bec4-4ab1-bad9-b157deadf00f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:59.304191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec657b-bec4-4ab1-bad9-b157deadf00f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:59.484973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec657b-bec4-4ab1-bad9-b157deadf00f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:59.487766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec657b-bec4-4ab1-bad9-b157deadf00f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:07:59.542879 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1155/2287] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:59 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:59.560016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf91e9-23a5-4c58-9557-b747c2824529 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:59.560588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf91e9-23a5-4c58-9557-b747c2824529 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:59.565579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf91e9-23a5-4c58-9557-b747c2824529 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:59.567262 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1133/2288] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:07:59 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:07:59.575718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:59.576264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:59.576264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:59.721226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:07:59.722474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:59.881188 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1156/2289] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:07:59 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:07:59.907483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf91e9-23a5-4c58-9557-b747c2824529 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:07:59.910348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-10cf91e9-23a5-4c58-9557-b747c2824529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:07:59.956223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf91e9-23a5-4c58-9557-b747c2824529 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:07:59.971287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666cc47-08d0-4118-90eb-1637a66fbd3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:07:59.972117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666cc47-08d0-4118-90eb-1637a66fbd3a service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:07:59.972540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666cc47-08d0-4118-90eb-1637a66fbd3a service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:07:59.973353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666cc47-08d0-4118-90eb-1637a66fbd3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:07:59.993818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666cc47-08d0-4118-90eb-1637a66fbd3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:07:59.996307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666cc47-08d0-4118-90eb-1637a66fbd3a service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:00.027124 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1134/2290] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:07:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:00.577322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:00.580246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:00.607667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa12a59-991b-4b88-a0bc-3ff9c54c2b75 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:00.634388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:00.635115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:00.635519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:00.637038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:00.644081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:00.685728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:00.691375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:00.744381 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1157/2291] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:01.194891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f12a76-6431-4371-9094-566da521e6a1 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:01.195432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f12a76-6431-4371-9094-566da521e6a1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:01.195432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f12a76-6431-4371-9094-566da521e6a1 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:01.197267 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1135/2292] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:08:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:08:01.223560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:08:01.247866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:01.274928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d374-096d-4e24-98c3-7a44ede42b6f service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:01.283766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59817885-f5f6-4f13-b993-592cc16587a9 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169307b11c045848f11262b004ccfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f181e0abde3e4a55a74f2abc9e764360', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:01.284642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59817885-f5f6-4f13-b993-592cc16587a9 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:01.287202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59817885-f5f6-4f13-b993-592cc16587a9 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:01.287523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59817885-f5f6-4f13-b993-592cc16587a9 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] PATH_INFO: `/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:01.291043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59817885-f5f6-4f13-b993-592cc16587a9 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorizing `identity:get_project(project_id=e5666a184d9d4b14bb32e635a9b75bf4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:01.294827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59817885-f5f6-4f13-b993-592cc16587a9 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:01.318351 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1158/2293] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:08:01 2021] GET /identity/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4 => generated 395 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:01.918306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29644edc-9991-40ff-9c99-8658585d57a6 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:01.918503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29644edc-9991-40ff-9c99-8658585d57a6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:01.918782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29644edc-9991-40ff-9c99-8658585d57a6 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:01.920562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1136/2294] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:08:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:08:01.931107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243eb4c0-8663-41ba-aaac-077a6cda42cd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:01.931623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243eb4c0-8663-41ba-aaac-077a6cda42cd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:01.931623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243eb4c0-8663-41ba-aaac-077a6cda42cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.020029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-243eb4c0-8663-41ba-aaac-077a6cda42cd None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:02.021566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-243eb4c0-8663-41ba-aaac-077a6cda42cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:02.052472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1159/2295] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:08:01 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:02.128850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29644edc-9991-40ff-9c99-8658585d57a6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:02.134366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109ed7-7df3-460b-8309-bf9035328f5c None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:02.134641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109ed7-7df3-460b-8309-bf9035328f5c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:02.135121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109ed7-7df3-460b-8309-bf9035328f5c None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.138145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1160/2296] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:08:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:08:02.149155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109ed7-7df3-460b-8309-bf9035328f5c None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:08:02.186462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109ed7-7df3-460b-8309-bf9035328f5c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:02.209541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109ed7-7df3-460b-8309-bf9035328f5c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:02.224358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2e741-876e-49ea-80ba-1b629ab7034a tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce1692cfaa44fe1a210a222c4dcb347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae237d62f92243ef85f30e7ed6f6e28f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:02.225615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2e741-876e-49ea-80ba-1b629ab7034a tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:02.226085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2e741-876e-49ea-80ba-1b629ab7034a tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:02.226571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2e741-876e-49ea-80ba-1b629ab7034a tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.230295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2e741-876e-49ea-80ba-1b629ab7034a tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorizing `identity:get_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:02.234049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2e741-876e-49ea-80ba-1b629ab7034a tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:02.242915 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1161/2297] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:08:02 2021] GET /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 383 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:02.255214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29644edc-9991-40ff-9c99-8658585d57a6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:02.259322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:02.259999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:02.260280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:02.260582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.272362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:02.273961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:02.287221 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1137/2298] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:02.347016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c01b9-72ee-41b3-b2b9-70fa5175745b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:02.347522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c01b9-72ee-41b3-b2b9-70fa5175745b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:02.347945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c01b9-72ee-41b3-b2b9-70fa5175745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.392089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ac4c01b9-72ee-41b3-b2b9-70fa5175745b None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:02.393360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ac4c01b9-72ee-41b3-b2b9-70fa5175745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:02.422028 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1162/2299] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:08:02 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:02.476079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:02.485307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bc63-dda4-4b7d-be35-f90348f1a124 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:02.497239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:02.497907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:02.498188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:02.498462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.514794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:02.516275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:02.533605 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1138/2300] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:02 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:02.840937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903c7ca-b498-4cd7-a9d2-c11ff71fce5a None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:02.841234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903c7ca-b498-4cd7-a9d2-c11ff71fce5a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:02.841515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903c7ca-b498-4cd7-a9d2-c11ff71fce5a None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.843642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1163/2301] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:08:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:08:02.851875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:08:02.877666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:02.908897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aecf66-5089-45c1-baf9-be20082724b4 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:02.922016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40a211-3e69-41dc-ba79-5bdb31f0432d tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169307b11c045848f11262b004ccfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f181e0abde3e4a55a74f2abc9e764360', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:02.924383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40a211-3e69-41dc-ba79-5bdb31f0432d tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:02.924855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40a211-3e69-41dc-ba79-5bdb31f0432d tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:02.927034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40a211-3e69-41dc-ba79-5bdb31f0432d tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] PATH_INFO: `/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:02.928496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40a211-3e69-41dc-ba79-5bdb31f0432d tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorizing `identity:get_project(project_id=e5666a184d9d4b14bb32e635a9b75bf4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:02.932145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40a211-3e69-41dc-ba79-5bdb31f0432d tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:02.939166 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1139/2302] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:08:02 2021] GET /identity/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4 => generated 395 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:08:03.197452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903c7ca-b498-4cd7-a9d2-c11ff71fce5a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:03.200907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a903c7ca-b498-4cd7-a9d2-c11ff71fce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:03.307639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fa9b3-f085-4c75-88eb-ec9f4eaf42f4 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:03.308126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fa9b3-f085-4c75-88eb-ec9f4eaf42f4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:03.308460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fa9b3-f085-4c75-88eb-ec9f4eaf42f4 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:03.310376 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1140/2303] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:08:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:08:03.329528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fa9b3-f085-4c75-88eb-ec9f4eaf42f4 None None] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:08:03.382398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fa9b3-f085-4c75-88eb-ec9f4eaf42f4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:03.414493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fa9b3-f085-4c75-88eb-ec9f4eaf42f4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:03.430906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde3f62-edc4-4721-90ff-b69a044ade38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169307b11c045848f11262b004ccfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f181e0abde3e4a55a74f2abc9e764360', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:03.433076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde3f62-edc4-4721-90ff-b69a044ade38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:03.433525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde3f62-edc4-4721-90ff-b69a044ade38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:03.433981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde3f62-edc4-4721-90ff-b69a044ade38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] PATH_INFO: `/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:03.436190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde3f62-edc4-4721-90ff-b69a044ade38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorizing `identity:get_project(project_id=e5666a184d9d4b14bb32e635a9b75bf4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:03.444993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde3f62-edc4-4721-90ff-b69a044ade38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:03.447199 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1141/2304] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:08:03 2021] GET /identity/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4 => generated 395 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:08:03.489699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903c7ca-b498-4cd7-a9d2-c11ff71fce5a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:03.512795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:03.519249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:03.526863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:03.526863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] PATH_INFO: `/v3/users/0b5347862d6b49aaa8c48e883187d1db` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:03.526863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5347862d6b49aaa8c48e883187d1db)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:03.534068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:03.968926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5347862d6b49aaa8c48e883187d1db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:04.018951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5347862d6b49aaa8c48e883187d1db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:04.053774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5347862d6b49aaa8c48e883187d1db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:04.055409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5347862d6b49aaa8c48e883187d1db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:04.203410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5347862d6b49aaa8c48e883187d1db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:04.219988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1164/2305] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:03 2021] DELETE /identity/v3/users/0b5347862d6b49aaa8c48e883187d1db => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:04.224784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:04.225269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:04.225552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:04.266922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:04.268994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:04.444201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1142/2306] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:04.460857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:04.462651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:04.597524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e573a8-e69a-4727-b404-2ae9f9ad6c55 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:04.609297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:04.609971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:04.610255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:04.610532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:04.638091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:04.646933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:04.664276 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1165/2307] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:06.272333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:06.274081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:06.514341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eaead-aaa8-44c7-870e-d519d460f1de None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:06.526899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6180-5cb9-43c2-92ac-0dc62c4b8da8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:06.527857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6180-5cb9-43c2-92ac-0dc62c4b8da8 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:06.528306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6180-5cb9-43c2-92ac-0dc62c4b8da8 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:06.528757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6180-5cb9-43c2-92ac-0dc62c4b8da8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:06.537392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9e7b6180-5cb9-43c2-92ac-0dc62c4b8da8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:06.642868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6180-5cb9-43c2-92ac-0dc62c4b8da8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:06.644691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6180-5cb9-43c2-92ac-0dc62c4b8da8 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:06.662794 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1143/2308] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:06 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:07.222912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:07.225927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:07.259046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3beecb4-85fc-4458-bf73-a23ec6a64c25 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:07.270670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:07.273661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:07.273661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:07.273661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] PATH_INFO: `/v3/projects/096b5278e40e405bac0dc56dbeb706df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:07.275295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096b5278e40e405bac0dc56dbeb706df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:07.278467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:07.348412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:07.349454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:07.349895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:07.355779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1144/2309] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:08:07 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:08:07.364568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:08:07.372688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:07.473475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:07.475760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:07.538921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096b5278e40e405bac0dc56dbeb706df', 'request_id': 'req-7388b768-973e-4734-85d8-3b76e5282601'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:07.692853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32ca8-1475-4440-a1be-9aaff6b2fdf3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:07.701147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096b5278e40e405bac0dc56dbeb706df', 'request_id': 'req-7388b768-973e-4734-85d8-3b76e5282601'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:07.713154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096b5278e40e405bac0dc56dbeb706df', 'request_id': 'req-7388b768-973e-4734-85d8-3b76e5282601'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:07.785347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] The token cache is being invalidate because project 096b5278e40e405bac0dc56dbeb706df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:07.786958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:07.788632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:07.790364 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1166/2310] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:07 2021] DELETE /identity/v3/projects/096b5278e40e405bac0dc56dbeb706df => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:07.794384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:07.796560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:07.915824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddcdb6-cfef-4f4c-9668-50d6eab8cf32 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169307b11c045848f11262b004ccfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f181e0abde3e4a55a74f2abc9e764360', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:07.917162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcdb6-cfef-4f4c-9668-50d6eab8cf32 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:07.917605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcdb6-cfef-4f4c-9668-50d6eab8cf32 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:07.918142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddcdb6-cfef-4f4c-9668-50d6eab8cf32 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] PATH_INFO: `/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:07.919863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddcdb6-cfef-4f4c-9668-50d6eab8cf32 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorizing `identity:get_project(project_id=e5666a184d9d4b14bb32e635a9b75bf4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:07.925348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddcdb6-cfef-4f4c-9668-50d6eab8cf32 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:07.929673 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1145/2311] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:08:07 2021] GET /identity/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4 => generated 395 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:08:08.012932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388b768-973e-4734-85d8-3b76e5282601 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:08.021332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:08.022630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:08.022913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:08.023185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] PATH_INFO: `/v3/users/fce1692cfaa44fe1a210a222c4dcb347` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:08.026835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce1692cfaa44fe1a210a222c4dcb347)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:08.028499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:08.375205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce1692cfaa44fe1a210a222c4dcb347'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:08.399655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce1692cfaa44fe1a210a222c4dcb347'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:08.426459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce1692cfaa44fe1a210a222c4dcb347'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:08.430825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce1692cfaa44fe1a210a222c4dcb347'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:08.557847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce1692cfaa44fe1a210a222c4dcb347'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:08.568571 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1167/2312] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:07 2021] DELETE /identity/v3/users/fce1692cfaa44fe1a210a222c4dcb347 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:08:08.876262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b341fa-4d5f-4096-b1c5-cdc9b9b11815 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:08.876822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b341fa-4d5f-4096-b1c5-cdc9b9b11815 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:08.877146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b341fa-4d5f-4096-b1c5-cdc9b9b11815 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:08.879496 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1146/2313] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:08:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:08:08.885623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:08:08.887379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:09.077121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:09.079711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:09.204244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b18fb4-ba37-45ed-b4ae-8dffe13b74ee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:09.217026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437e660-7760-4fb3-a325-5803d131fe2b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169307b11c045848f11262b004ccfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f181e0abde3e4a55a74f2abc9e764360', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:09.217299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e660-7760-4fb3-a325-5803d131fe2b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:09.217417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e660-7760-4fb3-a325-5803d131fe2b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:09.217711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437e660-7760-4fb3-a325-5803d131fe2b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] PATH_INFO: `/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:09.220868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437e660-7760-4fb3-a325-5803d131fe2b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorizing `identity:get_project(project_id=e5666a184d9d4b14bb32e635a9b75bf4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:09.226484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437e660-7760-4fb3-a325-5803d131fe2b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:09.232682 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1168/2314] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:08:08 2021] GET /identity/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4 => generated 395 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:09.325348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b341fa-4d5f-4096-b1c5-cdc9b9b11815 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:09.334806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e8b341fa-4d5f-4096-b1c5-cdc9b9b11815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:09.383612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b341fa-4d5f-4096-b1c5-cdc9b9b11815 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:09.397284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:09.398017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:09.398364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:09.398826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:09.404974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:09.423243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:09.423766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:09.423861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:09.481553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] MFA Rules not processed for user `aa5e089e14854aec83cc6b1f9ca9fedc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:09.482941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:09.599918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:09.637562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:09.652039 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1169/2315] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:09 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:09.659667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:09.661637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1147/2316] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:09 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:09.661775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:09.837229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158f014-3f57-4783-8baf-2194957181d3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:09.859657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f3501-3b00-4a97-89b4-cb21c9d73a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:09.863410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f3501-3b00-4a97-89b4-cb21c9d73a8c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:09.863706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f3501-3b00-4a97-89b4-cb21c9d73a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:09.864139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f3501-3b00-4a97-89b4-cb21c9d73a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:09.866522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f3501-3b00-4a97-89b4-cb21c9d73a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:09.868583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f3501-3b00-4a97-89b4-cb21c9d73a8c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:10.085994 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1170/2317] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:09 2021] POST /identity/v3/projects => generated 403 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:10.091263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:10.108031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588b62-7046-4e78-8b43-f97655feb773 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:10.297554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f39df-65b0-4b33-8a67-17cd69e3d1ac None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:10.297904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f39df-65b0-4b33-8a67-17cd69e3d1ac None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:10.298146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f39df-65b0-4b33-8a67-17cd69e3d1ac None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:10.300577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1171/2318] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:08:10.324400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f39df-65b0-4b33-8a67-17cd69e3d1ac None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:08:10.391453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:10.396120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:10.396639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:10.397091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:10.398147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:10.403694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:10.578630 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1148/2319] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:10 2021] POST /identity/v3/users => generated 308 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:10.579835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:10.583497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:10.646840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f39df-65b0-4b33-8a67-17cd69e3d1ac None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:10.648002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39adfed-ddf9-4e03-a1e4-96dfcb255ebe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:10.663151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:10.663151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:10.663151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:10.670445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] PATH_INFO: `/v3/projects/ae237d62f92243ef85f30e7ed6f6e28f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:10.672631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae237d62f92243ef85f30e7ed6f6e28f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:10.684637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:10.837271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f39df-65b0-4b33-8a67-17cd69e3d1ac None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:10.842870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae237d62f92243ef85f30e7ed6f6e28f', 'request_id': 'req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:10.857908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae237d62f92243ef85f30e7ed6f6e28f', 'request_id': 'req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:10.929764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169307b11c045848f11262b004ccfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f181e0abde3e4a55a74f2abc9e764360', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:10.930664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:10.930910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:10.931184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] PATH_INFO: `/v3/projects/0b2cf24cb701492c91a759d2a54b35b3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:10.933128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b2cf24cb701492c91a759d2a54b35b3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:10.935501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:10.942653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae237d62f92243ef85f30e7ed6f6e28f', 'request_id': 'req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:10.975475 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1172/2320] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:08:10 2021] GET /identity/v3/projects/0b2cf24cb701492c91a759d2a54b35b3 => generated 393 bytes in 659 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:10.980037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:10.989117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] The token cache is being invalidate because project ae237d62f92243ef85f30e7ed6f6e28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:10.992653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:10.993971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3cee18d0-5ac7-40b2-ad2a-a53dcf1f5a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:11.002790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1149/2321] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:10 2021] DELETE /identity/v3/projects/ae237d62f92243ef85f30e7ed6f6e28f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:11.009539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:11.009827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:11.012714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:11.090209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:11.096773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:11.183881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845599d2-4b8e-4344-ad23-3bb8c89c952c tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:11.199308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cf167-ccef-4648-a7ca-80c8983cbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:11.199977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cf167-ccef-4648-a7ca-80c8983cbc30 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:11.200758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cf167-ccef-4648-a7ca-80c8983cbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:11.201145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cf167-ccef-4648-a7ca-80c8983cbc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:11.203501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cf167-ccef-4648-a7ca-80c8983cbc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:11.208713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cf167-ccef-4648-a7ca-80c8983cbc30 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:11.240940 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1173/2322] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:10 2021] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:11.240940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:11.240940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:11.240940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:11.251591 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1150/2323] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:11.252678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:11.258123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:11.286246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1c192-01fc-47b0-8f99-53e826a4d950 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:11.300627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9bfbc-a778-42fa-856e-176cb3cb303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:11.323022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9bfbc-a778-42fa-856e-176cb3cb303e admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:11.323022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9bfbc-a778-42fa-856e-176cb3cb303e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:11.323022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9bfbc-a778-42fa-856e-176cb3cb303e admin admin] PATH_INFO: `/v3/projects/d048456167bb496da920eeaed310f9be/users/5610a6a7a189428fad8ed6e25a0569ab/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:11.330863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] MFA Rules not processed for user `66b9e8144a0048a581cc606482753808`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:11.332255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:11.375462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9bfbc-a778-42fa-856e-176cb3cb303e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d048456167bb496da920eeaed310f9be, user_id=5610a6a7a189428fad8ed6e25a0569ab, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:11.379983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9bfbc-a778-42fa-856e-176cb3cb303e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:11.532533 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1151/2324] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:11 2021] PUT /identity/v3/projects/d048456167bb496da920eeaed310f9be/users/5610a6a7a189428fad8ed6e25a0569ab/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:11.534238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38058e77-f989-4c14-be3b-47a1bea880a9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:11.535669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38058e77-f989-4c14-be3b-47a1bea880a9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:11.536103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38058e77-f989-4c14-be3b-47a1bea880a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:11.618685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-38058e77-f989-4c14-be3b-47a1bea880a9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:11.620378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-38058e77-f989-4c14-be3b-47a1bea880a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:11.631444 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1174/2325] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:11 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:11.632333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:11.634817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:11.696185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aff1f-00b5-4b11-b879-44cf2eff6128 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:11.808680 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1152/2326] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:11.816222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38058e77-f989-4c14-be3b-47a1bea880a9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:11.839431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38058e77-f989-4c14-be3b-47a1bea880a9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:11.849648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:11.850632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:11.852811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:11.853334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:11.854823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:11.863635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:11.871565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:11.872601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:11.873046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:11.873397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] PATH_INFO: `/v3/users/8bd1919231cd43d7a4b5bdf170586892` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:11.882235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd1919231cd43d7a4b5bdf170586892)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:11.884397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:11.903788 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1153/2327] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:11 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:11.905191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:11.913470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:12.133968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc44b7-f3c2-42af-9c5f-866422e98eb7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:12.145548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:12.147564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:12.148026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:12.149023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:12.186100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd1919231cd43d7a4b5bdf170586892'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:12.207395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd1919231cd43d7a4b5bdf170586892'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:12.248425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd1919231cd43d7a4b5bdf170586892'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:12.251885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd1919231cd43d7a4b5bdf170586892'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:12.268957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:12.271413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:12.284036 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1154/2328] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:11 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:12.285404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:12.299732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0cb4b-fc60-46f6-badc-7bb9d4e03b92 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:12.316765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b7b97-9e2e-4590-a1ec-ae7d9d1e96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:12.318644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b7b97-9e2e-4590-a1ec-ae7d9d1e96bb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:12.319463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b7b97-9e2e-4590-a1ec-ae7d9d1e96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:12.321167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b7b97-9e2e-4590-a1ec-ae7d9d1e96bb admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:12.323535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b7b97-9e2e-4590-a1ec-ae7d9d1e96bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:08:12.324057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b7b97-9e2e-4590-a1ec-ae7d9d1e96bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:12.327030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b7b97-9e2e-4590-a1ec-ae7d9d1e96bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:12.333682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd1919231cd43d7a4b5bdf170586892'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:12.350729 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1175/2329] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:11 2021] DELETE /identity/v3/users/8bd1919231cd43d7a4b5bdf170586892 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:12.353171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:12.356234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:12.373615 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1155/2330] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:08:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:12.375341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:12.375471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:12.375730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:12.434775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:12.441295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:12.534790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7bf5d-a671-430a-a7f0-9f7eb9ec1e9b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:12.545911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:12.548748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:12.548748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:12.552551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] PATH_INFO: `/v3/projects/d048456167bb496da920eeaed310f9be/users/5610a6a7a189428fad8ed6e25a0569ab/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:12.562189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d048456167bb496da920eeaed310f9be, user_id=5610a6a7a189428fad8ed6e25a0569ab, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:12.573839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:12.614766 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1176/2331] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:12 2021] PUT /identity/v3/projects/d048456167bb496da920eeaed310f9be/users/5610a6a7a189428fad8ed6e25a0569ab/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:12.616027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:12.622007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:12.648833 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1156/2332] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:12.684700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:12.686660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:12.783597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e8dd-75c0-49ce-a550-509eda2c89a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:12.792356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:12.794071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:12.794651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:12.795153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:12.796636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:12.798825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:12.846084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25b124-d551-4249-8e27-c34c47c611bc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:12.965527 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1177/2333] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:12 2021] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:12.969358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:12.987289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:12.990184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:12.991075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:12.991369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:13.040168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:13.045434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:13.089734 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1157/2334] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:13.159242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0652e94-2ae4-4491-be8c-d80136bec7a7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:13.173092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:13.173797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:13.175069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:13.175069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:13.175069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:13.177007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:13.314403 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1178/2335] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:12 2021] POST /identity/v3/users => generated 290 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:13.315847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:13.341148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d30c6-5c65-4688-85ce-835869460c63 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:13.347299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:13.348225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:13.348602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:13.349575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:13.350432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:13.352517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:13.373312 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1158/2336] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:13 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:13.373498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:13.389578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4016b-0400-4b5c-a0bd-124b6a2d78bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:13.410912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84adac2-e534-4560-b9e0-4ad4aa1cf997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:13.411858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84adac2-e534-4560-b9e0-4ad4aa1cf997 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:13.413397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84adac2-e534-4560-b9e0-4ad4aa1cf997 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:13.415115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84adac2-e534-4560-b9e0-4ad4aa1cf997 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:13.418676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84adac2-e534-4560-b9e0-4ad4aa1cf997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:13.423672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84adac2-e534-4560-b9e0-4ad4aa1cf997 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:13.463958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1179/2337] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:13 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:13.469692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:13.488604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398e20c-9700-4a77-b670-8faf62fb3457 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:13.514996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:13.516051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:13.516402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:13.516770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] PATH_INFO: `/v3/projects/eb86ae064e7543c2ad11a93f28d79edd/users/ee57c0190f944d9692b1f81cad983159/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:13.562120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb86ae064e7543c2ad11a93f28d79edd, user_id=ee57c0190f944d9692b1f81cad983159, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:13.565110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:13.664275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1159/2338] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:13 2021] PUT /identity/v3/projects/eb86ae064e7543c2ad11a93f28d79edd/users/ee57c0190f944d9692b1f81cad983159/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:13.679031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5d5c-5578-426d-9422-1e8d6a9b3b06 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:13.679429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5d5c-5578-426d-9422-1e8d6a9b3b06 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:13.679859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5d5c-5578-426d-9422-1e8d6a9b3b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:13.754957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f9cb5d5c-5578-426d-9422-1e8d6a9b3b06 None None] MFA Rules not processed for user `ee57c0190f944d9692b1f81cad983159`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:13.756799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f9cb5d5c-5578-426d-9422-1e8d6a9b3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:13.877461 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1180/2339] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:13 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:13.881965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:14.051213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeee852-42c9-4f87-a367-bd738991f8f4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:14.071029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:14.072054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:14.072054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:14.072439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:14.076004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:14.079557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:14.213727 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1160/2340] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:13 2021] POST /identity/v3/projects => generated 377 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:08:14.215024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb5d5c-5578-426d-9422-1e8d6a9b3b06 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:14.247378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb5d5c-5578-426d-9422-1e8d6a9b3b06 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:14.396931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:14.397642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:14.397924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:14.398276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:14.398997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:14.401013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:14.543367 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1181/2341] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:14 2021] POST /identity/v3/users => generated 295 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:14.545882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:14.564501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651fff-1cf6-4482-8d53-c8e45e219ff9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:14.577053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:14.577745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:14.578028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:14.578304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:14.579057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:14.580848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:14.620647 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1161/2342] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:14 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:14.621855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:14.638334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6268c-ca8b-4b38-9fdd-b7d63df74c20 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:14.674878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:14.680063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:14.682971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:14.684664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] PATH_INFO: `/v3/projects/5eb4d3ba3c6045d49d8664c69d20c815/users/0d39cf369e434ed0a5962c28804787ba/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:14.755665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb4d3ba3c6045d49d8664c69d20c815, user_id=0d39cf369e434ed0a5962c28804787ba, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:14.758379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:14.812376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:14.815199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:14.834109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f041c-469a-41e1-9ee0-b38c6b69cacd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:14.842824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:14.855090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:14.857045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:14.857449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] PATH_INFO: `/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:14.871875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5666a184d9d4b14bb32e635a9b75bf4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:14.877608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:14.973293 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1182/2343] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:14 2021] PUT /identity/v3/projects/5eb4d3ba3c6045d49d8664c69d20c815/users/0d39cf369e434ed0a5962c28804787ba/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:14.977666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:15.108661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5666a184d9d4b14bb32e635a9b75bf4', 'request_id': 'req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:15.120547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5666a184d9d4b14bb32e635a9b75bf4', 'request_id': 'req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:15.158426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709e138-4938-4d94-acb3-510d6c99de8c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:15.208032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5666a184d9d4b14bb32e635a9b75bf4', 'request_id': 'req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:15.235148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] The token cache is being invalidate because project e5666a184d9d4b14bb32e635a9b75bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:15.235921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:15.238779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:15.244750 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1162/2344] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:14 2021] DELETE /identity/v3/projects/e5666a184d9d4b14bb32e635a9b75bf4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:15.245916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:15.247838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:15.289488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:15.290113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:15.290397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:15.290676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:15.291473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:15.321632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:15.363131 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1183/2345] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:14 2021] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:15.401550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:15.403633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:15.455334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9060-9952-4c43-b30f-bf615fbf9b1c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:15.455543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfa6eb-4668-4dfb-b284-fcb52d56e13c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:15.455543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:15.455543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:15.455543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:15.455866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] PATH_INFO: `/v3/users/9169307b11c045848f11262b004ccfc2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:15.455866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=9169307b11c045848f11262b004ccfc2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:15.455866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:15.459169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c1b00-0e3f-4462-af8e-661dd47a1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:15.460107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1b00-0e3f-4462-af8e-661dd47a1409 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:15.460476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1b00-0e3f-4462-af8e-661dd47a1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:15.462881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1b00-0e3f-4462-af8e-661dd47a1409 admin admin] PATH_INFO: `/v3/projects/5eb4d3ba3c6045d49d8664c69d20c815/users/0d39cf369e434ed0a5962c28804787ba/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:15.472283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c1b00-0e3f-4462-af8e-661dd47a1409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb4d3ba3c6045d49d8664c69d20c815, user_id=0d39cf369e434ed0a5962c28804787ba, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:15.475911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c1b00-0e3f-4462-af8e-661dd47a1409 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:15.519432 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1184/2346] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:15 2021] PUT /identity/v3/projects/5eb4d3ba3c6045d49d8664c69d20c815/users/0d39cf369e434ed0a5962c28804787ba/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:15.525941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:15.526310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:15.526512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:15.654056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] MFA Rules not processed for user `0d39cf369e434ed0a5962c28804787ba`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:15.655671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:15.757193 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1185/2347] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:15 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:15.977289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:15.979968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:16.072128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9169307b11c045848f11262b004ccfc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:16.083094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9169307b11c045848f11262b004ccfc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:16.096529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9169307b11c045848f11262b004ccfc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:16.097459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9169307b11c045848f11262b004ccfc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:16.098270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-74f5cb11-9f9b-468d-835b-709d620e4dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9169307b11c045848f11262b004ccfc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:16.149810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71392-582e-4b13-879b-a816dee8bd7e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:16.157174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:16.158069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:16.158417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:16.158766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:16.161200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:16.176305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:16.180411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:16.193928 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1186/2348] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:15 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:16.258839 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1163/2349] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:15 2021] DELETE /identity/v3/users/9169307b11c045848f11262b004ccfc2 => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:16.842509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:16.844186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:16.995083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261b7ae-aa44-4b31-b030-f240f5a3672b service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:17.131105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:17.133775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:17.136508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:17.137066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] PATH_INFO: `/v3/users/ee57c0190f944d9692b1f81cad983159` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:17.139186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee57c0190f944d9692b1f81cad983159)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:17.143168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:17.459748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee57c0190f944d9692b1f81cad983159'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:17.477234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee57c0190f944d9692b1f81cad983159'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:17.501624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee57c0190f944d9692b1f81cad983159'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:17.503282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee57c0190f944d9692b1f81cad983159'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:17.640993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee57c0190f944d9692b1f81cad983159'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:17.650559 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1187/2350] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:16 2021] DELETE /identity/v3/users/ee57c0190f944d9692b1f81cad983159 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:17.659158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:17.660125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:17.666065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:17.715895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:17.717375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:17.896530 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1164/2351] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:17.909649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:17.911936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:18.071773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2f99-cb0d-48cc-b570-c14586306403 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:18.081584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:18.086994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:18.086994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:18.086994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:18.114284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:18.116037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:18.132568 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1188/2352] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:18.409621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:18.411218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:18.434287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7912e8c-cc7e-4673-8f79-42c390855da1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:18.450957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:18.452199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:18.452582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:18.452983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] PATH_INFO: `/v3/projects/f181e0abde3e4a55a74f2abc9e764360` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:18.463092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f181e0abde3e4a55a74f2abc9e764360)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:18.466021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:18.699198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f181e0abde3e4a55a74f2abc9e764360', 'request_id': 'req-a366e0c6-8dbf-425c-b464-8f72043d7f73'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:18.711242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f181e0abde3e4a55a74f2abc9e764360', 'request_id': 'req-a366e0c6-8dbf-425c-b464-8f72043d7f73'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:18.773040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:18.774557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:18.796290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f181e0abde3e4a55a74f2abc9e764360', 'request_id': 'req-a366e0c6-8dbf-425c-b464-8f72043d7f73'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:18.800330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae315-cec2-49e8-9107-c84e195f32b1 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:18.818404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] The token cache is being invalidate because project f181e0abde3e4a55a74f2abc9e764360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:18.818846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:18.819857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:18.822895 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1165/2353] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:18 2021] DELETE /identity/v3/projects/f181e0abde3e4a55a74f2abc9e764360 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:18.830148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:18.833039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:18.927340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:18.933129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:18.933420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:18.933700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] PATH_INFO: `/v3/projects/eb86ae064e7543c2ad11a93f28d79edd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:18.949797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb86ae064e7543c2ad11a93f28d79edd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:18.954763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:19.009517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366e0c6-8dbf-425c-b464-8f72043d7f73 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:19.015944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:19.017125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:19.017567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:19.017995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] PATH_INFO: `/v3/users/8c93df29f3ce4f36ba6a8ba996036840` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:19.019467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c93df29f3ce4f36ba6a8ba996036840)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:19.021769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:19.140695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb86ae064e7543c2ad11a93f28d79edd', 'request_id': 'req-3a6170d1-3c65-4c49-89ec-341905b63908'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.292012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb86ae064e7543c2ad11a93f28d79edd', 'request_id': 'req-3a6170d1-3c65-4c49-89ec-341905b63908'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.307781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb86ae064e7543c2ad11a93f28d79edd', 'request_id': 'req-3a6170d1-3c65-4c49-89ec-341905b63908'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.312814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] The token cache is being invalidate because project eb86ae064e7543c2ad11a93f28d79edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:19.313238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.313900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.315870 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1189/2354] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:18 2021] DELETE /identity/v3/projects/eb86ae064e7543c2ad11a93f28d79edd => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:19.319658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:19.321385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:19.363322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c93df29f3ce4f36ba6a8ba996036840'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.374134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c93df29f3ce4f36ba6a8ba996036840'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.397272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c93df29f3ce4f36ba6a8ba996036840'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.398073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c93df29f3ce4f36ba6a8ba996036840'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.399281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c93df29f3ce4f36ba6a8ba996036840'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:19.419613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6170d1-3c65-4c49-89ec-341905b63908 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:19.425373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:19.427193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:19.427433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:19.427687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] PATH_INFO: `/v3/users/0d39cf369e434ed0a5962c28804787ba` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:19.429434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d39cf369e434ed0a5962c28804787ba)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:19.432195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:19.535895 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1166/2355] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:18 2021] DELETE /identity/v3/users/8c93df29f3ce4f36ba6a8ba996036840 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:08:20.137416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d39cf369e434ed0a5962c28804787ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.160232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d39cf369e434ed0a5962c28804787ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.192509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d39cf369e434ed0a5962c28804787ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.192509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d39cf369e434ed0a5962c28804787ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.284475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:20.286152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:20.339941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf5a39c4-cdd9-4bea-b5e4-ed3449b2ddb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d39cf369e434ed0a5962c28804787ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.358062 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1190/2356] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:19 2021] DELETE /identity/v3/users/0d39cf369e434ed0a5962c28804787ba => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:20.395550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85d916-7e1a-4563-82cb-2328b2b2e246 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:20.512911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:20.513979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:20.514261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:20.514536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] PATH_INFO: `/v3/projects/0b2cf24cb701492c91a759d2a54b35b3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:20.515786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2cf24cb701492c91a759d2a54b35b3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:20.517775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:20.650425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2cf24cb701492c91a759d2a54b35b3', 'request_id': 'req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.657583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2cf24cb701492c91a759d2a54b35b3', 'request_id': 'req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.749426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2cf24cb701492c91a759d2a54b35b3', 'request_id': 'req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.792699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] The token cache is being invalidate because project 0b2cf24cb701492c91a759d2a54b35b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:20.793192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.796640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:20.812252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1167/2357] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:20 2021] DELETE /identity/v3/projects/0b2cf24cb701492c91a759d2a54b35b3 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:20.813190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802f78-405f-4a48-a17c-8b3e63a04bd9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:20.813483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802f78-405f-4a48-a17c-8b3e63a04bd9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:20.822302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d802f78-405f-4a48-a17c-8b3e63a04bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:20.838609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7d802f78-405f-4a48-a17c-8b3e63a04bd9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:20.839844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7d802f78-405f-4a48-a17c-8b3e63a04bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:20.906639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:20.908287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:20.926961 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1191/2358] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:20.929227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41933ffb-8dc0-4fd8-957c-18a1abf69ba1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:20.929651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41933ffb-8dc0-4fd8-957c-18a1abf69ba1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:20.930004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41933ffb-8dc0-4fd8-957c-18a1abf69ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:20.961216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aa5aa-10f4-4c3b-97ea-88e0cf255d75 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:20.977702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:20.978224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-41933ffb-8dc0-4fd8-957c-18a1abf69ba1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:20.979374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:20.979970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-41933ffb-8dc0-4fd8-957c-18a1abf69ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:20.980091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:20.980432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] PATH_INFO: `/v3/projects/5eb4d3ba3c6045d49d8664c69d20c815` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:20.982117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb4d3ba3c6045d49d8664c69d20c815)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:20.985939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:20.989498 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1192/2359] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:20.993901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41933ffb-8dc0-4fd8-957c-18a1abf69ba1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.004799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41933ffb-8dc0-4fd8-957c-18a1abf69ba1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.010198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.010858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.011477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.011903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.012960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:08:21.013436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.015261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.028823 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1193/2360] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:08:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:21.034546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.048168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9f0cf-20d8-454c-9ade-d0036bbf2c82 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.053676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.054978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.055598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.055882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.056591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.059141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.177152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb4d3ba3c6045d49d8664c69d20c815', 'request_id': 'req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:21.183917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb4d3ba3c6045d49d8664c69d20c815', 'request_id': 'req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:21.206760 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1194/2361] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/projects => generated 399 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:21.210884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.265048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb4d3ba3c6045d49d8664c69d20c815', 'request_id': 'req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:21.277713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] The token cache is being invalidate because project 5eb4d3ba3c6045d49d8664c69d20c815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:21.277988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:21.278627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ce7c28e0-7ef4-4d20-a84b-2ed2e046a47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:21.279671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775b5fc-e75f-4ee5-b08d-e914240de713 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.280493 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1168/2362] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:20 2021] DELETE /identity/v3/projects/5eb4d3ba3c6045d49d8664c69d20c815 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:08:21.287700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8546e-d3b1-493f-8939-01cee41a5c20 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.288289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8546e-d3b1-493f-8939-01cee41a5c20 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.288289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8546e-d3b1-493f-8939-01cee41a5c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.290571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.292096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.294718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.294718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.294718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.296236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.312259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3ac8546e-d3b1-493f-8939-01cee41a5c20 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:21.313850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3ac8546e-d3b1-493f-8939-01cee41a5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:21.321799 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1169/2363] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:21.330429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2827c6-b534-4562-a7ba-529c14fb43e8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.330791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2827c6-b534-4562-a7ba-529c14fb43e8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.331075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2827c6-b534-4562-a7ba-529c14fb43e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.350332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7f2827c6-b534-4562-a7ba-529c14fb43e8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:21.351505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7f2827c6-b534-4562-a7ba-529c14fb43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:21.363373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1170/2364] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:21.366518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2827c6-b534-4562-a7ba-529c14fb43e8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.376445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2827c6-b534-4562-a7ba-529c14fb43e8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.381357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.382004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.382725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.384408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.384408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:08:21.384408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.386478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.393408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1195/2365] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:08:21.397326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.404139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:21.404275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1171/2366] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:08:21.407541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.412285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d362-b91d-46a7-9d73-8a5f3ab29619 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.417824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.418574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.418963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.419339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.420179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.420393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe6c8-fe53-402b-8e63-4f081987555e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.422011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.425331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.425975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.426252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.426558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.428074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.430035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.434399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1196/2367] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:21.437571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.449663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07793165-36cd-414a-a5a0-cfee067fcf68 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.454723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.455455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.455806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.456145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.456982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.458766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.474275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1197/2368] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:21.478586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.493465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998e5a5-ba88-4b9c-8c05-32b2a39648b5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.495407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189e16-213c-416f-9c22-daa7ae1af419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.496287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189e16-213c-416f-9c22-daa7ae1af419 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.496573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189e16-213c-416f-9c22-daa7ae1af419 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.496852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189e16-213c-416f-9c22-daa7ae1af419 admin admin] PATH_INFO: `/v3/projects/6ffb8f31156140e99186291a9ada4eed/users/f871adc4c2954c29b7cf443219440ed9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.513199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5189e16-213c-416f-9c22-daa7ae1af419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffb8f31156140e99186291a9ada4eed, user_id=f871adc4c2954c29b7cf443219440ed9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.515821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5189e16-213c-416f-9c22-daa7ae1af419 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.532832 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1172/2369] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/projects => generated 411 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:21.537116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.597627 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1198/2370] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:21 2021] PUT /identity/v3/projects/6ffb8f31156140e99186291a9ada4eed/users/f871adc4c2954c29b7cf443219440ed9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:21.605622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd08a-4c65-40a9-87a5-33245477e185 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.608994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc206e6-0663-4b8d-8c49-7aebfe936f56 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.609505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc206e6-0663-4b8d-8c49-7aebfe936f56 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.610092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc206e6-0663-4b8d-8c49-7aebfe936f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.640492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9dc206e6-0663-4b8d-8c49-7aebfe936f56 None None] MFA Rules not processed for user `f871adc4c2954c29b7cf443219440ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:21.641820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9dc206e6-0663-4b8d-8c49-7aebfe936f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:21.666284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.666958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.667239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.667529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.668336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.670351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.712598 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1199/2371] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:21.713732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc206e6-0663-4b8d-8c49-7aebfe936f56 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.724725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc206e6-0663-4b8d-8c49-7aebfe936f56 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.733444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.733444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.733978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.734258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.734969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.736935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.757839 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1173/2372] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/users => generated 306 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:08:21.761741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.772424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6c9c-f691-4b0d-8625-9a398370fc5d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.778502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.779110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.782794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.782794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.782794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.782794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.796315 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1174/2373] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:21.800131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.816043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20077d91-cf1e-4649-a63b-8ee2930770d4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.823695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.824771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.827147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.830530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.831328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.832987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:21.851583 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1175/2374] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:21.864860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.870708 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1200/2375] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/projects => generated 399 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:08:21.873630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:21.895017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767c4d-e23b-4080-b05a-e0ffc2ad89fb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.988326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e46183-96ff-4b9e-9bac-9cec5d547f13 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:21.993384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c2cda-41b1-44e1-a59d-1f0da3c486a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.994299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2cda-41b1-44e1-a59d-1f0da3c486a5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.995201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2cda-41b1-44e1-a59d-1f0da3c486a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.995578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c2cda-41b1-44e1-a59d-1f0da3c486a5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.996280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:21.996788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c2cda-41b1-44e1-a59d-1f0da3c486a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:21.997883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:21.998166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:21.998443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] PATH_INFO: `/v3/projects/e65cafc179094f63bf88bfba4c57fd1f/users/6441cac91831435cb23d56e935cb99c6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:21.999132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c2cda-41b1-44e1-a59d-1f0da3c486a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.021409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65cafc179094f63bf88bfba4c57fd1f, user_id=6441cac91831435cb23d56e935cb99c6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:22.021409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.102923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1201/2376] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:21 2021] POST /identity/v3/users => generated 306 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:22.105195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e1da-0a93-47b8-ab37-ceba7378a390 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.105769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e1da-0a93-47b8-ab37-ceba7378a390 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.114082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e1da-0a93-47b8-ab37-ceba7378a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.146320 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1176/2377] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:21 2021] PUT /identity/v3/projects/e65cafc179094f63bf88bfba4c57fd1f/users/6441cac91831435cb23d56e935cb99c6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:22.151184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:22.162129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7a32e1da-0a93-47b8-ab37-ceba7378a390 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:22.163359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7a32e1da-0a93-47b8-ab37-ceba7378a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:22.216962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021116f7-fb3d-48d8-8a8d-2da3db768221 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:22.221838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b6155-785b-4569-94b0-a9b59cb6d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:22.222523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b6155-785b-4569-94b0-a9b59cb6d6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.222794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b6155-785b-4569-94b0-a9b59cb6d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.223069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b6155-785b-4569-94b0-a9b59cb6d6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.224045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b6155-785b-4569-94b0-a9b59cb6d6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:22.225688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b6155-785b-4569-94b0-a9b59cb6d6e8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.236925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1177/2378] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:22 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:22.238352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.238644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.239011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.241645 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1202/2379] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:08:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:22.258544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e1da-0a93-47b8-ab37-ceba7378a390 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:22.260560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:22.261833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:22.270294 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1178/2380] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:22.277535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e1da-0a93-47b8-ab37-ceba7378a390 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:22.281147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:22.286418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:22.286594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:22.286594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.286594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.286594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] PATH_INFO: `/v3/projects/45ee502aa2e14490913adf8a5892ef22/users/21cb3d59b0bf4d34abf1f7a970165ef9/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.306543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ee502aa2e14490913adf8a5892ef22, user_id=21cb3d59b0bf4d34abf1f7a970165ef9, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:22.309689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.375057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa4f4-d2f5-4d4d-8044-885cc3432384 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:22.381044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:22.381712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.381983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.382422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.393009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:22.394612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.403311 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1179/2381] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:08:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:22.404170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:22.406089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:22.460456 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1203/2382] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:22 2021] PUT /identity/v3/projects/45ee502aa2e14490913adf8a5892ef22/users/21cb3d59b0bf4d34abf1f7a970165ef9/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:22.461469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:22.472937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ef9f6-8d7f-4d05-84ca-7b395e549aa9 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:22.549602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5a652-544e-466c-8f74-d72be1072b22 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:22.557592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aa460-1fd4-4b4c-9989-fe6851d41093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:22.558391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:22.558957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa460-1fd4-4b4c-9989-fe6851d41093 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.559079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.559268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa460-1fd4-4b4c-9989-fe6851d41093 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.559374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.559554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aa460-1fd4-4b4c-9989-fe6851d41093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.559643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.560487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:22.562516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.569464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aa460-1fd4-4b4c-9989-fe6851d41093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:22.570891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aa460-1fd4-4b4c-9989-fe6851d41093 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.573668 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1204/2383] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:22 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:22.577692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:22.581996 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1180/2384] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:22.587945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c8628-ad23-493e-9529-5cb3776d0775 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:22.593701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:22.594662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.594979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.595215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] PATH_INFO: `/v3/projects/45ee502aa2e14490913adf8a5892ef22/users/21cb3d59b0bf4d34abf1f7a970165ef9/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.597350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ee502aa2e14490913adf8a5892ef22, user_id=21cb3d59b0bf4d34abf1f7a970165ef9, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:22.600129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:22.612470 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1205/2385] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:22 2021] PUT /identity/v3/projects/45ee502aa2e14490913adf8a5892ef22/users/21cb3d59b0bf4d34abf1f7a970165ef9/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:08:22.622217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d366c9-81a1-4051-bc5e-7fe750dcb0c3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:22.622617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d366c9-81a1-4051-bc5e-7fe750dcb0c3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:22.623004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d366c9-81a1-4051-bc5e-7fe750dcb0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:22.667391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d4d366c9-81a1-4051-bc5e-7fe750dcb0c3 None None] MFA Rules not processed for user `21cb3d59b0bf4d34abf1f7a970165ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:22.667981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4d366c9-81a1-4051-bc5e-7fe750dcb0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:22.748928 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1181/2386] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:22 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:23.674536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:23.676967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:23.803718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5fc2b-6823-4990-9a95-3d62c5a6b171 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:23.810595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:23.811603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:23.811948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:23.812284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:23.883586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:23.885524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:23.895227 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1206/2387] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:23 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:24.838689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dae1a-d4d4-45af-ae77-52c4630c39db None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:24.839177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dae1a-d4d4-45af-ae77-52c4630c39db None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:24.839427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dae1a-d4d4-45af-ae77-52c4630c39db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:24.876323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6e8dae1a-d4d4-45af-ae77-52c4630c39db None None] MFA Rules not processed for user `2cb2a59c7c9b4a13964c78ff0fb1a8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:24.877659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6e8dae1a-d4d4-45af-ae77-52c4630c39db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:25.009301 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1182/2388] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:24 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:25.936006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:25.938307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:25.985429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7694574-5296-452f-a9c4-dfcfebd62974 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:26.021599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:26.024846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:26.025970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:26.026599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:26.027604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:26.027814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:26.028253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:26.051998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:26.055262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:26.070236 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1207/2389] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:25 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:26.070728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] MFA Rules not processed for user `5610a6a7a189428fad8ed6e25a0569ab`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:26.072148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:26.234401 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1183/2390] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:26 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:27.461672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:27.481712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24d243-9902-4c44-a090-2981a6a89144 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:27.493605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f3518-1d62-477f-9079-cf270753b05e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:27.494302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f3518-1d62-477f-9079-cf270753b05e service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:27.494610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f3518-1d62-477f-9079-cf270753b05e service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:27.494944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f3518-1d62-477f-9079-cf270753b05e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:27.496826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b9f3518-1d62-477f-9079-cf270753b05e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:27.636726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f3518-1d62-477f-9079-cf270753b05e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:27.638519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f3518-1d62-477f-9079-cf270753b05e service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:27.665209 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1208/2391] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:27 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:28.048293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:28.049956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:28.180413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d94b6-94ff-4109-904e-a12388f9946e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:28.200746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:28.202816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:28.216538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:28.217138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] PATH_INFO: `/v3/users/6689f8b5d7b547a3ac63aabe8ecb8712` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:28.218660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6689f8b5d7b547a3ac63aabe8ecb8712)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:28.220608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:28.524351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6689f8b5d7b547a3ac63aabe8ecb8712'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:28.532783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6689f8b5d7b547a3ac63aabe8ecb8712'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:28.548364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6689f8b5d7b547a3ac63aabe8ecb8712'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:28.552367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6689f8b5d7b547a3ac63aabe8ecb8712'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:28.553251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6689f8b5d7b547a3ac63aabe8ecb8712'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:28.713313 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1184/2392] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:28 2021] DELETE /identity/v3/users/6689f8b5d7b547a3ac63aabe8ecb8712 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:28.716466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:28.717581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:28.718028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:28.754062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:28.755843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:28.874130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:28.875620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:28.895409 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1209/2393] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:28.908774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:28.910428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:29.041362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297962b6-1487-40aa-be56-7f5a63b96c36 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:29.059518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:29.061000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:29.061496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:29.063710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154430d6-9ee0-40db-88eb-db5834639e69 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:29.064861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:29.069290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:29.069924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:29.070999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:29.072094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:29.073481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:29.087246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:29.090493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:29.115726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1210/2394] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:29.189169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:29.195817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:29.209281 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1185/2395] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:28 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:29.986159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:29.988126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:30.012754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112962d7-c9b4-4e6c-94ad-83c845b6574e service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:30.019374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:30.020759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:30.022115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:30.022659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] PATH_INFO: `/v3/projects/f0a7e7426dc44124a01d7d7479839375` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:30.027030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a7e7426dc44124a01d7d7479839375)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:30.032485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:30.276725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a7e7426dc44124a01d7d7479839375', 'request_id': 'req-749a372c-5ac7-4782-abc1-605e80a7a6cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.436313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a7e7426dc44124a01d7d7479839375', 'request_id': 'req-749a372c-5ac7-4782-abc1-605e80a7a6cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.443478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a7e7426dc44124a01d7d7479839375', 'request_id': 'req-749a372c-5ac7-4782-abc1-605e80a7a6cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.461250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] The token cache is being invalidate because project f0a7e7426dc44124a01d7d7479839375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:30.461789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.463288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.474612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1211/2396] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:29 2021] DELETE /identity/v3/projects/f0a7e7426dc44124a01d7d7479839375 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:30.479301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:30.497050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:30.501504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fcbe-ea40-4ab3-9da2-c0469bf045b6 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:30.502266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:30.636378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a372c-5ac7-4782-abc1-605e80a7a6cc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:30.641429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:30.642337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:30.642627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:30.642741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:30.645433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] PATH_INFO: `/v3/users/1c4afd5525204e789d067abc77fc2e60` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:30.645554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:30.645554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:30.645554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] PATH_INFO: `/v3/users/f871adc4c2954c29b7cf443219440ed9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:30.645847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4afd5525204e789d067abc77fc2e60)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:30.647999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f871adc4c2954c29b7cf443219440ed9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:30.648509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:30.651091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:30.893207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4afd5525204e789d067abc77fc2e60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.906028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4afd5525204e789d067abc77fc2e60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.928591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4afd5525204e789d067abc77fc2e60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.930107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4afd5525204e789d067abc77fc2e60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.938239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-189dab2c-3515-43e5-ad1e-01a9f2ae3a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4afd5525204e789d067abc77fc2e60'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.965786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f871adc4c2954c29b7cf443219440ed9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:30.976934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f871adc4c2954c29b7cf443219440ed9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:31.023987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f871adc4c2954c29b7cf443219440ed9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:31.029312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f871adc4c2954c29b7cf443219440ed9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:31.039128 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1186/2397] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:30 2021] DELETE /identity/v3/users/1c4afd5525204e789d067abc77fc2e60 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:31.041454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:31.041892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:31.044016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:31.102762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:31.106298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:31.116402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ad499cd6-f9ae-461b-a542-ccc1cf0aabd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f871adc4c2954c29b7cf443219440ed9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:31.128755 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1212/2398] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:30 2021] DELETE /identity/v3/users/f871adc4c2954c29b7cf443219440ed9 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:31.134538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:31.134878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:31.135160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:31.169750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:31.174307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:31.239067 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1187/2399] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:08:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:31.254352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:31.255880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:31.323239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1213/2400] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:31.354895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:31.356985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:31.385576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351cb7b-062b-48e0-b2ab-e54355a351d2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:31.454457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d81a91-ebe3-4152-81e9-650f504a614c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:31.464331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:31.465142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:31.465502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:31.465752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f8c77-1ca6-4b0b-bfd1-42d90dfe9faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:31.465899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:31.466440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8c77-1ca6-4b0b-bfd1-42d90dfe9faa service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:31.466727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8c77-1ca6-4b0b-bfd1-42d90dfe9faa service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:31.467004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f8c77-1ca6-4b0b-bfd1-42d90dfe9faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:31.495955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f8c77-1ca6-4b0b-bfd1-42d90dfe9faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:31.500797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f8c77-1ca6-4b0b-bfd1-42d90dfe9faa service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:31.531013 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1214/2401] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:31.563310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:31.566112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:31.610846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1188/2402] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:08:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:08:31.901548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed4a5e-cba2-4680-accb-1774ba333c5e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:31.901842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed4a5e-cba2-4680-accb-1774ba333c5e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:31.902114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed4a5e-cba2-4680-accb-1774ba333c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:31.956283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-59ed4a5e-cba2-4680-accb-1774ba333c5e None None] MFA Rules not processed for user `491f06d5a64145919a6e4a9ec0fa9171`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:31.975530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-59ed4a5e-cba2-4680-accb-1774ba333c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:32.105956 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1215/2403] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:31 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:32.771731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:32.771731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:32.795782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054da5f-41c9-4c6d-beb8-4911806c7c34 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:32.811196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:32.812076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:32.812356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:32.812627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] PATH_INFO: `/v3/projects/d4ee003d0ba44bcfad9af5e3d7c70837` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:32.815633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ee003d0ba44bcfad9af5e3d7c70837)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:32.817582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:32.974971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ee003d0ba44bcfad9af5e3d7c70837', 'request_id': 'req-616d7b2d-8ea3-424a-a288-08e58297eeaf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:32.988452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ee003d0ba44bcfad9af5e3d7c70837', 'request_id': 'req-616d7b2d-8ea3-424a-a288-08e58297eeaf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:33.062404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ee003d0ba44bcfad9af5e3d7c70837', 'request_id': 'req-616d7b2d-8ea3-424a-a288-08e58297eeaf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:33.078925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] The token cache is being invalidate because project d4ee003d0ba44bcfad9af5e3d7c70837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:33.079492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:33.089203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-616d7b2d-8ea3-424a-a288-08e58297eeaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:33.091446 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1189/2404] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:32 2021] DELETE /identity/v3/projects/d4ee003d0ba44bcfad9af5e3d7c70837 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:33.097088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b2015-829d-4c0f-9b42-8646271b9c92 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:33.097740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b2015-829d-4c0f-9b42-8646271b9c92 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:33.098167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b2015-829d-4c0f-9b42-8646271b9c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:33.130721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b98b2015-829d-4c0f-9b42-8646271b9c92 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:33.132634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b98b2015-829d-4c0f-9b42-8646271b9c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:33.283354 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1216/2405] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:33.292169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad601bb9-6b1d-4c45-b970-d82b9bf7a954 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:33.292463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad601bb9-6b1d-4c45-b970-d82b9bf7a954 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:33.292738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad601bb9-6b1d-4c45-b970-d82b9bf7a954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:33.324244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ad601bb9-6b1d-4c45-b970-d82b9bf7a954 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:33.325667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ad601bb9-6b1d-4c45-b970-d82b9bf7a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:33.344485 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1190/2406] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:33.348933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b2015-829d-4c0f-9b42-8646271b9c92 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:33.359620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b2015-829d-4c0f-9b42-8646271b9c92 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:33.377419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:33.378096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:33.378373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:33.378644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:33.379372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:08:33.379847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:33.383627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:33.414695 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1217/2407] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:08:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:33.419362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad601bb9-6b1d-4c45-b970-d82b9bf7a954 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:33.429217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad601bb9-6b1d-4c45-b970-d82b9bf7a954 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:33.449436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:33.450120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:33.450404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:33.450671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:33.451382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:33.463756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:33.597177 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1191/2408] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:33 2021] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:33.598408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:33.615849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7ba03-47e8-4d48-bdf0-497907caf8b2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:33.730671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:33.732425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:33.759216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:33.760700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:33.765882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:33.766356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:33.767526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:33.769655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:33.844067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b79008-ac34-45d3-8327-bf2c676f99d2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:33.858251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:33.859738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:33.860087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:33.860276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] PATH_INFO: `/v3/projects/6ffb8f31156140e99186291a9ada4eed` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:33.876971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffb8f31156140e99186291a9ada4eed)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:33.876971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:33.878696 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1218/2409] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:33 2021] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:33.880560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:33.939070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e631f-0f87-4003-91df-3372c834c227 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:33.984102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:33.984102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:33.984102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:33.984102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:33.985772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:33.990096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:34.043597 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1219/2410] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:33 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:34.064044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:34.138429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23605b2-ffa3-4a6a-b6e6-b5fe8d52032d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:34.139071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffb8f31156140e99186291a9ada4eed', 'request_id': 'req-3dc145fc-df6d-44da-b911-858c5d62b870'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.155311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffb8f31156140e99186291a9ada4eed', 'request_id': 'req-3dc145fc-df6d-44da-b911-858c5d62b870'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.233580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffb8f31156140e99186291a9ada4eed', 'request_id': 'req-3dc145fc-df6d-44da-b911-858c5d62b870'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.264043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] The token cache is being invalidate because project 6ffb8f31156140e99186291a9ada4eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:34.264824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.265837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.269137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1192/2411] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:33 2021] DELETE /identity/v3/projects/6ffb8f31156140e99186291a9ada4eed => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:08:34.273581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:34.275784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:34.285244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:34.286703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:34.288157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:34.288677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:34.290384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:34.295154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:34.298189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc145fc-df6d-44da-b911-858c5d62b870 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:34.304267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:34.305266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:34.305548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:34.305997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] PATH_INFO: `/v3/users/21cb3d59b0bf4d34abf1f7a970165ef9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:34.307323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cb3d59b0bf4d34abf1f7a970165ef9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:34.310641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:34.311114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1220/2412] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:34 2021] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:34.312384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:34.315538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:34.330545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d303-09b1-433f-99cd-d661fdad8369 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:34.337078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b717b55-0cfd-4ae7-8a78-9241ca7b39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:34.339613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717b55-0cfd-4ae7-8a78-9241ca7b39fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:34.340062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717b55-0cfd-4ae7-8a78-9241ca7b39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:34.340489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717b55-0cfd-4ae7-8a78-9241ca7b39fc admin admin] PATH_INFO: `/v3/projects/5b6d5bd7bdb44cb4b96d8b09e2076afe/users/521350f6dd84495e93a070bf983b32c7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:34.359226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b717b55-0cfd-4ae7-8a78-9241ca7b39fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6d5bd7bdb44cb4b96d8b09e2076afe, user_id=521350f6dd84495e93a070bf983b32c7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:34.363071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b717b55-0cfd-4ae7-8a78-9241ca7b39fc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:34.515808 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1221/2413] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:34 2021] PUT /identity/v3/projects/5b6d5bd7bdb44cb4b96d8b09e2076afe/users/521350f6dd84495e93a070bf983b32c7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:34.522534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18da39b-5105-4061-968e-4d8bff84700f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:34.523042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18da39b-5105-4061-968e-4d8bff84700f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:34.523468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18da39b-5105-4061-968e-4d8bff84700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:34.616456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e18da39b-5105-4061-968e-4d8bff84700f None None] MFA Rules not processed for user `6441cac91831435cb23d56e935cb99c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:34.617827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e18da39b-5105-4061-968e-4d8bff84700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:34.645348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cb3d59b0bf4d34abf1f7a970165ef9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.670511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cb3d59b0bf4d34abf1f7a970165ef9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.701203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cb3d59b0bf4d34abf1f7a970165ef9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.701203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cb3d59b0bf4d34abf1f7a970165ef9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.701203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57f5317b-734c-40a6-859c-1cb3b42c4ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cb3d59b0bf4d34abf1f7a970165ef9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:34.784334 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1193/2414] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:34 2021] DELETE /identity/v3/users/21cb3d59b0bf4d34abf1f7a970165ef9 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:34.791920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:34.794082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:34.794442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:34.804235 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1222/2415] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:34 2021] POST /identity/v3/auth/tokens => generated 3278 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:34.814406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6d2a7-7608-4d1d-9bdb-010625af3e60 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:34.814965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6d2a7-7608-4d1d-9bdb-010625af3e60 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:34.815389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6d2a7-7608-4d1d-9bdb-010625af3e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:34.863729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] MFA Rules not processed for user `521350f6dd84495e93a070bf983b32c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:34.866854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:34.890252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-92b6d2a7-7608-4d1d-9bdb-010625af3e60 None None] MFA Rules not processed for user `6441cac91831435cb23d56e935cb99c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:34.912216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-92b6d2a7-7608-4d1d-9bdb-010625af3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:35.043979 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1194/2416] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:34 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:35.048273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:35.052455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:35.132069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1223/2417] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:34 2021] POST /identity/v3/auth/tokens => generated 3278 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:35.195187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b01a7e-7b24-4b49-bfc9-7380d57a1296 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:35.205428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:35.206150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:35.206426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:35.207900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:35.208618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:35.215929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:35.366417 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1195/2418] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:35 2021] POST /identity/v3/projects => generated 375 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:35.370601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6d2a7-7608-4d1d-9bdb-010625af3e60 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:35.388909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6d2a7-7608-4d1d-9bdb-010625af3e60 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:35.538438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:35.540149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:35.552090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:35.552784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:35.553101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:35.553382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:35.554127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:35.556041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:35.700313 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1224/2419] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:35 2021] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:35.703790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:35.730236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28337c2-822a-49d1-b92e-1c5b7ce61db7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:35.752490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:35.753473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:35.756154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:35.756646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:35.757706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:35.762131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:35.763054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dbac1-698a-4c57-bf5e-52651e9e4bc6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:35.802468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:35.803204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:35.803495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:35.803774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:35.819094 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1225/2420] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:35 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:35.821274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:35.863539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc0d57-34b9-4676-bcaf-be2a28e44776 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:35.881584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:35.882521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:35.882808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:35.883123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] PATH_INFO: `/v3/projects/2d69e208193f400ba83829e2140333e9/users/7dfcec1c9af14fd3ae6a81eff0b99937/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:35.920799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d69e208193f400ba83829e2140333e9, user_id=7dfcec1c9af14fd3ae6a81eff0b99937, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:35.923573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:35.949428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:35.951252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:35.987214 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1196/2421] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:35 2021] GET /identity/v3/auth/tokens => generated 3278 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:36.024367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:36.025888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:36.057129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04daca-6192-4c16-ac79-91d68e3d864d service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:36.075674 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1226/2422] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:35 2021] PUT /identity/v3/projects/2d69e208193f400ba83829e2140333e9/users/7dfcec1c9af14fd3ae6a81eff0b99937/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:36.079864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:36.111360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:36.112289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:36.112572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:36.112846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] PATH_INFO: `/v3/projects/45ee502aa2e14490913adf8a5892ef22` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:36.119830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ee502aa2e14490913adf8a5892ef22)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:36.131956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:36.326421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f560d-5257-4719-9a3b-6932cbdae554 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:36.342906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:36.343925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:36.345070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:36.346043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:36.348927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:36.352569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:36.370928 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1227/2423] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:36 2021] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:36.375661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:36.397824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b7617-442e-4125-98b8-8cabe0d8a1e0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:36.416435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e6bd-eab0-48b8-810d-62418549bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:36.417784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e6bd-eab0-48b8-810d-62418549bbba admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:36.418067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e6bd-eab0-48b8-810d-62418549bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:36.418345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e6bd-eab0-48b8-810d-62418549bbba admin admin] PATH_INFO: `/v3/projects/2d69e208193f400ba83829e2140333e9/users/7dfcec1c9af14fd3ae6a81eff0b99937/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:36.420526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e6bd-eab0-48b8-810d-62418549bbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d69e208193f400ba83829e2140333e9, user_id=7dfcec1c9af14fd3ae6a81eff0b99937, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:36.423237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e6bd-eab0-48b8-810d-62418549bbba admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:36.465160 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1228/2424] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:36 2021] PUT /identity/v3/projects/2d69e208193f400ba83829e2140333e9/users/7dfcec1c9af14fd3ae6a81eff0b99937/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:36.466835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:36.467122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:36.470538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:36.516439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] MFA Rules not processed for user `7dfcec1c9af14fd3ae6a81eff0b99937`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:36.518411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:36.745977 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1229/2425] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:36 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:36.754543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:36.756537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:36.954926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ee502aa2e14490913adf8a5892ef22', 'request_id': 'req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:36.989450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ee502aa2e14490913adf8a5892ef22', 'request_id': 'req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:37.009434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504c504-d408-4bef-848c-521728e44ab0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:37.085257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ee502aa2e14490913adf8a5892ef22', 'request_id': 'req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:37.106381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] The token cache is being invalidate because project 45ee502aa2e14490913adf8a5892ef22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:37.106674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:37.107998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2ae8782-f4de-45f0-a3aa-3367e77b1aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:37.109903 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1197/2426] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:36 2021] DELETE /identity/v3/projects/45ee502aa2e14490913adf8a5892ef22 => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:37.119126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a5ce-32c9-4845-afec-4b6937b189c6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:37.119413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a5ce-32c9-4845-afec-4b6937b189c6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:37.119691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a5ce-32c9-4845-afec-4b6937b189c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:37.177061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-adf6a5ce-32c9-4845-afec-4b6937b189c6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:37.178580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-adf6a5ce-32c9-4845-afec-4b6937b189c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:37.196550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:37.197617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:37.204225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:37.204225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:37.209914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:37.366658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1198/2427] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:37.372995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a6cda-9123-4c83-8d5b-27a82c6ff2e6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:37.374937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a6cda-9123-4c83-8d5b-27a82c6ff2e6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:37.375275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a6cda-9123-4c83-8d5b-27a82c6ff2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:37.419365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:37.422318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:37.427678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-777a6cda-9123-4c83-8d5b-27a82c6ff2e6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:37.433182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-777a6cda-9123-4c83-8d5b-27a82c6ff2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:37.439626 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1230/2428] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:36 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:37.470138 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1199/2429] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:37.476037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:37.498271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d647bd-fa47-4c98-a756-9cdd846f7b4c service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:37.512907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:37.514107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:37.514502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:37.514876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:37.515999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:08:37.516558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:37.518485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:37.553612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1231/2430] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:08:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:37.554037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a6cda-9123-4c83-8d5b-27a82c6ff2e6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:37.568210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a6cda-9123-4c83-8d5b-27a82c6ff2e6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:37.597283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:37.597972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:37.599195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:37.599898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:37.600669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:37.602951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:37.853422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1200/2431] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:37 2021] POST /identity/v3/projects => generated 405 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:08:37.856752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:37.876731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c7a0-0cfb-47ad-b7bd-13a14bb4841e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:38.045018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:38.045911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:38.046375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:38.046653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:38.047369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:38.057434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:38.251360 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1232/2432] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:37 2021] POST /identity/v3/users => generated 303 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:38.255479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:38.278331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3461dce-4396-42b9-bede-7fb53b99b533 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:38.314256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:38.315848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:38.316444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:38.317527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:38.319842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:38.326251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:38.364128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:38.364248 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1201/2433] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:38 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:38.413690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b1581-a4f6-4043-bf7c-7ea96767e8ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:38.435627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:38.438676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:38.438968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:38.441514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:38.456715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:38.463669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:38.512366 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1233/2434] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:38 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:38.517284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:38.533834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ac3c-cddc-4c06-88d8-0f6afa89fd51 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:38.563293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703c0b5-de7c-4786-bce7-47fd4edda4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:38.573513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c0b5-de7c-4786-bce7-47fd4edda4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:38.574026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c0b5-de7c-4786-bce7-47fd4edda4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:38.574763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c0b5-de7c-4786-bce7-47fd4edda4a7 admin admin] PATH_INFO: `/v3/projects/59f8b4655374484fb667a21c2fcd9844/users/5ce370eb806d4b2a8a369261fd5b1c74/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:38.618034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c0b5-de7c-4786-bce7-47fd4edda4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f8b4655374484fb667a21c2fcd9844, user_id=5ce370eb806d4b2a8a369261fd5b1c74, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:38.627013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c0b5-de7c-4786-bce7-47fd4edda4a7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:38.795042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:38.800705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1202/2435] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:38 2021] PUT /identity/v3/projects/59f8b4655374484fb667a21c2fcd9844/users/5ce370eb806d4b2a8a369261fd5b1c74/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:38.810541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:38.811131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:38.811421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:38.811968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:38.860773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:38.862996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:39.009235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe029d-4061-4f35-96d1-1f4c5e0a3147 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:39.030607 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1203/2436] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:39.084094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:39.085821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:39.180817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397094f-a1ba-4a56-888d-54bc392ff194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:39.185358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397094f-a1ba-4a56-888d-54bc392ff194 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:39.185358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397094f-a1ba-4a56-888d-54bc392ff194 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:39.185358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397094f-a1ba-4a56-888d-54bc392ff194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:39.186963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d397094f-a1ba-4a56-888d-54bc392ff194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:39.205311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee129a0b-948c-467c-8839-972de6aed119 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:39.214139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21616684-076c-4559-af37-2339eee7542b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:39.214383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21616684-076c-4559-af37-2339eee7542b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:39.214774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21616684-076c-4559-af37-2339eee7542b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:39.215170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21616684-076c-4559-af37-2339eee7542b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:39.235907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21616684-076c-4559-af37-2339eee7542b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:39.237543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21616684-076c-4559-af37-2339eee7542b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:39.263021 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1204/2437] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:39.355478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397094f-a1ba-4a56-888d-54bc392ff194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:39.363244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397094f-a1ba-4a56-888d-54bc392ff194 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:39.388996 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1234/2438] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:40.400736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21616684-076c-4559-af37-2339eee7542b service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:40.402291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-21616684-076c-4559-af37-2339eee7542b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:40.435934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21616684-076c-4559-af37-2339eee7542b service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:40.451419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:40.452619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:40.453088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:40.453511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] PATH_INFO: `/v3/users/521350f6dd84495e93a070bf983b32c7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:40.457586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521350f6dd84495e93a070bf983b32c7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:40.467224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:40.801846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521350f6dd84495e93a070bf983b32c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:40.834820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521350f6dd84495e93a070bf983b32c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:40.859197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521350f6dd84495e93a070bf983b32c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:40.861505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521350f6dd84495e93a070bf983b32c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:40.864510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521350f6dd84495e93a070bf983b32c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:40.992331 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1205/2439] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:40 2021] DELETE /identity/v3/users/521350f6dd84495e93a070bf983b32c7 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:40.996739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab64c-afb5-45b2-8800-25776bb78ba3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:40.997259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab64c-afb5-45b2-8800-25776bb78ba3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:40.997368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ab64c-afb5-45b2-8800-25776bb78ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:41.081652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ff2ab64c-afb5-45b2-8800-25776bb78ba3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:41.084182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff2ab64c-afb5-45b2-8800-25776bb78ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:41.218076 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1235/2440] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:41.243065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:41.244800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:41.437693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7333204-11f4-4cdb-85bc-e8136feded20 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:41.446389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:41.447787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:41.449441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:41.451581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:41.482089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:41.485103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:41.502139 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1206/2441] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:42.707312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:42.707806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:42.707888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:42.732997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] MFA Rules not processed for user `aa5e089e14854aec83cc6b1f9ca9fedc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:42.734664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:42.801968 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1236/2442] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:42 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:43.222026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:43.224439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:43.246992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b36a60-56bf-40c6-9f34-32da7a8a66db service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:43.263173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:43.264479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:43.265024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:43.265513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] PATH_INFO: `/v3/users/66b9e8144a0048a581cc606482753808` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:43.267952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b9e8144a0048a581cc606482753808)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:43.271231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:43.637694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b9e8144a0048a581cc606482753808'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:43.666616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b9e8144a0048a581cc606482753808'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:43.703919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b9e8144a0048a581cc606482753808'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:43.710368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b9e8144a0048a581cc606482753808'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:43.711395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b9e8144a0048a581cc606482753808'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:43.835231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1207/2443] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:43 2021] DELETE /identity/v3/users/66b9e8144a0048a581cc606482753808 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:43.999668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:44.003242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:44.041049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255e787-8199-46b5-a941-83b2a80a67da None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:44.142998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:44.146004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:44.148612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:44.154410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] PATH_INFO: `/v3/projects/5b6d5bd7bdb44cb4b96d8b09e2076afe` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:44.156387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6d5bd7bdb44cb4b96d8b09e2076afe)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:44.158657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:44.244760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:44.246820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:44.276864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149403df-65e1-447e-9d07-2d0a4a381187 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:44.315702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6d5bd7bdb44cb4b96d8b09e2076afe', 'request_id': 'req-87bf06af-9585-43f3-95d2-cd2c0d2cb300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.378422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:44.379859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:44.380361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:44.380844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] PATH_INFO: `/v3/projects/f1c9d95c0097420ba158062e91371e63` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:44.382549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c9d95c0097420ba158062e91371e63)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:44.384867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:44.424130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6d5bd7bdb44cb4b96d8b09e2076afe', 'request_id': 'req-87bf06af-9585-43f3-95d2-cd2c0d2cb300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.433612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6d5bd7bdb44cb4b96d8b09e2076afe', 'request_id': 'req-87bf06af-9585-43f3-95d2-cd2c0d2cb300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.465220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] The token cache is being invalidate because project 5b6d5bd7bdb44cb4b96d8b09e2076afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:44.465732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.466596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.468699 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1237/2444] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:43 2021] DELETE /identity/v3/projects/5b6d5bd7bdb44cb4b96d8b09e2076afe => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:44.473399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:44.475478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:44.530613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf06af-9585-43f3-95d2-cd2c0d2cb300 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:44.554395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c9d95c0097420ba158062e91371e63', 'request_id': 'req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.565454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c9d95c0097420ba158062e91371e63', 'request_id': 'req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.641604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:44.642593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:44.642988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:44.643333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] PATH_INFO: `/v3/users/7dfcec1c9af14fd3ae6a81eff0b99937` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:44.644598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dfcec1c9af14fd3ae6a81eff0b99937)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:44.646603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:44.652511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c9d95c0097420ba158062e91371e63', 'request_id': 'req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.668192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] The token cache is being invalidate because project f1c9d95c0097420ba158062e91371e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:44.669070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.670459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c0d6ca0-95ab-4394-a7c0-1b2cf03c80cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.677801 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1208/2445] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:44 2021] DELETE /identity/v3/projects/f1c9d95c0097420ba158062e91371e63 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:08:44.683361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf3fc-f5cb-40b6-a44f-c6a4f8b40ffa None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:44.683898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf3fc-f5cb-40b6-a44f-c6a4f8b40ffa None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:44.684373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abf3fc-f5cb-40b6-a44f-c6a4f8b40ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:44.713079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-47abf3fc-f5cb-40b6-a44f-c6a4f8b40ffa None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:44.714388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-47abf3fc-f5cb-40b6-a44f-c6a4f8b40ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:44.723698 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1209/2446] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:44.732737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f439f-c344-4cab-8e53-5bdb8a2af8cb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:44.733400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f439f-c344-4cab-8e53-5bdb8a2af8cb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:44.733668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f439f-c344-4cab-8e53-5bdb8a2af8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:44.755940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d02f439f-c344-4cab-8e53-5bdb8a2af8cb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:44.757304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d02f439f-c344-4cab-8e53-5bdb8a2af8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:44.772944 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1210/2447] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:08:44.777548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f439f-c344-4cab-8e53-5bdb8a2af8cb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:44.809715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f439f-c344-4cab-8e53-5bdb8a2af8cb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:44.825818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:44.826864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:44.827204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:44.827606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:44.832389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:08:44.832933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:44.838467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:44.873480 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1211/2448] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:08:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:44.877825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:44.879649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dfcec1c9af14fd3ae6a81eff0b99937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.889636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dfcec1c9af14fd3ae6a81eff0b99937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.895478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401144b-be48-4f5b-959b-60057d8a14c1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:44.908578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dfcec1c9af14fd3ae6a81eff0b99937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.909692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dfcec1c9af14fd3ae6a81eff0b99937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.911358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:44.912176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:44.912548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:44.913034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:44.913820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:44.916433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:44.984512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dfcec1c9af14fd3ae6a81eff0b99937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:44.992437 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1238/2449] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:44 2021] DELETE /identity/v3/users/7dfcec1c9af14fd3ae6a81eff0b99937 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:45.060158 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1212/2450] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:44 2021] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:45.064688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:45.067234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:45.204765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231a1e1-72ae-4d7b-b869-d9494e979f6e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:45.350825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:45.351570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:45.351851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:45.352126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:45.353715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:45.358957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:45.571225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:45.572410 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1239/2451] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:45 2021] POST /identity/v3/users => generated 293 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:45.588379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42614c-6325-4b1c-aa98-b4f821ba96f9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:45.601831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:45.602516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:45.605424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:45.605424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:45.605424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:45.605965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:45.630382 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1213/2452] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:45 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:45.635743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:45.654866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440cb50-27c6-443b-a8e3-52ad4195d2e2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:45.673581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c4f0e-221a-482b-90ac-927ebac4d911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:45.674844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4f0e-221a-482b-90ac-927ebac4d911 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:45.676606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4f0e-221a-482b-90ac-927ebac4d911 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:45.676913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4f0e-221a-482b-90ac-927ebac4d911 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:45.680428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c4f0e-221a-482b-90ac-927ebac4d911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:45.689661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c4f0e-221a-482b-90ac-927ebac4d911 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:45.723918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1240/2453] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:45 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:45.730336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:45.744603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100c6bb-6295-4ad8-8aef-6313e364b5c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:45.758228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:45.765217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:45.765217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:45.765217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] PATH_INFO: `/v3/projects/66ef4aef5d1a42c6b19b8c77eccf6bc1/users/74efde38ac7f47acb399e54c900f1a6e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:45.780524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ef4aef5d1a42c6b19b8c77eccf6bc1, user_id=74efde38ac7f47acb399e54c900f1a6e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:45.785761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:45.910977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:45.911304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:45.911533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:45.912869 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1214/2454] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:45 2021] PUT /identity/v3/projects/66ef4aef5d1a42c6b19b8c77eccf6bc1/users/74efde38ac7f47acb399e54c900f1a6e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:45.942705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:45.943943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:45.968325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:45.971850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:46.143732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086de9b4-e939-4e79-a899-614bf59bb381 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:46.151178 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1241/2455] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:46.162746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:46.165302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:46.179850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:46.184774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:46.185097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:46.185360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] PATH_INFO: `/v3/projects/2d69e208193f400ba83829e2140333e9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:46.188960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d69e208193f400ba83829e2140333e9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:46.202780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:46.276497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742388da-0f00-4022-a8d6-7860763713f4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:46.285081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b16991-5a0b-4c86-ab07-6f7a50fd79ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:46.286816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b16991-5a0b-4c86-ab07-6f7a50fd79ce service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:46.287337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b16991-5a0b-4c86-ab07-6f7a50fd79ce service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:46.287831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b16991-5a0b-4c86-ab07-6f7a50fd79ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:46.308298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b16991-5a0b-4c86-ab07-6f7a50fd79ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:46.310861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b16991-5a0b-4c86-ab07-6f7a50fd79ce service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:46.324015 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1242/2456] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:46.431757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d69e208193f400ba83829e2140333e9', 'request_id': 'req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:46.458144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d69e208193f400ba83829e2140333e9', 'request_id': 'req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:47.027850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d69e208193f400ba83829e2140333e9', 'request_id': 'req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:47.038791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] The token cache is being invalidate because project 2d69e208193f400ba83829e2140333e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:47.039077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:47.039701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96ccb7e1-5e3e-41f5-9bde-dac5e8d24b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:47.041363 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1215/2457] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:45 2021] DELETE /identity/v3/projects/2d69e208193f400ba83829e2140333e9 => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:47.047514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eb545-7526-45eb-a298-e6f924c40047 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:47.047807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eb545-7526-45eb-a298-e6f924c40047 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:47.048114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171eb545-7526-45eb-a298-e6f924c40047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:47.067543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-171eb545-7526-45eb-a298-e6f924c40047 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:47.069492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-171eb545-7526-45eb-a298-e6f924c40047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:47.141978 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1243/2458] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:47.151781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3be0-79a3-4264-9ce5-f2f57319712d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:47.152139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3be0-79a3-4264-9ce5-f2f57319712d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:47.152367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3be0-79a3-4264-9ce5-f2f57319712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:47.185935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-57af3be0-79a3-4264-9ce5-f2f57319712d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:47.190904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-57af3be0-79a3-4264-9ce5-f2f57319712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:47.247004 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1216/2459] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:47.259455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eb545-7526-45eb-a298-e6f924c40047 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:47.281756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171eb545-7526-45eb-a298-e6f924c40047 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:47.310651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b7095-96fd-4c5d-b7b4-6f5cbf9374a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:47.313309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7095-96fd-4c5d-b7b4-6f5cbf9374a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:47.313784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7095-96fd-4c5d-b7b4-6f5cbf9374a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:47.315613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7095-96fd-4c5d-b7b4-6f5cbf9374a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:47.318317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b7095-96fd-4c5d-b7b4-6f5cbf9374a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:08:47.321171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b7095-96fd-4c5d-b7b4-6f5cbf9374a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:47.331007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b7095-96fd-4c5d-b7b4-6f5cbf9374a7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:47.362677 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1244/2460] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:08:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:08:47.366703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3be0-79a3-4264-9ce5-f2f57319712d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:47.380373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3be0-79a3-4264-9ce5-f2f57319712d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:47.402510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:47.403287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:47.403706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:47.404090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:47.404939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:47.427526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:47.427634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:47.427634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:47.427634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:47.490693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] MFA Rules not processed for user `5ce370eb806d4b2a8a369261fd5b1c74`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:47.495094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:47.611852 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1217/2461] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:47 2021] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:47.618876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:47.738591 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1245/2462] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:47 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:47.739696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:47.741155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:47.823050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a39a9-e46e-454b-b5bf-3b620107b447 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:47.831604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a3524-40ba-4948-858c-fb6315ea2afc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:47.833112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:47.833878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:47.834074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:47.834354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:47.835098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:47.838037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:47.862116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:47.867820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:47.867820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:47.867820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:47.867820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:47.867820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.016907 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1218/2463] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:47 2021] POST /identity/v3/users => generated 285 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:48.018982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:48.042421 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1246/2464] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:47 2021] POST /identity/v3/projects => generated 405 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:48.053671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e64b50-d859-44dc-a671-4e8dbb7b2061 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:48.055163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:48.232781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:48.234807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.241075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.241075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.241075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:48.241075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.255077 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1219/2465] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:48 2021] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:48.262324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:48.271750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f275c-caed-466a-9957-7011d4a02047 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:48.302650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:48.303359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.307373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.307715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.313062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:48.318596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054e43-c8f9-436b-be54-5c1f2efcef2f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:48.320111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.341318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:48.344758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.344758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.344758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.344758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:48.347204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.385122 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1220/2466] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:48 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:48.386362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:48.417381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c29a62-3ddc-46fc-89cf-e0196a0b45a6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:48.454197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2831bb9-839d-4dbf-9b50-9b496cf4c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:48.460838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831bb9-839d-4dbf-9b50-9b496cf4c980 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.461163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831bb9-839d-4dbf-9b50-9b496cf4c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.461421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831bb9-839d-4dbf-9b50-9b496cf4c980 admin admin] PATH_INFO: `/v3/projects/bc19d38e80ce426fa6d268838d133f13/users/9bf2eefd87de409785735fc802bc95ed/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.481433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2831bb9-839d-4dbf-9b50-9b496cf4c980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc19d38e80ce426fa6d268838d133f13, user_id=9bf2eefd87de409785735fc802bc95ed, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:48.484648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2831bb9-839d-4dbf-9b50-9b496cf4c980 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.493789 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1247/2467] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:48 2021] POST /identity/v3/users => generated 309 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:48.497599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:48.513950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d09a6-c13d-4fe7-9486-8d7535f5429a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:48.521282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:48.524267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.524605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.524909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.525655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:48.527357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.575403 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1221/2468] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:48 2021] PUT /identity/v3/projects/bc19d38e80ce426fa6d268838d133f13/users/9bf2eefd87de409785735fc802bc95ed/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:48.580281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.581202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.582378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.589875 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1248/2469] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:48 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:48.595876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:48.614026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:48.614846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76842bd2-a4ed-45c9-871d-d92645d234e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:48.616436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:48.720371 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1222/2470] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:48.736617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:48.737895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.738402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.739361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] PATH_INFO: `/v3/projects/96c1aa7a871440d69a532eab5d139700/users/548b667e0e844adeb4d35eefea8de59c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.746606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:48.752162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:48.825851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c1aa7a871440d69a532eab5d139700, user_id=548b667e0e844adeb4d35eefea8de59c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:48.833258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.899681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c4d48-649a-46ee-acc4-e1a6fefed8dc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:48.905756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:48.906648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:48.907154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:48.907497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:48.923379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:48.927168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:48.943533 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1223/2471] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:48.983645 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1249/2472] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:48 2021] PUT /identity/v3/projects/96c1aa7a871440d69a532eab5d139700/users/548b667e0e844adeb4d35eefea8de59c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:48.987871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:49.003757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eacb3-cbd4-4a95-85c4-a546194777df service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:49.107686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa484e0c-d4ff-4104-9951-4b602f7a98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:49.108799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484e0c-d4ff-4104-9951-4b602f7a98f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:49.109176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484e0c-d4ff-4104-9951-4b602f7a98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:49.109781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484e0c-d4ff-4104-9951-4b602f7a98f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:49.110599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa484e0c-d4ff-4104-9951-4b602f7a98f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:49.114912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa484e0c-d4ff-4104-9951-4b602f7a98f3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:49.138154 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1224/2473] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:48 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:49.139366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:49.153425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed3ebc-efe0-403f-bd76-c513749e35c9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:49.160090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b7cb2-2f6d-4aa9-97c2-956566b06ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:49.162505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7cb2-2f6d-4aa9-97c2-956566b06ded admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:49.162799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7cb2-2f6d-4aa9-97c2-956566b06ded admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:49.163155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7cb2-2f6d-4aa9-97c2-956566b06ded admin admin] PATH_INFO: `/v3/projects/96c1aa7a871440d69a532eab5d139700/users/548b667e0e844adeb4d35eefea8de59c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:49.167057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b7cb2-2f6d-4aa9-97c2-956566b06ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c1aa7a871440d69a532eab5d139700, user_id=548b667e0e844adeb4d35eefea8de59c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:49.173224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b7cb2-2f6d-4aa9-97c2-956566b06ded admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:49.190446 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1250/2474] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:49 2021] PUT /identity/v3/projects/96c1aa7a871440d69a532eab5d139700/users/548b667e0e844adeb4d35eefea8de59c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:52.497288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e85d-7c7c-4fc4-83cd-ebd43d19f124 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:52.498152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e85d-7c7c-4fc4-83cd-ebd43d19f124 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:52.498581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e85d-7c7c-4fc4-83cd-ebd43d19f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:52.576348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bb52e85d-7c7c-4fc4-83cd-ebd43d19f124 None None] MFA Rules not processed for user `548b667e0e844adeb4d35eefea8de59c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:52.577622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bb52e85d-7c7c-4fc4-83cd-ebd43d19f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:52.745763 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1225/2475] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:52 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:54.202667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b93a8-a8d1-4d74-86e0-2279222d7655 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:54.203227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b93a8-a8d1-4d74-86e0-2279222d7655 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:54.203227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b93a8-a8d1-4d74-86e0-2279222d7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:54.255744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1d8b93a8-a8d1-4d74-86e0-2279222d7655 None None] MFA Rules not processed for user `9bf2eefd87de409785735fc802bc95ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:54.257472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1d8b93a8-a8d1-4d74-86e0-2279222d7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:54.388491 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1251/2476] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:54 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:54.388680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e85d-7c7c-4fc4-83cd-ebd43d19f124 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:54.511600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e85d-7c7c-4fc4-83cd-ebd43d19f124 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:54.524916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:54.526293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:54.526796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:54.527300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:54.528896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:54.532121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:54.894329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b93a8-a8d1-4d74-86e0-2279222d7655 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:54.895012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1226/2477] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:08:54 2021] POST /identity/v3/projects => generated 371 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:54.923481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b93a8-a8d1-4d74-86e0-2279222d7655 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:55.128359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:55.129170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:55.130524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:55.132510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:55.133463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:55.141833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:55.264328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1252/2478] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:08:54 2021] POST /identity/v3/users => generated 292 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:08:55.268260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:55.286639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4371a-ff55-412b-8424-bfafb3e13a22 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:55.299640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:55.300325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:55.300624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:55.300898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:55.301654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:55.303267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:55.326559 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1227/2479] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:55 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:08:55.331520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:55.360195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ddd2-965f-4097-a424-bbdf2f8408bb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:55.379571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:55.384540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:55.385644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:55.386100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] PATH_INFO: `/v3/projects/f149a077b12b44338d36531fe1dc3a6e/users/6f5d83b0aa774ee497fb90b09daa459c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:55.414662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f149a077b12b44338d36531fe1dc3a6e, user_id=6f5d83b0aa774ee497fb90b09daa459c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:55.418566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:55.572513 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1253/2480] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:55 2021] PUT /identity/v3/projects/f149a077b12b44338d36531fe1dc3a6e/users/6f5d83b0aa774ee497fb90b09daa459c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:55.573478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:55.587725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b807a2-708c-4fe5-8c1f-9e7f94ab634b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:55.749927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:55.753490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:55.753994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:55.754421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:55.755900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:55.758881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:55.800421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:55.811826 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1228/2481] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:08:55 2021] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:08:55.816349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e59823-ed38-4310-aa71-3c1c20207839 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:55.844111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b303b-3f65-4157-84fa-d60aa14160e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:55.845045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b303b-3f65-4157-84fa-d60aa14160e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:55.847884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b303b-3f65-4157-84fa-d60aa14160e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:55.848195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b303b-3f65-4157-84fa-d60aa14160e6 admin admin] PATH_INFO: `/v3/projects/f149a077b12b44338d36531fe1dc3a6e/users/6f5d83b0aa774ee497fb90b09daa459c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:55.851239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b303b-3f65-4157-84fa-d60aa14160e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f149a077b12b44338d36531fe1dc3a6e, user_id=6f5d83b0aa774ee497fb90b09daa459c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:55.858326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b303b-3f65-4157-84fa-d60aa14160e6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:55.893074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1254/2482] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:08:55 2021] PUT /identity/v3/projects/f149a077b12b44338d36531fe1dc3a6e/users/6f5d83b0aa774ee497fb90b09daa459c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:57.145633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:57.183775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b9e42-3550-44a6-8f30-237fc92cf2c6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:57.308738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:57.310402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:57.311514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:57.311514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] PATH_INFO: `/v3/users/5ce370eb806d4b2a8a369261fd5b1c74` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:57.314496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce370eb806d4b2a8a369261fd5b1c74)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:57.318049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:57.618046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce370eb806d4b2a8a369261fd5b1c74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:57.640715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce370eb806d4b2a8a369261fd5b1c74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:57.667827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce370eb806d4b2a8a369261fd5b1c74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:57.668824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce370eb806d4b2a8a369261fd5b1c74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:57.669733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce370eb806d4b2a8a369261fd5b1c74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:57.846607 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1229/2483] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:57 2021] DELETE /identity/v3/users/5ce370eb806d4b2a8a369261fd5b1c74 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:58.588997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98cc3-3f5e-41da-947e-9fd0aa205485 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:58.589530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98cc3-3f5e-41da-947e-9fd0aa205485 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:58.589969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98cc3-3f5e-41da-947e-9fd0aa205485 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:58.594672 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1255/2484] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:08:58 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:08:58.606427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:58.609805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:58.620931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:58.626230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:58.627720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:58.675697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:58.678342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:58.741588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d79dff-076b-46bf-81ed-7f2f718406de admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:58.748000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:58.749319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:58.749777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:58.750677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] PATH_INFO: `/v3/projects/59f8b4655374484fb667a21c2fcd9844` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:58.752328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f8b4655374484fb667a21c2fcd9844)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:58.754473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:58.781838 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1256/2485] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:08:58 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:58.814913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:58.823658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:58.835967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494a295-8056-440e-a58f-9123ec5ceaab None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:58.843022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7cfd9-b761-434e-a9d7-4354821cbdff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:58.844052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7cfd9-b761-434e-a9d7-4354821cbdff service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:58.844399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7cfd9-b761-434e-a9d7-4354821cbdff service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:58.844765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7cfd9-b761-434e-a9d7-4354821cbdff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:58.855632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7cfd9-b761-434e-a9d7-4354821cbdff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:58.858152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7cfd9-b761-434e-a9d7-4354821cbdff service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:58.870716 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1257/2486] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:08:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:08:58.968176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f8b4655374484fb667a21c2fcd9844', 'request_id': 'req-3a371f5f-1f97-4ff5-b7df-692a36304b2e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:58.988052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f8b4655374484fb667a21c2fcd9844', 'request_id': 'req-3a371f5f-1f97-4ff5-b7df-692a36304b2e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.018868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b13ab-bb76-4e2d-887a-f1866e22b4cd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:59.019950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b13ab-bb76-4e2d-887a-f1866e22b4cd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:59.020466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b13ab-bb76-4e2d-887a-f1866e22b4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:59.086054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f8b4655374484fb667a21c2fcd9844', 'request_id': 'req-3a371f5f-1f97-4ff5-b7df-692a36304b2e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.087643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-be9b13ab-bb76-4e2d-887a-f1866e22b4cd None None] MFA Rules not processed for user `6f5d83b0aa774ee497fb90b09daa459c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:59.089896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be9b13ab-bb76-4e2d-887a-f1866e22b4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:59.102303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] The token cache is being invalidate because project 59f8b4655374484fb667a21c2fcd9844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:08:59.102596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.105271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.114249 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1230/2487] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:58 2021] DELETE /identity/v3/projects/59f8b4655374484fb667a21c2fcd9844 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:08:59.117255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:59.122613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:59.263597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a371f5f-1f97-4ff5-b7df-692a36304b2e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:59.271578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:59.273032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:59.273463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:59.273900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] PATH_INFO: `/v3/users/548b667e0e844adeb4d35eefea8de59c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:59.275585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=548b667e0e844adeb4d35eefea8de59c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:59.279098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:59.281010 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1258/2488] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:59 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:59.294046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231753-4ac1-4afa-a03f-676c1d981db0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:59.294400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231753-4ac1-4afa-a03f-676c1d981db0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:59.294744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60231753-4ac1-4afa-a03f-676c1d981db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:59.315638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-60231753-4ac1-4afa-a03f-676c1d981db0 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:59.317186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-60231753-4ac1-4afa-a03f-676c1d981db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:59.435129 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1259/2489] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:08:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:59.436795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:59.446193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:59.446193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:59.457267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] MFA Rules not processed for user `9bf2eefd87de409785735fc802bc95ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:08:59.458575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:59.528094 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1260/2490] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:08:59 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:08:59.529660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:08:59.531030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:08:59.612924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce535a5-7bd7-4ebe-9fcb-ee8fc74d57b3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:08:59.620824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:08:59.621510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:08:59.621772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:08:59.622327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:08:59.638079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:08:59.639851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:08:59.648943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1261/2491] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:08:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:59.760439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548b667e0e844adeb4d35eefea8de59c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.778178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548b667e0e844adeb4d35eefea8de59c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.795713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548b667e0e844adeb4d35eefea8de59c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.796677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548b667e0e844adeb4d35eefea8de59c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.797674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6ca8cd2c-9c84-4610-8282-4405f693c2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548b667e0e844adeb4d35eefea8de59c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:08:59.981901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1231/2492] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:08:59 2021] DELETE /identity/v3/users/548b667e0e844adeb4d35eefea8de59c => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:00.462886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:00.487099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fa009-9ed1-4648-8b4d-ce9318f2f1ed service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:00.588699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad8984-60e1-40d5-8b5c-8e74620d3cc0 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:00.589030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad8984-60e1-40d5-8b5c-8e74620d3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:00.589309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad8984-60e1-40d5-8b5c-8e74620d3cc0 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:00.590557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:00.591109 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1232/2493] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:09:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:09:00.591833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:00.592526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:00.592983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] PATH_INFO: `/v3/projects/96c1aa7a871440d69a532eab5d139700` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:00.601273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e542d-4d45-4fcb-8a29-daeea791e5b5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:00.601567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e542d-4d45-4fcb-8a29-daeea791e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:00.601843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e542d-4d45-4fcb-8a29-daeea791e5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:00.602904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c1aa7a871440d69a532eab5d139700)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:00.605119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:00.628897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4a1e542d-4d45-4fcb-8a29-daeea791e5b5 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:00.630517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4a1e542d-4d45-4fcb-8a29-daeea791e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:00.710653 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1233/2494] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:09:00 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:00.712154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:00.712451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:00.712732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:00.740609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] MFA Rules not processed for user `74efde38ac7f47acb399e54c900f1a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:00.741795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:00.780725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c1aa7a871440d69a532eab5d139700', 'request_id': 'req-63170921-1089-46ab-84b6-9fa66b88b811'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:00.837709 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1234/2495] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:00 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:00.839140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:00.840435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:00.851568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c1aa7a871440d69a532eab5d139700', 'request_id': 'req-63170921-1089-46ab-84b6-9fa66b88b811'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:00.859283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c1aa7a871440d69a532eab5d139700', 'request_id': 'req-63170921-1089-46ab-84b6-9fa66b88b811'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:00.873837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] The token cache is being invalidate because project 96c1aa7a871440d69a532eab5d139700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:00.874123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:00.874978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63170921-1089-46ab-84b6-9fa66b88b811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:00.876727 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1262/2496] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:00 2021] DELETE /identity/v3/projects/96c1aa7a871440d69a532eab5d139700 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:00.882625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f56bba-5051-463c-94ad-fa2a53f129a6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:00.883145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f56bba-5051-463c-94ad-fa2a53f129a6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:00.889112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f56bba-5051-463c-94ad-fa2a53f129a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:00.902561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e5f56bba-5051-463c-94ad-fa2a53f129a6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:00.903927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e5f56bba-5051-463c-94ad-fa2a53f129a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:00.917856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd01fe8-dfcc-434c-b1ab-90ebd015058b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:00.983750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce41119-ec6b-4f0c-9be3-3a0d4a03c5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:00.984738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce41119-ec6b-4f0c-9be3-3a0d4a03c5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:00.985059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce41119-ec6b-4f0c-9be3-3a0d4a03c5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:00.985341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce41119-ec6b-4f0c-9be3-3a0d4a03c5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:00.986769 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1263/2497] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:00.987299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bce41119-ec6b-4f0c-9be3-3a0d4a03c5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:00.995432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567d1e-896c-4695-b623-3ca628832f7c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:00.995726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567d1e-896c-4695-b623-3ca628832f7c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:00.996002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80567d1e-896c-4695-b623-3ca628832f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.017963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-80567d1e-896c-4695-b623-3ca628832f7c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:01.019199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-80567d1e-896c-4695-b623-3ca628832f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:01.028103 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1264/2498] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:01.032357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567d1e-896c-4695-b623-3ca628832f7c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.042178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80567d1e-896c-4695-b623-3ca628832f7c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.046949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.047590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.047869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.048139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.048851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:01.049186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.050856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.059520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce41119-ec6b-4f0c-9be3-3a0d4a03c5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.062259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce41119-ec6b-4f0c-9be3-3a0d4a03c5b3 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.063087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1265/2499] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:09:01.067559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.074444 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1235/2500] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:01.077877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49951ca0-d9a2-4da3-85d4-81e4b795604f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.084527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.084991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.085276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.085557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.086249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.088831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.103627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.103913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.104186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.124844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:01.129511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:01.138488 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1236/2501] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:09:01 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:01.151197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.152606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:01.163118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7be4a7-6d84-48c4-be4b-b86715991d86 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.167702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.176347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.176347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.176347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.177543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.179102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.188264 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1237/2502] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:01 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:09:01.224123 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1266/2503] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:01 2021] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:09:01.233353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.240055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22f9b6-41ee-441c-8636-daaae987b8d1 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.298470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.299137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.299415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.299685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.300376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.302295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.482196 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1238/2504] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:01 2021] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:01.486530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.498488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0c38b-c4af-48a0-96a5-d5131110e12a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.503361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.504143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.504519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.504913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.505756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.507442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.518074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1267/2505] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:01.528251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.543139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fb91-4c7b-47e5-83a9-13cc402524d6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.550234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.550907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.551189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.551409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.552153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.553846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.565623 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1239/2506] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:01.569969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.583041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96c7c5-1d9e-4c43-9cb5-6e5f9cab2873 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.589974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b51a0-da20-49f8-91b6-0840cde9eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.590135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b51a0-da20-49f8-91b6-0840cde9eb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.590453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b51a0-da20-49f8-91b6-0840cde9eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.590582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b51a0-da20-49f8-91b6-0840cde9eb1e admin admin] PATH_INFO: `/v3/projects/deb36d0e1a0e4dc6baba28441b926b22/users/b2091bc96d5541c7b50b051b47b12817/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.611589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.614481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:01.617035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b51a0-da20-49f8-91b6-0840cde9eb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb36d0e1a0e4dc6baba28441b926b22, user_id=b2091bc96d5541c7b50b051b47b12817, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.619904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b51a0-da20-49f8-91b6-0840cde9eb1e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.688205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8f9e4-a4b9-4252-bf26-3b67e794c5c2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.694022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.694663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.694943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.695218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.697984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:01.733243 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1268/2507] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:01 2021] PUT /identity/v3/projects/deb36d0e1a0e4dc6baba28441b926b22/users/b2091bc96d5541c7b50b051b47b12817/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:01.745675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a4a16-bf45-408a-a856-d796f7380c1b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.746099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a4a16-bf45-408a-a856-d796f7380c1b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.746620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a4a16-bf45-408a-a856-d796f7380c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.761545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.763207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:01.774045 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1240/2508] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:01 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:09:01.775074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bf2a4a16-bf45-408a-a856-d796f7380c1b None None] MFA Rules not processed for user `b2091bc96d5541c7b50b051b47b12817`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:01.776498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bf2a4a16-bf45-408a-a856-d796f7380c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:01.860921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1269/2509] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:01 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:01.862603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:01.873769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2dfb8-724b-451f-8d12-3055fc383139 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:01.934861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:01.935885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:01.936361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:01.936648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:01.937400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:01.939363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:02.311004 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1241/2510] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:01 2021] POST /identity/v3/projects => generated 373 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:02.313031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a4a16-bf45-408a-a856-d796f7380c1b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:02.349116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a4a16-bf45-408a-a856-d796f7380c1b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:02.409084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:02.409925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:02.410319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:02.410670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:02.411520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:02.413539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:02.520152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:02.576641 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1270/2511] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:02 2021] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:02.580710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:02.606655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b912c0b-a067-4fd8-a1d3-368a75427333 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:02.668526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:02.668526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:02.668526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:02.668526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:02.669737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:02.669737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:02.669911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baba94-e4af-44d4-9f3e-c06129d5f4f4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:02.669911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:02.669911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:02.669911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:02.670254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:02.670343 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1271/2512] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:02.670343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:02.670502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:02.678059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381754e-eb0b-47c5-a8c5-5efff085433b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:02.694527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:02.695425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:02.696570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:02.697050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] PATH_INFO: `/v3/projects/fab669cc11d94e90a30a9f24a4fc93a9/users/d0155bedaaa8442abafdd39167fd4209/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:02.729116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab669cc11d94e90a30a9f24a4fc93a9, user_id=d0155bedaaa8442abafdd39167fd4209, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:02.731854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:02.777347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:02.779077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:02.806652 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1242/2513] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:02 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:09:02.851282 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1272/2514] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:02 2021] PUT /identity/v3/projects/fab669cc11d94e90a30a9f24a4fc93a9/users/d0155bedaaa8442abafdd39167fd4209/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:02.857097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:02.870332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681681e3-e5a9-491e-ad59-1809b306a23f service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:02.934358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb19e-472c-448f-b1cd-6edabaef4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:02.935220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb19e-472c-448f-b1cd-6edabaef4911 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:02.935604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb19e-472c-448f-b1cd-6edabaef4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:02.935943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb19e-472c-448f-b1cd-6edabaef4911 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:02.937057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afb19e-472c-448f-b1cd-6edabaef4911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:02.938697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afb19e-472c-448f-b1cd-6edabaef4911 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:02.954586 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1243/2515] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:02 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:02.964514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:02.982588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1954d71-9d80-4409-a761-ea7c0bdd3ca9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:02.989338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:02.990655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:02.991105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:02.991536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] PATH_INFO: `/v3/projects/fab669cc11d94e90a30a9f24a4fc93a9/users/d0155bedaaa8442abafdd39167fd4209/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:02.994091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab669cc11d94e90a30a9f24a4fc93a9, user_id=d0155bedaaa8442abafdd39167fd4209, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:02.997198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:03.023266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a02d-c384-452c-976d-bef0297ad174 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:03.023830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a02d-c384-452c-976d-bef0297ad174 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:03.024423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a02d-c384-452c-976d-bef0297ad174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:03.025176 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1273/2516] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:02 2021] PUT /identity/v3/projects/fab669cc11d94e90a30a9f24a4fc93a9/users/d0155bedaaa8442abafdd39167fd4209/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:03.067159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fde0a02d-c384-452c-976d-bef0297ad174 None None] MFA Rules not processed for user `d0155bedaaa8442abafdd39167fd4209`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:03.068141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fde0a02d-c384-452c-976d-bef0297ad174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:03.206793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:03.210824 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1244/2517] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:03 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:03.223777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0bb90-376f-4936-ab2d-4d163d4807f0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:03.235254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:03.237152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:03.237445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:03.237937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:03.239128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:03.239605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:03.241830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:03.261646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a02d-c384-452c-976d-bef0297ad174 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:03.269145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1274/2518] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:03.273298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a02d-c384-452c-976d-bef0297ad174 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:03.283594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:03.284351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:03.284637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:03.285608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:03.286018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:03.294385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:03.414135 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1245/2519] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:03 2021] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:09:03.415490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:03.425545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feeeae-2fe5-410b-9074-801dc5317c95 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:03.498940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9ddd5-2b9d-446b-ab94-6c24444fef35 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:03.500012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ddd5-2b9d-446b-ab94-6c24444fef35 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:03.500300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ddd5-2b9d-446b-ab94-6c24444fef35 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:03.500581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9ddd5-2b9d-446b-ab94-6c24444fef35 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:03.501469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9ddd5-2b9d-446b-ab94-6c24444fef35 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:03.501784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9ddd5-2b9d-446b-ab94-6c24444fef35 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:03.503518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9ddd5-2b9d-446b-ab94-6c24444fef35 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:03.516317 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1275/2520] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:09:05.216191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:05.218221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:05.300884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028223d0-bc95-493b-9542-a2e4a1041ef8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:05.306637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:05.309284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:05.309284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:05.309284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:05.317287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:05.318894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:05.330375 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1246/2521] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:05 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:09:05.348297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585b85-6ccb-4774-862f-d6b8720e34ec None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:05.348822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585b85-6ccb-4774-862f-d6b8720e34ec None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:05.349025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585b85-6ccb-4774-862f-d6b8720e34ec None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:05.351004 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1276/2522] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:05.356222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:05.367531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:05.376211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be77147-20f3-4229-9daa-515afa191cb7 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:05.381536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:05.382396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:05.382675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:05.382948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/ec2b69462262462791c19681f2da8acf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:05.384771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=ec2b69462262462791c19681f2da8acf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:05.386773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:05.388831 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1247/2523] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:05 2021] GET /identity/v3/projects/ec2b69462262462791c19681f2da8acf => generated 371 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:06.479766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1a2d-f237-4a91-809b-70e571e724ea None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:06.480291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1a2d-f237-4a91-809b-70e571e724ea None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:06.480291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e1a2d-f237-4a91-809b-70e571e724ea None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:06.482105 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1277/2524] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:06.489353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:06.502069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:06.511407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b26c7-4fcc-4b4d-9856-ba7e6d6490d3 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:06.516074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:06.517057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:06.517413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:06.517758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/ec2b69462262462791c19681f2da8acf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:06.519066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=ec2b69462262462791c19681f2da8acf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:06.521216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:06.522979 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1248/2525] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:06 2021] GET /identity/v3/projects/ec2b69462262462791c19681f2da8acf => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:09:10.325858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829c73-a027-4d7c-bbe1-0304f0265742 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:10.326391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829c73-a027-4d7c-bbe1-0304f0265742 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:10.326495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829c73-a027-4d7c-bbe1-0304f0265742 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:10.328160 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1278/2526] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:10.333398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:10.346962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:10.355843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6388-52ba-4469-a55b-2de31df115e9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:10.361105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:10.361969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:10.365144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:10.365144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/ec2b69462262462791c19681f2da8acf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:10.365144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=ec2b69462262462791c19681f2da8acf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:10.366042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:10.368364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1249/2527] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:10 2021] GET /identity/v3/projects/ec2b69462262462791c19681f2da8acf => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:10.399433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2829c73-a027-4d7c-bbe1-0304f0265742 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:10.413843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2829c73-a027-4d7c-bbe1-0304f0265742 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:10.419588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:10.420977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:10.421939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:10.422893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/ec2b69462262462791c19681f2da8acf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:10.423963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec2b69462262462791c19681f2da8acf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:10.426782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:10.438822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:10.438822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:10.554076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115faccf-30f6-44f4-8ec1-50509f48f3b8 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:10.559101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:10.560014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:10.560305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:10.560598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] PATH_INFO: `/v3/users/90d14ca3dbcf46d799645c342fc39b0e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:10.562147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d14ca3dbcf46d799645c342fc39b0e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:10.564070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:10.610049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2b69462262462791c19681f2da8acf', 'request_id': 'req-fef78a1f-0b7d-4238-9207-1b622772782e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.701941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2b69462262462791c19681f2da8acf', 'request_id': 'req-fef78a1f-0b7d-4238-9207-1b622772782e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.709679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2b69462262462791c19681f2da8acf', 'request_id': 'req-fef78a1f-0b7d-4238-9207-1b622772782e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.720811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] The token cache is being invalidate because project ec2b69462262462791c19681f2da8acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:10.721153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.721822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fef78a1f-0b7d-4238-9207-1b622772782e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.723500 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1279/2528] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:10 2021] DELETE /identity/v3/projects/ec2b69462262462791c19681f2da8acf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:10.798558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d14ca3dbcf46d799645c342fc39b0e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.806046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d14ca3dbcf46d799645c342fc39b0e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.828758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d14ca3dbcf46d799645c342fc39b0e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.829607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d14ca3dbcf46d799645c342fc39b0e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.830204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d14ca3dbcf46d799645c342fc39b0e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:10.957351 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1250/2529] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:10 2021] DELETE /identity/v3/users/90d14ca3dbcf46d799645c342fc39b0e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:10.970315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:10.970823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:10.971249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:10.992237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:10.994909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:11.062909 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1280/2530] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:11.090179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:11.091766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:11.157658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7aaf5-5f2b-4b11-824d-5f6e737f61a7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:11.161140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff65cc1-e0ac-46d5-a5e3-e8af4e992ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:11.161789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff65cc1-e0ac-46d5-a5e3-e8af4e992ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:11.162069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff65cc1-e0ac-46d5-a5e3-e8af4e992ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:11.162340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff65cc1-e0ac-46d5-a5e3-e8af4e992ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:11.173215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff65cc1-e0ac-46d5-a5e3-e8af4e992ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:11.178646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff65cc1-e0ac-46d5-a5e3-e8af4e992ca0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:11.186275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1251/2531] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:11.550609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:11.552720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:11.572079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6fc67-ebcd-4623-8dee-f953725e6460 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:11.577486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:11.578798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:11.579751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:11.580034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] PATH_INFO: `/v3/projects/1cbb59dcbd544ccfbcbb709c6fe1201a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:11.581779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbb59dcbd544ccfbcbb709c6fe1201a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:11.583795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:11.685858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'request_id': 'req-d92dea6c-2618-4b29-b057-1eb74cbed3aa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:11.777195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'request_id': 'req-d92dea6c-2618-4b29-b057-1eb74cbed3aa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:11.784112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'request_id': 'req-d92dea6c-2618-4b29-b057-1eb74cbed3aa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:11.795061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] The token cache is being invalidate because project 1cbb59dcbd544ccfbcbb709c6fe1201a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:11.795286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:11.795905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d92dea6c-2618-4b29-b057-1eb74cbed3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:11.797464 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1281/2532] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:11 2021] DELETE /identity/v3/projects/1cbb59dcbd544ccfbcbb709c6fe1201a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:11.803300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad0bd-2646-4c24-b590-0e69777c2c3f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:11.803758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad0bd-2646-4c24-b590-0e69777c2c3f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:11.803864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad0bd-2646-4c24-b590-0e69777c2c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:11.821626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4a2ad0bd-2646-4c24-b590-0e69777c2c3f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:11.822885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4a2ad0bd-2646-4c24-b590-0e69777c2c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:11.881980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1252/2533] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:11.890420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1c85-8bbb-4dfa-ae04-fe67c443e423 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:11.890689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1c85-8bbb-4dfa-ae04-fe67c443e423 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:11.890965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d1c85-8bbb-4dfa-ae04-fe67c443e423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:11.910141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1a5d1c85-8bbb-4dfa-ae04-fe67c443e423 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:11.911330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1a5d1c85-8bbb-4dfa-ae04-fe67c443e423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:11.920305 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1282/2534] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:11.924745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ad0bd-2646-4c24-b590-0e69777c2c3f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:11.935145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ad0bd-2646-4c24-b590-0e69777c2c3f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:11.939809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:11.940463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:11.940744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:11.941054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:11.941774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:11.942133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:11.943716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:11.956436 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1253/2535] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:11.960577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1c85-8bbb-4dfa-ae04-fe67c443e423 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:11.971022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d1c85-8bbb-4dfa-ae04-fe67c443e423 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:11.975748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:11.976407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:11.976687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:11.977607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:11.978299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:11.980457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:12.064778 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1283/2536] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:11 2021] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:09:12.068671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:12.079499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30925198-d01d-4e67-bfba-7934d2a57297 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:12.136493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:12.137186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:12.137465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:12.137738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:12.138428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:12.140345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:12.252840 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1254/2537] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:12 2021] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:12.256951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:12.267776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf55a-045d-4f1e-9ac6-e03f6c4c39f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:12.272432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:12.273122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:12.273402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:12.273713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:12.274978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:12.276568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:12.287468 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1284/2538] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:09:12.294168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:12.304125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aa270-10aa-4913-9bca-6639971c9d58 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:12.309176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a307c87-2548-42ea-9daa-60418a5ab696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:12.309832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307c87-2548-42ea-9daa-60418a5ab696 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:12.310109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307c87-2548-42ea-9daa-60418a5ab696 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:12.310401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307c87-2548-42ea-9daa-60418a5ab696 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:12.311167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307c87-2548-42ea-9daa-60418a5ab696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:12.312775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307c87-2548-42ea-9daa-60418a5ab696 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:12.323636 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1255/2539] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:12.327793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:12.338613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ee44e-5857-43fa-99da-302d791ce01c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:12.343291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3018a-1fd8-487a-9ea3-bc17e4b0d90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:12.344159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3018a-1fd8-487a-9ea3-bc17e4b0d90b admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:12.344436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3018a-1fd8-487a-9ea3-bc17e4b0d90b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:12.344712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3018a-1fd8-487a-9ea3-bc17e4b0d90b admin admin] PATH_INFO: `/v3/projects/e16d892afaa64de189fc2741a7a66ce3/users/a96f15c2e70e4c52b13a0ea3a1ba5e74/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:12.359590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3018a-1fd8-487a-9ea3-bc17e4b0d90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16d892afaa64de189fc2741a7a66ce3, user_id=a96f15c2e70e4c52b13a0ea3a1ba5e74, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:12.362176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3018a-1fd8-487a-9ea3-bc17e4b0d90b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:12.463424 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1285/2540] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:12 2021] PUT /identity/v3/projects/e16d892afaa64de189fc2741a7a66ce3/users/a96f15c2e70e4c52b13a0ea3a1ba5e74/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:12.479177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:12.479517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:12.479830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:12.507325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] MFA Rules not processed for user `a96f15c2e70e4c52b13a0ea3a1ba5e74`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:12.509174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:12.576161 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1256/2541] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:14.390834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c40714-0503-47f1-bee0-6abf34b6f5c3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:14.391295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c40714-0503-47f1-bee0-6abf34b6f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:14.391424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c40714-0503-47f1-bee0-6abf34b6f5c3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:14.394927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1286/2542] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:14.399443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:14.401110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:14.490026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:14.491523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:14.585114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38576b-88d7-48fa-adba-a7b0409905bf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:14.598193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:14.606924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:14.606924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:14.606924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/deb36d0e1a0e4dc6baba28441b926b22` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:14.606924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=deb36d0e1a0e4dc6baba28441b926b22)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:14.607255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:14.607255 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1257/2543] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:14 2021] GET /identity/v3/projects/deb36d0e1a0e4dc6baba28441b926b22 => generated 373 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:09:14.631143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c40714-0503-47f1-bee0-6abf34b6f5c3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:14.645962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c40714-0503-47f1-bee0-6abf34b6f5c3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:14.652290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:14.653243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:14.653597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:14.653942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:14.654812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:14.655325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:14.657101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:14.672514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1287/2544] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:14.678056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:14.692393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09ccdc-edcd-4415-ab38-b268383f7e64 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:14.699469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:14.699469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:14.699970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:14.700133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:14.700840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:14.702802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:14.866700 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1258/2545] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:14 2021] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:14.870907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:14.881603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330782-7628-4d41-9034-24424e61fd2d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:14.951561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207c6c-5012-4d8e-a286-59cf958c4fd4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:14.952381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207c6c-5012-4d8e-a286-59cf958c4fd4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:14.952775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207c6c-5012-4d8e-a286-59cf958c4fd4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:14.953566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207c6c-5012-4d8e-a286-59cf958c4fd4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:14.954233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207c6c-5012-4d8e-a286-59cf958c4fd4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:14.954419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207c6c-5012-4d8e-a286-59cf958c4fd4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:14.956186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207c6c-5012-4d8e-a286-59cf958c4fd4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:14.987886 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1288/2546] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:15.071664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:15.166176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522892b-2e94-46bc-b644-d8823b3939fe tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:15.173735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:15.174656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:15.175038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:15.175415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:15.246303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:15.248062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:15.276552 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1259/2547] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:15 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:17.861259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8228-0338-4c41-bbf1-bfda577afe80 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:17.861733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8228-0338-4c41-bbf1-bfda577afe80 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:17.861956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8228-0338-4c41-bbf1-bfda577afe80 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:17.863974 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1289/2548] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:17.870902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:17.872728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:17.887249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:17.896581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929c587-9d0d-4d5c-a057-0f904c064b85 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:17.901771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:17.902639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:17.902920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:17.903192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:17.904383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=0870cfe8b19c4e2cb4d1455e21067c37)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:17.906416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:17.908108 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1260/2549] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:17 2021] GET /identity/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37 => generated 369 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:18.660217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec111-5c84-4673-80ce-8390c6ed64b4 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:18.660507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec111-5c84-4673-80ce-8390c6ed64b4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:18.660831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec111-5c84-4673-80ce-8390c6ed64b4 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:18.662747 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1290/2550] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:18.667901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:18.684975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:18.694087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a0e41-6507-4b82-bc9a-8eaaa70291c1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:18.699658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:18.700534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:18.700794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:18.701101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:18.709086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=0870cfe8b19c4e2cb4d1455e21067c37)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:18.709086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:18.709086 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1261/2551] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:18 2021] GET /identity/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37 => generated 369 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:18.754125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fec111-5c84-4673-80ce-8390c6ed64b4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:18.771759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fec111-5c84-4673-80ce-8390c6ed64b4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:18.778625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:18.779838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:18.780992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:18.781433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:18.783136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:18.783621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:18.786012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:18.801818 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1291/2552] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:18.806479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:18.817099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86d06-3238-4449-9d08-3f4609a0c139 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:18.823168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f753dda-974f-4d60-9396-9bf55ecfa7b6 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:18.824151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f753dda-974f-4d60-9396-9bf55ecfa7b6 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:18.824502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f753dda-974f-4d60-9396-9bf55ecfa7b6 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:18.824785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f753dda-974f-4d60-9396-9bf55ecfa7b6 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:18.825529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f753dda-974f-4d60-9396-9bf55ecfa7b6 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:18.827439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f753dda-974f-4d60-9396-9bf55ecfa7b6 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:18.908869 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1262/2553] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:18 2021] POST /identity/v3/users => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:09:18.913211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:18.924195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7be20-4fd8-4212-b8e8-fb162d73564e tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:18.929265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:18.930409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:18.930691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:18.931286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:18.932200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:18.932630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:18.934156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:18.951072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1292/2554] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:19.149770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c09a77-6e22-48cc-9bd6-42d3c502712c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:19.150378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c09a77-6e22-48cc-9bd6-42d3c502712c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:19.150865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c09a77-6e22-48cc-9bd6-42d3c502712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:19.182793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-30c09a77-6e22-48cc-9bd6-42d3c502712c None None] MFA Rules not processed for user `2cb2a59c7c9b4a13964c78ff0fb1a8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:19.184917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-30c09a77-6e22-48cc-9bd6-42d3c502712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:19.206086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:19.303039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1263/2555] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:19 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:19.309187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b01f-9ce0-4e18-b251-e308371856c4 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:19.315144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:19.316013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:19.316297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:19.316574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] PATH_INFO: `/v3/users/a96f15c2e70e4c52b13a0ea3a1ba5e74` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:19.317814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96f15c2e70e4c52b13a0ea3a1ba5e74)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:19.319725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:19.574423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96f15c2e70e4c52b13a0ea3a1ba5e74'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:19.581507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96f15c2e70e4c52b13a0ea3a1ba5e74'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:19.594954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96f15c2e70e4c52b13a0ea3a1ba5e74'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:19.595885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96f15c2e70e4c52b13a0ea3a1ba5e74'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:19.680053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-684b86d5-c41a-4eba-bf2c-8e54a97c6089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96f15c2e70e4c52b13a0ea3a1ba5e74'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:19.682887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331402-0445-4d88-9de4-93148de2c555 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:19.683837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331402-0445-4d88-9de4-93148de2c555 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:19.683837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331402-0445-4d88-9de4-93148de2c555 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:19.685296 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1264/2556] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:09:19.688303 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1293/2557] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:19 2021] DELETE /identity/v3/users/a96f15c2e70e4c52b13a0ea3a1ba5e74 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:09:19.690674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35331402-0445-4d88-9de4-93148de2c555 None None] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:19.692723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:19.693069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:19.693362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:19.697533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-35331402-0445-4d88-9de4-93148de2c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:19.715948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:19.717530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:19.783533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35331402-0445-4d88-9de4-93148de2c555 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:19.784943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-35331402-0445-4d88-9de4-93148de2c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:19.805215 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1294/2558] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:19.812079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:19.815057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:19.870298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35331402-0445-4d88-9de4-93148de2c555 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:19.875195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:19.876075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:19.876373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:19.876632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:19.877908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=0870cfe8b19c4e2cb4d1455e21067c37)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:19.880029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:19.881852 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1265/2559] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:19 2021] GET /identity/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37 => generated 369 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:09:19.892081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f594-66d1-477e-b2fa-e5780449e1e8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:19.897109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ec35-6cfa-43e6-845b-7b98545ee53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:19.897848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ec35-6cfa-43e6-845b-7b98545ee53c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:19.898225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ec35-6cfa-43e6-845b-7b98545ee53c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:19.898606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ec35-6cfa-43e6-845b-7b98545ee53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:19.910344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ec35-6cfa-43e6-845b-7b98545ee53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:19.911888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ec35-6cfa-43e6-845b-7b98545ee53c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:19.923527 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1295/2560] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:20.343874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:20.345735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:20.361708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efaff6-6baa-49a4-8a8a-89cf58dfeb57 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:20.368166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:20.375953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:20.376504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:20.377583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] PATH_INFO: `/v3/projects/e16d892afaa64de189fc2741a7a66ce3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:20.379338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16d892afaa64de189fc2741a7a66ce3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:20.381426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:20.532778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16d892afaa64de189fc2741a7a66ce3', 'request_id': 'req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:20.539406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16d892afaa64de189fc2741a7a66ce3', 'request_id': 'req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:20.605403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16d892afaa64de189fc2741a7a66ce3', 'request_id': 'req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:20.616527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] The token cache is being invalidate because project e16d892afaa64de189fc2741a7a66ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:20.619911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:20.619911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d28f97ea-3cb2-4618-a01f-a94aa61df6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:20.619911 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1266/2561] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:20 2021] DELETE /identity/v3/projects/e16d892afaa64de189fc2741a7a66ce3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:20.625144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec983c-9497-4027-a287-63b84925acf6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:20.625601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec983c-9497-4027-a287-63b84925acf6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:20.625946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec983c-9497-4027-a287-63b84925acf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:20.645137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ecec983c-9497-4027-a287-63b84925acf6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:20.648991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ecec983c-9497-4027-a287-63b84925acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:20.706137 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1296/2562] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:20.714740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055d6e-03be-45c0-a55b-e253792eea9c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:20.715028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055d6e-03be-45c0-a55b-e253792eea9c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:20.715303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055d6e-03be-45c0-a55b-e253792eea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:20.735862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-20055d6e-03be-45c0-a55b-e253792eea9c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:20.737243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-20055d6e-03be-45c0-a55b-e253792eea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:20.745470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1267/2563] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:20.749620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec983c-9497-4027-a287-63b84925acf6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:20.759297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec983c-9497-4027-a287-63b84925acf6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:20.763848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:20.764499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:20.764786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:20.765091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:20.765878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:20.766125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:20.767733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:20.780311 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1297/2564] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:20.784420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055d6e-03be-45c0-a55b-e253792eea9c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:20.794722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055d6e-03be-45c0-a55b-e253792eea9c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:20.799461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:20.800199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:20.800470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:20.800737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:20.801507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:20.803389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:20.901980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1268/2565] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:20 2021] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:20.903012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:20.913048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011afed-d09e-44c5-b3fc-491d2a18791b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:20.975188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:20.975860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:20.976177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:20.977023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:20.977783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:20.979954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:21.063038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1298/2566] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:20 2021] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:09:21.066928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:21.079084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0d9e-7fad-4efd-ac01-069cb3852799 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:21.084255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:21.085159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.085549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.085863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.086697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:21.088545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:21.102484 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1269/2567] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:21.106251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:21.117892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdcf2c-1f83-45ed-ab7c-122052f6c739 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:21.122925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b95c4-2084-4e6d-96a2-f87910283028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:21.123912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b95c4-2084-4e6d-96a2-f87910283028 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.124575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b95c4-2084-4e6d-96a2-f87910283028 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.125015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b95c4-2084-4e6d-96a2-f87910283028 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.125968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b95c4-2084-4e6d-96a2-f87910283028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:21.127626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b95c4-2084-4e6d-96a2-f87910283028 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:21.140918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1299/2568] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:21.142601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:21.152710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbd1e0-0bae-4669-a9cc-65f44f6b703c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:21.157561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496787d-75cd-4694-8ba7-dc41f578da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:21.158480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496787d-75cd-4694-8ba7-dc41f578da07 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.158760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496787d-75cd-4694-8ba7-dc41f578da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.159035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496787d-75cd-4694-8ba7-dc41f578da07 admin admin] PATH_INFO: `/v3/projects/63cdf796f2e84d6ebb3c03943ef35e0c/users/a53d0545f68d4b7eb74eff42f386f5c5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.175710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496787d-75cd-4694-8ba7-dc41f578da07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cdf796f2e84d6ebb3c03943ef35e0c, user_id=a53d0545f68d4b7eb74eff42f386f5c5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:21.178412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496787d-75cd-4694-8ba7-dc41f578da07 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:21.227567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.227863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.228145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.229956 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1300/2569] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:21.236700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:21.238713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:21.282510 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1270/2570] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:21 2021] PUT /identity/v3/projects/63cdf796f2e84d6ebb3c03943ef35e0c/users/a53d0545f68d4b7eb74eff42f386f5c5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:21.295924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95d08-a9bc-42c4-8c8c-726515de8f9a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.296708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95d08-a9bc-42c4-8c8c-726515de8f9a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.297101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95d08-a9bc-42c4-8c8c-726515de8f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.341096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:21.343222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:21.375071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1ab95d08-a9bc-42c4-8c8c-726515de8f9a None None] MFA Rules not processed for user `a53d0545f68d4b7eb74eff42f386f5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:21.375071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ab95d08-a9bc-42c4-8c8c-726515de8f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:21.426219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3b509-26f2-435e-8a07-f30b51ce5519 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:21.473885 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1271/2571] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:21.490560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94de775-7747-4ef4-905c-bb28b33bc14b tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:21.491446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de775-7747-4ef4-905c-bb28b33bc14b tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.491730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de775-7747-4ef4-905c-bb28b33bc14b tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.492037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94de775-7747-4ef4-905c-bb28b33bc14b tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.493312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94de775-7747-4ef4-905c-bb28b33bc14b tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=0870cfe8b19c4e2cb4d1455e21067c37)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:21.495458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94de775-7747-4ef4-905c-bb28b33bc14b tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:21.497200 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1301/2572] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:21 2021] GET /identity/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37 => generated 369 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:21.526049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95d08-a9bc-42c4-8c8c-726515de8f9a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:21.541201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95d08-a9bc-42c4-8c8c-726515de8f9a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:21.546746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:21.547771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.548187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.548853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/users/7c13eeb416894ee8abaf242537f66dc8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.565316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7c13eeb416894ee8abaf242537f66dc8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:21.569569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:21.730616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c13eeb416894ee8abaf242537f66dc8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:21.737750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c13eeb416894ee8abaf242537f66dc8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:21.749533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c13eeb416894ee8abaf242537f66dc8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:21.750271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c13eeb416894ee8abaf242537f66dc8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:21.750893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c13eeb416894ee8abaf242537f66dc8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:21.780521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:21.780911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:21.781301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:21.799552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] MFA Rules not processed for user `491f06d5a64145919a6e4a9ec0fa9171`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:21.800830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:21.859137 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1302/2573] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:21.937512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1272/2574] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:21 2021] DELETE /identity/v3/users/7c13eeb416894ee8abaf242537f66dc8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:21.941707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:21.943107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:21.959068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da752-836c-4b6a-a329-c33da4337c04 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:22.021386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:22.022245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:22.022530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:22.022805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:22.024551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0870cfe8b19c4e2cb4d1455e21067c37)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:22.026490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:22.036731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:22.038340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:22.120288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef54b-3092-466c-b3cc-b59f797828cb tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:22.127787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:22.128444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:22.128729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:22.129037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:22.131097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:22.144590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0870cfe8b19c4e2cb4d1455e21067c37', 'request_id': 'req-711a8ae8-24dc-4066-a8ed-e29912f777ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:22.192208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:22.193780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:22.204290 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1273/2575] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:22 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:22.245401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0870cfe8b19c4e2cb4d1455e21067c37', 'request_id': 'req-711a8ae8-24dc-4066-a8ed-e29912f777ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:22.252230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0870cfe8b19c4e2cb4d1455e21067c37', 'request_id': 'req-711a8ae8-24dc-4066-a8ed-e29912f777ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:22.264640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] The token cache is being invalidate because project 0870cfe8b19c4e2cb4d1455e21067c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:22.264640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:22.264640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-711a8ae8-24dc-4066-a8ed-e29912f777ec tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:22.265746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1303/2576] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:21 2021] DELETE /identity/v3/projects/0870cfe8b19c4e2cb4d1455e21067c37 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:22.433182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:22.444627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c23b09-f5f2-44cf-841e-ec6e07fc4c4c service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:22.514567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:22.515516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:22.516008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:22.516352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:22.518650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:22.580588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:22.582189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:22.591406 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1274/2577] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:22 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:23.039425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e8ada-7994-45dc-a98c-11284bdba5bd None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:23.039936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e8ada-7994-45dc-a98c-11284bdba5bd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:23.040165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e8ada-7994-45dc-a98c-11284bdba5bd None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:23.041929 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1304/2578] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:23.048175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:23.050816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:23.066149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:23.067549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:23.149830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75249e9f-32a9-465b-bd08-c414f88a5fed service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:23.154980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:23.155918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:23.156269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:23.156624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/deb36d0e1a0e4dc6baba28441b926b22` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:23.157965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=deb36d0e1a0e4dc6baba28441b926b22)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:23.161393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:23.163559 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1275/2579] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:23 2021] GET /identity/v3/projects/deb36d0e1a0e4dc6baba28441b926b22 => generated 373 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:25.035737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7cf2-027d-4863-9fbb-0f7cb2e0cbae None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:25.035737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7cf2-027d-4863-9fbb-0f7cb2e0cbae None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:25.036203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f7cf2-027d-4863-9fbb-0f7cb2e0cbae None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:25.038060 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1305/2580] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:25.050574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:25.074850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:25.086396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3d40-e982-4bb5-bdbc-88e020b624c9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:25.091686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1e1de-c258-4a30-a770-2b86186ce342 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:25.092911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1e1de-c258-4a30-a770-2b86186ce342 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:25.094018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1e1de-c258-4a30-a770-2b86186ce342 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:25.094537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1e1de-c258-4a30-a770-2b86186ce342 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/deb36d0e1a0e4dc6baba28441b926b22` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:25.096244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1e1de-c258-4a30-a770-2b86186ce342 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=deb36d0e1a0e4dc6baba28441b926b22)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:25.098786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1e1de-c258-4a30-a770-2b86186ce342 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:25.101029 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1276/2581] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:25 2021] GET /identity/v3/projects/deb36d0e1a0e4dc6baba28441b926b22 => generated 373 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:29.662876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666f03-c4c7-41f5-9c6d-5b8af0a3427c None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:29.663415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666f03-c4c7-41f5-9c6d-5b8af0a3427c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:29.663497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666f03-c4c7-41f5-9c6d-5b8af0a3427c None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:29.666866 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1306/2582] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:09:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:29.671635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be7ac-0274-4f5a-b4c9-f996d2dca29a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:29.672102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be7ac-0274-4f5a-b4c9-f996d2dca29a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:29.672102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be7ac-0274-4f5a-b4c9-f996d2dca29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:29.695196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-094be7ac-0274-4f5a-b4c9-f996d2dca29a None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:29.698333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-094be7ac-0274-4f5a-b4c9-f996d2dca29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:29.767201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1277/2583] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:09:29 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:29.790991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666f03-c4c7-41f5-9c6d-5b8af0a3427c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:29.792967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-85666f03-c4c7-41f5-9c6d-5b8af0a3427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:29.809950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666f03-c4c7-41f5-9c6d-5b8af0a3427c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:29.815139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:29.815952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:29.816235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:29.816512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:29.825561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:29.827214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:29.838247 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1307/2584] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:29.948309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce7509-6590-4040-b13c-3cc6f9acb769 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:29.948713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce7509-6590-4040-b13c-3cc6f9acb769 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:29.949094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce7509-6590-4040-b13c-3cc6f9acb769 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:29.951007 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1278/2585] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:09:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:29.956198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:09:29.969417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:29.979479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f194e7-0fd0-4ae6-b0c3-73b1ba53666a service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:29.984367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b707f0-32f5-4704-bac3-47142cf0873c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0155bedaaa8442abafdd39167fd4209', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fab669cc11d94e90a30a9f24a4fc93a9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:29.986793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b707f0-32f5-4704-bac3-47142cf0873c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:29.986793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b707f0-32f5-4704-bac3-47142cf0873c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:29.986793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b707f0-32f5-4704-bac3-47142cf0873c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] PATH_INFO: `/v3/projects/deb36d0e1a0e4dc6baba28441b926b22` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:29.987086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b707f0-32f5-4704-bac3-47142cf0873c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorizing `identity:get_project(project_id=deb36d0e1a0e4dc6baba28441b926b22)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:29.989632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b707f0-32f5-4704-bac3-47142cf0873c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:29.991297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1308/2586] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:09:29 2021] GET /identity/v3/projects/deb36d0e1a0e4dc6baba28441b926b22 => generated 373 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:32.374971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce7509-6590-4040-b13c-3cc6f9acb769 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:32.377093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0bce7509-6590-4040-b13c-3cc6f9acb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:32.483984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce7509-6590-4040-b13c-3cc6f9acb769 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:32.488765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:32.489749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:32.490071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:32.490411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] PATH_INFO: `/v3/users/b2091bc96d5541c7b50b051b47b12817` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:32.491719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2091bc96d5541c7b50b051b47b12817)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:32.493719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:32.723593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2091bc96d5541c7b50b051b47b12817'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:32.730689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2091bc96d5541c7b50b051b47b12817'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:32.743452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2091bc96d5541c7b50b051b47b12817'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:32.744271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2091bc96d5541c7b50b051b47b12817'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:32.744975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2091bc96d5541c7b50b051b47b12817'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:32.864600 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1279/2587] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:32 2021] DELETE /identity/v3/users/b2091bc96d5541c7b50b051b47b12817 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:32.865993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:32.867268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:32.867268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:32.886161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:32.887580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:32.955176 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1309/2588] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:32.967587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:32.969338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:33.057532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca639d65-70fd-49fd-b930-94699bcf52d6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:33.061336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:33.062146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:33.062426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:33.062701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:33.072643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:33.074226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:33.087525 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1280/2589] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:33.716176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:33.718150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:33.749830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba08a1-406a-4fad-a5d4-3a6b48fe7865 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:33.764032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:33.765094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:33.765466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:33.765846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] PATH_INFO: `/v3/projects/deb36d0e1a0e4dc6baba28441b926b22` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:33.767250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb36d0e1a0e4dc6baba28441b926b22)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:33.769358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:33.910143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb36d0e1a0e4dc6baba28441b926b22', 'request_id': 'req-4eab154e-4d0c-447b-96e7-8f3a40126463'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:33.977500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb36d0e1a0e4dc6baba28441b926b22', 'request_id': 'req-4eab154e-4d0c-447b-96e7-8f3a40126463'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:33.986359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb36d0e1a0e4dc6baba28441b926b22', 'request_id': 'req-4eab154e-4d0c-447b-96e7-8f3a40126463'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.000166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] The token cache is being invalidate because project deb36d0e1a0e4dc6baba28441b926b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:34.000619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.001580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.003426 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1310/2590] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:33 2021] DELETE /identity/v3/projects/deb36d0e1a0e4dc6baba28441b926b22 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:09:34.007614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:34.018559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d6ff-9797-486a-9607-ef93178af5e0 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:34.082258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:34.083332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:34.083919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:34.084093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] PATH_INFO: `/v3/users/d0155bedaaa8442abafdd39167fd4209` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:34.086081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0155bedaaa8442abafdd39167fd4209)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:34.088187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:34.275748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0155bedaaa8442abafdd39167fd4209'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.283892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0155bedaaa8442abafdd39167fd4209'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.297613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0155bedaaa8442abafdd39167fd4209'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.298336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0155bedaaa8442abafdd39167fd4209'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.299422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7528400f-7878-4936-b8fc-273ab229baa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0155bedaaa8442abafdd39167fd4209'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:34.489691 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1281/2591] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:34 2021] DELETE /identity/v3/users/d0155bedaaa8442abafdd39167fd4209 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:35.041973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:35.043616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:35.058447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab154e-4d0c-447b-96e7-8f3a40126463 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:35.125941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:35.126802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:35.127084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:35.127359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] PATH_INFO: `/v3/projects/fab669cc11d94e90a30a9f24a4fc93a9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:35.128558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab669cc11d94e90a30a9f24a4fc93a9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:35.130496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:35.250162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab669cc11d94e90a30a9f24a4fc93a9', 'request_id': 'req-cdf08543-f1b4-467b-9ffe-1613eca24454'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:35.337624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab669cc11d94e90a30a9f24a4fc93a9', 'request_id': 'req-cdf08543-f1b4-467b-9ffe-1613eca24454'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:35.346723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab669cc11d94e90a30a9f24a4fc93a9', 'request_id': 'req-cdf08543-f1b4-467b-9ffe-1613eca24454'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:35.359855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] The token cache is being invalidate because project fab669cc11d94e90a30a9f24a4fc93a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:35.360450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:35.362306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cdf08543-f1b4-467b-9ffe-1613eca24454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:35.364650 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1311/2592] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:35 2021] DELETE /identity/v3/projects/fab669cc11d94e90a30a9f24a4fc93a9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:35.376860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb6db-d006-48b5-a149-7b6fd88c8b01 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:35.376860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb6db-d006-48b5-a149-7b6fd88c8b01 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:35.376860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb6db-d006-48b5-a149-7b6fd88c8b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:35.400404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-40beb6db-d006-48b5-a149-7b6fd88c8b01 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:35.401978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-40beb6db-d006-48b5-a149-7b6fd88c8b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:35.470259 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1282/2593] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:35.478715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd3721-cd82-4d89-ab5f-4632a270b29f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:35.479079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd3721-cd82-4d89-ab5f-4632a270b29f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:35.479586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd3721-cd82-4d89-ab5f-4632a270b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:35.503999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-64dd3721-cd82-4d89-ab5f-4632a270b29f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:35.505413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-64dd3721-cd82-4d89-ab5f-4632a270b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:35.528536 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1312/2594] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:35.533576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb6db-d006-48b5-a149-7b6fd88c8b01 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:35.551435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb6db-d006-48b5-a149-7b6fd88c8b01 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:35.560469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:35.561184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:35.561472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:35.562375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:35.563357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:35.563677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:35.567875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:35.582584 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1283/2595] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:35.588223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd3721-cd82-4d89-ab5f-4632a270b29f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:35.599227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd3721-cd82-4d89-ab5f-4632a270b29f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:35.605427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:35.606283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:35.606561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:35.606825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:35.607568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:35.609634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:35.698087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1313/2596] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:35 2021] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:35.702380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:35.730552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a74e14-8f52-4733-99e4-41795eb74f6b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:35.830250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:35.830250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:35.830250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:35.830250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:35.830720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:35.831004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:35.984176 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1284/2597] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:35 2021] POST /identity/v3/users => generated 288 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:35.987954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:36.003378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de92a5-a0dc-43c6-8177-49505af18f8b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:36.016577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:36.017485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.017916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.022256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.023472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:36.025103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:36.073645 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1314/2598] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:35 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:36.079980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:36.103235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b8774-05a7-4a79-b6c9-a9d468e4aa14 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:36.109343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99fd5d-a18b-4814-b434-2084e8b6c2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:36.110420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fd5d-a18b-4814-b434-2084e8b6c2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.110420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fd5d-a18b-4814-b434-2084e8b6c2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.110607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fd5d-a18b-4814-b434-2084e8b6c2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.111618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99fd5d-a18b-4814-b434-2084e8b6c2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:36.114853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99fd5d-a18b-4814-b434-2084e8b6c2f9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:36.139343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:36.152132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a1ade-9221-4c5a-b233-4cb0984ab250 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:36.153230 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1285/2599] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:36 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:36.170869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:36.172144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.172668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.173270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] PATH_INFO: `/v3/projects/c70df2525137490a9e18b5e4af25a7b4/users/c6c295b9814d44efba37e7a37df6fa9b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.214662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70df2525137490a9e18b5e4af25a7b4, user_id=c6c295b9814d44efba37e7a37df6fa9b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:36.220394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:36.314824 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1315/2600] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:36 2021] PUT /identity/v3/projects/c70df2525137490a9e18b5e4af25a7b4/users/c6c295b9814d44efba37e7a37df6fa9b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:09:36.328092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c430-bcfd-423e-80da-b4392b2b1c25 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.328656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c430-bcfd-423e-80da-b4392b2b1c25 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.329187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62c430-bcfd-423e-80da-b4392b2b1c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.359098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-be62c430-bcfd-423e-80da-b4392b2b1c25 None None] MFA Rules not processed for user `c6c295b9814d44efba37e7a37df6fa9b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:36.360549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be62c430-bcfd-423e-80da-b4392b2b1c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:36.457467 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1286/2601] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:36.459759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:36.549289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7637fb7-71a6-478e-8fc4-9b5a4d433221 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:36.561088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:36.562031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.562522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.563029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.564003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:36.566579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:36.695556 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1316/2602] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:36 2021] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:36.703384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62c430-bcfd-423e-80da-b4392b2b1c25 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:36.717600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62c430-bcfd-423e-80da-b4392b2b1c25 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:36.784038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:36.784884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.785236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.785458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.786287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:36.789407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:36.901096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:36.902224 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1287/2603] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:36 2021] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:36.924274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda209bc-05c5-4ebb-b051-de16a283d3da admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:36.930980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:36.932048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.932536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.939625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.939625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:36.939625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:36.953173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:36.959541 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1317/2604] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:36 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:36.965714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec7b06-2db3-44c2-b618-0e7f1d9a4c69 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:36.971221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:36.972610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:36.973146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:36.973584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] PATH_INFO: `/v3/projects/27a856db1f1e4d76973ed5345627e80c/users/aeeadf6d81ef4e40a4bf362738856f4d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:36.993148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a856db1f1e4d76973ed5345627e80c, user_id=aeeadf6d81ef4e40a4bf362738856f4d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:36.997154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:37.078597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1288/2605] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:36 2021] PUT /identity/v3/projects/27a856db1f1e4d76973ed5345627e80c/users/aeeadf6d81ef4e40a4bf362738856f4d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:37.082578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:37.097494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005a439-f287-4d35-b404-475768d1c83c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:37.259783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13e67-d689-479f-a964-44d65b242b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:37.260544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13e67-d689-479f-a964-44d65b242b41 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:37.260824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13e67-d689-479f-a964-44d65b242b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:37.261161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13e67-d689-479f-a964-44d65b242b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:37.261884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13e67-d689-479f-a964-44d65b242b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:37.263489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13e67-d689-479f-a964-44d65b242b41 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:37.294782 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1318/2606] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:37.297916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:37.310087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3710d-5488-4d7c-92a1-606c3ea0afbf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:37.315889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279620b-5252-4fd2-9ed4-7bd339d48103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:37.316865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279620b-5252-4fd2-9ed4-7bd339d48103 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:37.317217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279620b-5252-4fd2-9ed4-7bd339d48103 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:37.317514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279620b-5252-4fd2-9ed4-7bd339d48103 admin admin] PATH_INFO: `/v3/projects/27a856db1f1e4d76973ed5345627e80c/users/aeeadf6d81ef4e40a4bf362738856f4d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:37.320683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279620b-5252-4fd2-9ed4-7bd339d48103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a856db1f1e4d76973ed5345627e80c, user_id=aeeadf6d81ef4e40a4bf362738856f4d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:37.323857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279620b-5252-4fd2-9ed4-7bd339d48103 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:37.337731 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1289/2607] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:37 2021] PUT /identity/v3/projects/27a856db1f1e4d76973ed5345627e80c/users/aeeadf6d81ef4e40a4bf362738856f4d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:37.348268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:37.348566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:37.348849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:37.389348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] MFA Rules not processed for user `aeeadf6d81ef4e40a4bf362738856f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:37.390490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:37.497046 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1319/2608] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:37 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:37.500505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:37.501062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:37.501188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:37.567363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] MFA Rules not processed for user `c6c295b9814d44efba37e7a37df6fa9b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:37.569332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:37.707183 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1290/2609] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:38.126775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:38.132270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:38.453727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbd5e7-a8d0-43d5-9e7c-0c17c407a54a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:38.453727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de996-0d48-48ef-a7ae-adbb2934200a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:38.453727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de996-0d48-48ef-a7ae-adbb2934200a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:38.453727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de996-0d48-48ef-a7ae-adbb2934200a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:38.459776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de996-0d48-48ef-a7ae-adbb2934200a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:38.459776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de996-0d48-48ef-a7ae-adbb2934200a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:38.459776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de996-0d48-48ef-a7ae-adbb2934200a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:38.459776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1320/2610] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:38.881662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:38.883952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:39.006489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04eabd-70b8-4168-87d4-5188982a2b71 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:39.006489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04eabd-70b8-4168-87d4-5188982a2b71 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:39.006489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04eabd-70b8-4168-87d4-5188982a2b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:39.051704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb30fd9-9743-4ce8-8d45-53c163f430ae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:39.051704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:39.051704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:39.051704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:39.052105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:39.052105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:39.064597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:39.066677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:39.070666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dc04eabd-70b8-4168-87d4-5188982a2b71 None None] MFA Rules not processed for user `c6c295b9814d44efba37e7a37df6fa9b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:39.071914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dc04eabd-70b8-4168-87d4-5188982a2b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:39.086177 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1291/2611] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:39.086348 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1321/2612] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:39 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:39.693424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:39.695769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:39.757929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:39.759259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:39.759753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:39.810319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] MFA Rules not processed for user `491f06d5a64145919a6e4a9ec0fa9171`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:39.811560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:39.812507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cff43-8221-4506-a32c-9a8b1df64383 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:39.824431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:39.824431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:39.824431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:39.824431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] PATH_INFO: `/v3/users/74efde38ac7f47acb399e54c900f1a6e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:39.824809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=74efde38ac7f47acb399e54c900f1a6e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:39.824809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:39.891946 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1322/2613] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:39 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:40.110636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74efde38ac7f47acb399e54c900f1a6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.117395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74efde38ac7f47acb399e54c900f1a6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.130028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74efde38ac7f47acb399e54c900f1a6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.131047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74efde38ac7f47acb399e54c900f1a6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.136368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74efde38ac7f47acb399e54c900f1a6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.197766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:40.197766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:40.212636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb0531-4b70-4fac-bc26-e294148fcf30 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:40.229488 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1292/2614] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:39 2021] DELETE /identity/v3/users/74efde38ac7f47acb399e54c900f1a6e => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:40.237175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:40.238764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:40.239113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:40.239478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] PATH_INFO: `/v3/users/a53d0545f68d4b7eb74eff42f386f5c5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:40.250496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53d0545f68d4b7eb74eff42f386f5c5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:40.267311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:40.515215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53d0545f68d4b7eb74eff42f386f5c5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.525465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53d0545f68d4b7eb74eff42f386f5c5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.539384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53d0545f68d4b7eb74eff42f386f5c5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.540178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53d0545f68d4b7eb74eff42f386f5c5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.640343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-285d8a2a-068d-4ffc-bb77-a9f16e4f9b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53d0545f68d4b7eb74eff42f386f5c5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:40.649292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:40.652854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:40.702087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1323/2615] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:40 2021] DELETE /identity/v3/users/a53d0545f68d4b7eb74eff42f386f5c5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:40.704716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:40.707540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:40.709374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:40.766461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:40.767606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:40.865435 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1324/2616] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:40.879306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:40.882176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:40.909262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21490dd-ff82-441d-94c9-43d2b7fbd5ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:40.928414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:40.929394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:40.929649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:40.929982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] PATH_INFO: `/v3/projects/66ef4aef5d1a42c6b19b8c77eccf6bc1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:40.932527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ef4aef5d1a42c6b19b8c77eccf6bc1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:40.938322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:41.052087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ea43-8e00-44ef-9579-28da7a6112cc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:41.107806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d0244-3a80-4523-99b8-df75c8ac8065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:41.111920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d0244-3a80-4523-99b8-df75c8ac8065 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:41.112421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d0244-3a80-4523-99b8-df75c8ac8065 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:41.113006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d0244-3a80-4523-99b8-df75c8ac8065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:41.148740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ef4aef5d1a42c6b19b8c77eccf6bc1', 'request_id': 'req-8088a687-eba6-4b65-99fc-b9f0e0607cab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:41.150617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d0244-3a80-4523-99b8-df75c8ac8065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:41.154360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d0244-3a80-4523-99b8-df75c8ac8065 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:41.165067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ef4aef5d1a42c6b19b8c77eccf6bc1', 'request_id': 'req-8088a687-eba6-4b65-99fc-b9f0e0607cab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:41.175594 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1325/2617] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:41.286221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ef4aef5d1a42c6b19b8c77eccf6bc1', 'request_id': 'req-8088a687-eba6-4b65-99fc-b9f0e0607cab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:41.304082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] The token cache is being invalidate because project 66ef4aef5d1a42c6b19b8c77eccf6bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:41.304573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:41.306514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8088a687-eba6-4b65-99fc-b9f0e0607cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:41.312927 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1293/2618] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:40 2021] DELETE /identity/v3/projects/66ef4aef5d1a42c6b19b8c77eccf6bc1 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:41.316011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ba3d-496c-48a1-a60a-0c36edeb07ff None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:41.316308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ba3d-496c-48a1-a60a-0c36edeb07ff None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:41.316590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ba3d-496c-48a1-a60a-0c36edeb07ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:41.337092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c340ba3d-496c-48a1-a60a-0c36edeb07ff None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:41.338322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c340ba3d-496c-48a1-a60a-0c36edeb07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:41.400665 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1326/2619] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:41.414262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d137-adb8-4672-8839-1a568c079cc3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:41.414623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d137-adb8-4672-8839-1a568c079cc3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:41.415039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8d137-adb8-4672-8839-1a568c079cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:41.435076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f6d8d137-adb8-4672-8839-1a568c079cc3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:41.440533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f6d8d137-adb8-4672-8839-1a568c079cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:41.445634 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1294/2620] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:41.450125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340ba3d-496c-48a1-a60a-0c36edeb07ff None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:41.459862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340ba3d-496c-48a1-a60a-0c36edeb07ff None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:41.465449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:41.466104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:41.466380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:41.466648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:41.467399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:41.467700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:41.469344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:41.483646 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1327/2621] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:09:41.490055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d137-adb8-4672-8839-1a568c079cc3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:41.499513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8d137-adb8-4672-8839-1a568c079cc3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:41.504402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:41.505214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:41.505501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:41.505782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:41.506489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:41.509335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:41.727169 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1295/2622] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:41 2021] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:41.729360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:41.745470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fc64-86bb-4908-b9c4-13ee013eb1d2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:41.862343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:41.863703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:41.863979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:41.864415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:41.865151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:41.868256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:42.126359 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1328/2623] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:41 2021] POST /identity/v3/users => generated 283 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:42.130322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:42.159938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122955e0-905c-4f71-9cd8-267b4aff3722 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:42.184540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:42.184540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:42.184540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:42.184540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:42.185117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:42.188578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:42.223039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1296/2624] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:42.227759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:42.238369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ed7e2-1240-4e64-ae46-6438a66a4bd8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:42.262912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:42.263601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:42.263879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:42.264149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:42.264907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:42.266498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:42.290816 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1329/2625] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:42.295372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:42.313691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaeddb-5e10-429a-a78f-dd0e5d28f670 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:42.325061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:42.327156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:42.329451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82281514-ca49-4ad5-b624-9cbf9126bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:42.330301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82281514-ca49-4ad5-b624-9cbf9126bacd admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:42.330585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82281514-ca49-4ad5-b624-9cbf9126bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:42.330863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82281514-ca49-4ad5-b624-9cbf9126bacd admin admin] PATH_INFO: `/v3/projects/74b18f04a1eb470bac90f3df16ec5170/users/613e2533f4e04cca8fafc3ea463accd9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:42.346530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45302d-47b8-4b28-8053-dc08c91068f6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:42.362269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:42.363231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:42.364186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:42.364466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] PATH_INFO: `/v3/projects/63cdf796f2e84d6ebb3c03943ef35e0c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:42.365721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cdf796f2e84d6ebb3c03943ef35e0c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:42.367636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82281514-ca49-4ad5-b624-9cbf9126bacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b18f04a1eb470bac90f3df16ec5170, user_id=613e2533f4e04cca8fafc3ea463accd9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:42.368615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:42.371300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82281514-ca49-4ad5-b624-9cbf9126bacd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:42.594392 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1297/2626] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:42 2021] PUT /identity/v3/projects/74b18f04a1eb470bac90f3df16ec5170/users/613e2533f4e04cca8fafc3ea463accd9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:42.599572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:42.599959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:42.600372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:42.619321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:42.620516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:42.655549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cdf796f2e84d6ebb3c03943ef35e0c', 'request_id': 'req-cfd26a06-62a4-4abe-b297-647a195126c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:42.701144 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1298/2627] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:42.711328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:42.713094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:42.816651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cdf796f2e84d6ebb3c03943ef35e0c', 'request_id': 'req-cfd26a06-62a4-4abe-b297-647a195126c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:42.823984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c961f16-77a5-4b2b-9f43-e4064f96105f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:42.830257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cdf796f2e84d6ebb3c03943ef35e0c', 'request_id': 'req-cfd26a06-62a4-4abe-b297-647a195126c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:42.849297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] The token cache is being invalidate because project 63cdf796f2e84d6ebb3c03943ef35e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:42.849936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:42.852516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfd26a06-62a4-4abe-b297-647a195126c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:42.855228 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1330/2628] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:42 2021] DELETE /identity/v3/projects/63cdf796f2e84d6ebb3c03943ef35e0c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:09:42.871867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4d027-7234-41c6-ad9d-cabbde1167d7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:42.871867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4d027-7234-41c6-ad9d-cabbde1167d7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:42.871867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4d027-7234-41c6-ad9d-cabbde1167d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:42.905443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b1a4d027-7234-41c6-ad9d-cabbde1167d7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:42.907122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1a4d027-7234-41c6-ad9d-cabbde1167d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:42.933107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:42.933771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:42.934049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:42.934320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:42.943423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:43.074179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:43.075996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:43.084802 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1331/2629] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:43.088413 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1299/2630] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:09:43.093754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b142b-3675-43cc-96a7-c6f93990f46d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:43.094048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b142b-3675-43cc-96a7-c6f93990f46d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:43.095281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b142b-3675-43cc-96a7-c6f93990f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:43.168729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ab1b142b-3675-43cc-96a7-c6f93990f46d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:43.169997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ab1b142b-3675-43cc-96a7-c6f93990f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:43.195514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1332/2631] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:43.199845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:43.216233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeb80e-0e5f-491d-80f0-96911e1acc98 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:43.224454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:43.225325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:43.225773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:43.226129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:43.227011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:43.227726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:43.230710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:43.251524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b142b-3675-43cc-96a7-c6f93990f46d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:43.271460 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1300/2632] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:43.274291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b142b-3675-43cc-96a7-c6f93990f46d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:43.279893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:43.286665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:43.286665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:43.286665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:43.286665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:43.286665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:43.476822 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1333/2633] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:43 2021] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:43.481040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:43.504299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab5ee8-98d5-48fd-8bbd-21822c5b9f95 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:43.597042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:43.598899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:43.599348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:43.599778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:43.601340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:43.607272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:43.751951 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1301/2634] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:43 2021] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:43.753322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:43.773098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db566e2b-a80c-4cde-b5ae-cd432b2b205a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:43.782757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:43.784468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:43.786343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:43.789263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:43.789263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:43.792536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:43.831376 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1334/2635] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:43 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:43.836094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:43.846406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafb1da-bad9-4d9e-a3ad-39a2a13d4013 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:43.853671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c41c3c-2972-425f-b093-5923d9307d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:43.854532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41c3c-2972-425f-b093-5923d9307d2d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:43.854953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41c3c-2972-425f-b093-5923d9307d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:43.855608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41c3c-2972-425f-b093-5923d9307d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:43.856517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c41c3c-2972-425f-b093-5923d9307d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:43.858427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c41c3c-2972-425f-b093-5923d9307d2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:43.869748 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1302/2636] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:43 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:43.873554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:43.884791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a7cb3-06e1-428d-9b4a-3f3887551d5d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:43.890171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:43.891746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:43.892178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:43.892607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] PATH_INFO: `/v3/projects/8e9b79c725bc437ea573edf85e81d797/users/f27e3cb24c0a488ba6c896eeac6757fc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:43.911584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9b79c725bc437ea573edf85e81d797, user_id=f27e3cb24c0a488ba6c896eeac6757fc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:43.915486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:44.034690 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1335/2637] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:43 2021] PUT /identity/v3/projects/8e9b79c725bc437ea573edf85e81d797/users/f27e3cb24c0a488ba6c896eeac6757fc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:44.045774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f27b00-f702-471c-8911-e27d8452e3d8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:44.046934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f27b00-f702-471c-8911-e27d8452e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:44.047374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f27b00-f702-471c-8911-e27d8452e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:44.061190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:44.063016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:44.089918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b3f27b00-f702-471c-8911-e27d8452e3d8 None None] MFA Rules not processed for user `f27e3cb24c0a488ba6c896eeac6757fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:44.092468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b3f27b00-f702-471c-8911-e27d8452e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:44.153781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e01f3-4a83-47ec-8300-dbce2ac03a68 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:44.161304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:44.162841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:44.163825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:44.164109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:44.166178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:44.186602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:44.188857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:44.201339 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1336/2638] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:09:44.226443 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1303/2639] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:44 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:44.240509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:44.242030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:44.368996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bea63-fd69-4f24-ad69-3bfb1b8d0a83 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:44.375257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de2ed7-9a41-4429-a81b-8f76f3e5b93c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:44.376134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de2ed7-9a41-4429-a81b-8f76f3e5b93c service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:44.376567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de2ed7-9a41-4429-a81b-8f76f3e5b93c service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:44.377051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de2ed7-9a41-4429-a81b-8f76f3e5b93c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:44.389325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de2ed7-9a41-4429-a81b-8f76f3e5b93c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:44.391396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de2ed7-9a41-4429-a81b-8f76f3e5b93c service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:44.406099 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1337/2640] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:44 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:44.465801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f27b00-f702-471c-8911-e27d8452e3d8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:44.601736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f27b00-f702-471c-8911-e27d8452e3d8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:44.610069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:44.611735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:44.612220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:44.612662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] PATH_INFO: `/v3/users/f27e3cb24c0a488ba6c896eeac6757fc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:44.614131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27e3cb24c0a488ba6c896eeac6757fc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:44.617692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:44.816034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27e3cb24c0a488ba6c896eeac6757fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:44.830356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27e3cb24c0a488ba6c896eeac6757fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:44.861975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27e3cb24c0a488ba6c896eeac6757fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:44.863159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27e3cb24c0a488ba6c896eeac6757fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:44.863927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27e3cb24c0a488ba6c896eeac6757fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:44.977523 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1304/2641] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:44 2021] DELETE /identity/v3/users/f27e3cb24c0a488ba6c896eeac6757fc => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:44.983049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9902be-7d86-4276-89b7-2229f9d39aa8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:44.984734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9902be-7d86-4276-89b7-2229f9d39aa8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:44.985491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9902be-7d86-4276-89b7-2229f9d39aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:45.016030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bd9902be-7d86-4276-89b7-2229f9d39aa8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:45.017508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd9902be-7d86-4276-89b7-2229f9d39aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:45.140844 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1338/2642] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:45.190991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:45.192662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:45.322429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32352132-02a4-4773-bcfd-2514a7016161 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:45.329042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:45.329042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:45.331551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:45.331551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:45.362581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:45.371751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:45.393617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1305/2643] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:46.197795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50097-0ede-43a8-8ec2-7ccd2d3aa18b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:46.198273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50097-0ede-43a8-8ec2-7ccd2d3aa18b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:46.198539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50097-0ede-43a8-8ec2-7ccd2d3aa18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:46.264783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b7d50097-0ede-43a8-8ec2-7ccd2d3aa18b None None] MFA Rules not processed for user `613e2533f4e04cca8fafc3ea463accd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:46.266077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b7d50097-0ede-43a8-8ec2-7ccd2d3aa18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:46.336573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:46.338028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:46.362588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444416-7167-4270-b6fa-45a75a283ca2 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:46.392149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:46.394103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:46.395901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:46.396381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] PATH_INFO: `/v3/projects/8e9b79c725bc437ea573edf85e81d797` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:46.401422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9b79c725bc437ea573edf85e81d797)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:46.403373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:46.463446 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1339/2644] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:46 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:46.466280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e8c64-9762-4104-9286-1f79045d5318 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:46.466689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e8c64-9762-4104-9286-1f79045d5318 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:46.467067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e8c64-9762-4104-9286-1f79045d5318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:46.492162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f77e8c64-9762-4104-9286-1f79045d5318 None None] MFA Rules not processed for user `613e2533f4e04cca8fafc3ea463accd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:46.494586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f77e8c64-9762-4104-9286-1f79045d5318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:46.514481 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1340/2645] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:46 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:46.646672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9b79c725bc437ea573edf85e81d797', 'request_id': 'req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:46.666009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9b79c725bc437ea573edf85e81d797', 'request_id': 'req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:46.725337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9b79c725bc437ea573edf85e81d797', 'request_id': 'req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:46.745586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] The token cache is being invalidate because project 8e9b79c725bc437ea573edf85e81d797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:46.745876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:46.746705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:46.748708 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1306/2646] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:46 2021] DELETE /identity/v3/projects/8e9b79c725bc437ea573edf85e81d797 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:46.754079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec43290-fb84-48c3-a137-9fe8ec8b33b1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:46.755302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec43290-fb84-48c3-a137-9fe8ec8b33b1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:46.755689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec43290-fb84-48c3-a137-9fe8ec8b33b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:46.815832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-eec43290-fb84-48c3-a137-9fe8ec8b33b1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:46.818235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eec43290-fb84-48c3-a137-9fe8ec8b33b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:46.905336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:46.907024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:46.948093 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1341/2647] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:46.953348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24586e-287c-40d6-af46-8d06e38cf356 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:46.953641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24586e-287c-40d6-af46-8d06e38cf356 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:46.953921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24586e-287c-40d6-af46-8d06e38cf356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:46.983889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2c24586e-287c-40d6-af46-8d06e38cf356 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:46.985984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2c24586e-287c-40d6-af46-8d06e38cf356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:47.000236 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1342/2648] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:47.003253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24586e-287c-40d6-af46-8d06e38cf356 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:47.029913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24586e-287c-40d6-af46-8d06e38cf356 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:47.037444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:47.038685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.038967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.039238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.039973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:47.040760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:47.049157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:47.069354 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1343/2649] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:47.069862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:47.097713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf156-0f17-4b6b-bcc4-8253cfd1c32a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:47.106245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:47.133228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.133557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.133781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.134501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:47.142157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:47.183893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a2db8-be61-4cbc-86c5-7eabbd99c6c6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:47.188373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:47.189316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.189693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.190287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.192477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:47.279904 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1344/2650] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:47 2021] POST /identity/v3/projects => generated 397 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:47.282179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:47.371534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:47.377068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:47.386031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da139b-c2c1-4d42-860f-de5986b58f53 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:47.391823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:47.392520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.392787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.393876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.394531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:47.398961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:47.405565 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1307/2651] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:46 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:47.516715 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1345/2652] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:47 2021] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:47.520481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:47.541922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e04b5-be93-4709-8f4f-ed96e64b1b20 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:47.553801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:47.554493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.554769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.555037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.555776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:47.558214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:47.579574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1308/2653] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:47.583369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:47.601690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee67b8-ad7f-4312-9637-5973e03b120b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:47.614808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f649e-ecbf-4932-93fc-7be75e06173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:47.618991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f649e-ecbf-4932-93fc-7be75e06173e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.618991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f649e-ecbf-4932-93fc-7be75e06173e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.621372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f649e-ecbf-4932-93fc-7be75e06173e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.622049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f649e-ecbf-4932-93fc-7be75e06173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:47.623708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f649e-ecbf-4932-93fc-7be75e06173e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:47.650796 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1346/2654] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:47.655155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:47.666667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653db058-79f2-4f91-9033-f74c438c9e3b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:47.680123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012c356-a155-473c-b889-b07c828f40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:47.681392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012c356-a155-473c-b889-b07c828f40ce admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.681860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012c356-a155-473c-b889-b07c828f40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.682294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012c356-a155-473c-b889-b07c828f40ce admin admin] PATH_INFO: `/v3/projects/a49984f7eca64635a0a1aad92f289295/users/7653d16383ca42c89a08be862d0edcb7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.732126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012c356-a155-473c-b889-b07c828f40ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49984f7eca64635a0a1aad92f289295, user_id=7653d16383ca42c89a08be862d0edcb7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:47.738166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012c356-a155-473c-b889-b07c828f40ce admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:47.852522 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1309/2655] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:47 2021] PUT /identity/v3/projects/a49984f7eca64635a0a1aad92f289295/users/7653d16383ca42c89a08be862d0edcb7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:47.863311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2edfa-64d2-4f3f-8099-d6c6eecf2845 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.863668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2edfa-64d2-4f3f-8099-d6c6eecf2845 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.863954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2edfa-64d2-4f3f-8099-d6c6eecf2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.910606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f98c0-5627-484d-8f57-5b91c8e5674f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:47.910795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f98c0-5627-484d-8f57-5b91c8e5674f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:47.911091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f98c0-5627-484d-8f57-5b91c8e5674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:47.939240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b5b2edfa-64d2-4f3f-8099-d6c6eecf2845 None None] MFA Rules not processed for user `7653d16383ca42c89a08be862d0edcb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:47.941815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-388f98c0-5627-484d-8f57-5b91c8e5674f None None] MFA Rules not processed for user `9bf2eefd87de409785735fc802bc95ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:47.943227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-388f98c0-5627-484d-8f57-5b91c8e5674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:47.947560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b5b2edfa-64d2-4f3f-8099-d6c6eecf2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:48.087733 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1310/2656] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:47 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:48.132941 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1347/2657] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:47 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:48.663502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f98c0-5627-484d-8f57-5b91c8e5674f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:48.895082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f98c0-5627-484d-8f57-5b91c8e5674f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:48.914280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:48.915781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:48.916514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:48.916859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:48.953239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:48.955278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:48.973779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1311/2658] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:48 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:49.093134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be331472-4293-42b8-8366-fed35c603d22 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:49.093603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be331472-4293-42b8-8366-fed35c603d22 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:49.093808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be331472-4293-42b8-8366-fed35c603d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:49.136758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-be331472-4293-42b8-8366-fed35c603d22 None None] MFA Rules not processed for user `7653d16383ca42c89a08be862d0edcb7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:49.138691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be331472-4293-42b8-8366-fed35c603d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:49.175721 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1348/2659] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:49 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:50.374899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:50.534016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462be8c-18d4-42df-bf50-1804687155de service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:50.541838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:50.543771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:50.544318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:50.544803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] PATH_INFO: `/v3/users/7653d16383ca42c89a08be862d0edcb7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:50.546490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7653d16383ca42c89a08be862d0edcb7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:50.558863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:50.835065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7653d16383ca42c89a08be862d0edcb7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:50.843205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7653d16383ca42c89a08be862d0edcb7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:50.891431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7653d16383ca42c89a08be862d0edcb7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:50.893588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7653d16383ca42c89a08be862d0edcb7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:50.894931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7653d16383ca42c89a08be862d0edcb7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:50.969179 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1312/2660] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:50 2021] DELETE /identity/v3/users/7653d16383ca42c89a08be862d0edcb7 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:50.973841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:50.974336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:50.974642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:51.006845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:51.008225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:51.139112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1349/2661] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:51.153456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:51.155441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:51.241846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46915d5f-3c58-4f50-96b4-74ecaaf76a45 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:51.245705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53afde-6319-4c57-a7e2-6131a64ff542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:51.246485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53afde-6319-4c57-a7e2-6131a64ff542 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:51.246871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53afde-6319-4c57-a7e2-6131a64ff542 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:51.247246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53afde-6319-4c57-a7e2-6131a64ff542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:51.259161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53afde-6319-4c57-a7e2-6131a64ff542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:51.260632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53afde-6319-4c57-a7e2-6131a64ff542 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:51.270500 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1313/2662] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:51.927531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:51.929135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:51.948148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1da3b9-e2f8-4ead-9478-e6df618bab28 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:51.975842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:51.976735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:51.977066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:51.977330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] PATH_INFO: `/v3/users/6441cac91831435cb23d56e935cb99c6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:51.980006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6441cac91831435cb23d56e935cb99c6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:51.981996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:51.988794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921349bf-ed32-415a-926d-51d11b240a49 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:51.989442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921349bf-ed32-415a-926d-51d11b240a49 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:51.990857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921349bf-ed32-415a-926d-51d11b240a49 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:51.992065 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1314/2663] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:09:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:09:51.997416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:51.997899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:51.998281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.019303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:52.020644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:52.110211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1315/2664] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:09:51 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:52.111200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:52.112589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:52.138899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38fa31-5270-46db-a02c-1669a65230f2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:52.148972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:52.149873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:52.150689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:52.150791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] PATH_INFO: `/v3/projects/a49984f7eca64635a0a1aad92f289295` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.152118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49984f7eca64635a0a1aad92f289295)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:52.154305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:52.221057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6441cac91831435cb23d56e935cb99c6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.230225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6441cac91831435cb23d56e935cb99c6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.249043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6441cac91831435cb23d56e935cb99c6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.250072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6441cac91831435cb23d56e935cb99c6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.303045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49984f7eca64635a0a1aad92f289295', 'request_id': 'req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.310297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49984f7eca64635a0a1aad92f289295', 'request_id': 'req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.324976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6441cac91831435cb23d56e935cb99c6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.332649 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1350/2665] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:09:51 2021] DELETE /identity/v3/users/6441cac91831435cb23d56e935cb99c6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:52.333610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:52.348628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:52.432846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49984f7eca64635a0a1aad92f289295', 'request_id': 'req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.449628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] The token cache is being invalidate because project a49984f7eca64635a0a1aad92f289295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:52.449941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.450900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3abf6fb9-79d4-47e1-ad7d-4ab372a9d7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:52.454576 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1316/2666] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:52 2021] DELETE /identity/v3/projects/a49984f7eca64635a0a1aad92f289295 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:52.462376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbac24-1fb2-49b6-8706-eb2dfd92a31a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:52.463001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbac24-1fb2-49b6-8706-eb2dfd92a31a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:52.463318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbac24-1fb2-49b6-8706-eb2dfd92a31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.470763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56fcc-29a2-4141-8007-cfcf16a368b5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:52.484628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78452e-0f3b-4b8d-acf1-949cf70867a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:52.485637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78452e-0f3b-4b8d-acf1-949cf70867a5 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:52.486077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78452e-0f3b-4b8d-acf1-949cf70867a5 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:52.486503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78452e-0f3b-4b8d-acf1-949cf70867a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.489943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2f78452e-0f3b-4b8d-acf1-949cf70867a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:52.492373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-26bbac24-1fb2-49b6-8706-eb2dfd92a31a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:52.494480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-26bbac24-1fb2-49b6-8706-eb2dfd92a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:52.511877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78452e-0f3b-4b8d-acf1-949cf70867a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:52.513828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78452e-0f3b-4b8d-acf1-949cf70867a5 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:52.541010 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1351/2667] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:52.579039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1317/2668] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:09:52.586032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03733f3e-1805-4a0a-9825-a9eddbe8f0d6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:52.587170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03733f3e-1805-4a0a-9825-a9eddbe8f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:52.588174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03733f3e-1805-4a0a-9825-a9eddbe8f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.625363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-03733f3e-1805-4a0a-9825-a9eddbe8f0d6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:52.627268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-03733f3e-1805-4a0a-9825-a9eddbe8f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:52.647847 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1352/2669] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:52.648731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbac24-1fb2-49b6-8706-eb2dfd92a31a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:52.658977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbac24-1fb2-49b6-8706-eb2dfd92a31a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:52.665440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:52.665780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:52.670983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:52.670983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.670983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:52.670983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:52.670983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:52.686499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1318/2670] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:52.688661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03733f3e-1805-4a0a-9825-a9eddbe8f0d6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:52.700039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03733f3e-1805-4a0a-9825-a9eddbe8f0d6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:52.705041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:52.705715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:52.706026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:52.706270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.706968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:52.708860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:52.798341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:52.798713 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1353/2671] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:52 2021] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:52.812907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d1c2-8ce5-4aa1-86d6-a18231e97fee admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:52.888346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:52.889116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:52.889495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:52.890129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:52.890779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:52.893091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:53.007727 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1319/2672] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:52 2021] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:09:53.011533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:53.024639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3ff8-dc88-43f1-8f1d-2e26a306ec6e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:53.029600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:53.031410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.032153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.032632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.033894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:53.036219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:53.052747 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1354/2673] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:53 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:53.057231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:53.067673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c647600-f1cf-4660-96c4-11265bce2137 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:53.073164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e5fc-c8b7-42b8-8a16-2d514ff8cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:53.073921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e5fc-c8b7-42b8-8a16-2d514ff8cdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.074274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e5fc-c8b7-42b8-8a16-2d514ff8cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.074616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e5fc-c8b7-42b8-8a16-2d514ff8cdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.075429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308e5fc-c8b7-42b8-8a16-2d514ff8cdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:53.077103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308e5fc-c8b7-42b8-8a16-2d514ff8cdb5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:53.089600 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1320/2674] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:53.095810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:53.109923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735b502-79d3-4a31-b5cf-90b498bd9153 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:53.118121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:53.119338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.120588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.121118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] PATH_INFO: `/v3/projects/4aa6a09f9e43475e8a7f5639f59b1654/users/888bca4c195e4f3185e32e956e256b06/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.161703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa6a09f9e43475e8a7f5639f59b1654, user_id=888bca4c195e4f3185e32e956e256b06, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:53.167478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:53.267021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1355/2675] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:53 2021] PUT /identity/v3/projects/4aa6a09f9e43475e8a7f5639f59b1654/users/888bca4c195e4f3185e32e956e256b06/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:53.274219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.274535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.274771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.295860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:53.297277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:53.393048 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1321/2676] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:53.420338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:53.422326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:53.428149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:53.429961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:53.461776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf61e98-d1bd-4eea-aac7-7d1776bcb92c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:53.475710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:53.481782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.481782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.481782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] PATH_INFO: `/v3/projects/e65cafc179094f63bf88bfba4c57fd1f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.481782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65cafc179094f63bf88bfba4c57fd1f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:53.489948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:53.584139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb84fa-fa95-4fa7-9ba6-9689bab06379 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:53.593792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b809c5-51ea-44eb-8eb1-c2ea5bd65644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:53.595721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b809c5-51ea-44eb-8eb1-c2ea5bd65644 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.596010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b809c5-51ea-44eb-8eb1-c2ea5bd65644 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.596279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b809c5-51ea-44eb-8eb1-c2ea5bd65644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.612799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b809c5-51ea-44eb-8eb1-c2ea5bd65644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:53.614661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b809c5-51ea-44eb-8eb1-c2ea5bd65644 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:53.644606 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1356/2677] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:53.674322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65cafc179094f63bf88bfba4c57fd1f', 'request_id': 'req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:53.682922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65cafc179094f63bf88bfba4c57fd1f', 'request_id': 'req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:53.747482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65cafc179094f63bf88bfba4c57fd1f', 'request_id': 'req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:53.761422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] The token cache is being invalidate because project e65cafc179094f63bf88bfba4c57fd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:09:53.761814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:53.762596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3bb5dddf-faf8-44d1-abf1-b84b0689a5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:09:53.769764 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1322/2678] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:53 2021] DELETE /identity/v3/projects/e65cafc179094f63bf88bfba4c57fd1f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:53.776811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d68ee-9b84-4f87-a3ac-7e6f9bd22246 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.777356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d68ee-9b84-4f87-a3ac-7e6f9bd22246 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.777793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d68ee-9b84-4f87-a3ac-7e6f9bd22246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.811708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f22d68ee-9b84-4f87-a3ac-7e6f9bd22246 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:53.813203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f22d68ee-9b84-4f87-a3ac-7e6f9bd22246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:53.907985 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1357/2679] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:53.918027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec713e7-3126-4847-a447-4828fed3f41d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.918327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec713e7-3126-4847-a447-4828fed3f41d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.918614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec713e7-3126-4847-a447-4828fed3f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.942685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eec713e7-3126-4847-a447-4828fed3f41d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:53.945499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eec713e7-3126-4847-a447-4828fed3f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:53.954387 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1323/2680] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:53.958650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d68ee-9b84-4f87-a3ac-7e6f9bd22246 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:53.971265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d68ee-9b84-4f87-a3ac-7e6f9bd22246 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:53.977316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:53.977992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:53.978276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:53.978555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:53.979293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:09:53.979735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:53.981446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:54.001707 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1358/2681] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:09:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:09:54.003407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec713e7-3126-4847-a447-4828fed3f41d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:54.014744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec713e7-3126-4847-a447-4828fed3f41d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:54.021081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:54.021885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:54.022305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:54.022829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:54.023697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:54.025810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:54.133727 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1324/2682] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:09:54 2021] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:54.138080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:54.150917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce77410-f8bb-4ddc-8d10-f5495324f966 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:54.227283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:54.228324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:54.229051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:54.229051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:54.229965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:54.232604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:54.331255 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1359/2683] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:09:54 2021] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:09:54.335889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:54.347240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a432a-f631-40f7-85ba-5930e926dfc5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:54.353113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:54.353857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:54.356392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:54.356392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:54.356392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:54.357154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:54.373767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:54.374351 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1325/2684] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:09:54.390819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78ddc0-5410-46ad-93ad-69902ec94ebc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:54.396122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddf958-6d48-4b01-87ba-8e1f02325865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:54.397092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf958-6d48-4b01-87ba-8e1f02325865 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:54.397455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf958-6d48-4b01-87ba-8e1f02325865 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:54.397796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf958-6d48-4b01-87ba-8e1f02325865 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:54.398752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddf958-6d48-4b01-87ba-8e1f02325865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:54.401052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddf958-6d48-4b01-87ba-8e1f02325865 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:54.412630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1360/2685] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:54 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:09:54.416786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:54.427747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a1d8-bdde-4591-971b-754e0689f57b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:54.434879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:54.435694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:54.436044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:54.436486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] PATH_INFO: `/v3/projects/4c0aeffe0df54fde9e4b4ae7b2730a88/users/35af910268234b16bd4a2a85773fa81b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:54.453226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0aeffe0df54fde9e4b4ae7b2730a88, user_id=35af910268234b16bd4a2a85773fa81b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:54.456305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:54.572264 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1326/2686] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:09:54 2021] PUT /identity/v3/projects/4c0aeffe0df54fde9e4b4ae7b2730a88/users/35af910268234b16bd4a2a85773fa81b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:09:54.577699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8858b02-5a4d-4586-83a2-d773353104a9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:54.577978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8858b02-5a4d-4586-83a2-d773353104a9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:54.578269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8858b02-5a4d-4586-83a2-d773353104a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:54.597914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c8858b02-5a4d-4586-83a2-d773353104a9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:54.599332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8858b02-5a4d-4586-83a2-d773353104a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:54.678881 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1361/2687] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:54.695008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:54.697500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:54.795917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c439516-1f2c-4a3e-91c5-c814ade5658d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:54.801808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:54.802407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:54.802691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:54.802969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:54.813927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:54.815421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:54.835072 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1327/2688] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:09:57.347222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b13a8a-31df-4c12-82d5-c11d44d235e3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:57.347720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b13a8a-31df-4c12-82d5-c11d44d235e3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:57.349233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b13a8a-31df-4c12-82d5-c11d44d235e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:57.432569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-53b13a8a-31df-4c12-82d5-c11d44d235e3 None None] MFA Rules not processed for user `35af910268234b16bd4a2a85773fa81b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:09:57.434239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-53b13a8a-31df-4c12-82d5-c11d44d235e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:57.529839 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1362/2689] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:09:57 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:09:57.858230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:09:57.859745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:09:57.953012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2601-93af-43f2-bfe1-c8e6d293289e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:09:57.965160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:09:57.965737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:09:57.966011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:09:57.966416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:09:57.975968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:09:57.977560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:09:57.987326 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1328/2690] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:09:57 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:02.793550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b48d-0c07-41c3-ae93-cd74c113e623 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:02.794702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b48d-0c07-41c3-ae93-cd74c113e623 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:02.795136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b48d-0c07-41c3-ae93-cd74c113e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:02.838438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8065b48d-0c07-41c3-ae93-cd74c113e623 None None] MFA Rules not processed for user `888bca4c195e4f3185e32e956e256b06`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:02.839911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8065b48d-0c07-41c3-ae93-cd74c113e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:02.931977 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1363/2691] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:02 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:03.428756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:03.439899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e70e-01f1-47a1-bfec-555501b0184b service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:03.446739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0f70-6474-4c4c-a4e1-364040853c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:03.447381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0f70-6474-4c4c-a4e1-364040853c2c service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:03.447742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0f70-6474-4c4c-a4e1-364040853c2c service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:03.448599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0f70-6474-4c4c-a4e1-364040853c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:03.458404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0f70-6474-4c4c-a4e1-364040853c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:03.460234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0f70-6474-4c4c-a4e1-364040853c2c service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:03.469661 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1329/2692] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:10:03 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:03.511002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81fde6-7a32-4461-8f35-3e644820f9ca None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:03.511290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81fde6-7a32-4461-8f35-3e644820f9ca None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:03.511629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81fde6-7a32-4461-8f35-3e644820f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:03.532299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2d81fde6-7a32-4461-8f35-3e644820f9ca None None] MFA Rules not processed for user `c6c295b9814d44efba37e7a37df6fa9b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:03.534196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2d81fde6-7a32-4461-8f35-3e644820f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:03.593629 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1364/2693] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:03 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:06.565783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172adff-62f0-42f1-8eae-87ca0f822181 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:06.567436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172adff-62f0-42f1-8eae-87ca0f822181 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:06.567436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172adff-62f0-42f1-8eae-87ca0f822181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:06.657691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8172adff-62f0-42f1-8eae-87ca0f822181 None None] MFA Rules not processed for user `491f06d5a64145919a6e4a9ec0fa9171`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:06.660344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8172adff-62f0-42f1-8eae-87ca0f822181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:06.764457 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1330/2694] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:06 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:07.203558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:07.204027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:07.204113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:07.226361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] MFA Rules not processed for user `888bca4c195e4f3185e32e956e256b06`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:07.227837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:07.237150 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1365/2695] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:07 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:17.054816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd0063-a5dd-4c8a-aa18-ab43e2c2f83a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:17.055403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd0063-a5dd-4c8a-aa18-ab43e2c2f83a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:17.055403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd0063-a5dd-4c8a-aa18-ab43e2c2f83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:17.074894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a1bd0063-a5dd-4c8a-aa18-ab43e2c2f83a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:17.076234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a1bd0063-a5dd-4c8a-aa18-ab43e2c2f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:17.177747 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1331/2696] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:10:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:17.382530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:17.385151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:17.485781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7978d-3c0a-4d82-9ee9-147f69ec9a11 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:17.494890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:17.502601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:17.502601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:17.502601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:17.512379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:17.514032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:17.533630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1366/2697] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:10:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:19.275777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd0063-a5dd-4c8a-aa18-ab43e2c2f83a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:19.299848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd0063-a5dd-4c8a-aa18-ab43e2c2f83a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:19.316131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d698e-e6c6-43de-9d03-08a79413bb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:19.317919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d698e-e6c6-43de-9d03-08a79413bb0e service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:19.318760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d698e-e6c6-43de-9d03-08a79413bb0e service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:19.319801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d698e-e6c6-43de-9d03-08a79413bb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:19.326753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5e8d698e-e6c6-43de-9d03-08a79413bb0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:19.441248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d698e-e6c6-43de-9d03-08a79413bb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:19.444404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d698e-e6c6-43de-9d03-08a79413bb0e service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:19.456635 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1332/2698] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:10:19 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:19.580527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:19.597791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340c5f-5a13-4b88-b7a0-b939244e1cd8 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:19.603071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:19.604506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:19.605208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:19.605712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] PATH_INFO: `/v3/users/35af910268234b16bd4a2a85773fa81b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:19.609221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=35af910268234b16bd4a2a85773fa81b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:19.611611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:19.831898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35af910268234b16bd4a2a85773fa81b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:19.847922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35af910268234b16bd4a2a85773fa81b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:19.872349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35af910268234b16bd4a2a85773fa81b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:19.873140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35af910268234b16bd4a2a85773fa81b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:19.968695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2c3a968-27a1-4f14-9307-bb75a514fc7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35af910268234b16bd4a2a85773fa81b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:19.977716 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1367/2699] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:10:19 2021] DELETE /identity/v3/users/35af910268234b16bd4a2a85773fa81b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:10:20.012534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4714-70be-44c5-9fb5-01a93209c9f4 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:20.013147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4714-70be-44c5-9fb5-01a93209c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:20.013692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4714-70be-44c5-9fb5-01a93209c9f4 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:20.015901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1333/2700] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:10:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:10:20.022263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:20.022815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:20.023251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:20.083186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:20.084924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:20.260035 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1368/2701] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:10:20 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:20.296333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4714-70be-44c5-9fb5-01a93209c9f4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:20.298351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93de4714-70be-44c5-9fb5-01a93209c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:20.316931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4714-70be-44c5-9fb5-01a93209c9f4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:20.317752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:20.320092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:20.324983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e87d8-58e2-497a-b299-705970386724 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:20.331105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e87d8-58e2-497a-b299-705970386724 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:20.336272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e87d8-58e2-497a-b299-705970386724 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:20.336272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e87d8-58e2-497a-b299-705970386724 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:20.373384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e87d8-58e2-497a-b299-705970386724 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:20.376562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e87d8-58e2-497a-b299-705970386724 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:20.407955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1334/2702] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:10:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:20.436943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862b99-af13-47d7-916d-8bb7e6eabfbb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:20.453639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:20.454489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:20.454768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:20.455041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] PATH_INFO: `/v3/projects/4c0aeffe0df54fde9e4b4ae7b2730a88` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:20.456300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0aeffe0df54fde9e4b4ae7b2730a88)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:20.458359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:20.618435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0aeffe0df54fde9e4b4ae7b2730a88', 'request_id': 'req-a961c4af-50b0-4700-9663-795489fbf397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:20.735967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0aeffe0df54fde9e4b4ae7b2730a88', 'request_id': 'req-a961c4af-50b0-4700-9663-795489fbf397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:20.745990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0aeffe0df54fde9e4b4ae7b2730a88', 'request_id': 'req-a961c4af-50b0-4700-9663-795489fbf397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:20.774077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] The token cache is being invalidate because project 4c0aeffe0df54fde9e4b4ae7b2730a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:10:20.782908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:20.782908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a961c4af-50b0-4700-9663-795489fbf397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:20.782908 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1369/2703] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:20 2021] DELETE /identity/v3/projects/4c0aeffe0df54fde9e4b4ae7b2730a88 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:10:20.784277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787995-dea5-406a-9384-67d6a34fb6d5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:20.784415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787995-dea5-406a-9384-67d6a34fb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:20.784698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787995-dea5-406a-9384-67d6a34fb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:20.827274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1d787995-dea5-406a-9384-67d6a34fb6d5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:20.829473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1d787995-dea5-406a-9384-67d6a34fb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:20.937775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1335/2704] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:20.951315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96088f5-2f1a-4675-8573-66a122e668b9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:20.954006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96088f5-2f1a-4675-8573-66a122e668b9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:20.955389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96088f5-2f1a-4675-8573-66a122e668b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:20.987704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d96088f5-2f1a-4675-8573-66a122e668b9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:20.989086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d96088f5-2f1a-4675-8573-66a122e668b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:20.998816 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1370/2705] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:21.003278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787995-dea5-406a-9384-67d6a34fb6d5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:21.019321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787995-dea5-406a-9384-67d6a34fb6d5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:21.034447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:21.034600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:21.034820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:21.035091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:21.036007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:10:21.036341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:21.038214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:21.063699 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1336/2706] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:10:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:10:21.071944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96088f5-2f1a-4675-8573-66a122e668b9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:21.083060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96088f5-2f1a-4675-8573-66a122e668b9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:21.092623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:21.093975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:21.094709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:21.095441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:21.096526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:21.098613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:21.201456 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1371/2707] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:10:21 2021] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:10:21.211911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:21.236558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64038-8ce5-480f-9d31-404d656e088c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:21.308448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:21.309386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:21.309688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:21.310004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:21.310734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:21.312965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:21.669448 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1337/2708] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:10:21 2021] POST /identity/v3/users => generated 303 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:10:21.673664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:21.684932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253402d-a62b-45e1-864a-51d3bbf9a775 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:21.690597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:21.694302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:21.694302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:21.694302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:21.694302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:21.694795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:21.708127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1372/2709] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:10:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:10:21.713191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:21.725871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aab4d-0e9a-4853-8d5d-5c25ec5f7622 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:21.732075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097defd-2213-4fbd-abe2-3bdc73e60fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:21.733138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097defd-2213-4fbd-abe2-3bdc73e60fdb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:21.733432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097defd-2213-4fbd-abe2-3bdc73e60fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:21.733776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097defd-2213-4fbd-abe2-3bdc73e60fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:21.734739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097defd-2213-4fbd-abe2-3bdc73e60fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:21.737866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097defd-2213-4fbd-abe2-3bdc73e60fdb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:21.764923 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1338/2710] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:10:21 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:10:21.766270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:21.779908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55aff-8dbf-4817-8e8d-44ff1a5048cf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:21.787243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:21.788286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:21.788665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:21.789154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] PATH_INFO: `/v3/projects/312311b1a1b24b19a58110efec89511f/users/b826b43cd3b44a29b5ddff8c3aa33c62/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:21.970810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312311b1a1b24b19a58110efec89511f, user_id=b826b43cd3b44a29b5ddff8c3aa33c62, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:21.975952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:22.059737 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1373/2711] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:10:21 2021] PUT /identity/v3/projects/312311b1a1b24b19a58110efec89511f/users/b826b43cd3b44a29b5ddff8c3aa33c62/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:10:22.064923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81561-d1ea-4853-94b5-ecbbd219258c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:22.071261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81561-d1ea-4853-94b5-ecbbd219258c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:22.071261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81561-d1ea-4853-94b5-ecbbd219258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:22.115388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-90b81561-d1ea-4853-94b5-ecbbd219258c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:22.116919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-90b81561-d1ea-4853-94b5-ecbbd219258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:22.209236 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1339/2712] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:22.220929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:22.222706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:22.339290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d343-b70b-46c0-a496-580d96dda7a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:22.345270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71469cdd-a6f8-4f73-ab05-ca758a1244e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:22.349740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469cdd-a6f8-4f73-ab05-ca758a1244e5 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:22.349740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469cdd-a6f8-4f73-ab05-ca758a1244e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:22.349740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469cdd-a6f8-4f73-ab05-ca758a1244e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:22.363462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71469cdd-a6f8-4f73-ab05-ca758a1244e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:22.365417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71469cdd-a6f8-4f73-ab05-ca758a1244e5 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:22.379250 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1374/2713] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:10:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:23.524959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:23.526119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:23.526599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:23.557710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] MFA Rules not processed for user `2cb2a59c7c9b4a13964c78ff0fb1a8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:23.558919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:23.688077 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1340/2714] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:23 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:24.814021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b766-d216-4a81-a512-69c657314562 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:24.814502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b766-d216-4a81-a512-69c657314562 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:24.816227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b766-d216-4a81-a512-69c657314562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:24.864306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-de46b766-d216-4a81-a512-69c657314562 None None] MFA Rules not processed for user `b826b43cd3b44a29b5ddff8c3aa33c62`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:24.866246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-de46b766-d216-4a81-a512-69c657314562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:24.988068 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1375/2715] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:24 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:25.108891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:25.110480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:25.235009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2015f-c926-4d5b-8ef5-79557c4f4ec2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:25.241325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:25.242928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:25.243468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:25.243879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:25.255462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:25.257320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:25.268983 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1341/2716] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:10:25 2021] GET /identity/v3/auth/tokens => generated 3272 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:33.685187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd8c5-a342-45e2-bf5d-0df95922ad5a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:33.686272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd8c5-a342-45e2-bf5d-0df95922ad5a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:33.686773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd8c5-a342-45e2-bf5d-0df95922ad5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:33.714524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-273fd8c5-a342-45e2-bf5d-0df95922ad5a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:33.716448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-273fd8c5-a342-45e2-bf5d-0df95922ad5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:33.790008 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1376/2717] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:10:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:33.805225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:33.806838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:33.889445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e758018-fc12-4555-8e03-0ad41dbeed11 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:33.894952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac890b-424e-4556-bd95-2cd32bdf283c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:33.898174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac890b-424e-4556-bd95-2cd32bdf283c service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:33.898174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac890b-424e-4556-bd95-2cd32bdf283c service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:33.898174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac890b-424e-4556-bd95-2cd32bdf283c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:33.905322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac890b-424e-4556-bd95-2cd32bdf283c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:33.907122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac890b-424e-4556-bd95-2cd32bdf283c service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:33.916462 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1342/2718] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:10:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:35.682253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cce6-0c58-4155-b9e7-8fedab2ed7c1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:35.683379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cce6-0c58-4155-b9e7-8fedab2ed7c1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:35.683803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cce6-0c58-4155-b9e7-8fedab2ed7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:35.735419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c9d6cce6-0c58-4155-b9e7-8fedab2ed7c1 None None] MFA Rules not processed for user `613e2533f4e04cca8fafc3ea463accd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:35.737125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c9d6cce6-0c58-4155-b9e7-8fedab2ed7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:35.814586 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1377/2719] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:35 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:36.795327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed5e5a-9924-42f3-a280-0b9d84f12581 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:36.796723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed5e5a-9924-42f3-a280-0b9d84f12581 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:36.797195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed5e5a-9924-42f3-a280-0b9d84f12581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:36.845760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-02ed5e5a-9924-42f3-a280-0b9d84f12581 None None] MFA Rules not processed for user `9bf2eefd87de409785735fc802bc95ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:36.850009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-02ed5e5a-9924-42f3-a280-0b9d84f12581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:36.964519 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1343/2720] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:36 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:42.776899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cce6-0c58-4155-b9e7-8fedab2ed7c1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:42.817797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cce6-0c58-4155-b9e7-8fedab2ed7c1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:42.833881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:42.836729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:42.837941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:42.838295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] PATH_INFO: `/v3/users/b826b43cd3b44a29b5ddff8c3aa33c62` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:42.842807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b826b43cd3b44a29b5ddff8c3aa33c62)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:42.845613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:43.087164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b826b43cd3b44a29b5ddff8c3aa33c62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:43.102999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b826b43cd3b44a29b5ddff8c3aa33c62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:43.131468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b826b43cd3b44a29b5ddff8c3aa33c62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:43.131923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b826b43cd3b44a29b5ddff8c3aa33c62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:43.225754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c89ee1db-bfc8-4d28-805b-d61574a13eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b826b43cd3b44a29b5ddff8c3aa33c62'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:43.232724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1378/2721] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:10:42 2021] DELETE /identity/v3/users/b826b43cd3b44a29b5ddff8c3aa33c62 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:10:43.725297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed5e5a-9924-42f3-a280-0b9d84f12581 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:43.739496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed5e5a-9924-42f3-a280-0b9d84f12581 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:43.809959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:43.811419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:43.811708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:43.811981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] PATH_INFO: `/v3/projects/312311b1a1b24b19a58110efec89511f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:43.813244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312311b1a1b24b19a58110efec89511f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:43.815262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:43.940728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312311b1a1b24b19a58110efec89511f', 'request_id': 'req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:43.949235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312311b1a1b24b19a58110efec89511f', 'request_id': 'req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:44.008574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312311b1a1b24b19a58110efec89511f', 'request_id': 'req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:44.023295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] The token cache is being invalidate because project 312311b1a1b24b19a58110efec89511f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:10:44.023852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:44.025327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-484dd875-a7f6-4cdc-9f44-a74630b8d2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:10:44.027516 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1344/2722] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:43 2021] DELETE /identity/v3/projects/312311b1a1b24b19a58110efec89511f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:10:44.034730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206bf56-8879-4071-9f10-04f844b76c95 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.035380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206bf56-8879-4071-9f10-04f844b76c95 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.035380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206bf56-8879-4071-9f10-04f844b76c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.055492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5206bf56-8879-4071-9f10-04f844b76c95 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:44.057031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5206bf56-8879-4071-9f10-04f844b76c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:44.118799 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1379/2723] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:44.127191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15824b1-7537-4d93-96b3-ca336d47c8e6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.127474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15824b1-7537-4d93-96b3-ca336d47c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.127746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15824b1-7537-4d93-96b3-ca336d47c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.147488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a15824b1-7537-4d93-96b3-ca336d47c8e6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:44.148680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a15824b1-7537-4d93-96b3-ca336d47c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:44.162207 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1345/2724] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:44.163356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206bf56-8879-4071-9f10-04f844b76c95 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:44.172981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206bf56-8879-4071-9f10-04f844b76c95 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:44.177932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:44.178613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.178895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.179228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.179966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:10:44.180274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:44.183018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:44.197687 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1380/2725] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:10:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:10:44.205255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15824b1-7537-4d93-96b3-ca336d47c8e6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:44.226647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15824b1-7537-4d93-96b3-ca336d47c8e6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:44.232154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:44.233224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.233684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.234053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.236256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:44.239231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:44.358340 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1346/2726] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:10:44 2021] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:10:44.362188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:44.375412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c6f7-2409-4630-9def-eafdfdebb5a4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:44.439591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:44.440356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.440739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.441122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.442710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:44.445276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:44.616358 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1381/2727] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:10:44 2021] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:10:44.619913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:44.632196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496ba29-a734-4cee-9f54-c886bbc81af4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:44.643051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:44.643731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.644010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.644285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.645132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:44.646731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:44.657773 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1347/2728] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:10:44 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:10:44.662101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:44.674646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7d1cd-656e-4581-8635-a3cbe5bb34a4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:44.679819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5b6c1-d37a-4052-8690-741932c47f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:44.680481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b6c1-d37a-4052-8690-741932c47f8b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.680761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b6c1-d37a-4052-8690-741932c47f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.681061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5b6c1-d37a-4052-8690-741932c47f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.681792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5b6c1-d37a-4052-8690-741932c47f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:44.683376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5b6c1-d37a-4052-8690-741932c47f8b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:44.696396 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1382/2729] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:10:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:10:44.699434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:44.709536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb7f7-a717-4035-b70b-a512d8906c28 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:44.714128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:44.715128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.715410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.715679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] PATH_INFO: `/v3/projects/b2a52fc668c14890989f5c2756094ba1/users/cf797406f5aa4ba792478c5af6eccb4f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.730381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a52fc668c14890989f5c2756094ba1, user_id=cf797406f5aa4ba792478c5af6eccb4f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:44.733025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:44.842466 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1348/2730] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:10:44 2021] PUT /identity/v3/projects/b2a52fc668c14890989f5c2756094ba1/users/cf797406f5aa4ba792478c5af6eccb4f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:10:44.847807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbdccc-2e71-4979-b747-38809fc8aac2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:44.848165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbdccc-2e71-4979-b747-38809fc8aac2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:44.848517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbdccc-2e71-4979-b747-38809fc8aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:44.867088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6bbbdccc-2e71-4979-b747-38809fc8aac2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:44.868289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6bbbdccc-2e71-4979-b747-38809fc8aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:44.929223 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1383/2731] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:10:44.939053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:44.940813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:45.018843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c601a8-371a-4cc6-aa98-babbaeee534f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:45.023270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad7fb2-28dc-4952-b6f8-eb5cb8ebd914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:45.023987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad7fb2-28dc-4952-b6f8-eb5cb8ebd914 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:45.024201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad7fb2-28dc-4952-b6f8-eb5cb8ebd914 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:45.024475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad7fb2-28dc-4952-b6f8-eb5cb8ebd914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:45.046337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad7fb2-28dc-4952-b6f8-eb5cb8ebd914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:45.047781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad7fb2-28dc-4952-b6f8-eb5cb8ebd914 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:45.070561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1349/2732] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:10:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:10:47.075309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3309-ff21-4f76-a142-e91cc7ad05e6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:47.075865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3309-ff21-4f76-a142-e91cc7ad05e6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:47.075865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3309-ff21-4f76-a142-e91cc7ad05e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:47.140380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-579d3309-ff21-4f76-a142-e91cc7ad05e6 None None] MFA Rules not processed for user `cf797406f5aa4ba792478c5af6eccb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:47.141637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-579d3309-ff21-4f76-a142-e91cc7ad05e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:47.409928 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1384/2733] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:47 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:47.471918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:47.472456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:47.472456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:47.491247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] MFA Rules not processed for user `cf797406f5aa4ba792478c5af6eccb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:47.492983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:47.500798 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1350/2734] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:47 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:47.511343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fe66c-bd8c-4ce0-8c28-f8508d2a128b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:47.512354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fe66c-bd8c-4ce0-8c28-f8508d2a128b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:47.512707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fe66c-bd8c-4ce0-8c28-f8508d2a128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:47.531183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b67fe66c-bd8c-4ce0-8c28-f8508d2a128b None None] MFA Rules not processed for user `cf797406f5aa4ba792478c5af6eccb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:47.532373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b67fe66c-bd8c-4ce0-8c28-f8508d2a128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:47.541537 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1385/2735] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:47 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:47.551718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:10:47.553767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:47.652736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871d13-070a-475d-85da-be5a070e18f8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:10:47.668581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecf67f-acd3-42ff-b971-f1e73797ef60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:10:47.669645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf67f-acd3-42ff-b971-f1e73797ef60 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:47.670005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf67f-acd3-42ff-b971-f1e73797ef60 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:47.670360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf67f-acd3-42ff-b971-f1e73797ef60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:47.682248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecf67f-acd3-42ff-b971-f1e73797ef60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:10:47.684460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecf67f-acd3-42ff-b971-f1e73797ef60 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:10:47.722369 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1351/2736] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:10:47 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:48.931356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f95c9-5d6a-4346-b03e-66af440c9b1a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:48.931896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f95c9-5d6a-4346-b03e-66af440c9b1a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:48.931896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f95c9-5d6a-4346-b03e-66af440c9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:49.002144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-816f95c9-5d6a-4346-b03e-66af440c9b1a None None] MFA Rules not processed for user `cf797406f5aa4ba792478c5af6eccb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:49.012439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-816f95c9-5d6a-4346-b03e-66af440c9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:49.065577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1386/2737] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:48 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:50.058311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:50.059326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:50.059609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:50.101319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] MFA Rules not processed for user `cf797406f5aa4ba792478c5af6eccb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:50.102579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:50.118857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1352/2738] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:50 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:10:55.256032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63ac7-2ae5-45f4-8ba5-1bea765df0cb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:10:55.256551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63ac7-2ae5-45f4-8ba5-1bea765df0cb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:10:55.256661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63ac7-2ae5-45f4-8ba5-1bea765df0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:10:55.286918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-29b63ac7-2ae5-45f4-8ba5-1bea765df0cb None None] MFA Rules not processed for user `aa5e089e14854aec83cc6b1f9ca9fedc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:10:55.290449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-29b63ac7-2ae5-45f4-8ba5-1bea765df0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:10:55.401814 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1387/2739] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:10:55 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:04.272171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:04.278124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:04.325322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c8f7-9a1e-43a6-b8a8-a3fd3a1930a7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:04.331310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:04.332489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:04.336812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:04.336812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] PATH_INFO: `/v3/users/491f06d5a64145919a6e4a9ec0fa9171` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:04.348278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491f06d5a64145919a6e4a9ec0fa9171)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:04.350443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:04.653322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491f06d5a64145919a6e4a9ec0fa9171'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:04.662278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491f06d5a64145919a6e4a9ec0fa9171'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:04.679917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491f06d5a64145919a6e4a9ec0fa9171'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:04.687841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491f06d5a64145919a6e4a9ec0fa9171'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:04.691870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491f06d5a64145919a6e4a9ec0fa9171'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:04.869841 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1353/2740] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:11:04 2021] DELETE /identity/v3/users/491f06d5a64145919a6e4a9ec0fa9171 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:11:04.874557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:04.875098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:04.875098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:04.897564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:04.898969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:04.980005 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1388/2741] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:04.987832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:04.998598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:05.061042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b18689-e2dc-4295-be8b-774dd402c2f1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:05.065223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:05.065870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:05.066716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:05.066991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:05.077955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:05.080078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:05.090675 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1354/2742] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:11:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:11:05.428008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:05.430119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:05.445888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e5ddc-6129-4be8-bda6-e7d6a554084a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:05.457380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:05.458516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:05.459051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:05.459568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] PATH_INFO: `/v3/projects/19a16dcc3c214ac2a218d3758e551792` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:05.461233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a16dcc3c214ac2a218d3758e551792)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:05.463547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:05.615041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a16dcc3c214ac2a218d3758e551792', 'request_id': 'req-b123dccf-61e7-43ef-9598-b991e9e46101'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:05.733937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a16dcc3c214ac2a218d3758e551792', 'request_id': 'req-b123dccf-61e7-43ef-9598-b991e9e46101'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:05.740904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a16dcc3c214ac2a218d3758e551792', 'request_id': 'req-b123dccf-61e7-43ef-9598-b991e9e46101'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:05.754317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] The token cache is being invalidate because project 19a16dcc3c214ac2a218d3758e551792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:11:05.754610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:05.755276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:05.759805 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1389/2743] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:05 2021] DELETE /identity/v3/projects/19a16dcc3c214ac2a218d3758e551792 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:11:05.761059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:05.773167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b797bb-0554-4765-a1f1-956179008561 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:05.835059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:05.835933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:05.836215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:05.836580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] PATH_INFO: `/v3/users/a7350f5675474375a12edae74b625bb6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:05.837837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7350f5675474375a12edae74b625bb6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:05.839754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:06.104318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7350f5675474375a12edae74b625bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:06.113096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7350f5675474375a12edae74b625bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:06.129974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7350f5675474375a12edae74b625bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:06.132080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7350f5675474375a12edae74b625bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:06.132712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-693c9933-c530-4ad6-b117-fb9372df0d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7350f5675474375a12edae74b625bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:06.324080 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1355/2744] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:11:05 2021] DELETE /identity/v3/users/a7350f5675474375a12edae74b625bb6 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:11:07.166200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:07.168710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:07.181826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123dccf-61e7-43ef-9598-b991e9e46101 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:07.247025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:07.247994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:07.248343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:07.248755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] PATH_INFO: `/v3/projects/d7258f2fc0e444fcb4f21e0eeb5d5190` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:07.250814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7258f2fc0e444fcb4f21e0eeb5d5190)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:07.254020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:07.418554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7258f2fc0e444fcb4f21e0eeb5d5190', 'request_id': 'req-1a0ccc3a-580f-4987-8557-19685b0fe41f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:07.559175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7258f2fc0e444fcb4f21e0eeb5d5190', 'request_id': 'req-1a0ccc3a-580f-4987-8557-19685b0fe41f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:07.559175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7258f2fc0e444fcb4f21e0eeb5d5190', 'request_id': 'req-1a0ccc3a-580f-4987-8557-19685b0fe41f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:07.571102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] The token cache is being invalidate because project d7258f2fc0e444fcb4f21e0eeb5d5190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:11:07.571471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:07.572048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a0ccc3a-580f-4987-8557-19685b0fe41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:11:07.573662 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1390/2745] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:07 2021] DELETE /identity/v3/projects/d7258f2fc0e444fcb4f21e0eeb5d5190 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:11:07.580115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219dcb9-1482-45d0-9ea6-2d98617987a3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:07.583651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219dcb9-1482-45d0-9ea6-2d98617987a3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:07.583651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219dcb9-1482-45d0-9ea6-2d98617987a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:07.599638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3219dcb9-1482-45d0-9ea6-2d98617987a3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:07.600854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3219dcb9-1482-45d0-9ea6-2d98617987a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:07.667550 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1356/2746] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:11:07.671266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d146-4639-4eba-91c8-4e2453b147f4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:07.671876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d146-4639-4eba-91c8-4e2453b147f4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:07.672296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d146-4639-4eba-91c8-4e2453b147f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:07.709791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cf39d146-4639-4eba-91c8-4e2453b147f4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:07.711272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cf39d146-4639-4eba-91c8-4e2453b147f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:07.725297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1391/2747] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:07.728753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219dcb9-1482-45d0-9ea6-2d98617987a3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:07.742488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219dcb9-1482-45d0-9ea6-2d98617987a3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:07.746801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:07.747857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:07.748576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:07.749419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:07.751116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:11:07.751735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:07.754053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:07.773362 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1357/2748] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:11:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:11:07.775546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d146-4639-4eba-91c8-4e2453b147f4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:07.788555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d146-4639-4eba-91c8-4e2453b147f4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:07.792622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:07.793724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:07.794210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:07.794674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:07.795556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:07.798551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:07.922881 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1392/2749] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:11:07 2021] POST /identity/v3/projects => generated 395 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:11:07.923131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:07.934336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1923f14-e64c-4eb3-928e-6bfec3ef0e46 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:08.001873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:08.002542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:08.002738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:08.003006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:08.003781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:08.005732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:08.168914 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1358/2750] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:11:07 2021] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:11:08.172678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:08.186716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d9d2d-3e81-4c23-9710-c1e88674368e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:08.191919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:08.192841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:08.193167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:08.193438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:08.194205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:08.196176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:08.211265 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1393/2751] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:11:08 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:11:08.215116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:08.226593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00959b6e-eebd-458a-93ba-2b58db803968 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:08.231814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c004c6b-4ca6-4276-8233-61d33cc844f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:08.232611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c004c6b-4ca6-4276-8233-61d33cc844f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:08.232932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c004c6b-4ca6-4276-8233-61d33cc844f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:08.233255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c004c6b-4ca6-4276-8233-61d33cc844f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:08.234003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c004c6b-4ca6-4276-8233-61d33cc844f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:08.242486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c004c6b-4ca6-4276-8233-61d33cc844f3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:08.261246 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1359/2752] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:11:08 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:11:08.265377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:08.279059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c015a-4c3f-4166-bf63-f5dd294733f3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:08.286155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:08.287139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:08.287476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:08.287758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] PATH_INFO: `/v3/projects/188fe358c4684fce8fc912f48b3f186e/users/b58b521d0334474e9f919c5d75289c78/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:08.304532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=188fe358c4684fce8fc912f48b3f186e, user_id=b58b521d0334474e9f919c5d75289c78, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:08.308416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:08.404957 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1394/2753] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:11:08 2021] PUT /identity/v3/projects/188fe358c4684fce8fc912f48b3f186e/users/b58b521d0334474e9f919c5d75289c78/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:11:08.410252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82040da5-ede8-4eb8-9089-3f89ba26e97b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:08.410713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82040da5-ede8-4eb8-9089-3f89ba26e97b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:08.411049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82040da5-ede8-4eb8-9089-3f89ba26e97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:08.429528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-82040da5-ede8-4eb8-9089-3f89ba26e97b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:08.430781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-82040da5-ede8-4eb8-9089-3f89ba26e97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:08.489019 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1360/2754] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:08.498752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:08.500538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:08.598864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d2449-e53a-486d-839f-9938f2716b6c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:08.603081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5a6e4-abf4-44e0-9387-793f99159c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:08.603720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a6e4-abf4-44e0-9387-793f99159c9a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:08.603998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a6e4-abf4-44e0-9387-793f99159c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:08.604299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a6e4-abf4-44e0-9387-793f99159c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:08.614625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5a6e4-abf4-44e0-9387-793f99159c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:08.616074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5a6e4-abf4-44e0-9387-793f99159c9a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:08.626067 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1395/2755] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:11:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:11:14.525273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9429-fc22-4947-8df2-906211fee22b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:14.526149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9429-fc22-4947-8df2-906211fee22b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:14.526447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d9429-fc22-4947-8df2-906211fee22b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:14.528266 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1361/2756] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:11:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:11:14.535120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ed6d-65a3-43ad-a860-2587340b7b2b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:14.536005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ed6d-65a3-43ad-a860-2587340b7b2b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:14.536580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68ed6d-65a3-43ad-a860-2587340b7b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:14.560520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8a68ed6d-65a3-43ad-a860-2587340b7b2b None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:14.561996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8a68ed6d-65a3-43ad-a860-2587340b7b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:14.637067 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1396/2757] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:11:14 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:14.660985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9429-fc22-4947-8df2-906211fee22b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:14.666160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-362d9429-fc22-4947-8df2-906211fee22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:14.686442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d9429-fc22-4947-8df2-906211fee22b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:14.693164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801e8e1-606d-484f-a3e0-ca9d0eea2172 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:14.693931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e8e1-606d-484f-a3e0-ca9d0eea2172 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:14.694438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e8e1-606d-484f-a3e0-ca9d0eea2172 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:14.695079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801e8e1-606d-484f-a3e0-ca9d0eea2172 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:14.704822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801e8e1-606d-484f-a3e0-ca9d0eea2172 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:14.707263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801e8e1-606d-484f-a3e0-ca9d0eea2172 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:14.730281 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1362/2758] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:11:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:11:16.138975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:16.139988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:16.140427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:16.198453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] MFA Rules not processed for user `b58b521d0334474e9f919c5d75289c78`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:16.199731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:16.311023 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1397/2759] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:16 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:16.321603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd49a-3f72-4a31-8241-58b0d337c97a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:16.322079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd49a-3f72-4a31-8241-58b0d337c97a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:16.322163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd49a-3f72-4a31-8241-58b0d337c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:16.346008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-870cd49a-3f72-4a31-8241-58b0d337c97a None None] MFA Rules not processed for user `b58b521d0334474e9f919c5d75289c78`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:16.348290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-870cd49a-3f72-4a31-8241-58b0d337c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:16.356461 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1363/2760] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:16 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:16.912896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:16.914476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:16.999953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7acb72-adec-400e-9e55-9f64a3f77de1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:17.007189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:17.008165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:17.008508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:17.008841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:17.019647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:17.022051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:17.032624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1398/2761] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:11:16 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:11:31.977518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154edc94-d5af-41c7-9e39-a818caba8cbc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:31.978072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154edc94-d5af-41c7-9e39-a818caba8cbc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:31.978174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154edc94-d5af-41c7-9e39-a818caba8cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:32.000720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-154edc94-d5af-41c7-9e39-a818caba8cbc None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:32.002075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-154edc94-d5af-41c7-9e39-a818caba8cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:32.062425 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1364/2762] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:11:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:32.086781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:32.088359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:32.168009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7141408-2b0c-4f32-b691-ba911fa94f35 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:32.173975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e163dc-3410-408c-a5c5-9ee9429c5ed5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:32.174380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e163dc-3410-408c-a5c5-9ee9429c5ed5 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:32.174671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e163dc-3410-408c-a5c5-9ee9429c5ed5 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:32.174949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e163dc-3410-408c-a5c5-9ee9429c5ed5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:32.184356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e163dc-3410-408c-a5c5-9ee9429c5ed5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:32.186010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e163dc-3410-408c-a5c5-9ee9429c5ed5 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:32.195557 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1399/2763] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:11:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:11:36.451885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e8f5-45b5-40bf-9c8f-386ad9cc1b77 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:36.453692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e8f5-45b5-40bf-9c8f-386ad9cc1b77 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:36.453692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e8f5-45b5-40bf-9c8f-386ad9cc1b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:36.472426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e351e8f5-45b5-40bf-9c8f-386ad9cc1b77 None None] MFA Rules not processed for user `b58b521d0334474e9f919c5d75289c78`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:36.473699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e351e8f5-45b5-40bf-9c8f-386ad9cc1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:36.485607 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1365/2764] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:36 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:46.088017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e6a0-ce50-4fc6-a7f5-87925139b2b2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:46.088555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e6a0-ce50-4fc6-a7f5-87925139b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:46.088753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e6a0-ce50-4fc6-a7f5-87925139b2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:46.108044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a5b9e6a0-ce50-4fc6-a7f5-87925139b2b2 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:46.109342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5b9e6a0-ce50-4fc6-a7f5-87925139b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:46.121821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1400/2765] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:11:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:46.136909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351e8f5-45b5-40bf-9c8f-386ad9cc1b77 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:11:46.149262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351e8f5-45b5-40bf-9c8f-386ad9cc1b77 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:11:46.154489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857054cd-bdbe-421b-a8d9-7cdb0484b8e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:11:46.155149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857054cd-bdbe-421b-a8d9-7cdb0484b8e0 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:46.155436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857054cd-bdbe-421b-a8d9-7cdb0484b8e0 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:46.155743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857054cd-bdbe-421b-a8d9-7cdb0484b8e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:46.168767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857054cd-bdbe-421b-a8d9-7cdb0484b8e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:11:46.169209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857054cd-bdbe-421b-a8d9-7cdb0484b8e0 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:11:46.180369 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1366/2766] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:11:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:11:46.907568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:46.907889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:46.908222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:46.925908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] MFA Rules not processed for user `9bf2eefd87de409785735fc802bc95ed`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:46.927108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:46.987328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1401/2767] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:46 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:11:47.972611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87bdf6-942d-4cbb-ada8-6c88b9cc997b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:11:47.972611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87bdf6-942d-4cbb-ada8-6c88b9cc997b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:11:47.972611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87bdf6-942d-4cbb-ada8-6c88b9cc997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:11:47.993787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fc87bdf6-942d-4cbb-ada8-6c88b9cc997b None None] MFA Rules not processed for user `613e2533f4e04cca8fafc3ea463accd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:11:47.995281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fc87bdf6-942d-4cbb-ada8-6c88b9cc997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:11:48.054799 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1367/2768] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:11:47 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:03.169174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:03.170789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:03.191312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3d13f-73de-4dcc-9128-ed86f2fdb63c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:03.197017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:03.198072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:03.198901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:03.199184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] PATH_INFO: `/v3/users/c6c295b9814d44efba37e7a37df6fa9b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:03.200550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c295b9814d44efba37e7a37df6fa9b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:03.202593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:03.449896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c295b9814d44efba37e7a37df6fa9b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:03.458514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c295b9814d44efba37e7a37df6fa9b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:03.477345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c295b9814d44efba37e7a37df6fa9b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:03.479431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c295b9814d44efba37e7a37df6fa9b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:03.594095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c295b9814d44efba37e7a37df6fa9b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:03.602656 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1402/2769] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:03 2021] DELETE /identity/v3/users/c6c295b9814d44efba37e7a37df6fa9b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:03.606965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:03.607503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:03.607503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:03.626128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:03.628047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:03.714936 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1368/2770] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:03.742798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:03.744468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:03.862866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9df043-1583-4b11-8b43-ed2bb8ad7645 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:03.867429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:03.868095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:03.868544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:03.869287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:03.880533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:03.882003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:03.893374 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1403/2771] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:04.252992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:04.261384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:04.287570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538d070-68de-4a17-87c1-52b7067857bb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:04.301104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:04.302898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:04.303540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:04.307608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] PATH_INFO: `/v3/projects/c70df2525137490a9e18b5e4af25a7b4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:04.307608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70df2525137490a9e18b5e4af25a7b4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:04.310832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:04.469096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70df2525137490a9e18b5e4af25a7b4', 'request_id': 'req-b4b15415-e637-456d-82a2-7c3c8b35ac51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:04.499461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70df2525137490a9e18b5e4af25a7b4', 'request_id': 'req-b4b15415-e637-456d-82a2-7c3c8b35ac51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:04.561861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70df2525137490a9e18b5e4af25a7b4', 'request_id': 'req-b4b15415-e637-456d-82a2-7c3c8b35ac51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:04.582986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] The token cache is being invalidate because project c70df2525137490a9e18b5e4af25a7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:04.583428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:04.584237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:04.585994 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1369/2772] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:04 2021] DELETE /identity/v3/projects/c70df2525137490a9e18b5e4af25a7b4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:04.590150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:04.602828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0028c21-9d66-41fd-aa42-c8e2b0f44be6 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:04.728904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:04.730208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:04.730778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:04.731174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] PATH_INFO: `/v3/users/aeeadf6d81ef4e40a4bf362738856f4d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:04.732902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeeadf6d81ef4e40a4bf362738856f4d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:04.737087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:04.906581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:04.908762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:04.981619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b15415-e637-456d-82a2-7c3c8b35ac51 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:04.985717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:04.986359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:04.986634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:04.986902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:04.988847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:05.064543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:05.066262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:05.071293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeeadf6d81ef4e40a4bf362738856f4d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.077851 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1370/2773] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:12:05.078031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeeadf6d81ef4e40a4bf362738856f4d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.090452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeeadf6d81ef4e40a4bf362738856f4d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.091283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeeadf6d81ef4e40a4bf362738856f4d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.155361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43e71d5f-1032-443e-8d4a-bc3542c3116b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeeadf6d81ef4e40a4bf362738856f4d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.169200 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1404/2774] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:04 2021] DELETE /identity/v3/users/aeeadf6d81ef4e40a4bf362738856f4d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:12:05.426687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:05.428216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:05.451859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea668f-c096-4c30-bdc3-957fb6a01490 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:05.526132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:05.527290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:05.527751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:05.528029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] PATH_INFO: `/v3/projects/27a856db1f1e4d76973ed5345627e80c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:05.533592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a856db1f1e4d76973ed5345627e80c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:05.533592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:05.737738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a856db1f1e4d76973ed5345627e80c', 'request_id': 'req-b12a727b-64e7-4037-ba58-68c1ee4703ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.745121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a856db1f1e4d76973ed5345627e80c', 'request_id': 'req-b12a727b-64e7-4037-ba58-68c1ee4703ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.869754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a856db1f1e4d76973ed5345627e80c', 'request_id': 'req-b12a727b-64e7-4037-ba58-68c1ee4703ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.883246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] The token cache is being invalidate because project 27a856db1f1e4d76973ed5345627e80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:05.883537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.884274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b12a727b-64e7-4037-ba58-68c1ee4703ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:05.887629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1371/2775] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:05 2021] DELETE /identity/v3/projects/27a856db1f1e4d76973ed5345627e80c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:05.896739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853b21-7d66-4732-a9a2-09a6df1fa787 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:05.897636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853b21-7d66-4732-a9a2-09a6df1fa787 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:05.898277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853b21-7d66-4732-a9a2-09a6df1fa787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:05.917486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e6853b21-7d66-4732-a9a2-09a6df1fa787 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:05.918994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e6853b21-7d66-4732-a9a2-09a6df1fa787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:06.027461 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1405/2776] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:06.040737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c5c9-7d31-4fcf-9d25-573ecdcd9e53 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.041794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c5c9-7d31-4fcf-9d25-573ecdcd9e53 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.042898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c5c9-7d31-4fcf-9d25-573ecdcd9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:06.074146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3537c5c9-7d31-4fcf-9d25-573ecdcd9e53 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:06.075249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3537c5c9-7d31-4fcf-9d25-573ecdcd9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:06.084466 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1372/2777] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:06.088466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6853b21-7d66-4732-a9a2-09a6df1fa787 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:06.100141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6853b21-7d66-4732-a9a2-09a6df1fa787 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:06.110005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:06.111742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.112854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.113369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:06.114477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:12:06.114971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:06.117445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:06.133657 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1406/2778] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:12:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:12:06.138289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c5c9-7d31-4fcf-9d25-573ecdcd9e53 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:06.150931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c5c9-7d31-4fcf-9d25-573ecdcd9e53 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:06.165779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:06.166588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.166937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.167278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:06.168081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:06.170180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:06.371582 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1373/2779] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:06 2021] POST /identity/v3/projects => generated 401 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:06.375925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:06.389802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508628ea-c5a1-4dc7-956f-b242010f2b3d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:06.500641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:06.500641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.500641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.500641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:06.501015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:06.501015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:06.643672 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1407/2780] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:06 2021] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:06.647527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:06.664805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138b8b9-6550-43a9-81a1-f81d32a4cae7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:06.670943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:06.671206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.672541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.674126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:06.683716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:06.685948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:06.705245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:06.710573 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1374/2781] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:06.733476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568562ef-2023-41ba-8862-618934adfc87 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:06.757327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a22ce7-e883-429b-ad8e-baad553a2915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:06.758255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a22ce7-e883-429b-ad8e-baad553a2915 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.758708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a22ce7-e883-429b-ad8e-baad553a2915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.760344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a22ce7-e883-429b-ad8e-baad553a2915 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:06.761336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a22ce7-e883-429b-ad8e-baad553a2915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:06.763145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a22ce7-e883-429b-ad8e-baad553a2915 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:06.791218 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1408/2782] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:06.795166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:06.807619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad802381-03d1-4c4f-a1d3-cf15530edf6f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:06.816833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:06.818260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.819129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.819629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] PATH_INFO: `/v3/projects/8c4f20967bf64eaa81819ba3d4f2e37b/users/ad9c82fc541e484cbbd8eb85ea84cb18/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:06.859622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4f20967bf64eaa81819ba3d4f2e37b, user_id=ad9c82fc541e484cbbd8eb85ea84cb18, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:06.867844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:06.955133 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1375/2783] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:06 2021] PUT /identity/v3/projects/8c4f20967bf64eaa81819ba3d4f2e37b/users/ad9c82fc541e484cbbd8eb85ea84cb18/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:06.966243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53546af-9a5f-45b4-bb83-f42e445f5452 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:06.966727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53546af-9a5f-45b4-bb83-f42e445f5452 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:06.966837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53546af-9a5f-45b4-bb83-f42e445f5452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:07.019745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:07.021600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:07.025897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d53546af-9a5f-45b4-bb83-f42e445f5452 None None] MFA Rules not processed for user `ad9c82fc541e484cbbd8eb85ea84cb18`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:07.027506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d53546af-9a5f-45b4-bb83-f42e445f5452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:07.151586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069211-5bca-421c-9d8b-186324f8d094 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:07.164775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:07.165703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:07.166163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:07.166593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:07.168920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:07.184472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1409/2784] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:06 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:07.189991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53546af-9a5f-45b4-bb83-f42e445f5452 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:07.286805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53546af-9a5f-45b4-bb83-f42e445f5452 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:07.301154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:07.302027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:07.302546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:07.302942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:07.303780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:07.306083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:07.347681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:07.349347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:07.369365 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1376/2785] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:07.430244 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1410/2786] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:07 2021] POST /identity/v3/projects => generated 403 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:12:07.436468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:07.446577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61731481-cc62-400b-93d5-c0c67c49199c service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:07.531489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:07.532266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:07.532553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:07.532831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:07.533669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:07.541147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:07.628700 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1377/2787] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:07 2021] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:07.632993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:07.644444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372e9af-e716-47ec-83b1-9de2c556cb09 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:07.651536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:07.652214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:07.653121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:07.653788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:07.654686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:07.656654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:07.670052 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1411/2788] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:07.674518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:07.686331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91da3d-e923-4a4e-92b3-db66679d9817 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:07.693013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:07.693924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:07.694197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:07.694519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] PATH_INFO: `/v3/projects/a83896b167354b8e9a8f1e6eb4acb087/users/57e1628fcbe34ab2ad760e0ee0f7151c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:07.723069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83896b167354b8e9a8f1e6eb4acb087, user_id=57e1628fcbe34ab2ad760e0ee0f7151c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:07.726081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:07.860226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1378/2789] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:07 2021] PUT /identity/v3/projects/a83896b167354b8e9a8f1e6eb4acb087/users/57e1628fcbe34ab2ad760e0ee0f7151c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:12:07.861800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:07.872738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ccf3c-6ce2-48d6-b542-7fe0141f66b8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:08.064475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d893-5a87-4963-9e84-1cfe3fddc30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:08.064475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d893-5a87-4963-9e84-1cfe3fddc30f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:08.064475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d893-5a87-4963-9e84-1cfe3fddc30f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:08.064475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d893-5a87-4963-9e84-1cfe3fddc30f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:08.066353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d893-5a87-4963-9e84-1cfe3fddc30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:08.066353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d893-5a87-4963-9e84-1cfe3fddc30f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:08.091346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:08.104075 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1412/2790] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:07 2021] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:08.107217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ad603-5d44-4be8-b9dd-c111c55aef39 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:08.113352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:08.114535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:08.115112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:08.115531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] PATH_INFO: `/v3/projects/a83896b167354b8e9a8f1e6eb4acb087/users/57e1628fcbe34ab2ad760e0ee0f7151c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:08.117866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83896b167354b8e9a8f1e6eb4acb087, user_id=57e1628fcbe34ab2ad760e0ee0f7151c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:08.122310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:08.144785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1379/2791] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:08 2021] PUT /identity/v3/projects/a83896b167354b8e9a8f1e6eb4acb087/users/57e1628fcbe34ab2ad760e0ee0f7151c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:08.156498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:08.157266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:08.157732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:08.187663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] MFA Rules not processed for user `57e1628fcbe34ab2ad760e0ee0f7151c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:08.189567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:08.297036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1413/2792] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:08 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:08.583962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:08.586070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:08.673327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5d0d-890d-4727-b832-96738f6851dc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:08.678978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246e858-c957-48e1-8537-f6f40ac5440d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:08.679721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e858-c957-48e1-8537-f6f40ac5440d service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:08.683266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e858-c957-48e1-8537-f6f40ac5440d service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:08.683266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e858-c957-48e1-8537-f6f40ac5440d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:08.686201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6246e858-c957-48e1-8537-f6f40ac5440d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:08.699349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246e858-c957-48e1-8537-f6f40ac5440d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:08.700982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246e858-c957-48e1-8537-f6f40ac5440d service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:08.711811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1380/2793] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:09.141234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:09.143646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:09.302489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce694a5-4aa4-4bcc-a790-8d002b178ccd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:09.310535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:09.311464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:09.311868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:09.314712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:09.336767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:09.340927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:09.364272 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1414/2794] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:09 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:09.683916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:09.684433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:09.684532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:09.723777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:09.725098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:09.827793 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1381/2795] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:12:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:09.847885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:09.849483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:10.013794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41a6a-74be-4c49-9602-0f7e0e96c36d service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:10.020269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:10.021321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:10.021321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:10.024852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:10.032659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:10.034371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:10.046081 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1415/2796] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:12:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:10.114579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:10.116019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:10.371999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b20c1b-aa51-4f39-97f2-116e75409491 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:10.390160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:10.391068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:10.391353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:10.396675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] PATH_INFO: `/v3/users/cf797406f5aa4ba792478c5af6eccb4f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:10.399191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf797406f5aa4ba792478c5af6eccb4f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:10.403740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:10.779221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf797406f5aa4ba792478c5af6eccb4f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:10.799822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf797406f5aa4ba792478c5af6eccb4f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:10.831442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf797406f5aa4ba792478c5af6eccb4f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:10.833097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf797406f5aa4ba792478c5af6eccb4f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:10.834091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d513f4a6-2c83-4101-aee2-e90aa0b5f773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf797406f5aa4ba792478c5af6eccb4f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:10.973143 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1382/2797] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:10 2021] DELETE /identity/v3/users/cf797406f5aa4ba792478c5af6eccb4f => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:11.451361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:11.464624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbcba3-69b1-4c37-a376-42435310a006 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:11.536175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:11.537020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:11.537297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:11.537563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] PATH_INFO: `/v3/projects/b2a52fc668c14890989f5c2756094ba1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:11.539600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a52fc668c14890989f5c2756094ba1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:11.543216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:11.775055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a52fc668c14890989f5c2756094ba1', 'request_id': 'req-a1285265-416c-4f0a-8660-2a5b5bf6b927'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:11.866060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a52fc668c14890989f5c2756094ba1', 'request_id': 'req-a1285265-416c-4f0a-8660-2a5b5bf6b927'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:11.882312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a52fc668c14890989f5c2756094ba1', 'request_id': 'req-a1285265-416c-4f0a-8660-2a5b5bf6b927'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:11.907592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] The token cache is being invalidate because project b2a52fc668c14890989f5c2756094ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:11.908208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:11.909124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1285265-416c-4f0a-8660-2a5b5bf6b927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:11.921763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:11.924793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:11.925414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:11.938213 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1416/2798] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:11 2021] DELETE /identity/v3/projects/b2a52fc668c14890989f5c2756094ba1 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:11.959390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:11.961818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:12.147944 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1383/2799] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:12.151208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84698158-8524-46b9-8eb1-2087ca01a2c6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.151482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84698158-8524-46b9-8eb1-2087ca01a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.151765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84698158-8524-46b9-8eb1-2087ca01a2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.170342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:12.172423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:12.203918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-84698158-8524-46b9-8eb1-2087ca01a2c6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:12.210308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-84698158-8524-46b9-8eb1-2087ca01a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:12.243114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1417/2800] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:12.244285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84698158-8524-46b9-8eb1-2087ca01a2c6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:12.260435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84698158-8524-46b9-8eb1-2087ca01a2c6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:12.274460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:12.275141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.275424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.275703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.276445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:12:12.276751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:12.278426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:12.310537 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1418/2801] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:12:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:12:12.311690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:12.327810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6904a-8908-412c-a1fa-6db9542abc60 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:12.337609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:12.338169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.345592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.345592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.345592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:12.345592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:12.390894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ad0c4-0133-4d75-af0c-c56b02b0392d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:12.398895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:12.399829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.400294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.400720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.403326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:12.492486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:12.494169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:12.508250 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1384/2802] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:12 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:12.522357 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1419/2803] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:12 2021] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:12:12.523750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:12.538145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:12.539984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:12.550453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4791d2a-bbdf-47ab-b6e2-7cbfa85bcdb2 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:12.681375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e235821-868a-47ac-8e7c-0494c6b285b9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:12.694473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:12.697314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.697988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.698957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.701677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:12.704374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:12.710351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:12.710543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.710543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.710543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] PATH_INFO: `/v3/users/ad9c82fc541e484cbbd8eb85ea84cb18` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.712269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9c82fc541e484cbbd8eb85ea84cb18)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:12.716711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:12.837391 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1385/2804] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:12 2021] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:12.841107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:12.868296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98dce2-e447-46d1-ab49-f53829418524 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:12.878475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:12.880538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.881057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.881511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.886538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:12.886538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:12.902372 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1386/2805] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:12.918505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:12.935070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc890a-fcf0-404d-8f19-e5a041f0950f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:12.941572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:12.942334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:12.942715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:12.943065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:12.954715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:12.971611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:13.062350 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1387/2806] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:13.069263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:13.094655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2eec-943d-4f7c-a59e-985eb52e1e16 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:13.123409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20d37d-8c99-46d8-902d-804fddd4fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:13.123409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d37d-8c99-46d8-902d-804fddd4fdeb admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:13.123409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d37d-8c99-46d8-902d-804fddd4fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:13.123409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20d37d-8c99-46d8-902d-804fddd4fdeb admin admin] PATH_INFO: `/v3/projects/576fa0b7a73d45bc86b799bb25424c30/users/f157276b2f2845258ce93423249ed74d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:13.156012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20d37d-8c99-46d8-902d-804fddd4fdeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=576fa0b7a73d45bc86b799bb25424c30, user_id=f157276b2f2845258ce93423249ed74d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:13.159222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20d37d-8c99-46d8-902d-804fddd4fdeb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:13.425633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9c82fc541e484cbbd8eb85ea84cb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:13.451759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9c82fc541e484cbbd8eb85ea84cb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:13.473471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9c82fc541e484cbbd8eb85ea84cb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:13.476060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9c82fc541e484cbbd8eb85ea84cb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:13.481757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1388/2807] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:13 2021] PUT /identity/v3/projects/576fa0b7a73d45bc86b799bb25424c30/users/f157276b2f2845258ce93423249ed74d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:13.488596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:13.490172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:13.490644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:13.551372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:13.555263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-99b1de22-1d72-45b7-a24d-82d0a97224d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9c82fc541e484cbbd8eb85ea84cb18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:13.555799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:13.572860 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1420/2808] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:12 2021] DELETE /identity/v3/users/ad9c82fc541e484cbbd8eb85ea84cb18 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:13.577903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:13.582712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:13.590877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:13.649155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:13.652518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:13.752990 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1389/2809] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:13.763924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:13.767525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:13.789167 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1421/2810] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:13.803043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:13.805301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:13.895784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951e506-d234-4d82-86e1-69d69bd398fb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:13.900040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa721a4-f2a4-4341-8b8b-8c676763f75a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:13.902453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:13.903190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:13.903457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:13.903745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:13.913338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:13.914483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:13.914930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:13.915363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:13.915725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:13.918902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:13.929733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:13.932203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:13.944501 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1390/2811] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:13.971080 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1422/2812] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:15.015339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:15.018507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:15.037315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58a1ea-a9cc-45c5-b2d3-31d4d31c21c4 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:15.050790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:15.051934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:15.053679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:15.054362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] PATH_INFO: `/v3/projects/8c4f20967bf64eaa81819ba3d4f2e37b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:15.056943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4f20967bf64eaa81819ba3d4f2e37b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:15.059237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:15.252573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4f20967bf64eaa81819ba3d4f2e37b', 'request_id': 'req-6e3c630a-e5eb-474f-8c2c-0c8133554217'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.269965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4f20967bf64eaa81819ba3d4f2e37b', 'request_id': 'req-6e3c630a-e5eb-474f-8c2c-0c8133554217'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.365269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4f20967bf64eaa81819ba3d4f2e37b', 'request_id': 'req-6e3c630a-e5eb-474f-8c2c-0c8133554217'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.379640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] The token cache is being invalidate because project 8c4f20967bf64eaa81819ba3d4f2e37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:15.380456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.381394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e3c630a-e5eb-474f-8c2c-0c8133554217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.384226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1391/2813] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:15 2021] DELETE /identity/v3/projects/8c4f20967bf64eaa81819ba3d4f2e37b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:15.389337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:15.401855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2f7a9-621c-4525-9a9e-7f23e730bddb service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:15.473129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:15.474490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:15.474862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:15.475230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] PATH_INFO: `/v3/users/57e1628fcbe34ab2ad760e0ee0f7151c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:15.476596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e1628fcbe34ab2ad760e0ee0f7151c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:15.478946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:15.692198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e1628fcbe34ab2ad760e0ee0f7151c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.701628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e1628fcbe34ab2ad760e0ee0f7151c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.724736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e1628fcbe34ab2ad760e0ee0f7151c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.725597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e1628fcbe34ab2ad760e0ee0f7151c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.790541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e1628fcbe34ab2ad760e0ee0f7151c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:15.809202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1423/2814] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:15 2021] DELETE /identity/v3/users/57e1628fcbe34ab2ad760e0ee0f7151c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:16.600323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdc28b-c5c7-4eb9-abc0-f5a25403f266 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:16.601704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdc28b-c5c7-4eb9-abc0-f5a25403f266 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:16.603081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdc28b-c5c7-4eb9-abc0-f5a25403f266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:16.763106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-28cdc28b-c5c7-4eb9-abc0-f5a25403f266 None None] MFA Rules not processed for user `f157276b2f2845258ce93423249ed74d`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:16.763106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-28cdc28b-c5c7-4eb9-abc0-f5a25403f266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:16.775465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:16.779932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:16.914942 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1392/2815] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:16 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:16.935811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5398e-6552-4f6b-993c-a017796400a0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:16.936747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5398e-6552-4f6b-993c-a017796400a0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:16.937535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5398e-6552-4f6b-993c-a017796400a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:17.001468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cdb5398e-6552-4f6b-993c-a017796400a0 None None] MFA Rules not processed for user `f157276b2f2845258ce93423249ed74d`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:17.004653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cdb5398e-6552-4f6b-993c-a017796400a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:17.009788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6dd10-cd7c-440a-ad79-5d0fb9cc007e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:17.027573 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1393/2816] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:16 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:17.029364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:17.030319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:17.030604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:17.030878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] PATH_INFO: `/v3/projects/a83896b167354b8e9a8f1e6eb4acb087` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:17.032845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83896b167354b8e9a8f1e6eb4acb087)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:17.035178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:17.205083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83896b167354b8e9a8f1e6eb4acb087', 'request_id': 'req-3469e39b-7b99-455a-91ea-b4bda987e939'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:17.338182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83896b167354b8e9a8f1e6eb4acb087', 'request_id': 'req-3469e39b-7b99-455a-91ea-b4bda987e939'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:17.346006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83896b167354b8e9a8f1e6eb4acb087', 'request_id': 'req-3469e39b-7b99-455a-91ea-b4bda987e939'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:17.362625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] The token cache is being invalidate because project a83896b167354b8e9a8f1e6eb4acb087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:17.363389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:17.364351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:17.366275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1424/2817] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:16 2021] DELETE /identity/v3/projects/a83896b167354b8e9a8f1e6eb4acb087 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:17.375371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eff7c-27df-49af-a0e8-d16127a6a341 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:17.375371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eff7c-27df-49af-a0e8-d16127a6a341 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:17.375371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4eff7c-27df-49af-a0e8-d16127a6a341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:17.399016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7f4eff7c-27df-49af-a0e8-d16127a6a341 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:17.400480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7f4eff7c-27df-49af-a0e8-d16127a6a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:17.481189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:17.482640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:17.522760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1394/2818] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:17.544645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b7cab-0734-49bd-bbe0-c8fb8bed22ee None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:17.544858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b7cab-0734-49bd-bbe0-c8fb8bed22ee None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:17.545202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b7cab-0734-49bd-bbe0-c8fb8bed22ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:17.594425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ce8b7cab-0734-49bd-bbe0-c8fb8bed22ee None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:17.596574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469e39b-7b99-455a-91ea-b4bda987e939 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:17.597420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce8b7cab-0734-49bd-bbe0-c8fb8bed22ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:17.606776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:17.607105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:17.607383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:17.607661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:17.609579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:17.643331 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1395/2819] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:17.644410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b7cab-0734-49bd-bbe0-c8fb8bed22ee None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:17.669589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b7cab-0734-49bd-bbe0-c8fb8bed22ee None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:17.686856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:17.687943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:17.688992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:17.689524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:17.690685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:12:17.692130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:17.694259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:17.718394 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1396/2820] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:12:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:12:17.721689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:17.744058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b90cad-0443-48aa-a5db-e6650eadd350 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:17.747391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:17.750274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:17.762055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:17.762958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:17.763817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:17.764688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:17.765631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:17.771577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:17.786472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1425/2821] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:17 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:12:18.022670 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1397/2822] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:17 2021] POST /identity/v3/projects => generated 375 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:18.026617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:18.042536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcd73-6008-4615-9858-50d2098a032f service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:18.155751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:18.157122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:18.157700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:18.158159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:18.159042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:18.165369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:18.288253 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1426/2823] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:18 2021] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:18.292518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:18.305478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069153f-31bc-47ff-86a3-cd3fa2b304af admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:18.318207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:18.318992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:18.319578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:18.320156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:18.320944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:18.323125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:18.337373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1398/2824] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:18 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:18.341201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:18.359446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6709f-f74b-4a54-97a1-ec957b5df9ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:18.376384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc964a-027f-4ca2-8aed-f3cb711dfc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:18.377077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc964a-027f-4ca2-8aed-f3cb711dfc4a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:18.377077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc964a-027f-4ca2-8aed-f3cb711dfc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:18.377418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc964a-027f-4ca2-8aed-f3cb711dfc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:18.378308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc964a-027f-4ca2-8aed-f3cb711dfc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:18.380089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc964a-027f-4ca2-8aed-f3cb711dfc4a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:18.397441 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1427/2825] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:18 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:18.402933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:18.414935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc166d-5377-4285-a97d-4545803a9d91 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:18.425270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:18.426526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:18.426819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:18.427102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] PATH_INFO: `/v3/projects/8b80d743dc6342a689968320db7836a0/users/8987227b269944619441e94b3876d311/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:18.452717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b80d743dc6342a689968320db7836a0, user_id=8987227b269944619441e94b3876d311, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:18.456052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:18.527218 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1399/2826] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:18 2021] PUT /identity/v3/projects/8b80d743dc6342a689968320db7836a0/users/8987227b269944619441e94b3876d311/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:18.538295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9306e-ed5c-4822-8aed-861b9d756a77 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:18.538766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9306e-ed5c-4822-8aed-861b9d756a77 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:18.538877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9306e-ed5c-4822-8aed-861b9d756a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:18.613680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-78c9306e-ed5c-4822-8aed-861b9d756a77 None None] MFA Rules not processed for user `8987227b269944619441e94b3876d311`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:18.614833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-78c9306e-ed5c-4822-8aed-861b9d756a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:18.781627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:18.793425 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1428/2827] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:18 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:18.939452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03e399-a276-43e3-8d6a-52ba463f4ba0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:18.944901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:18.945596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:18.945883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:18.946327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:18.947047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:18.949131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:19.070888 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1400/2828] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:18 2021] POST /identity/v3/projects => generated 373 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:19.074678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9306e-ed5c-4822-8aed-861b9d756a77 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:19.099268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9306e-ed5c-4822-8aed-861b9d756a77 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:19.210924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:19.211543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:19.211821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:19.212093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:19.212803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:19.214858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:19.324630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1429/2829] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:19 2021] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:19.326012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:19.366543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b084-274e-4ae4-a3f0-590097420bf8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:19.381083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:19.381788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:19.382520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:19.382808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:19.383960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:19.386098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:19.401731 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1401/2830] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:19 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:19.404992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:19.416206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5dc9-9d68-493d-b00e-e79ce2036006 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:19.442486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:19.443395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:19.443729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:19.443935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] PATH_INFO: `/v3/projects/5d36c518dd0a4a2fa39fbe84d48682fb/users/26c9d2461f18421c94fb26db23312ac5/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:19.473144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d36c518dd0a4a2fa39fbe84d48682fb, user_id=26c9d2461f18421c94fb26db23312ac5, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:19.478242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:19.548325 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1430/2831] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:19 2021] PUT /identity/v3/projects/5d36c518dd0a4a2fa39fbe84d48682fb/users/26c9d2461f18421c94fb26db23312ac5/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:19.552917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:19.567390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fddce-0b10-4b69-bc1c-7d8d980bbb36 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:19.655750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b644c-d9de-4201-ab40-6ac9b60f849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:19.656524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b644c-d9de-4201-ab40-6ac9b60f849e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:19.657045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b644c-d9de-4201-ab40-6ac9b60f849e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:19.657330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b644c-d9de-4201-ab40-6ac9b60f849e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:19.658074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b644c-d9de-4201-ab40-6ac9b60f849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:19.660173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b644c-d9de-4201-ab40-6ac9b60f849e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:19.690932 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1402/2832] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:19 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:19.693507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:19.711601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656309-4f4e-4b83-a92e-cab9da022fb3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:19.717547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be10f-8164-4793-a179-934412184e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:19.720476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be10f-8164-4793-a179-934412184e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:19.720834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be10f-8164-4793-a179-934412184e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:19.721266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be10f-8164-4793-a179-934412184e07 admin admin] PATH_INFO: `/v3/projects/5d36c518dd0a4a2fa39fbe84d48682fb/users/26c9d2461f18421c94fb26db23312ac5/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:19.723660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be10f-8164-4793-a179-934412184e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d36c518dd0a4a2fa39fbe84d48682fb, user_id=26c9d2461f18421c94fb26db23312ac5, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:19.730264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be10f-8164-4793-a179-934412184e07 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:19.745897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1431/2833] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:19 2021] PUT /identity/v3/projects/5d36c518dd0a4a2fa39fbe84d48682fb/users/26c9d2461f18421c94fb26db23312ac5/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:19.758673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e8894-3196-49a0-bc6e-1658a8827fae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:19.758965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e8894-3196-49a0-bc6e-1658a8827fae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:19.759250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e8894-3196-49a0-bc6e-1658a8827fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:19.803488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ad5e8894-3196-49a0-bc6e-1658a8827fae None None] MFA Rules not processed for user `26c9d2461f18421c94fb26db23312ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:19.806696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ad5e8894-3196-49a0-bc6e-1658a8827fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:19.908244 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1403/2834] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:19 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:19.908811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:19.909325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:19.909419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:19.930643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] MFA Rules not processed for user `8987227b269944619441e94b3876d311`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:19.932260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:20.021740 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1432/2835] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:19 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:12:20.395225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e8894-3196-49a0-bc6e-1658a8827fae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:20.528405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e8894-3196-49a0-bc6e-1658a8827fae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:20.539122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720629-89ce-4690-8f27-f74b4e09904e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:20.540412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720629-89ce-4690-8f27-f74b4e09904e service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:20.541288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720629-89ce-4690-8f27-f74b4e09904e service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:20.541727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720629-89ce-4690-8f27-f74b4e09904e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:20.572131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720629-89ce-4690-8f27-f74b4e09904e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:20.575936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720629-89ce-4690-8f27-f74b4e09904e service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:20.578024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:20.580048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:20.599270 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1404/2836] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:20 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:20.678576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29831d8c-fd46-4824-a557-61232d2fc1cb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:20.682846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dc303-d0ac-4a18-a162-9f6f32a44308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:20.684215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc303-d0ac-4a18-a162-9f6f32a44308 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:20.684215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc303-d0ac-4a18-a162-9f6f32a44308 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:20.684574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dc303-d0ac-4a18-a162-9f6f32a44308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:20.687644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f05dc303-d0ac-4a18-a162-9f6f32a44308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:20.699409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dc303-d0ac-4a18-a162-9f6f32a44308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:20.701915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dc303-d0ac-4a18-a162-9f6f32a44308 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:20.712441 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1433/2837] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:28.380938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac164-8704-4188-9f8b-f242400179d4 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:28.381446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac164-8704-4188-9f8b-f242400179d4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:28.383338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac164-8704-4188-9f8b-f242400179d4 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:28.383841 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1405/2838] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:12:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:12:28.395063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f540-62ca-4750-a112-46efa57bbd0e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:28.395820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f540-62ca-4750-a112-46efa57bbd0e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:28.396110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f540-62ca-4750-a112-46efa57bbd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:28.427702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac164-8704-4188-9f8b-f242400179d4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:28.458182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6cc0f540-62ca-4750-a112-46efa57bbd0e None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:28.459307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac164-8704-4188-9f8b-f242400179d4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:28.464748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6cc0f540-62ca-4750-a112-46efa57bbd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:28.487906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:28.489013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:28.493332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:28.493797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:28.497661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:28.540535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:28.544831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:28.562645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1406/2839] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:12:28.629012 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1434/2840] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:12:28 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:28.653707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:28.655994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:28.678247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e5bd-7fd9-41a3-a108-41da24c3a1c1 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:28.686138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:28.688270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:28.688270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:28.688270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:28.700349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:28.702265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:28.750718 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1407/2841] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:30.021240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339727d-b251-4233-999e-e3ee9ee11b51 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:30.022167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339727d-b251-4233-999e-e3ee9ee11b51 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:30.022605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339727d-b251-4233-999e-e3ee9ee11b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:30.043520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3339727d-b251-4233-999e-e3ee9ee11b51 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:30.045207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3339727d-b251-4233-999e-e3ee9ee11b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:30.124459 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1435/2842] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:12:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:30.152243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:30.155647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:30.287159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9235eb-2843-409b-9adf-c610f451a319 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:30.295839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:30.296504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:30.296784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:30.297661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:30.306608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:30.308449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:30.321233 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1408/2843] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:12:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:32.438598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:32.439120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:32.439206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:32.464412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] MFA Rules not processed for user `613e2533f4e04cca8fafc3ea463accd9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:32.465902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:32.533300 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1436/2844] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:32 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:32.539947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:32.552455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbcc1c-9b6d-45a5-a3c5-4244bed6932d service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:32.560315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989beb4-d006-4072-8f85-9dc1877425da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:32.561045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989beb4-d006-4072-8f85-9dc1877425da service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:32.562213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989beb4-d006-4072-8f85-9dc1877425da service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:32.562213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989beb4-d006-4072-8f85-9dc1877425da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:32.564492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0989beb4-d006-4072-8f85-9dc1877425da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:32.580543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989beb4-d006-4072-8f85-9dc1877425da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:32.582271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989beb4-d006-4072-8f85-9dc1877425da service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:32.596500 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1409/2845] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:34.268028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:34.270323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:34.321687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdf457-01bc-47fe-b42c-6fd0452fc1cb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:34.347965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499d88-80d6-4f6a-8463-e1277741b32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:34.352005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499d88-80d6-4f6a-8463-e1277741b32a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:34.352788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499d88-80d6-4f6a-8463-e1277741b32a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:34.355504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499d88-80d6-4f6a-8463-e1277741b32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:34.359048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01499d88-80d6-4f6a-8463-e1277741b32a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:34.474698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499d88-80d6-4f6a-8463-e1277741b32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:34.485964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499d88-80d6-4f6a-8463-e1277741b32a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:34.513601 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1437/2846] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:35.297784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e663e-073b-411e-bdc6-ddb479023e9a None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:35.298738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e663e-073b-411e-bdc6-ddb479023e9a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:35.299171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e663e-073b-411e-bdc6-ddb479023e9a None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:35.307380 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1410/2847] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:12:35 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:12:35.313407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:35.314347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:35.315122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:35.336859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:35.338299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:35.355588 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1438/2848] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:12:35 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:35.381345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e663e-073b-411e-bdc6-ddb479023e9a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:35.383457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bd3e663e-073b-411e-bdc6-ddb479023e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:35.405571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e663e-073b-411e-bdc6-ddb479023e9a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:35.413751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:35.414700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:35.415068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:35.415350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:35.426921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:35.429165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:35.441900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1411/2849] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:36.777379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:36.779189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:36.815159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11adcad-83e7-4c6c-bfb9-7239e045e45d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:36.825998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:36.827146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:36.827593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:36.830631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:36.834282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:36.853990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:36.856202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:36.874145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1439/2850] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:41.159261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:41.161493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:41.342985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4161318-de31-4761-b0f7-06fe69fedb8e service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:41.354659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:41.355887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:41.356355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:41.356822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] PATH_INFO: `/v3/users/b58b521d0334474e9f919c5d75289c78` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:41.358585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58b521d0334474e9f919c5d75289c78)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:41.365131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:41.637976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58b521d0334474e9f919c5d75289c78'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:41.648752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58b521d0334474e9f919c5d75289c78'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:41.662621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58b521d0334474e9f919c5d75289c78'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:41.663444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58b521d0334474e9f919c5d75289c78'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:41.664147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9eaa34cc-e98b-49b9-9a36-f51a9dc90e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58b521d0334474e9f919c5d75289c78'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:41.807461 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1412/2851] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:41 2021] DELETE /identity/v3/users/b58b521d0334474e9f919c5d75289c78 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:42.099389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:42.125280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01fafd-abde-44a5-8049-3a7752add160 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:42.198863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:42.200010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:42.200359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:42.201032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] PATH_INFO: `/v3/projects/188fe358c4684fce8fc912f48b3f186e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:42.202489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] RBAC: Authorizing `identity:delete_project(project_id=188fe358c4684fce8fc912f48b3f186e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:42.205349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:42.345257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188fe358c4684fce8fc912f48b3f186e', 'request_id': 'req-90ef8f4c-45da-4928-900a-1a75b8f1482b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:42.412117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188fe358c4684fce8fc912f48b3f186e', 'request_id': 'req-90ef8f4c-45da-4928-900a-1a75b8f1482b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:42.419741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188fe358c4684fce8fc912f48b3f186e', 'request_id': 'req-90ef8f4c-45da-4928-900a-1a75b8f1482b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:42.430910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] The token cache is being invalidate because project 188fe358c4684fce8fc912f48b3f186e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:42.431455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:42.433328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-90ef8f4c-45da-4928-900a-1a75b8f1482b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:42.435172 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1440/2852] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:42 2021] DELETE /identity/v3/projects/188fe358c4684fce8fc912f48b3f186e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:42.441780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c19b48-501a-4856-bfc0-2ec83f2c74b8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:42.446242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c19b48-501a-4856-bfc0-2ec83f2c74b8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:42.446242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c19b48-501a-4856-bfc0-2ec83f2c74b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:42.461002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a7c19b48-501a-4856-bfc0-2ec83f2c74b8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:42.462220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7c19b48-501a-4856-bfc0-2ec83f2c74b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:42.532703 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1413/2853] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:12:42.540501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ba2cd-7780-415a-9d59-21cbde67f45a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:42.540734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ba2cd-7780-415a-9d59-21cbde67f45a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:42.541302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ba2cd-7780-415a-9d59-21cbde67f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:42.560857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-664ba2cd-7780-415a-9d59-21cbde67f45a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:42.562854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-664ba2cd-7780-415a-9d59-21cbde67f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:42.572455 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1441/2854] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:42.576752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c19b48-501a-4856-bfc0-2ec83f2c74b8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:42.588007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c19b48-501a-4856-bfc0-2ec83f2c74b8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:42.595730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:42.602136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:42.602136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:42.602136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:42.602136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:12:42.602136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:42.602136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:42.619738 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1414/2855] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:12:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:12:42.631278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ba2cd-7780-415a-9d59-21cbde67f45a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:42.637106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ba2cd-7780-415a-9d59-21cbde67f45a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:42.645344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:42.646013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:42.646318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:42.646573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:42.648071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:42.650235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:42.775148 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1442/2856] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:42 2021] POST /identity/v3/projects => generated 401 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:42.779365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:42.791143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f50a8-f045-455a-ba33-102711aac86f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:42.849205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:42.850088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:42.850241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:42.850715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:42.851428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:42.853426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:42.956381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1415/2857] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:42 2021] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:12:42.961159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:42.975679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecab9-cb82-46e5-974c-8cec128b62d5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:42.977830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:42.978504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:42.985331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:42.985686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:42.986610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:42.988346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:43.000679 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1443/2858] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:42 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:43.005012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:43.015316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82a81-8d0e-42c9-b962-5957cb4943a6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:43.020343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5fd13-8613-4828-9801-5f19a6467ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:43.021060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5fd13-8613-4828-9801-5f19a6467ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:43.021402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5fd13-8613-4828-9801-5f19a6467ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:43.021681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5fd13-8613-4828-9801-5f19a6467ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:43.022608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5fd13-8613-4828-9801-5f19a6467ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:43.024193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5fd13-8613-4828-9801-5f19a6467ba3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:43.035472 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1416/2859] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:12:43.039371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:43.053873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184ef2-6336-48a8-a7d3-130ae00a85f1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:43.056490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:43.057445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:43.057719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:43.057998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] PATH_INFO: `/v3/projects/a0c1fd4c214c43d694996c1237c66fe5/users/8e809d47a6cd4eafabfcf4f2f3c827e9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:43.074987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c1fd4c214c43d694996c1237c66fe5, user_id=8e809d47a6cd4eafabfcf4f2f3c827e9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:43.078226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:43.180198 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1444/2860] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:43 2021] PUT /identity/v3/projects/a0c1fd4c214c43d694996c1237c66fe5/users/8e809d47a6cd4eafabfcf4f2f3c827e9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:12:43.182131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:43.182436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:43.186559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:43.208332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:43.210192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:43.293538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:43.296479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:43.381354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1417/2861] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:43.419587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f468f7-365c-40c2-b4c0-1a46b4a4e388 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:43.421408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:43.422896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:43.434186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:43.435813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:43.436261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:43.437305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:43.442709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:43.471185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:43.474170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:43.489170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fece13-7263-4583-8f48-6b859e5af11c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:43.490804 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1445/2862] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:12:43.510043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:43.510728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:43.511653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:43.512068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:43.524384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:43.526765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:43.535341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:43.539392 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1418/2863] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:43.547691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13935dfe-5a40-493d-93d8-7071de187549 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:43.553500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:43.554192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:43.554473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:43.554747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:43.556559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:43.623646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:43.625621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:43.643075 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1446/2864] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:43 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:12:44.914366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:44.917393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:44.935821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0fd93-d22c-4405-8cab-8dec1b9aa68e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:44.953356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:44.953356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:44.953356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:44.953356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] PATH_INFO: `/v3/users/888bca4c195e4f3185e32e956e256b06` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:44.953789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=888bca4c195e4f3185e32e956e256b06)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:44.957350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:45.206385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888bca4c195e4f3185e32e956e256b06'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:45.214735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888bca4c195e4f3185e32e956e256b06'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:45.232913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888bca4c195e4f3185e32e956e256b06'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:45.233787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888bca4c195e4f3185e32e956e256b06'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:45.234492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3c2fbad-8c3f-4387-bbb6-f0cf7b8bbbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888bca4c195e4f3185e32e956e256b06'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:45.400433 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1419/2865] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:44 2021] DELETE /identity/v3/users/888bca4c195e4f3185e32e956e256b06 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:12:45.788917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:45.809464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e24cb-1087-4316-b1bf-0f1ed78e867a service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:45.886485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:45.887342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:45.887651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:45.888563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] PATH_INFO: `/v3/projects/4aa6a09f9e43475e8a7f5639f59b1654` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:45.889796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa6a09f9e43475e8a7f5639f59b1654)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:45.891706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:46.083833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa6a09f9e43475e8a7f5639f59b1654', 'request_id': 'req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:46.177098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3faf8-aaaa-4e22-94b7-e364e4df6052 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:46.177652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3faf8-aaaa-4e22-94b7-e364e4df6052 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:46.177775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3faf8-aaaa-4e22-94b7-e364e4df6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:46.190425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa6a09f9e43475e8a7f5639f59b1654', 'request_id': 'req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:46.211673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa6a09f9e43475e8a7f5639f59b1654', 'request_id': 'req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:46.218758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-47a3faf8-aaaa-4e22-94b7-e364e4df6052 None None] MFA Rules not processed for user `f157276b2f2845258ce93423249ed74d`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:46.222385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-47a3faf8-aaaa-4e22-94b7-e364e4df6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:46.244140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] The token cache is being invalidate because project 4aa6a09f9e43475e8a7f5639f59b1654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:46.245084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:46.245338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76e093c4-06ff-4ee4-b809-e0dd4a7266aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:46.247375 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1447/2866] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:45 2021] DELETE /identity/v3/projects/4aa6a09f9e43475e8a7f5639f59b1654 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:46.253664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0271c7-9caf-4610-ba1a-1781faeceb10 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:46.254272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0271c7-9caf-4610-ba1a-1781faeceb10 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:46.254765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0271c7-9caf-4610-ba1a-1781faeceb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:46.312427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fe0271c7-9caf-4610-ba1a-1781faeceb10 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:46.316569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fe0271c7-9caf-4610-ba1a-1781faeceb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:46.438848 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1448/2867] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:46.446906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce7d-1bc2-44e3-840f-6c76f2590084 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:46.447435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce7d-1bc2-44e3-840f-6c76f2590084 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:46.448519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080ce7d-1bc2-44e3-840f-6c76f2590084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:46.498287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7080ce7d-1bc2-44e3-840f-6c76f2590084 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:46.500018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7080ce7d-1bc2-44e3-840f-6c76f2590084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:46.526108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1449/2868] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:46.532284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ce7d-1bc2-44e3-840f-6c76f2590084 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:46.553582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080ce7d-1bc2-44e3-840f-6c76f2590084 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:46.560970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:46.562215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:46.562735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:46.563333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:46.565013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:12:46.565591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:46.567673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:46.587102 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1450/2869] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:12:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:12:46.592244 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1420/2870] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:46 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:12:46.592441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:46.606978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a916bd-b814-42fa-bfe5-e91ae3851b21 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:46.612654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:46.614276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:46.616109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:46.616109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:46.616109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:46.618029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:46.795281 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1451/2871] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:46 2021] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:46.796023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3faf8-aaaa-4e22-94b7-e364e4df6052 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:46.836537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3faf8-aaaa-4e22-94b7-e364e4df6052 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:46.973798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:46.974492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:46.974827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:46.975105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:46.975808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:46.978173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:47.110484 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1421/2872] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:46 2021] POST /identity/v3/users => generated 287 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:47.113731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:47.124727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c090-ceba-40ce-8231-063fb7655389 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:47.147110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:47.149117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:47.149586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:47.151309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:47.162556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:47.166191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:47.182197 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1452/2873] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:47.186545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:47.198730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7358e70-7896-46bc-a549-3a7107963d38 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:47.205466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba360d6-faf3-4a95-8206-d970152d88c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:47.206529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba360d6-faf3-4a95-8206-d970152d88c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:47.206987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba360d6-faf3-4a95-8206-d970152d88c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:47.207428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba360d6-faf3-4a95-8206-d970152d88c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:47.208349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba360d6-faf3-4a95-8206-d970152d88c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:47.210260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba360d6-faf3-4a95-8206-d970152d88c5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:47.228211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1422/2874] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:47 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:47.233140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:47.244643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16fbb9-7f8d-4406-8ee8-4c103e005d24 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:47.251597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:47.255596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:47.255596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:47.255596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] PATH_INFO: `/v3/projects/af3f5665f009477385c524a3e23aedc6/users/6015b6dc2cbd4171a690602866d50ace/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:47.275663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3f5665f009477385c524a3e23aedc6, user_id=6015b6dc2cbd4171a690602866d50ace, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:47.278484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:47.356939 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1453/2875] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:47 2021] PUT /identity/v3/projects/af3f5665f009477385c524a3e23aedc6/users/6015b6dc2cbd4171a690602866d50ace/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:47.363568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:47.364640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:47.365310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:47.427360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:47.432612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:47.466089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:47.471008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:47.582306 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1423/2876] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:47.604419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:47.609243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:47.619974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcaa86-ba5c-48ae-b374-dae61f22de18 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:47.633642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:47.640028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:47.641684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:47.641684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:47.650601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e908-2a6c-40e9-b9cc-41c5db30f240 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:47.650957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:47.663550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32181-64a5-4508-ac7f-37a460c6c293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:47.664279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32181-64a5-4508-ac7f-37a460c6c293 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:47.664717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32181-64a5-4508-ac7f-37a460c6c293 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:47.667382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32181-64a5-4508-ac7f-37a460c6c293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:47.675490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:47.678618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:47.702794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32181-64a5-4508-ac7f-37a460c6c293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:47.708844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32181-64a5-4508-ac7f-37a460c6c293 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:47.721997 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1454/2877] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:47 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:47.729997 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1424/2878] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:51.866250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:51.868060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:51.894421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cbe1-debc-4a8d-a5b9-dffa76360560 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:51.912104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:51.913502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:51.913994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:51.914458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] PATH_INFO: `/v3/users/8987227b269944619441e94b3876d311` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:51.916397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8987227b269944619441e94b3876d311)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:51.924726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:52.329818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8987227b269944619441e94b3876d311'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:52.344734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8987227b269944619441e94b3876d311'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:52.376046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8987227b269944619441e94b3876d311'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:52.376987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8987227b269944619441e94b3876d311'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:52.492829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8987227b269944619441e94b3876d311'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:52.507241 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1455/2879] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:51 2021] DELETE /identity/v3/users/8987227b269944619441e94b3876d311 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:52.511508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:52.511963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:52.512048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:52.541645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:52.545073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:52.664692 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1425/2880] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:12:52.683701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:52.685594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:52.779262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2943-f7d4-4b66-86b9-a982ec98f482 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:52.806940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:52.808017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:52.809218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:52.809710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:52.841594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:52.847619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:52.875076 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1456/2881] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:54.098882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:54.102998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:54.133107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69a4f8-df7a-4486-9150-f65c1045d337 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:54.147313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:54.148397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:54.148855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:54.149162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] PATH_INFO: `/v3/projects/8b80d743dc6342a689968320db7836a0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:54.151637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b80d743dc6342a689968320db7836a0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:54.157955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:54.324531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b80d743dc6342a689968320db7836a0', 'request_id': 'req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:54.327885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b80d743dc6342a689968320db7836a0', 'request_id': 'req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:54.421701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b80d743dc6342a689968320db7836a0', 'request_id': 'req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:54.438629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] The token cache is being invalidate because project 8b80d743dc6342a689968320db7836a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:54.439599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:54.440488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:54.445442 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1426/2882] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:54 2021] DELETE /identity/v3/projects/8b80d743dc6342a689968320db7836a0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:54.446706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:54.461521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e88e34-a254-4be0-a762-5ed58e6188f2 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:54.668947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:54.670642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:54.671638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:54.672057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] PATH_INFO: `/v3/users/26c9d2461f18421c94fb26db23312ac5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:54.674404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c9d2461f18421c94fb26db23312ac5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:54.676536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:55.024276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c9d2461f18421c94fb26db23312ac5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:55.033820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c9d2461f18421c94fb26db23312ac5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:55.057451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c9d2461f18421c94fb26db23312ac5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:55.058809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c9d2461f18421c94fb26db23312ac5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:55.197585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b3818e5f-b369-43cb-9153-7a68554dfcce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c9d2461f18421c94fb26db23312ac5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:55.205251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1457/2883] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:12:54 2021] DELETE /identity/v3/users/26c9d2461f18421c94fb26db23312ac5 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:12:57.219126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:57.222616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:57.242920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb3a1-cd11-4371-b275-c8ee9eca7fd0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:57.375745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:57.377042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:57.377888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:57.378219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] PATH_INFO: `/v3/projects/5d36c518dd0a4a2fa39fbe84d48682fb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:57.382286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d36c518dd0a4a2fa39fbe84d48682fb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:57.384961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:57.569865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d36c518dd0a4a2fa39fbe84d48682fb', 'request_id': 'req-3d83db2a-6568-49e0-beca-eafb1e2b160d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:57.604504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d36c518dd0a4a2fa39fbe84d48682fb', 'request_id': 'req-3d83db2a-6568-49e0-beca-eafb1e2b160d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:57.752349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d36c518dd0a4a2fa39fbe84d48682fb', 'request_id': 'req-3d83db2a-6568-49e0-beca-eafb1e2b160d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:57.768167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] The token cache is being invalidate because project 5d36c518dd0a4a2fa39fbe84d48682fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:12:57.777743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:57.777743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d83db2a-6568-49e0-beca-eafb1e2b160d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:12:57.779477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25b55-f299-45c5-9abe-7a1879770f2f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:57.779962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25b55-f299-45c5-9abe-7a1879770f2f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:57.780095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25b55-f299-45c5-9abe-7a1879770f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:57.780546 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1427/2884] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:57 2021] DELETE /identity/v3/projects/5d36c518dd0a4a2fa39fbe84d48682fb => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:57.801208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-58e25b55-f299-45c5-9abe-7a1879770f2f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:57.803636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-58e25b55-f299-45c5-9abe-7a1879770f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:57.884262 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1458/2885] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:57.895311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93a645-2253-4b56-a8f4-d075681df456 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:57.896602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93a645-2253-4b56-a8f4-d075681df456 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:57.901577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93a645-2253-4b56-a8f4-d075681df456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:57.923924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3f93a645-2253-4b56-a8f4-d075681df456 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:57.926591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3f93a645-2253-4b56-a8f4-d075681df456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:57.944924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1428/2886] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:57.953939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e25b55-f299-45c5-9abe-7a1879770f2f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:57.981169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e25b55-f299-45c5-9abe-7a1879770f2f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:57.996449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:57.997385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:57.997842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:57.998286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:57.999878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:12:58.000343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:58.002300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:58.025183 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1459/2887] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:12:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:12:58.029312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93a645-2253-4b56-a8f4-d075681df456 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:58.046504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93a645-2253-4b56-a8f4-d075681df456 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:58.072352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:58.073289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:58.079328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:58.079328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:58.079328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:58.079328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:58.259180 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1429/2888] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:12:58 2021] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:58.266488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:58.286728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6e65-2850-4900-af50-c951b6ad0ae3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:58.387830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:58.389664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:58.390144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:58.390596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:58.392049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:58.394939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:58.544727 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1460/2889] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:12:58 2021] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:12:58.601333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:58.639292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad71e5-1ead-4e8e-a692-b6550f9c7984 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:58.659237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:58.660587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:58.660587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:58.660587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:58.697809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:58.705243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:58.763832 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1430/2890] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:58 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:12:58.767853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:58.778336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b565e-540d-499c-9a32-8dbb19081a48 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:58.792967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4ab8-9d84-4048-bf02-31d5f036f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:58.793674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4ab8-9d84-4048-bf02-31d5f036f394 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:58.794168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4ab8-9d84-4048-bf02-31d5f036f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:58.794587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4ab8-9d84-4048-bf02-31d5f036f394 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:58.795488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4ab8-9d84-4048-bf02-31d5f036f394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:58.797868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4ab8-9d84-4048-bf02-31d5f036f394 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:58.820011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:58.820260 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1461/2891] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:12:58 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:12:58.846157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c2a7f-88ce-44d0-8c8c-05069b7c6ce2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:58.853760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:58.854050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:58.854332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:58.873577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859afb36-f461-48a3-a512-553edeef9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:58.883497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859afb36-f461-48a3-a512-553edeef9a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:58.883781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859afb36-f461-48a3-a512-553edeef9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:58.884046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859afb36-f461-48a3-a512-553edeef9a97 admin admin] PATH_INFO: `/v3/projects/53cc391e03de44dbb245531288da2872/users/e3cb179749ef4bc786cc3059f72734f8/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:58.941850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859afb36-f461-48a3-a512-553edeef9a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cc391e03de44dbb245531288da2872, user_id=e3cb179749ef4bc786cc3059f72734f8, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:58.948982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859afb36-f461-48a3-a512-553edeef9a97 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:58.956305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] MFA Rules not processed for user `8e809d47a6cd4eafabfcf4f2f3c827e9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:58.957566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:59.069819 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1431/2892] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:12:58 2021] PUT /identity/v3/projects/53cc391e03de44dbb245531288da2872/users/e3cb179749ef4bc786cc3059f72734f8/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:12:59.075512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:59.076128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:59.076614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:59.116461 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1462/2893] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:58 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:12:59.163098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:12:59.165479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:59.289042 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1432/2894] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:12:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:12:59.309605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:59.311056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:59.450225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:12:59.451669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:12:59.493389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036c13c-a233-46ce-a667-66fdd6f23308 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:59.609271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5036-7ae9-4121-a5ab-46e65fef509d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:59.610343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5036-7ae9-4121-a5ab-46e65fef509d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:59.610839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5036-7ae9-4121-a5ab-46e65fef509d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:59.611323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5036-7ae9-4121-a5ab-46e65fef509d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:59.628008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e5036-7ae9-4121-a5ab-46e65fef509d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:59.629844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e5036-7ae9-4121-a5ab-46e65fef509d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:59.642710 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1463/2895] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:12:59.686944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846e57-e05f-4fc3-b73a-036e0cbdbb02 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:12:59.711198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:12:59.711875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:12:59.712346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:12:59.712629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:12:59.844082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:12:59.845765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:12:59.857720 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1433/2896] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:12:59 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:02.705242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027904d-eaa0-4886-8f66-9a3c0e388e3b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:02.705770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027904d-eaa0-4886-8f66-9a3c0e388e3b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:02.706632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027904d-eaa0-4886-8f66-9a3c0e388e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:02.762114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e027904d-eaa0-4886-8f66-9a3c0e388e3b None None] MFA Rules not processed for user `6015b6dc2cbd4171a690602866d50ace`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:02.764727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e027904d-eaa0-4886-8f66-9a3c0e388e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:02.929135 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1464/2897] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:02.965525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:02.985042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b6597-bb5f-4e96-9790-788a576d8d1f service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:02.992821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:02.993936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:02.994380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:02.995389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:03.008569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:03.010119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:03.022779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1434/2898] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:02 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:08.824257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:08.827065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:08.827808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:08.878138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] MFA Rules not processed for user `6015b6dc2cbd4171a690602866d50ace`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:08.879662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:08.887457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1465/2899] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:10.475893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:10.477371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:10.509911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e1ae5-fc85-4d58-a803-eb56ab7ecdba service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:10.520124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:10.522816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:10.525155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:10.525478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] PATH_INFO: `/v3/users/8e809d47a6cd4eafabfcf4f2f3c827e9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:10.530659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e809d47a6cd4eafabfcf4f2f3c827e9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:10.534492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:10.575202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:10.576841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:10.609588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bb893-93ea-42c1-85a9-52237fc6eca8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:10.619409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:10.622423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:10.622657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:10.622848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:10.625886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:10.640593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:10.642758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:10.656286 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1466/2900] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:13:10.684118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:10.685635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:10.712000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6ee4-28fa-479c-9c4a-0d19189ee219 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:10.723974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:10.726767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:10.726767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:10.726767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] PATH_INFO: `/v3/users/613e2533f4e04cca8fafc3ea463accd9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:10.728985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=613e2533f4e04cca8fafc3ea463accd9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:10.731088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:10.911268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e809d47a6cd4eafabfcf4f2f3c827e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:10.930455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e809d47a6cd4eafabfcf4f2f3c827e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:10.962053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e809d47a6cd4eafabfcf4f2f3c827e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:10.966061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e809d47a6cd4eafabfcf4f2f3c827e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:10.966061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e809d47a6cd4eafabfcf4f2f3c827e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:11.041800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613e2533f4e04cca8fafc3ea463accd9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:11.053799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613e2533f4e04cca8fafc3ea463accd9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:11.088839 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1435/2901] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:10 2021] DELETE /identity/v3/users/8e809d47a6cd4eafabfcf4f2f3c827e9 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:11.116436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613e2533f4e04cca8fafc3ea463accd9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:11.117501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613e2533f4e04cca8fafc3ea463accd9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:11.216403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-de4d2e21-9b3f-4740-b5dc-9e2ca2302de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613e2533f4e04cca8fafc3ea463accd9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:11.228692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1467/2902] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:10 2021] DELETE /identity/v3/users/613e2533f4e04cca8fafc3ea463accd9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:13:11.973948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:11.974991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:12.138522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab946-bc44-48f3-b297-22c0189b0fb1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:12.237473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:12.245112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:12.245651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:12.246133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] PATH_INFO: `/v3/projects/a0c1fd4c214c43d694996c1237c66fe5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:12.250373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c1fd4c214c43d694996c1237c66fe5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:12.254291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:12.442548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c1fd4c214c43d694996c1237c66fe5', 'request_id': 'req-2556ffdc-1383-42d6-9cb8-c66f231420af'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:12.461811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c1fd4c214c43d694996c1237c66fe5', 'request_id': 'req-2556ffdc-1383-42d6-9cb8-c66f231420af'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:12.548114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c1fd4c214c43d694996c1237c66fe5', 'request_id': 'req-2556ffdc-1383-42d6-9cb8-c66f231420af'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:12.564177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] The token cache is being invalidate because project a0c1fd4c214c43d694996c1237c66fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:12.564459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:12.568133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2556ffdc-1383-42d6-9cb8-c66f231420af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:12.571699 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1436/2903] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:11 2021] DELETE /identity/v3/projects/a0c1fd4c214c43d694996c1237c66fe5 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:12.577449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50b072-83ed-4014-82aa-5cd8aea13e07 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:12.578108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50b072-83ed-4014-82aa-5cd8aea13e07 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:12.578602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50b072-83ed-4014-82aa-5cd8aea13e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:12.601688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4b50b072-83ed-4014-82aa-5cd8aea13e07 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:12.603378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b50b072-83ed-4014-82aa-5cd8aea13e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:12.746481 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1468/2904] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:12.753035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:12.753035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:12.753035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:12.781802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:12.783066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:12.809385 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1437/2905] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:12.810522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50b072-83ed-4014-82aa-5cd8aea13e07 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:12.821814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50b072-83ed-4014-82aa-5cd8aea13e07 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:12.833804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:12.834633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:12.834922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:12.835195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:12.836002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:12.836304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:12.839351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:12.876134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:12.878058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:12.910676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcddc5-888e-4492-856d-9a6c030eef93 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:12.910950 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1469/2906] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:13:12.912026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:12.923599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:12.926395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:12.928190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:12.928643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] PATH_INFO: `/v3/projects/74b18f04a1eb470bac90f3df16ec5170` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:12.930774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b18f04a1eb470bac90f3df16ec5170)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:12.932582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e264f56-7e9c-453e-865f-1e7a6f024f3e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:12.933219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:12.944329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:12.944994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:12.945282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:12.945562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:12.946273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:12.954753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:13.148831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b18f04a1eb470bac90f3df16ec5170', 'request_id': 'req-fe54f9d5-3ced-426c-bb4e-41860fb85058'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:13.165654 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1470/2907] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:12 2021] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:13.169754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:13.170600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b18f04a1eb470bac90f3df16ec5170', 'request_id': 'req-fe54f9d5-3ced-426c-bb4e-41860fb85058'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:13.253535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b18f04a1eb470bac90f3df16ec5170', 'request_id': 'req-fe54f9d5-3ced-426c-bb4e-41860fb85058'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:13.283124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] The token cache is being invalidate because project 74b18f04a1eb470bac90f3df16ec5170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:13.285184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:13.288805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fe54f9d5-3ced-426c-bb4e-41860fb85058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:13.299280 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1438/2908] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:12 2021] DELETE /identity/v3/projects/74b18f04a1eb470bac90f3df16ec5170 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:13.304865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e14f1-6637-4e2d-ae01-ae27bdc3f3f7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.305477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e14f1-6637-4e2d-ae01-ae27bdc3f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.319793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d4b9-5824-460c-9487-bb1deeadbf91 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:13.319945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e14f1-6637-4e2d-ae01-ae27bdc3f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.320031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:13.321831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.322130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.322410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.324379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:13.328055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:13.332220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-016e14f1-6637-4e2d-ae01-ae27bdc3f3f7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:13.334094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-016e14f1-6637-4e2d-ae01-ae27bdc3f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:13.344613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1439/2909] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:13:13.352566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf479b82-446a-474e-9440-32b480a571de None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.352858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf479b82-446a-474e-9440-32b480a571de None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.353162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf479b82-446a-474e-9440-32b480a571de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.397533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cf479b82-446a-474e-9440-32b480a571de None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:13.398791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cf479b82-446a-474e-9440-32b480a571de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:13.421159 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1440/2910] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:13.426164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf479b82-446a-474e-9440-32b480a571de None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:13.461655 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1471/2911] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:13 2021] POST /identity/v3/users => generated 292 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:13.467118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:13.470950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:13.480914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf479b82-446a-474e-9440-32b480a571de None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:13.491664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:13.492860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.495340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8406adc-6775-491e-a1cf-c60fcc6176fc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:13.496209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.496512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.497554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:13.498058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:13.500434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:13.509964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:13.512484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.513179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.513689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.515328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:13.518240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:13.535449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1441/2912] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:13:13.539951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:13.546506 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1472/2913] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:13 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:13.550895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:13.555733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15058f1f-a829-44ed-bfcf-ce239c7d09ee admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:13.562145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:13.563138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.563684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.563955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.564670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:13.566658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:13.571689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4bae9-e956-47d0-8b7f-741366f44440 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:13.586766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:13.589386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.590578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.592067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.594871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:13.596773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:13.612994 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1473/2914] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:13 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:13.617034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:13.629937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dec90-e3d5-498a-a08c-e156c6737f99 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:13.639542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ac59c-8486-47ab-9ccd-a97728b03ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:13.640657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac59c-8486-47ab-9ccd-a97728b03ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.641034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac59c-8486-47ab-9ccd-a97728b03ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.641315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac59c-8486-47ab-9ccd-a97728b03ccf admin admin] PATH_INFO: `/v3/projects/e0db74de806d4042916906036a29323b/users/883c40c7de2a4666897b157078d704e6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.673393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ac59c-8486-47ab-9ccd-a97728b03ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0db74de806d4042916906036a29323b, user_id=883c40c7de2a4666897b157078d704e6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:13.691492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ac59c-8486-47ab-9ccd-a97728b03ccf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:13.708951 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1442/2915] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:13 2021] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:13:13.714029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:13.809291 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1474/2916] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:13 2021] PUT /identity/v3/projects/e0db74de806d4042916906036a29323b/users/883c40c7de2a4666897b157078d704e6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:13.824149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173b9a-c540-4013-a935-fc4c60801ea7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.824780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173b9a-c540-4013-a935-fc4c60801ea7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.825450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173b9a-c540-4013-a935-fc4c60801ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.843667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de58a33-2d5c-4c10-a8cf-226a6bfd024c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:13.904685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-39173b9a-c540-4013-a935-fc4c60801ea7 None None] MFA Rules not processed for user `883c40c7de2a4666897b157078d704e6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:13.912508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-39173b9a-c540-4013-a935-fc4c60801ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:13.939409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:13.940191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:13.940578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:13.940930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:13.942144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:13.949506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:14.013728 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1475/2917] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:14.056029 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1443/2918] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:13 2021] POST /identity/v3/users => generated 301 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:14.059806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39173b9a-c540-4013-a935-fc4c60801ea7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:14.076287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39173b9a-c540-4013-a935-fc4c60801ea7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:14.082237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:14.089591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:14.089591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:14.089591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:14.089591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:14.089591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:14.101161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:14.103153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1476/2919] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:13:14.104158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:14.108353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:14.126737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77309e-78a0-4e4f-8d13-399a72c426c9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:14.134045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:14.134970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:14.135904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:14.136413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:14.138430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:14.140709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:14.161283 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1477/2920] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:14.163067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:14.197164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7062a88-14bc-44e9-8666-1e4252833ea3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:14.213766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:14.214775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:14.216096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:14.217979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] PATH_INFO: `/v3/projects/f7118d8084894577a96d6c3e391d33c2/users/81bc7a57b29445dbb7201a774048ad32/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:14.254170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7118d8084894577a96d6c3e391d33c2, user_id=81bc7a57b29445dbb7201a774048ad32, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:14.256656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dd436-2f10-4de8-9482-c21bf1e65d0a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:14.258483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:14.293946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5df37f-f4d4-4211-8994-e8ed43fa25b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:14.296149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5df37f-f4d4-4211-8994-e8ed43fa25b6 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:14.296658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5df37f-f4d4-4211-8994-e8ed43fa25b6 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:14.298196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5df37f-f4d4-4211-8994-e8ed43fa25b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:14.310915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5df37f-f4d4-4211-8994-e8ed43fa25b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:14.314843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5df37f-f4d4-4211-8994-e8ed43fa25b6 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:14.333327 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1444/2921] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:14 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:14.445731 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1478/2922] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:14 2021] PUT /identity/v3/projects/f7118d8084894577a96d6c3e391d33c2/users/81bc7a57b29445dbb7201a774048ad32/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:14.458041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f50531-144b-4306-8d32-096d02a652a0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:14.458211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f50531-144b-4306-8d32-096d02a652a0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:14.458531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f50531-144b-4306-8d32-096d02a652a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:14.523385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-33f50531-144b-4306-8d32-096d02a652a0 None None] MFA Rules not processed for user `81bc7a57b29445dbb7201a774048ad32`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:14.525667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-33f50531-144b-4306-8d32-096d02a652a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:14.701142 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1445/2923] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:14 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:13:14.723567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:14.850217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19939b-ca7b-4ee7-ad66-b683fb2883d4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:14.856737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e318f-d516-4158-aeb3-5753219e1f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:14.858179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e318f-d516-4158-aeb3-5753219e1f4d service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:14.858646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e318f-d516-4158-aeb3-5753219e1f4d service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:14.859103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e318f-d516-4158-aeb3-5753219e1f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:14.868742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e318f-d516-4158-aeb3-5753219e1f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:14.870664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e318f-d516-4158-aeb3-5753219e1f4d service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:14.882706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1479/2924] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:14 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:14.986350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f50531-144b-4306-8d32-096d02a652a0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:15.162062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f50531-144b-4306-8d32-096d02a652a0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:15.177704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:15.178600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:15.178874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:15.179142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] PATH_INFO: `/v3/users/81bc7a57b29445dbb7201a774048ad32` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:15.181327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bc7a57b29445dbb7201a774048ad32)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:15.183315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:15.719534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bc7a57b29445dbb7201a774048ad32'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:15.728511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bc7a57b29445dbb7201a774048ad32'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:15.756071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bc7a57b29445dbb7201a774048ad32'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:15.758766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bc7a57b29445dbb7201a774048ad32'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:15.761152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bc7a57b29445dbb7201a774048ad32'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:15.925371 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1446/2925] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:14 2021] DELETE /identity/v3/users/81bc7a57b29445dbb7201a774048ad32 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:15.926674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e167-e768-4eda-836c-80e2b0353618 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:15.927540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e167-e768-4eda-836c-80e2b0353618 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:15.928063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e167-e768-4eda-836c-80e2b0353618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:15.969909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e444e167-e768-4eda-836c-80e2b0353618 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:15.971479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e444e167-e768-4eda-836c-80e2b0353618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:16.122896 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1480/2926] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:13:16.137278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:16.139580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:16.390953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9a113-d02d-4b8a-91c4-2e65bfbc22b8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:16.416322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:16.418659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:16.420719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:16.421081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:16.454325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:16.456210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:16.478400 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1447/2927] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:17.245633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:17.247403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:17.247868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:17.279443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:17.282921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:17.318525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2b889-9e1b-44ba-a433-4d415ecf87cd service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:17.349662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:17.350534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:17.350820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:17.351094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] PATH_INFO: `/v3/projects/f7118d8084894577a96d6c3e391d33c2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:17.351754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] MFA Rules not processed for user `e3cb179749ef4bc786cc3059f72734f8`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:17.353815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:17.356222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7118d8084894577a96d6c3e391d33c2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:17.358438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:17.570307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7118d8084894577a96d6c3e391d33c2', 'request_id': 'req-25619162-eca1-4530-8250-d5abef97ad51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:17.580519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7118d8084894577a96d6c3e391d33c2', 'request_id': 'req-25619162-eca1-4530-8250-d5abef97ad51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:17.672980 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1481/2928] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:17 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:17.683690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:17.685457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:17.727849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd542-2ecc-4e6e-8459-346da2bab773 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:17.832078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7118d8084894577a96d6c3e391d33c2', 'request_id': 'req-25619162-eca1-4530-8250-d5abef97ad51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:17.861743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] The token cache is being invalidate because project f7118d8084894577a96d6c3e391d33c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:17.862039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:17.865099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25619162-eca1-4530-8250-d5abef97ad51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:17.869051 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1448/2929] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:17 2021] DELETE /identity/v3/projects/f7118d8084894577a96d6c3e391d33c2 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:17.878522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda14521-43aa-415e-b81f-9383d488ff49 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:17.878802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda14521-43aa-415e-b81f-9383d488ff49 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:17.879015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda14521-43aa-415e-b81f-9383d488ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:17.888507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:17.889858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:17.890743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:17.890743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:17.891124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:17.894878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:17.925050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dda14521-43aa-415e-b81f-9383d488ff49 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:17.926960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dda14521-43aa-415e-b81f-9383d488ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:17.968162 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1449/2930] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:17.977233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5479dca-3a17-4634-95b9-8fe8abb93e8d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:17.977522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5479dca-3a17-4634-95b9-8fe8abb93e8d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:17.977920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5479dca-3a17-4634-95b9-8fe8abb93e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.021994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f5479dca-3a17-4634-95b9-8fe8abb93e8d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:18.023416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f5479dca-3a17-4634-95b9-8fe8abb93e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:18.037737 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1450/2931] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:18.043758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5479dca-3a17-4634-95b9-8fe8abb93e8d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:18.066924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5479dca-3a17-4634-95b9-8fe8abb93e8d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:18.111013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:18.112407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:18.113030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:18.113601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.115289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:18.115849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:18.118139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:18.127779 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1482/2932] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:17 2021] POST /identity/v3/projects => generated 385 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:18.132541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:18.141788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:18.175886 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1451/2933] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:13:18.178146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:18.198000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fdf31-75ed-4eab-a139-0f6ad071cdef admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:18.336426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:18.345362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:18.347199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:18.347199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.347199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:18.354992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:18.361481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404e6b-e568-433a-8254-5558da6ca01f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:18.371462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:18.376026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:18.376026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:18.376026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.376026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:18.385807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:18.547758 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1452/2934] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:18 2021] POST /identity/v3/projects => generated 363 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:18.555854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:18.565196 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1483/2935] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:18 2021] POST /identity/v3/users => generated 299 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:13:18.565818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:18.594462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec192abb-da5b-41af-90b8-5dc4e079c5f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:18.692537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbee2de-3a11-4b7e-804c-f61ed5099339 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:18.698190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:18.699243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:18.699526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:18.699798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.700497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:18.703010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:18.719520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:18.720198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:18.720481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:18.720762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.721533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:18.723126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:18.733294 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1484/2936] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:18 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:13:18.734197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:18.738107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:18.752863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f55ed-51d6-4e04-bc43-3ed203740163 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:18.759058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:18.760224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:18.760532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:18.760781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] PATH_INFO: `/v3/users/883c40c7de2a4666897b157078d704e6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.762262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883c40c7de2a4666897b157078d704e6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:18.764924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:18.887155 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1453/2937] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:18 2021] POST /identity/v3/users => generated 282 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:18.888012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:18.890442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:18.957316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38e14d-5cde-4378-974e-e60c31199dd6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:18.963460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:18.964250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:18.964640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:18.965078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:18.967196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:18.994684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883c40c7de2a4666897b157078d704e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:19.000158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.001854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.005616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883c40c7de2a4666897b157078d704e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:19.021286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883c40c7de2a4666897b157078d704e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:19.022092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883c40c7de2a4666897b157078d704e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:19.043741 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1454/2938] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:19.043741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:19.053232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391ab2-9eeb-4010-b110-b10fd7cd4bf7 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:19.058336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fcf71-9288-4f97-9f54-08ee343284aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:19.061362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fcf71-9288-4f97-9f54-08ee343284aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.061645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fcf71-9288-4f97-9f54-08ee343284aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.061920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fcf71-9288-4f97-9f54-08ee343284aa admin admin] PATH_INFO: `/v3/projects/93f66f3f38674111af80e14c33a3e39d/users/bc3887c19533490a973e8c1775fe1c93/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.080353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fcf71-9288-4f97-9f54-08ee343284aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f66f3f38674111af80e14c33a3e39d, user_id=bc3887c19533490a973e8c1775fe1c93, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.084257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fcf71-9288-4f97-9f54-08ee343284aa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.127867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883c40c7de2a4666897b157078d704e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:19.146990 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1485/2939] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:18 2021] DELETE /identity/v3/users/883c40c7de2a4666897b157078d704e6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:19.150391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:19.150391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:19.214171 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1455/2940] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:19 2021] PUT /identity/v3/projects/93f66f3f38674111af80e14c33a3e39d/users/bc3887c19533490a973e8c1775fe1c93/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:19.215498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.215783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.216059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.273337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:19.276925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:19.322370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d714c-38d6-41dc-b3c2-316c7cb20e78 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:19.440121 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1456/2941] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:19.441829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:19.445010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:19.465714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:19.467369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.467369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.469224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.470059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.471821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.474001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d25159-4dc7-4cad-ba4a-2c359f0d71b4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:19.489247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:19.490107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.490391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.491434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.495369 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1486/2942] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:19.496131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:19.508163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.509905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:19.517571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.548659 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1457/2943] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:19.548659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:19.567659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5e233-5c5b-4ac8-8851-9dd94f328b2f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:19.593504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:19.604088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.606617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.607004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.607580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf4a64-23a4-4222-8523-00f3cac0aa5f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:19.608094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.612532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:19.613370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.613616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.614104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.614569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.642241 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1458/2944] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:19.648172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.648762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:19.649845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.667086 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1487/2945] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:19.668194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:19.686356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fa91-46ba-45cb-8728-805648ad9709 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:19.696633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c96b1-26ef-4948-985b-a6d40ec00b7a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:19.709504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:19.709703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ad03-480b-43f2-8583-c4bf9acdfe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:19.710835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ad03-480b-43f2-8583-c4bf9acdfe2c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.711362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ad03-480b-43f2-8583-c4bf9acdfe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.713439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ad03-480b-43f2-8583-c4bf9acdfe2c admin admin] PATH_INFO: `/v3/projects/93f66f3f38674111af80e14c33a3e39d/users/bc3887c19533490a973e8c1775fe1c93/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.714299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.721080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6ad03-480b-43f2-8583-c4bf9acdfe2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f66f3f38674111af80e14c33a3e39d, user_id=bc3887c19533490a973e8c1775fe1c93, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.722156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.723075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] PATH_INFO: `/v3/projects/00414bfe9d194c88b02d9664fdeaa217/users/30652e6248664267895369366201816e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.730297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6ad03-480b-43f2-8583-c4bf9acdfe2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.744460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=00414bfe9d194c88b02d9664fdeaa217, user_id=30652e6248664267895369366201816e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:19.747609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:19.761068 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1459/2946] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:19 2021] PUT /identity/v3/projects/93f66f3f38674111af80e14c33a3e39d/users/bc3887c19533490a973e8c1775fe1c93/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:19.915791 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1488/2947] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:19 2021] PUT /identity/v3/projects/00414bfe9d194c88b02d9664fdeaa217/users/30652e6248664267895369366201816e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:19.920931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:19.921511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:19.921993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:19.951612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:19.956937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:20.120185 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1460/2948] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:20.151019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:20.154693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:20.219537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276128e-6cdc-4da6-b786-798bbc295dea admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:20.223719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0efa1-50c2-44eb-90db-3c870102f389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:20.224443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0efa1-50c2-44eb-90db-3c870102f389 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:20.224800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0efa1-50c2-44eb-90db-3c870102f389 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:20.225180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0efa1-50c2-44eb-90db-3c870102f389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:20.235367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0efa1-50c2-44eb-90db-3c870102f389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:20.237116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0efa1-50c2-44eb-90db-3c870102f389 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:20.249689 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1489/2949] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:20.825064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:20.828522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:20.841051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a9688-a1d1-49db-a0a8-c1d91c5d11dd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:20.848345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:20.849709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:20.850070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:20.850419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] PATH_INFO: `/v3/projects/e0db74de806d4042916906036a29323b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:20.851741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0db74de806d4042916906036a29323b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:20.853714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:21.039992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0db74de806d4042916906036a29323b', 'request_id': 'req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:21.059272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0db74de806d4042916906036a29323b', 'request_id': 'req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:21.184714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0db74de806d4042916906036a29323b', 'request_id': 'req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:21.203855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] The token cache is being invalidate because project e0db74de806d4042916906036a29323b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:21.204150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:21.204829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d1909f5-fd76-43ef-bb2e-2316e1f8a1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:21.207323 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1461/2950] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:20 2021] DELETE /identity/v3/projects/e0db74de806d4042916906036a29323b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:21.222058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd9d1a-7075-468f-bbfb-63ebd42b715c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:21.222651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd9d1a-7075-468f-bbfb-63ebd42b715c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:21.222651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd9d1a-7075-468f-bbfb-63ebd42b715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:21.263297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4abd9d1a-7075-468f-bbfb-63ebd42b715c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:21.264175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4abd9d1a-7075-468f-bbfb-63ebd42b715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:21.363350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a12e88-1609-49d8-8eff-b8aee4c76a8d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:21.363350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a12e88-1609-49d8-8eff-b8aee4c76a8d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:21.363608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a12e88-1609-49d8-8eff-b8aee4c76a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:21.365529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1490/2951] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:21.391218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f1a12e88-1609-49d8-8eff-b8aee4c76a8d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:21.394919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f1a12e88-1609-49d8-8eff-b8aee4c76a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:21.405970 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1462/2952] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:21.410934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd9d1a-7075-468f-bbfb-63ebd42b715c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:21.423959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd9d1a-7075-468f-bbfb-63ebd42b715c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:21.438662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:21.439684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:21.440162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:21.440775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:21.441755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:21.446304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:21.446304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:21.459786 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1491/2953] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:13:21.464973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a12e88-1609-49d8-8eff-b8aee4c76a8d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:21.478507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a12e88-1609-49d8-8eff-b8aee4c76a8d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:21.497888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:21.499755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:21.499755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:21.500126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:21.500781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:21.502588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:21.672337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1463/2954] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:21 2021] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:21.672658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:21.695245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cd784-0467-4178-9da5-5b3f261ccf00 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:21.863734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:21.864650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:21.865310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:21.865759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:21.866616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:21.868700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:22.016337 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1492/2955] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:21 2021] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:22.021217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:22.050322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d362021-cda2-4030-8e14-c4aec48b8c34 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:22.063273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:22.063971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:22.066946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:22.067516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:22.068682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:22.073997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:22.106941 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1464/2956] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:22 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:22.110998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:22.129307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5ef0f-ce2d-4e12-a04f-22164939334e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:22.135473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d19446-f1b3-40e4-a100-1a99c4f9c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:22.137242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19446-f1b3-40e4-a100-1a99c4f9c559 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:22.137882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19446-f1b3-40e4-a100-1a99c4f9c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:22.138225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19446-f1b3-40e4-a100-1a99c4f9c559 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:22.139741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d19446-f1b3-40e4-a100-1a99c4f9c559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:22.141755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d19446-f1b3-40e4-a100-1a99c4f9c559 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:22.157513 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1493/2957] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:22 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:22.162670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:22.198859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fa9f-a482-4dd1-b2c9-8dc5a705f1c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:22.210953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:22.214897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:22.215407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:22.217041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] PATH_INFO: `/v3/projects/f5ed5c4fc23d460e8d63226986b549bd/users/3d55f68c111b4a388351c18551dd43ce/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:22.261916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ed5c4fc23d460e8d63226986b549bd, user_id=3d55f68c111b4a388351c18551dd43ce, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:22.266727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:22.371460 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1465/2958] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:22 2021] PUT /identity/v3/projects/f5ed5c4fc23d460e8d63226986b549bd/users/3d55f68c111b4a388351c18551dd43ce/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:13:22.377707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3365d-ca3a-45ee-90b0-97dc7095136e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:22.378227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3365d-ca3a-45ee-90b0-97dc7095136e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:22.378314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3365d-ca3a-45ee-90b0-97dc7095136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:22.426520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b8e3365d-ca3a-45ee-90b0-97dc7095136e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:22.426520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b8e3365d-ca3a-45ee-90b0-97dc7095136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:22.553304 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1494/2959] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:22.612190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:22.612190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:22.719531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f1f0-fe6c-468b-9241-204b6d84330f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:22.728736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:22.730680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:22.738210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:22.739874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:22.764557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:22.766118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:22.785609 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1466/2960] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:28.230460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3365d-ca3a-45ee-90b0-97dc7095136e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:28.245256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3365d-ca3a-45ee-90b0-97dc7095136e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:28.255793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:28.257472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:28.257920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:28.258345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:28.263414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:28.284246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:28.288136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:28.309849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1495/2961] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:13:30.503166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:30.504821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:30.529093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39616475-1051-473d-8a50-496cb0374506 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:30.570614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:30.573521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:30.574893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:30.575328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] PATH_INFO: `/v3/users/f157276b2f2845258ce93423249ed74d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:30.583693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f157276b2f2845258ce93423249ed74d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:30.611034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:30.879009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f157276b2f2845258ce93423249ed74d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:30.901845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f157276b2f2845258ce93423249ed74d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:30.936774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f157276b2f2845258ce93423249ed74d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:30.938454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f157276b2f2845258ce93423249ed74d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:30.939407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6e04c8f3-8df5-477c-923b-0a351c9e9984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f157276b2f2845258ce93423249ed74d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:31.064076 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1467/2962] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:30 2021] DELETE /identity/v3/users/f157276b2f2845258ce93423249ed74d => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:32.236049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:32.254065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f639bb-7708-43ee-acf0-65bf01484a18 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:32.412278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:32.413389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:32.416591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:32.417408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] PATH_INFO: `/v3/projects/576fa0b7a73d45bc86b799bb25424c30` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:32.427358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576fa0b7a73d45bc86b799bb25424c30)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:32.432227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:32.631983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576fa0b7a73d45bc86b799bb25424c30', 'request_id': 'req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:32.716288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576fa0b7a73d45bc86b799bb25424c30', 'request_id': 'req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:32.748511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576fa0b7a73d45bc86b799bb25424c30', 'request_id': 'req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:32.823712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] The token cache is being invalidate because project 576fa0b7a73d45bc86b799bb25424c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:32.824005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:32.825315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f7a3bb0-d3cd-4e5e-830c-90da7f139785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:32.836451 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1496/2963] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:32 2021] DELETE /identity/v3/projects/576fa0b7a73d45bc86b799bb25424c30 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:32.843993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d010-ec33-4647-843e-a6c6ede6db01 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:32.844864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d010-ec33-4647-843e-a6c6ede6db01 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:32.845343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2d010-ec33-4647-843e-a6c6ede6db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:32.888426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1dc2d010-ec33-4647-843e-a6c6ede6db01 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:32.889987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1dc2d010-ec33-4647-843e-a6c6ede6db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:32.972810 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1468/2964] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:32.981025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32749c8-90f8-4b70-ab52-c2b3003330f5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:32.982294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32749c8-90f8-4b70-ab52-c2b3003330f5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:32.983382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32749c8-90f8-4b70-ab52-c2b3003330f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.013252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a32749c8-90f8-4b70-ab52-c2b3003330f5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:33.015634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a32749c8-90f8-4b70-ab52-c2b3003330f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:33.026163 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1497/2965] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:33.031471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d010-ec33-4647-843e-a6c6ede6db01 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:33.050463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2d010-ec33-4647-843e-a6c6ede6db01 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:33.065364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:33.074081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:33.074377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:33.074846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.075796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:33.076264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:33.078458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:33.137800 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1469/2966] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:13:33.140315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32749c8-90f8-4b70-ab52-c2b3003330f5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:33.157520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32749c8-90f8-4b70-ab52-c2b3003330f5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:33.171658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:33.172594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:33.173141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:33.173613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.175285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:33.178206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:33.289098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1498/2967] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:33 2021] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:33.295323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:33.311219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d6897-8abd-40d1-afdc-38c28a69be61 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:33.422847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:33.423682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:33.424066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:33.424440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.425279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:33.427411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:33.546018 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1470/2968] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:33 2021] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:33.551116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:33.568515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8fd0-2280-42dd-9926-d1f01fd2ae41 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:33.582526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:33.583214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:33.583698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:33.583984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.584727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:33.587390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:33.611185 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1499/2969] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:33 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:33.614996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:33.633805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896ebcd-6609-4f20-b553-8a53f6e4b788 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:33.647247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56f46b-59f2-42eb-b240-46cc2be35434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:33.649591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56f46b-59f2-42eb-b240-46cc2be35434 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:33.651408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56f46b-59f2-42eb-b240-46cc2be35434 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:33.653370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56f46b-59f2-42eb-b240-46cc2be35434 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.654730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56f46b-59f2-42eb-b240-46cc2be35434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:33.660953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56f46b-59f2-42eb-b240-46cc2be35434 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:33.693868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1471/2970] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:33 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:33.695028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:33.711080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16953f9f-faa3-461e-acd5-d4b572de5735 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:33.726980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:33.726980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:33.726980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:33.726980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] PATH_INFO: `/v3/projects/c86857b4629c4cdbbd6a4664d499fb87/users/d5e4a505ed3847588a7f577f2e607afd/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.748515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86857b4629c4cdbbd6a4664d499fb87, user_id=d5e4a505ed3847588a7f577f2e607afd, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:33.757682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:33.870729 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1500/2971] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:33 2021] PUT /identity/v3/projects/c86857b4629c4cdbbd6a4664d499fb87/users/d5e4a505ed3847588a7f577f2e607afd/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:13:33.876104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:33.876648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:33.876898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:33.909373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:33.911568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:34.049088 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1472/2972] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:13:34.063921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:34.066478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:34.208820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:34.210552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:34.222120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df7144-53a6-473c-8733-1a828cb79edc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:34.237824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:34.253771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:34.255155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4585a-d265-4d3f-b12a-b74de34ea753 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:34.255514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:34.255900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:34.275234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:34.276326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:34.276707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:34.278508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] PATH_INFO: `/v3/users/2cb2a59c7c9b4a13964c78ff0fb1a8f4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:34.281131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb2a59c7c9b4a13964c78ff0fb1a8f4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:34.283761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:34.286999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:34.291473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:34.343442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1501/2973] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:34.534120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb2a59c7c9b4a13964c78ff0fb1a8f4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:34.568585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb2a59c7c9b4a13964c78ff0fb1a8f4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:34.630076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb2a59c7c9b4a13964c78ff0fb1a8f4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:34.632008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb2a59c7c9b4a13964c78ff0fb1a8f4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:34.633604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb2a59c7c9b4a13964c78ff0fb1a8f4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:34.727052 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1473/2974] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:34 2021] DELETE /identity/v3/users/2cb2a59c7c9b4a13964c78ff0fb1a8f4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:36.326521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:36.354768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d929-4659-4d18-9e7d-c63dee70d2c8 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:36.510571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:36.512946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:36.513541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:36.514097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] PATH_INFO: `/v3/projects/276a36e6a97d46a78b7e483daa26cc2e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:36.515714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276a36e6a97d46a78b7e483daa26cc2e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:36.518004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:36.723891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276a36e6a97d46a78b7e483daa26cc2e', 'request_id': 'req-175d6c60-199b-48f9-9a96-1c0f587d8b63'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:36.802740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276a36e6a97d46a78b7e483daa26cc2e', 'request_id': 'req-175d6c60-199b-48f9-9a96-1c0f587d8b63'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:36.814528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276a36e6a97d46a78b7e483daa26cc2e', 'request_id': 'req-175d6c60-199b-48f9-9a96-1c0f587d8b63'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:36.838308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] The token cache is being invalidate because project 276a36e6a97d46a78b7e483daa26cc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:36.838599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:36.840744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:36.848823 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1502/2975] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:36 2021] DELETE /identity/v3/projects/276a36e6a97d46a78b7e483daa26cc2e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:36.851007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:36.852446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:36.893344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5942a1-95d3-416c-9c0a-e033f2374486 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:37.012583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:37.014176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:37.014458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:37.014979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] PATH_INFO: `/v3/users/dd3fde87c98340b49ca655f503114dd8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:37.022523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3fde87c98340b49ca655f503114dd8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:37.025869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:37.265127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3fde87c98340b49ca655f503114dd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:37.276965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3fde87c98340b49ca655f503114dd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:37.293559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3fde87c98340b49ca655f503114dd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:37.295042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3fde87c98340b49ca655f503114dd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:37.295735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-488478a0-269a-4a29-8925-8584f237e8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3fde87c98340b49ca655f503114dd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:37.375894 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1474/2976] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:36 2021] DELETE /identity/v3/users/dd3fde87c98340b49ca655f503114dd8 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:38.597416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:38.604547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:38.633945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d6c60-199b-48f9-9a96-1c0f587d8b63 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:38.765578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:38.767330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:38.767842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:38.768630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] PATH_INFO: `/v3/projects/a886b036c6ea4b869569c99d144dc3cd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:38.770337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a886b036c6ea4b869569c99d144dc3cd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:38.782810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:38.859159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:38.860036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:38.860529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:38.931644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] MFA Rules not processed for user `bc3887c19533490a973e8c1775fe1c93`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:38.933446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:39.021007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a886b036c6ea4b869569c99d144dc3cd', 'request_id': 'req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:39.096640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a886b036c6ea4b869569c99d144dc3cd', 'request_id': 'req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:39.104307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a886b036c6ea4b869569c99d144dc3cd', 'request_id': 'req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:39.113668 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1475/2977] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:38 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:39.123322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:39.127813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:39.131209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] The token cache is being invalidate because project a886b036c6ea4b869569c99d144dc3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:39.131495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:39.132326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f96bc0e-67e2-40a9-bd7f-75d7fe1436d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:39.135647 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1503/2978] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:38 2021] DELETE /identity/v3/projects/a886b036c6ea4b869569c99d144dc3cd => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:39.142127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58412ab-a99f-4ad8-8f73-d4ee919d0cce None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:39.142410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58412ab-a99f-4ad8-8f73-d4ee919d0cce None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:39.142686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58412ab-a99f-4ad8-8f73-d4ee919d0cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:39.188564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e58412ab-a99f-4ad8-8f73-d4ee919d0cce None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:39.192079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e58412ab-a99f-4ad8-8f73-d4ee919d0cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:39.260188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f83b65-68ed-477b-aa3c-8ee6a96ff5c1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:39.326227 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1504/2979] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:39.334021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782376ef-a15a-4939-ad38-120327cbae8f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:39.334306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782376ef-a15a-4939-ad38-120327cbae8f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:39.334583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782376ef-a15a-4939-ad38-120327cbae8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:39.375060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-782376ef-a15a-4939-ad38-120327cbae8f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:39.376285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-782376ef-a15a-4939-ad38-120327cbae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:39.398173 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1505/2980] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:13:39.402501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782376ef-a15a-4939-ad38-120327cbae8f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:39.406569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:39.407386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:39.407774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:39.408155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:39.410238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:39.415565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782376ef-a15a-4939-ad38-120327cbae8f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:39.432401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:39.432697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:39.433015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:39.433290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:39.434096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:39.435574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:39.438030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:39.459654 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1506/2981] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:13:39.463741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:39.476181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f37e3-86db-40ab-ad67-243fcc4b6863 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:39.483580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1180e-7c96-460c-8380-7321b0674578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:39.484253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1180e-7c96-460c-8380-7321b0674578 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:39.484540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1180e-7c96-460c-8380-7321b0674578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:39.484813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1180e-7c96-460c-8380-7321b0674578 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:39.485557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1180e-7c96-460c-8380-7321b0674578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:39.488726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1180e-7c96-460c-8380-7321b0674578 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:39.531935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:39.533503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:39.559548 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1476/2982] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:39 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:39.635551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:39.649622 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1507/2983] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:39 2021] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:13:39.699862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d914e-9b9b-4e3b-aa8e-0631b29f2872 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:39.919873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:39.922105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:39.922626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:39.923147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:39.924125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:39.933819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:40.036680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaea96-a517-4563-bda0-1a81901933be None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:40.036948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaea96-a517-4563-bda0-1a81901933be None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:40.037234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaea96-a517-4563-bda0-1a81901933be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:40.274055 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1477/2984] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:39 2021] POST /identity/v3/users => generated 288 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:40.274992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:40.294687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-69aaea96-a517-4563-bda0-1a81901933be None None] MFA Rules not processed for user `30652e6248664267895369366201816e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:40.299109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69aaea96-a517-4563-bda0-1a81901933be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:40.312939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281514b-f74f-4dc9-b96d-1e013e9171d4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:40.328795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:40.329905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:40.329905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:40.330099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:40.330915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:40.332520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:40.358063 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1478/2985] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:40.363357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:40.399372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f5b54-284b-4df3-9236-f04c5774d372 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:40.432063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:40.433398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:40.433998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:40.435251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:40.436508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:40.440944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:40.476560 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1479/2986] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:40 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:13:40.480198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:40.520355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df303b-5494-4e80-95c9-e17a7673f546 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:40.535140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d9db7-d075-41c0-a2ff-331af219185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:40.537453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d9db7-d075-41c0-a2ff-331af219185f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:40.539209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d9db7-d075-41c0-a2ff-331af219185f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:40.539657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d9db7-d075-41c0-a2ff-331af219185f admin admin] PATH_INFO: `/v3/projects/ed880d80bcfb4641b02f26da5fad21b8/users/f9e59d219fa640e48533e0efdf150b16/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:40.574938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d9db7-d075-41c0-a2ff-331af219185f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed880d80bcfb4641b02f26da5fad21b8, user_id=f9e59d219fa640e48533e0efdf150b16, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:40.578542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d9db7-d075-41c0-a2ff-331af219185f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:40.628335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1508/2987] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:39 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 643 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:40.641681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaea96-a517-4563-bda0-1a81901933be None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:40.643376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69aaea96-a517-4563-bda0-1a81901933be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:40.760579 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1480/2988] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:40 2021] PUT /identity/v3/projects/ed880d80bcfb4641b02f26da5fad21b8/users/f9e59d219fa640e48533e0efdf150b16/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:40.787336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a5ce-6d27-4681-9f72-51c31054f58d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:40.788728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a5ce-6d27-4681-9f72-51c31054f58d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:40.789066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a5ce-6d27-4681-9f72-51c31054f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:40.928422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d4d7a5ce-6d27-4681-9f72-51c31054f58d None None] MFA Rules not processed for user `f9e59d219fa640e48533e0efdf150b16`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:40.937931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4d7a5ce-6d27-4681-9f72-51c31054f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:41.020818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaea96-a517-4563-bda0-1a81901933be None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:41.195362 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1481/2989] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:40 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:41.196410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7a5ce-6d27-4681-9f72-51c31054f58d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:41.226474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e7b95-9814-43b2-bbea-8fdd39a75691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:41.227417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e7b95-9814-43b2-bbea-8fdd39a75691 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:41.227883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e7b95-9814-43b2-bbea-8fdd39a75691 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:41.228303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e7b95-9814-43b2-bbea-8fdd39a75691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:41.391553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e7b95-9814-43b2-bbea-8fdd39a75691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:41.391553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e7b95-9814-43b2-bbea-8fdd39a75691 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:41.428631 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1509/2990] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:40 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:13:41.430216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284ef62-9778-4c40-a3ab-087672e76e99 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:41.430502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284ef62-9778-4c40-a3ab-087672e76e99 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:41.430778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284ef62-9778-4c40-a3ab-087672e76e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:41.450020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7a5ce-6d27-4681-9f72-51c31054f58d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:41.457754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:41.458148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:41.458349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:41.458632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:41.459353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:41.461333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:41.538692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4284ef62-9778-4c40-a3ab-087672e76e99 None None] MFA Rules not processed for user `d5e4a505ed3847588a7f577f2e607afd`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:41.546792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4284ef62-9778-4c40-a3ab-087672e76e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:41.639333 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1482/2991] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:41 2021] POST /identity/v3/projects => generated 375 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:41.643934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:41.746752 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1510/2992] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:41 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:41.750614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e536-6373-452f-bd75-854840768427 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:41.754371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e536-6373-452f-bd75-854840768427 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:41.758016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e536-6373-452f-bd75-854840768427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:41.803982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f9e1e536-6373-452f-bd75-854840768427 None None] MFA Rules not processed for user `d5e4a505ed3847588a7f577f2e607afd`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:41.807442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f9e1e536-6373-452f-bd75-854840768427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:41.927206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d02cb-475a-424b-b773-3835f167fc2f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:41.954946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:41.968866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:41.969230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:41.969511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:41.970274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:41.972742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:42.020820 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1511/2993] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:41 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:42.071600 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1483/2994] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:41 2021] POST /identity/v3/users => generated 294 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:42.089034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1e536-6373-452f-bd75-854840768427 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:42.109719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1e536-6373-452f-bd75-854840768427 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:42.135749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:42.138685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:42.140658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:42.145371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:42.146773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:42.149119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:42.201054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:42.206312 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1512/2995] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:42.221786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2f69b-862b-4f51-b276-e180f74c7aef admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:42.245621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:42.246551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:42.253252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:42.253645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] PATH_INFO: `/v3/projects/cbd62ea5e59c47fc8d5c271934c6a120/users/68e2585485584fc59e9b72868227f2c8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:42.306306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd62ea5e59c47fc8d5c271934c6a120, user_id=68e2585485584fc59e9b72868227f2c8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:42.309302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:42.448570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:42.449267 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1484/2996] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:42 2021] PUT /identity/v3/projects/cbd62ea5e59c47fc8d5c271934c6a120/users/68e2585485584fc59e9b72868227f2c8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:42.456919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:42.457126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:42.629511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4d34-b2f5-429c-ae68-b8cf17bdfc87 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:42.643493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:42.645145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:42.645617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:42.646671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:42.649601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:42.654148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:42.686764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f41741-e850-44f8-be3c-2c51102af6de admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:42.689311 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1485/2997] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:42.690228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:42.716637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66854c7-6df6-4a1b-888a-8e80e707be0f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:42.737856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c841-8b81-4b5e-8cf2-172fc94630f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:42.739072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c841-8b81-4b5e-8cf2-172fc94630f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:42.739353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c841-8b81-4b5e-8cf2-172fc94630f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:42.739625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c841-8b81-4b5e-8cf2-172fc94630f1 admin admin] PATH_INFO: `/v3/projects/cbd62ea5e59c47fc8d5c271934c6a120/users/68e2585485584fc59e9b72868227f2c8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:42.743894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c841-8b81-4b5e-8cf2-172fc94630f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd62ea5e59c47fc8d5c271934c6a120, user_id=68e2585485584fc59e9b72868227f2c8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:42.751256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c841-8b81-4b5e-8cf2-172fc94630f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:42.776553 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1486/2998] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:42 2021] PUT /identity/v3/projects/cbd62ea5e59c47fc8d5c271934c6a120/users/68e2585485584fc59e9b72868227f2c8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:42.789633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d9b20-83b7-4c30-ac4c-9c38be8214de None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:42.789922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d9b20-83b7-4c30-ac4c-9c38be8214de None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:42.790201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d9b20-83b7-4c30-ac4c-9c38be8214de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:42.861149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc440b7-3006-4ef6-8292-b33885984069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:42.863577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc440b7-3006-4ef6-8292-b33885984069 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:42.865927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc440b7-3006-4ef6-8292-b33885984069 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:42.866499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc440b7-3006-4ef6-8292-b33885984069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:42.869811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6e2d9b20-83b7-4c30-ac4c-9c38be8214de None None] MFA Rules not processed for user `68e2585485584fc59e9b72868227f2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:42.871039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6e2d9b20-83b7-4c30-ac4c-9c38be8214de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:43.025985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc440b7-3006-4ef6-8292-b33885984069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:43.029553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc440b7-3006-4ef6-8292-b33885984069 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:43.050848 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1513/2999] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:42 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:13:43.080663 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1487/3000] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:42 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:13:43.082479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452bf1-6811-4ac2-ae57-31ac94d8facb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:43.082881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452bf1-6811-4ac2-ae57-31ac94d8facb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:43.083467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452bf1-6811-4ac2-ae57-31ac94d8facb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:43.125876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ad452bf1-6811-4ac2-ae57-31ac94d8facb None None] MFA Rules not processed for user `f9e59d219fa640e48533e0efdf150b16`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:43.135991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ad452bf1-6811-4ac2-ae57-31ac94d8facb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:43.343064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d9b20-83b7-4c30-ac4c-9c38be8214de None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:43.360168 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1514/3001] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:43 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:13:43.531934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d9b20-83b7-4c30-ac4c-9c38be8214de None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:43.547249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e246e27-35f1-4228-ab02-84b65f0bcac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:43.548836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246e27-35f1-4228-ab02-84b65f0bcac8 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:43.549395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246e27-35f1-4228-ab02-84b65f0bcac8 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:43.549787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e246e27-35f1-4228-ab02-84b65f0bcac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:43.574263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e246e27-35f1-4228-ab02-84b65f0bcac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:43.577714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e246e27-35f1-4228-ab02-84b65f0bcac8 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:43.619600 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1488/3002] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:43 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:46.452500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cdb2f-0f4c-4580-ba50-4c1dedeff684 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:46.453170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cdb2f-0f4c-4580-ba50-4c1dedeff684 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:46.453364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cdb2f-0f4c-4580-ba50-4c1dedeff684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:46.473275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-750cdb2f-0f4c-4580-ba50-4c1dedeff684 None None] MFA Rules not processed for user `30652e6248664267895369366201816e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:46.474568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-750cdb2f-0f4c-4580-ba50-4c1dedeff684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:46.654287 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1515/3003] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:46 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:47.457737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:47.458382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:47.458566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:47.595726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] MFA Rules not processed for user `3d55f68c111b4a388351c18551dd43ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:47.609748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:47.840241 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1489/3004] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:47 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:47.954095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cdb2f-0f4c-4580-ba50-4c1dedeff684 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:48.038433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cdb2f-0f4c-4580-ba50-4c1dedeff684 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:48.094528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:48.095435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:48.096049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:48.096520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:48.132840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:48.138499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:48.193615 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1516/3005] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:47 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:50.378709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:50.380515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:50.657081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258b51-3a3b-41ce-889e-f3e495d7ab62 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:50.670617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:50.671801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:50.672447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:50.672988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] PATH_INFO: `/v3/users/9bf2eefd87de409785735fc802bc95ed` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:50.674996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf2eefd87de409785735fc802bc95ed)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:50.682407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:51.072504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf2eefd87de409785735fc802bc95ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:51.103903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf2eefd87de409785735fc802bc95ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:51.154918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf2eefd87de409785735fc802bc95ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:51.156961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf2eefd87de409785735fc802bc95ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:51.158704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf2eefd87de409785735fc802bc95ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:51.269756 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1490/3006] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:50 2021] DELETE /identity/v3/users/9bf2eefd87de409785735fc802bc95ed => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:51.446534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:51.448142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:51.802621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6df9-0b1d-40ef-915d-4c4c1e9e3e5f service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:51.989801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:51.997045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:51.997045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:51.997045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:52.018498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:52.198676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:52.204061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:52.252572 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1517/3007] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 806 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:54.132005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:54.134376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:54.151152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6edf0e-0b39-4f35-b692-f7ca5135cc47 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:54.158878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:54.159996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:54.160445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:54.160908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] PATH_INFO: `/v3/projects/bc19d38e80ce426fa6d268838d133f13` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:54.166073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc19d38e80ce426fa6d268838d133f13)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:54.168373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:54.334507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc19d38e80ce426fa6d268838d133f13', 'request_id': 'req-60e98a80-c053-4f70-8047-c0c5d8c016f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:54.347523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc19d38e80ce426fa6d268838d133f13', 'request_id': 'req-60e98a80-c053-4f70-8047-c0c5d8c016f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:54.491862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc19d38e80ce426fa6d268838d133f13', 'request_id': 'req-60e98a80-c053-4f70-8047-c0c5d8c016f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:54.504586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] The token cache is being invalidate because project bc19d38e80ce426fa6d268838d133f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:54.505598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:54.505598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:54.507419 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1491/3008] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:54 2021] DELETE /identity/v3/projects/bc19d38e80ce426fa6d268838d133f13 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:54.511361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:54.522685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a086901-00a6-4fa3-98a0-763026e3a9af service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:54.565040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:54.572766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:54.607827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:54.608717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:54.609970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:54.609970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] PATH_INFO: `/v3/users/6f5d83b0aa774ee497fb90b09daa459c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:54.610925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5d83b0aa774ee497fb90b09daa459c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:54.613134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:54.693537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98a80-c053-4f70-8047-c0c5d8c016f5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:54.698740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:54.699847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:54.700133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:54.700408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] PATH_INFO: `/v3/users/aa5e089e14854aec83cc6b1f9ca9fedc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:54.702726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5e089e14854aec83cc6b1f9ca9fedc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:54.707172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:54.976145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5d83b0aa774ee497fb90b09daa459c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:54.995574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5d83b0aa774ee497fb90b09daa459c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.017734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5d83b0aa774ee497fb90b09daa459c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.018360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5d83b0aa774ee497fb90b09daa459c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.027338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5e089e14854aec83cc6b1f9ca9fedc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.039802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5e089e14854aec83cc6b1f9ca9fedc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.053672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5e089e14854aec83cc6b1f9ca9fedc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.054421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5e089e14854aec83cc6b1f9ca9fedc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.055067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5e089e14854aec83cc6b1f9ca9fedc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.096576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2cdd0233-3e45-4374-848b-9eab84e11013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5d83b0aa774ee497fb90b09daa459c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:55.105096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1518/3009] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:54 2021] DELETE /identity/v3/users/6f5d83b0aa774ee497fb90b09daa459c => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:13:55.106589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:55.106884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:55.108102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:55.145255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:55.146472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:55.183557 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1492/3010] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:54 2021] DELETE /identity/v3/users/aa5e089e14854aec83cc6b1f9ca9fedc => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:55.240403 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1519/3011] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:13:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:55.408954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:55.412423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:55.580169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257f142-069a-408c-9174-1542f2459bfa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:55.586628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:55.587914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:55.588703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:55.590311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:55.696366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:55.697917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:55.708123 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1493/3012] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:13:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:55.723820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:55.730155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:55.795742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:55.797361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:55.974480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55edea8-0d2c-4e43-b346-21caba3936c5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:55.990179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:55.994016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:55.994422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:55.994557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b624f4-5829-489e-a677-df969de088d1 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:55.995675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] PATH_INFO: `/v3/projects/f149a077b12b44338d36531fe1dc3a6e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:56.001963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f149a077b12b44338d36531fe1dc3a6e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:56.004309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:56.012547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:56.013479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:56.013757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:56.014033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] PATH_INFO: `/v3/projects/e25e5a44bb7e4ef7a38e961e6203b72b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:56.017783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25e5a44bb7e4ef7a38e961e6203b72b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:56.022578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:56.196732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f149a077b12b44338d36531fe1dc3a6e', 'request_id': 'req-444447cc-42c3-4614-bef5-b8545ac34585'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.227452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'request_id': 'req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.238698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'request_id': 'req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.303361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f149a077b12b44338d36531fe1dc3a6e', 'request_id': 'req-444447cc-42c3-4614-bef5-b8545ac34585'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.315885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f149a077b12b44338d36531fe1dc3a6e', 'request_id': 'req-444447cc-42c3-4614-bef5-b8545ac34585'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.346803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] The token cache is being invalidate because project f149a077b12b44338d36531fe1dc3a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:56.347118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.349074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-444447cc-42c3-4614-bef5-b8545ac34585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.352147 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1520/3013] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:55 2021] DELETE /identity/v3/projects/f149a077b12b44338d36531fe1dc3a6e => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:56.365831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'request_id': 'req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.381890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1067236-b92b-47dd-b2da-c0c864868597 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:56.384760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1067236-b92b-47dd-b2da-c0c864868597 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:56.390292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1067236-b92b-47dd-b2da-c0c864868597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:56.390544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] The token cache is being invalidate because project e25e5a44bb7e4ef7a38e961e6203b72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:56.390544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.390544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.396705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1494/3014] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:55 2021] DELETE /identity/v3/projects/e25e5a44bb7e4ef7a38e961e6203b72b => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:56.398298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:56.400647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:56.422366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c1067236-b92b-47dd-b2da-c0c864868597 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:56.424834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c1067236-b92b-47dd-b2da-c0c864868597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:56.557896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e6c2-d6ee-420e-a6a3-d6223d87483d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:56.570850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:56.572270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:56.572552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:56.572829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] PATH_INFO: `/v3/users/5610a6a7a189428fad8ed6e25a0569ab` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:56.574320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5610a6a7a189428fad8ed6e25a0569ab)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:56.577050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:56.577624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1521/3015] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:56.589916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598271-1f8c-4113-9cdb-a9e9c1af9029 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:56.591513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598271-1f8c-4113-9cdb-a9e9c1af9029 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:56.591800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598271-1f8c-4113-9cdb-a9e9c1af9029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:56.644248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f7598271-1f8c-4113-9cdb-a9e9c1af9029 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:56.645635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f7598271-1f8c-4113-9cdb-a9e9c1af9029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:56.665468 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1522/3016] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:56.669009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7598271-1f8c-4113-9cdb-a9e9c1af9029 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:56.689185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7598271-1f8c-4113-9cdb-a9e9c1af9029 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:56.695496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:56.696183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:56.696468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:56.697879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:56.698922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:56.699306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:56.702470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:56.730510 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1523/3017] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:13:56.745100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:56.792955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896af42-f618-4fed-9062-9f7be81ff4d6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:56.800658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:56.801702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:56.802442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:56.802796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:56.803676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:56.806086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:56.892957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5610a6a7a189428fad8ed6e25a0569ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.910392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5610a6a7a189428fad8ed6e25a0569ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.935993 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1524/3018] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:56 2021] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:56.939102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:56.940656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5610a6a7a189428fad8ed6e25a0569ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.948172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5610a6a7a189428fad8ed6e25a0569ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:56.948172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5610a6a7a189428fad8ed6e25a0569ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:57.036188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e65507-582c-4115-8f99-c14ee08729fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:57.043947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:57.044868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:57.045107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:57.045385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:57.046139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:57.048614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:57.053790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1495/3019] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:13:56 2021] DELETE /identity/v3/users/5610a6a7a189428fad8ed6e25a0569ab => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:57.175160 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1525/3020] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:56 2021] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:57.176531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:57.178324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:57.326010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea0786-b9e5-4494-b557-b8b1e9d08bec admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:57.335958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:57.336719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:57.337031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:57.337301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:57.338224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:57.339855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:57.351735 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1496/3021] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:57 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:57.355394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:57.368619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183831-4c45-42e9-a398-a758fe3d890e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:57.375084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce795f83-f4fc-4a6c-92ca-5bad100bec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:57.375968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795f83-f4fc-4a6c-92ca-5bad100bec8a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:57.376663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795f83-f4fc-4a6c-92ca-5bad100bec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:57.377157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795f83-f4fc-4a6c-92ca-5bad100bec8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:57.378262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce795f83-f4fc-4a6c-92ca-5bad100bec8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:57.380197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce795f83-f4fc-4a6c-92ca-5bad100bec8a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:57.394580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1526/3022] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:57 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:57.398521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:57.409740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db602717-adfd-40fd-8046-82c9344ee9fb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:57.416177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:57.417698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:57.418677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:57.419242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] PATH_INFO: `/v3/projects/797eea783876402eb115d387de456029/users/764713a646504fc5be7d4461fd503aaa/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:57.442015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] RBAC: Authorizing `identity:create_grant(project_id=797eea783876402eb115d387de456029, user_id=764713a646504fc5be7d4461fd503aaa, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:57.445203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:57.574460 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1497/3023] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:57 2021] PUT /identity/v3/projects/797eea783876402eb115d387de456029/users/764713a646504fc5be7d4461fd503aaa/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:57.584386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d8c8-f4e1-4fc4-94c5-d8b4d699ca9b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:57.584962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d8c8-f4e1-4fc4-94c5-d8b4d699ca9b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:57.585485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d8c8-f4e1-4fc4-94c5-d8b4d699ca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:57.603883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:57.606575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:57.653613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8352d8c8-f4e1-4fc4-94c5-d8b4d699ca9b None None] MFA Rules not processed for user `764713a646504fc5be7d4461fd503aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:57.655113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8352d8c8-f4e1-4fc4-94c5-d8b4d699ca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:57.750645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46e5ce-a537-4870-8f73-1f32c3b3893c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:57.767235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:57.769287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:57.769287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:57.769513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] PATH_INFO: `/v3/projects/d048456167bb496da920eeaed310f9be` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:57.771247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d048456167bb496da920eeaed310f9be)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:57.774381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:57.845629 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1527/3024] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:57 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:57.863163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352d8c8-f4e1-4fc4-94c5-d8b4d699ca9b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:57.891471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352d8c8-f4e1-4fc4-94c5-d8b4d699ca9b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:57.894806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:57.896500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:57.897800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:57.898178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:57.899711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:57.901801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:57.968429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd048456167bb496da920eeaed310f9be', 'request_id': 'req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:57.984738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd048456167bb496da920eeaed310f9be', 'request_id': 'req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:58.001345 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1528/3025] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:57 2021] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:58.002297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.058496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd048456167bb496da920eeaed310f9be', 'request_id': 'req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:58.090867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] The token cache is being invalidate because project d048456167bb496da920eeaed310f9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:13:58.092472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:58.104047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a5a6885c-ea80-4bb3-9211-d8e4e43bcc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:13:58.116598 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1498/3026] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:57 2021] DELETE /identity/v3/projects/d048456167bb496da920eeaed310f9be => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:13:58.129190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b67b4-6abf-4294-9a79-f1900a3eb46d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.131757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b67b4-6abf-4294-9a79-f1900a3eb46d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.132806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b67b4-6abf-4294-9a79-f1900a3eb46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.197363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7c1b67b4-6abf-4294-9a79-f1900a3eb46d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:58.198565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7c1b67b4-6abf-4294-9a79-f1900a3eb46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:58.248485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e16e67-c27f-4a9f-8534-78bf40bf7133 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.269725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:58.270414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.270746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.271024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.273484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:58.276293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:58.342325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1499/3027] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:58.347523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491d3e-865c-4ed5-b2a3-f875ea74d1ac None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.350307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491d3e-865c-4ed5-b2a3-f875ea74d1ac None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.350755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c491d3e-865c-4ed5-b2a3-f875ea74d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.378141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8c491d3e-865c-4ed5-b2a3-f875ea74d1ac None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:58.379665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8c491d3e-865c-4ed5-b2a3-f875ea74d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:58.394152 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1500/3028] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:58.398404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491d3e-865c-4ed5-b2a3-f875ea74d1ac None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.416529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1529/3029] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:58 2021] POST /identity/v3/users => generated 300 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:13:58.417900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.422475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:58.430655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c491d3e-865c-4ed5-b2a3-f875ea74d1ac None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.443047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:58.444140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.444423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.444753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.445521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:13:58.448148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:58.451370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bed4fb-188e-421b-afbb-6a1cfc90d793 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.453652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:58.468088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:58.468776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.469090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.469364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.470267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:58.473862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:58.497975 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1501/3030] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:13:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:13:58.499913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.515549 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1530/3031] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:58.516498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.519903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce64c-d899-423b-847e-2582bd6b9882 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.531729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:58.533268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.533554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.533830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.534535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:58.539061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd281-0e5b-4dd0-ac9f-fcf6dbdeb485 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.540308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:58.544907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:58.545849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.546132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.546410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] PATH_INFO: `/v3/projects/c73c6b06dc374011854627b95da05e17/users/64b20bdabb28458d8c279ff60d7a6225/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.571914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73c6b06dc374011854627b95da05e17, user_id=64b20bdabb28458d8c279ff60d7a6225, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:58.581475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:58.700003 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1502/3032] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:58 2021] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:13:58.704617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.729551 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1531/3033] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:58 2021] PUT /identity/v3/projects/c73c6b06dc374011854627b95da05e17/users/64b20bdabb28458d8c279ff60d7a6225/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:58.737044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.826331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2bc78-f863-4a8a-b254-06ed4d3f3f6c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.881147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb7712-5903-4f84-9523-48f6e9b899f9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.888475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:58.889881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:58.890270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:58.890608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:58.893350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:58.893475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:58.923437 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1532/3034] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:58.925414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:58.977866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8277c34-5246-4a46-a355-c244e27cad51 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:58.997786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeed6f9-c0cb-4209-9e5c-199e83f024ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:59.001823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeed6f9-c0cb-4209-9e5c-199e83f024ff admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.003001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeed6f9-c0cb-4209-9e5c-199e83f024ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.003931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeed6f9-c0cb-4209-9e5c-199e83f024ff admin admin] PATH_INFO: `/v3/projects/c73c6b06dc374011854627b95da05e17/users/64b20bdabb28458d8c279ff60d7a6225/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.013678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeed6f9-c0cb-4209-9e5c-199e83f024ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73c6b06dc374011854627b95da05e17, user_id=64b20bdabb28458d8c279ff60d7a6225, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:59.017301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:59.018534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.019606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.019890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.020607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:59.022548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:59.029676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeed6f9-c0cb-4209-9e5c-199e83f024ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:59.069447 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1533/3035] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:58 2021] PUT /identity/v3/projects/c73c6b06dc374011854627b95da05e17/users/64b20bdabb28458d8c279ff60d7a6225/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:13:59.081400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98086c-91c0-4bb9-ae0e-01226a279706 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.081686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98086c-91c0-4bb9-ae0e-01226a279706 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.081966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98086c-91c0-4bb9-ae0e-01226a279706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.141065 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1503/3036] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:13:58 2021] POST /identity/v3/users => generated 294 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:13:59.151015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:59.165927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ae98086c-91c0-4bb9-ae0e-01226a279706 None None] MFA Rules not processed for user `64b20bdabb28458d8c279ff60d7a6225`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:59.167101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae98086c-91c0-4bb9-ae0e-01226a279706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:59.169406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880af3dd-4b01-443a-ba4c-8dd891802ce3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:59.313900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:59.314578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.314861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.315135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.315876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:59.319165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:59.353492 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1504/3038] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:59 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:59.354486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:59.354950 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1534/3038] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:59 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:59.365629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aaa8f-43ee-4a81-a61f-763f71cdca20 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:59.373036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbdb0-23dc-4ae1-8259-20755a74b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:59.373785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbdb0-23dc-4ae1-8259-20755a74b638 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.374370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbdb0-23dc-4ae1-8259-20755a74b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.375639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbdb0-23dc-4ae1-8259-20755a74b638 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.376397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbdb0-23dc-4ae1-8259-20755a74b638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:59.378583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbdb0-23dc-4ae1-8259-20755a74b638 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:59.390713 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1505/3039] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:13:59 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:13:59.394959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98086c-91c0-4bb9-ae0e-01226a279706 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:59.407904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98086c-91c0-4bb9-ae0e-01226a279706 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:59.413490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:59.414623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.415285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.415725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] PATH_INFO: `/v3/projects/646e75ab8f934ab7b7d2fab01bb800d9/users/c59c9265b73d4f778c27de407dce255f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.436101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646e75ab8f934ab7b7d2fab01bb800d9, user_id=c59c9265b73d4f778c27de407dce255f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:59.442403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:13:59.534539 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1535/3040] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:13:59 2021] PUT /identity/v3/projects/646e75ab8f934ab7b7d2fab01bb800d9/users/c59c9265b73d4f778c27de407dce255f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:13:59.545542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7400-f8e7-439c-bc79-9119c8ca4d64 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.545839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7400-f8e7-439c-bc79-9119c8ca4d64 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.553680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7400-f8e7-439c-bc79-9119c8ca4d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.609712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ac2c7400-f8e7-439c-bc79-9119c8ca4d64 None None] MFA Rules not processed for user `c59c9265b73d4f778c27de407dce255f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:13:59.611005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac2c7400-f8e7-439c-bc79-9119c8ca4d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:59.684555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:59.687509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:13:59.732508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1506/3041] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:13:59 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:13:59.735681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c7400-f8e7-439c-bc79-9119c8ca4d64 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:13:59.832561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0871556-61f6-4000-a342-af0d118dee12 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:59.862958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:59.863690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.863968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.864310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.926250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c7400-f8e7-439c-bc79-9119c8ca4d64 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:13:59.937159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:13:59.938097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:13:59.942410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:13:59.942968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:13:59.943883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:13:59.946668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:00.035170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:00.038201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:00.059419 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1536/3042] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:13:59 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:00.124761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:00.132166 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1507/3043] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:13:59 2021] POST /identity/v3/projects => generated 389 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:00.150179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9b1f-56fc-4c64-84d9-24f1811b0eb7 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:00.262863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:00.263963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:00.264354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:00.264738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:00.265990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:00.268163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:00.425751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:00.435304 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1537/3044] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:14:00 2021] POST /identity/v3/users => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:00.441181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5048bd4-207f-419e-81bf-fae6818e2bf3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:00.447275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:00.448561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:00.448964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:00.449876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:00.450883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:00.452707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:00.468651 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1508/3045] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:00 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:00.473353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:00.486912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43798ab-c3a3-4998-9c35-d5b52e869221 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:00.492952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:00.494761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:00.494761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:00.494761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] PATH_INFO: `/v3/projects/6d97041cde334198968e1ebc1a4a9834/users/ea206b9760fc4cc89aa44234b9891f04/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:00.550742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d97041cde334198968e1ebc1a4a9834, user_id=ea206b9760fc4cc89aa44234b9891f04, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:00.562964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:00.719204 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1538/3046] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:00 2021] PUT /identity/v3/projects/6d97041cde334198968e1ebc1a4a9834/users/ea206b9760fc4cc89aa44234b9891f04/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:00.721329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:00.737164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64b67-4e47-438d-956b-70ec25e163b7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:00.841932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca571ae-a7e3-4970-89de-9af8bebbba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:00.842909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca571ae-a7e3-4970-89de-9af8bebbba4e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:00.843311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca571ae-a7e3-4970-89de-9af8bebbba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:00.843685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca571ae-a7e3-4970-89de-9af8bebbba4e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:00.844549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca571ae-a7e3-4970-89de-9af8bebbba4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:00.846361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca571ae-a7e3-4970-89de-9af8bebbba4e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:00.873914 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1509/3047] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:00 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:14:00.876281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:00.889866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec7c1f-280e-4a8e-b34a-6304d69e32d2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:00.896366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf304be1-c8f3-4b25-9f15-7063df56385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:00.897699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304be1-c8f3-4b25-9f15-7063df56385a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:00.898135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304be1-c8f3-4b25-9f15-7063df56385a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:00.898571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304be1-c8f3-4b25-9f15-7063df56385a admin admin] PATH_INFO: `/v3/projects/6d97041cde334198968e1ebc1a4a9834/users/ea206b9760fc4cc89aa44234b9891f04/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:00.901186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf304be1-c8f3-4b25-9f15-7063df56385a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d97041cde334198968e1ebc1a4a9834, user_id=ea206b9760fc4cc89aa44234b9891f04, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:00.904647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf304be1-c8f3-4b25-9f15-7063df56385a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:00.932474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684641-01ce-410c-860a-41da78ee04d1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:00.933064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684641-01ce-410c-860a-41da78ee04d1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:00.933497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf684641-01ce-410c-860a-41da78ee04d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:00.935035 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1539/3048] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:00 2021] PUT /identity/v3/projects/6d97041cde334198968e1ebc1a4a9834/users/ea206b9760fc4cc89aa44234b9891f04/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:00.982167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bf684641-01ce-410c-860a-41da78ee04d1 None None] MFA Rules not processed for user `ea206b9760fc4cc89aa44234b9891f04`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:00.984395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bf684641-01ce-410c-860a-41da78ee04d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:01.099334 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1510/3049] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:00 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:01.112006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b1ab-57ba-4edd-82b4-e4cf106d8aed None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:01.112580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b1ab-57ba-4edd-82b4-e4cf106d8aed None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:01.112580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b1ab-57ba-4edd-82b4-e4cf106d8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:01.135140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6471b1ab-57ba-4edd-82b4-e4cf106d8aed None None] MFA Rules not processed for user `c59c9265b73d4f778c27de407dce255f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:01.136218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6471b1ab-57ba-4edd-82b4-e4cf106d8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:01.253967 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1540/3050] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:01 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:01.278660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790885a5-c397-4e68-ba48-2734149b4992 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:01.278660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790885a5-c397-4e68-ba48-2734149b4992 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:01.278660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790885a5-c397-4e68-ba48-2734149b4992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:01.346654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-790885a5-c397-4e68-ba48-2734149b4992 None None] MFA Rules not processed for user `3d55f68c111b4a388351c18551dd43ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:01.348369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-790885a5-c397-4e68-ba48-2734149b4992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:01.438250 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1511/3051] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:01 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:01.938913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471b1ab-57ba-4edd-82b4-e4cf106d8aed None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:02.048546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471b1ab-57ba-4edd-82b4-e4cf106d8aed None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:02.227357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d2511-4f56-4a6e-a0e6-1b3b0fedd6c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:02.227357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d2511-4f56-4a6e-a0e6-1b3b0fedd6c3 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:02.227357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d2511-4f56-4a6e-a0e6-1b3b0fedd6c3 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:02.227357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d2511-4f56-4a6e-a0e6-1b3b0fedd6c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:02.230808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d2511-4f56-4a6e-a0e6-1b3b0fedd6c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:02.230808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d2511-4f56-4a6e-a0e6-1b3b0fedd6c3 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:02.230808 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1541/3052] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:01 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:05.913688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790885a5-c397-4e68-ba48-2734149b4992 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:06.045128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790885a5-c397-4e68-ba48-2734149b4992 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:06.045454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:06.046369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:06.046650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:06.046922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] PATH_INFO: `/v3/users/764713a646504fc5be7d4461fd503aaa` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:06.048201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764713a646504fc5be7d4461fd503aaa)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:06.050413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:06.459313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764713a646504fc5be7d4461fd503aaa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:06.478746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764713a646504fc5be7d4461fd503aaa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:06.528259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764713a646504fc5be7d4461fd503aaa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:06.528849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764713a646504fc5be7d4461fd503aaa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:06.529645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764713a646504fc5be7d4461fd503aaa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:06.641599 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1512/3053] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:14:05 2021] DELETE /identity/v3/users/764713a646504fc5be7d4461fd503aaa => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:06.645928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:06.646444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:06.646544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:06.699734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:06.702057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:06.835780 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1542/3054] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:06.845795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:06.853066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:07.001896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37949f-9501-41d9-b89c-583558121f77 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:07.007138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:07.008035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:07.008274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:07.008556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:07.025237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:07.026641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:07.049530 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1513/3055] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:08.214341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:08.217338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:08.252433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dc8ad-ff17-4ddd-bf11-fb083c0cd5ad None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:08.266340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:08.276065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:08.276065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:08.276065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] PATH_INFO: `/v3/projects/797eea783876402eb115d387de456029` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:08.276065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] RBAC: Authorizing `identity:delete_project(project_id=797eea783876402eb115d387de456029)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:08.278049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:08.459647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797eea783876402eb115d387de456029', 'request_id': 'req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:08.546368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797eea783876402eb115d387de456029', 'request_id': 'req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:08.553253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797eea783876402eb115d387de456029', 'request_id': 'req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:08.585301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] The token cache is being invalidate because project 797eea783876402eb115d387de456029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:14:08.585913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:08.590563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:08.594318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1543/3056] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:14:08 2021] DELETE /identity/v3/projects/797eea783876402eb115d387de456029 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:08.598111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:08.640849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7534b0-e6e2-499e-a89f-0d0690576446 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:08.832171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:08.833095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:08.833375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:08.833655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] PATH_INFO: `/v3/users/64b20bdabb28458d8c279ff60d7a6225` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:08.837986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b20bdabb28458d8c279ff60d7a6225)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:08.840845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:09.070230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b20bdabb28458d8c279ff60d7a6225'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:09.118613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b20bdabb28458d8c279ff60d7a6225'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:09.150053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b20bdabb28458d8c279ff60d7a6225'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:09.151042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b20bdabb28458d8c279ff60d7a6225'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:09.151837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b20bdabb28458d8c279ff60d7a6225'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:09.236164 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1514/3057] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:14:08 2021] DELETE /identity/v3/users/64b20bdabb28458d8c279ff60d7a6225 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:14:10.249112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:10.251195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:10.388227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67fdaf-1129-4af7-a1a7-3e36c1b5210f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:10.500803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095da4b6-cc30-4c4d-adce-06e9d973876b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:10.501885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095da4b6-cc30-4c4d-adce-06e9d973876b service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:10.502335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095da4b6-cc30-4c4d-adce-06e9d973876b service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:10.503007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095da4b6-cc30-4c4d-adce-06e9d973876b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:10.505052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-095da4b6-cc30-4c4d-adce-06e9d973876b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:10.616193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095da4b6-cc30-4c4d-adce-06e9d973876b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:10.623000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095da4b6-cc30-4c4d-adce-06e9d973876b service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:10.638613 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1544/3058] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:10 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:11.370079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:11.371198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:11.587738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417c81-039f-44ab-99a1-e2b76f1da52a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:11.600485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:11.603369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:11.603834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:11.604684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] PATH_INFO: `/v3/projects/c73c6b06dc374011854627b95da05e17` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:11.608772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73c6b06dc374011854627b95da05e17)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:11.613885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:11.820374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73c6b06dc374011854627b95da05e17', 'request_id': 'req-62151be2-7c0a-47cd-956c-a31f3198c333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:11.835678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73c6b06dc374011854627b95da05e17', 'request_id': 'req-62151be2-7c0a-47cd-956c-a31f3198c333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:11.912308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73c6b06dc374011854627b95da05e17', 'request_id': 'req-62151be2-7c0a-47cd-956c-a31f3198c333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:11.938693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] The token cache is being invalidate because project c73c6b06dc374011854627b95da05e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:14:11.938693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:11.938693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-62151be2-7c0a-47cd-956c-a31f3198c333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:11.942610 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1515/3059] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:14:11 2021] DELETE /identity/v3/projects/c73c6b06dc374011854627b95da05e17 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:11.948441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee723-5fe2-47fe-bd86-c7c162274061 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:11.950765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee723-5fe2-47fe-bd86-c7c162274061 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:11.951255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee723-5fe2-47fe-bd86-c7c162274061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:11.981237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7c4ee723-5fe2-47fe-bd86-c7c162274061 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:11.982870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7c4ee723-5fe2-47fe-bd86-c7c162274061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:12.089950 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1545/3060] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:14:12.097887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90d0d-9562-40f0-84c6-65c06a560d3c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.098851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90d0d-9562-40f0-84c6-65c06a560d3c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.099225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90d0d-9562-40f0-84c6-65c06a560d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.123054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5ba90d0d-9562-40f0-84c6-65c06a560d3c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:12.125371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5ba90d0d-9562-40f0-84c6-65c06a560d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:12.142712 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1516/3061] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:14:12.143605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee723-5fe2-47fe-bd86-c7c162274061 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:12.167210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee723-5fe2-47fe-bd86-c7c162274061 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:12.173838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:12.174929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.175422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.176163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.177251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:14:12.177929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:12.179914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:12.209672 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1546/3062] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:14:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:14:12.213741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba90d0d-9562-40f0-84c6-65c06a560d3c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:12.226073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba90d0d-9562-40f0-84c6-65c06a560d3c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:12.233375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:12.234337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.234832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.235556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.237160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:12.241887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:12.345575 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1517/3063] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:14:12 2021] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:12.349796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:12.367193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293994d8-4aed-4cb0-bba8-c25426f12af5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:12.468491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:12.469712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.470207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.470705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.471763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:12.474006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:12.570424 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1547/3064] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:14:12 2021] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:12.573503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:12.590069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e917c7-a997-4e75-8af4-6833f241bf34 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:12.603233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:12.604457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.605517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.606002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.607023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:12.609121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:12.627716 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1518/3065] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:12.631507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:12.645452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d205b50-edb0-478e-a518-5c1085a5e199 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:12.651947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dbbb3-f73a-47c3-8e25-43261ff3ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:12.653751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dbbb3-f73a-47c3-8e25-43261ff3ffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.658518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dbbb3-f73a-47c3-8e25-43261ff3ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.658518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dbbb3-f73a-47c3-8e25-43261ff3ffd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.658518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dbbb3-f73a-47c3-8e25-43261ff3ffd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:12.662297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dbbb3-f73a-47c3-8e25-43261ff3ffd1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:12.697124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:12.699941 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1548/3066] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:12 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:12.709391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fb880-4897-44c2-bcb7-7723ded1452b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:12.728038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c8439-7f6c-48c0-8bf5-aced057a4489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:12.729296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8439-7f6c-48c0-8bf5-aced057a4489 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.729755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8439-7f6c-48c0-8bf5-aced057a4489 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.730882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8439-7f6c-48c0-8bf5-aced057a4489 admin admin] PATH_INFO: `/v3/projects/c455cc0f858a452bb0b60cf0af0c453c/users/e79788d5030a44b9b522c73791f77233/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.772535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c8439-7f6c-48c0-8bf5-aced057a4489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c455cc0f858a452bb0b60cf0af0c453c, user_id=e79788d5030a44b9b522c73791f77233, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:12.775230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c8439-7f6c-48c0-8bf5-aced057a4489 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:12.882060 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1519/3067] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:12 2021] PUT /identity/v3/projects/c455cc0f858a452bb0b60cf0af0c453c/users/e79788d5030a44b9b522c73791f77233/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:14:12.891803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4603-ed75-418d-abbe-722539ffe2a0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:12.891987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4603-ed75-418d-abbe-722539ffe2a0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:12.892272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a4603-ed75-418d-abbe-722539ffe2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:12.977511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f53a4603-ed75-418d-abbe-722539ffe2a0 None None] MFA Rules not processed for user `e79788d5030a44b9b522c73791f77233`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:12.978571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f53a4603-ed75-418d-abbe-722539ffe2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:13.147822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58479e-3387-4cd6-8294-ca15499c78f6 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:13.148487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58479e-3387-4cd6-8294-ca15499c78f6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:13.149089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58479e-3387-4cd6-8294-ca15499c78f6 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:13.151602 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1520/3068] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:14:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:14:13.192292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:13.192772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:13.193290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:13.251478 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1549/3069] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:12 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:13.256351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a4603-ed75-418d-abbe-722539ffe2a0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:13.260322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:13.263436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:13.448535 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1521/3070] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:14:13 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:13.502667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:13.504386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:13.518926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a4603-ed75-418d-abbe-722539ffe2a0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:13.537820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9226d-be10-430e-a07b-b99edd2241ef None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:13.541856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:13.545369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:13.546294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:13.547115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:13.549605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:13.550315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:13.552191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:13.552568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:13.552962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:13.558704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:13.578372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:13.581173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:13.603386 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1522/3071] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:14:13.761934 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1550/3072] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:14:13 2021] POST /identity/v3/projects => generated 395 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:13.766041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:13.781785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db8479-c81a-4e18-b0e7-c0a7192a30d9 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:13.875259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:13.876129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:13.876504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:13.876895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:13.877698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:13.879923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:14.038548 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1523/3073] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:14:13 2021] POST /identity/v3/users => generated 304 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:14.040375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:14.109091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfcc07-9dec-4ed0-be2f-b41028378823 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:14.116824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:14.117931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:14.118934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:14.119485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:14.121063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:14.124310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:14.143812 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1551/3074] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:14 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:14.148151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:14.162900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7d648-c62f-40f7-a5ef-2fce13bc8094 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:14.176271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:14.177770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:14.177770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:14.184048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] PATH_INFO: `/v3/projects/bd6e775c3a324d7983ac405ab625923c/users/1f3f4bc1d20b4089935e993a421f520c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:14.204443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6e775c3a324d7983ac405ab625923c, user_id=1f3f4bc1d20b4089935e993a421f520c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:14.210315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:14.607893 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1524/3075] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:14 2021] PUT /identity/v3/projects/bd6e775c3a324d7983ac405ab625923c/users/1f3f4bc1d20b4089935e993a421f520c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:14:14.611881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:14.628104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39300135-82e2-478e-af8d-54b847991d1f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:14.712486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18c476-a6e7-4072-ae2f-261ef295ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:14.713348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c476-a6e7-4072-ae2f-261ef295ca46 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:14.713700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c476-a6e7-4072-ae2f-261ef295ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:14.714039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18c476-a6e7-4072-ae2f-261ef295ca46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:14.714923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18c476-a6e7-4072-ae2f-261ef295ca46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:14.716819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18c476-a6e7-4072-ae2f-261ef295ca46 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:14.737679 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1552/3076] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:14 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:14.741590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:14.756167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa4a36-8179-4bb3-8ccc-e9eafede0e8a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:14.771122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:14.772359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:14.772801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:14.773396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] PATH_INFO: `/v3/projects/bd6e775c3a324d7983ac405ab625923c/users/1f3f4bc1d20b4089935e993a421f520c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:14.777311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6e775c3a324d7983ac405ab625923c, user_id=1f3f4bc1d20b4089935e993a421f520c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:14.781124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:14.800593 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1525/3077] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:14 2021] PUT /identity/v3/projects/bd6e775c3a324d7983ac405ab625923c/users/1f3f4bc1d20b4089935e993a421f520c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:14.809698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e7c7-a77b-4f8e-8182-9a861c68f724 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:14.814381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e7c7-a77b-4f8e-8182-9a861c68f724 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:14.814381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e7c7-a77b-4f8e-8182-9a861c68f724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:14.881730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8fc6e7c7-a77b-4f8e-8182-9a861c68f724 None None] MFA Rules not processed for user `1f3f4bc1d20b4089935e993a421f520c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:14.884837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8fc6e7c7-a77b-4f8e-8182-9a861c68f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:14.941559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:14.943648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:15.086229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ab2f4-0a14-4f15-bfcc-64cabd646124 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:15.097046 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1553/3078] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:14 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:15.100181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b449-1b34-41f5-9993-212b44e0e0c8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:15.100736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b449-1b34-41f5-9993-212b44e0e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:15.101476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b449-1b34-41f5-9993-212b44e0e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:15.108338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:15.109047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:15.109335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:15.109611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:15.111561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:15.123293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:15.125179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:15.139689 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1526/3079] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:15.154632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8570b449-1b34-41f5-9993-212b44e0e0c8 None None] MFA Rules not processed for user `e79788d5030a44b9b522c73791f77233`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:15.156409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8570b449-1b34-41f5-9993-212b44e0e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:15.242307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1554/3080] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:15 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:15.272194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:15.275749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:15.364025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8ab7-6557-4020-9983-a402f9123ce1 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:15.372065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e53dea-65bf-47e6-9587-b21c77e43748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:15.372841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e53dea-65bf-47e6-9587-b21c77e43748 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:15.375813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e53dea-65bf-47e6-9587-b21c77e43748 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:15.375813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e53dea-65bf-47e6-9587-b21c77e43748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:15.389794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e53dea-65bf-47e6-9587-b21c77e43748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:15.391537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e53dea-65bf-47e6-9587-b21c77e43748 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:15.415440 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1527/3081] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:15 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:15.612641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7d92a-9d2b-4bb3-b521-5ae1e3bad790 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:15.613139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7d92a-9d2b-4bb3-b521-5ae1e3bad790 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:15.613645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7d92a-9d2b-4bb3-b521-5ae1e3bad790 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:15.617007 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1555/3082] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:14:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:14:15.625103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0daf-aee5-4b3a-9980-83813eb939a0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:15.625103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0daf-aee5-4b3a-9980-83813eb939a0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:15.625103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d0daf-aee5-4b3a-9980-83813eb939a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:15.682917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-db0d0daf-aee5-4b3a-9980-83813eb939a0 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:15.682917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-db0d0daf-aee5-4b3a-9980-83813eb939a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:15.771748 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1528/3083] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:14:15 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:15.799901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7d92a-9d2b-4bb3-b521-5ae1e3bad790 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:15.815803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7d92a-9d2b-4bb3-b521-5ae1e3bad790 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:15.827503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:15.828252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:15.828610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:15.828916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:15.843097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:15.844780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:15.872005 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1556/3084] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:16.324755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8363c-76a3-4590-9a14-d8719c5a87d7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:16.325204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8363c-76a3-4590-9a14-d8719c5a87d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:16.325577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8363c-76a3-4590-9a14-d8719c5a87d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:16.386993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cdc8363c-76a3-4590-9a14-d8719c5a87d7 None None] MFA Rules not processed for user `e3cb179749ef4bc786cc3059f72734f8`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:16.389661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cdc8363c-76a3-4590-9a14-d8719c5a87d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:16.486676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1529/3085] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:16 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:16.628123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:16.631440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:16.649171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05926155-a0f9-4f2a-932e-2d99b2a3f119 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:16.656376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21c3f2-0fd3-45bc-be12-6ee490dc8b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:16.658510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21c3f2-0fd3-45bc-be12-6ee490dc8b76 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:16.660120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21c3f2-0fd3-45bc-be12-6ee490dc8b76 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:16.660120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21c3f2-0fd3-45bc-be12-6ee490dc8b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:16.661286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cb21c3f2-0fd3-45bc-be12-6ee490dc8b76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:16.678686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21c3f2-0fd3-45bc-be12-6ee490dc8b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:16.685593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21c3f2-0fd3-45bc-be12-6ee490dc8b76 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:16.692196 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1557/3086] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:16 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:18.521157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:18.522367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:18.523546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:18.564486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] MFA Rules not processed for user `6015b6dc2cbd4171a690602866d50ace`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:18.565788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:18.654446 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1530/3087] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:22.058709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628681c3-0aeb-4b33-89c9-1d76682933ee None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:22.059243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628681c3-0aeb-4b33-89c9-1d76682933ee None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:22.059243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628681c3-0aeb-4b33-89c9-1d76682933ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:22.093095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-628681c3-0aeb-4b33-89c9-1d76682933ee None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:22.097388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-628681c3-0aeb-4b33-89c9-1d76682933ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:22.170824 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1558/3088] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:14:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:22.188180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:22.188180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:22.296591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd737ab-8a1f-42e2-97ab-97b3f1e7fe94 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:22.304213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e07b0-237f-4706-b4a2-bbdbb295f088 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:22.306002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e07b0-237f-4706-b4a2-bbdbb295f088 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:22.306548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e07b0-237f-4706-b4a2-bbdbb295f088 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:22.307178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e07b0-237f-4706-b4a2-bbdbb295f088 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:22.322015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e07b0-237f-4706-b4a2-bbdbb295f088 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:22.325674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e07b0-237f-4706-b4a2-bbdbb295f088 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:22.341208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1531/3089] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:14:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:24.414790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628681c3-0aeb-4b33-89c9-1d76682933ee None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:24.438184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628681c3-0aeb-4b33-89c9-1d76682933ee None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:24.453482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:24.454895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:24.455256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:24.455533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:24.461551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:24.611670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:24.613323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:24.645201 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1559/3090] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:24 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:30.826303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf0b6-5398-40eb-8b36-f67d610fc82c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:30.826779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf0b6-5398-40eb-8b36-f67d610fc82c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:30.827284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf0b6-5398-40eb-8b36-f67d610fc82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:30.850551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-757cf0b6-5398-40eb-8b36-f67d610fc82c None None] MFA Rules not processed for user `c59c9265b73d4f778c27de407dce255f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:30.851762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-757cf0b6-5398-40eb-8b36-f67d610fc82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:30.945259 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1532/3091] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:30 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:14:38.665003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:38.666609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:38.732984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d3ab-948e-417a-b760-686401e0fb70 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:38.737888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:38.738770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:38.739055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:38.739330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] PATH_INFO: `/v3/users/d5e4a505ed3847588a7f577f2e607afd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:38.740526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e4a505ed3847588a7f577f2e607afd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:38.743056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:39.114173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e4a505ed3847588a7f577f2e607afd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:39.122354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e4a505ed3847588a7f577f2e607afd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:39.148690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e4a505ed3847588a7f577f2e607afd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:39.148690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e4a505ed3847588a7f577f2e607afd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:39.747317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d2d5b5-9d7c-4799-b3df-313af46bda76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e4a505ed3847588a7f577f2e607afd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:39.753846 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1560/3092] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:14:38 2021] DELETE /identity/v3/users/d5e4a505ed3847588a7f577f2e607afd => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:40.103543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cf0b6-5398-40eb-8b36-f67d610fc82c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:40.121819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cf0b6-5398-40eb-8b36-f67d610fc82c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:40.186567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:40.188250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:40.188549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:40.188831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] PATH_INFO: `/v3/projects/c86857b4629c4cdbbd6a4664d499fb87` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:40.192203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86857b4629c4cdbbd6a4664d499fb87)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:40.194268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:40.337825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86857b4629c4cdbbd6a4664d499fb87', 'request_id': 'req-8e82e2d0-a797-42e0-8308-bd83f217616b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:40.345198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86857b4629c4cdbbd6a4664d499fb87', 'request_id': 'req-8e82e2d0-a797-42e0-8308-bd83f217616b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:40.422127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86857b4629c4cdbbd6a4664d499fb87', 'request_id': 'req-8e82e2d0-a797-42e0-8308-bd83f217616b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:40.434347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] The token cache is being invalidate because project c86857b4629c4cdbbd6a4664d499fb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:14:40.434720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:40.435878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e82e2d0-a797-42e0-8308-bd83f217616b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:40.437689 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1533/3093] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:14:40 2021] DELETE /identity/v3/projects/c86857b4629c4cdbbd6a4664d499fb87 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:40.448057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191674b-65f8-49ec-bcea-2bb4a9218902 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:40.448057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191674b-65f8-49ec-bcea-2bb4a9218902 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:40.448057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191674b-65f8-49ec-bcea-2bb4a9218902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:40.464774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3191674b-65f8-49ec-bcea-2bb4a9218902 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:40.466250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3191674b-65f8-49ec-bcea-2bb4a9218902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:40.541922 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1561/3094] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:40.550082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867efa4c-1828-483c-8520-eb08613fddba None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:40.550586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867efa4c-1828-483c-8520-eb08613fddba None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:40.550861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867efa4c-1828-483c-8520-eb08613fddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:40.571443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-867efa4c-1828-483c-8520-eb08613fddba None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:40.573393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-867efa4c-1828-483c-8520-eb08613fddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:40.581514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1534/3095] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:40.585902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191674b-65f8-49ec-bcea-2bb4a9218902 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:40.596920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191674b-65f8-49ec-bcea-2bb4a9218902 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:40.601850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:40.602527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:40.603172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:40.603693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:40.604499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:14:40.604952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:40.608546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:40.620305 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1562/3096] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:14:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:14:40.624620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867efa4c-1828-483c-8520-eb08613fddba None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:40.634367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867efa4c-1828-483c-8520-eb08613fddba None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:40.640061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:40.640723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:40.641033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:40.641307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:40.641999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:40.643978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:40.784223 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1535/3097] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:14:40 2021] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:40.789054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:40.800953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53f48-3452-4c09-b7b6-003d47bcdf9c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:40.864329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:40.865192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:40.865483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:40.865757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:40.866454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:40.868369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:40.957307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1563/3098] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:14:40 2021] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:40.959580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:40.973380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff182-6479-4f94-960d-ed2dc7ecc6b5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:40.981542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:40.985117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:40.985117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:40.985117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:40.985117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:40.986153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:41.004930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:41.017342 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1536/3099] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:41.020574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f1b94-ebb2-4e10-a608-ba0bd25c4625 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:41.026785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaefed-03d8-4248-8f1d-a14905c30b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:41.027597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaefed-03d8-4248-8f1d-a14905c30b27 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:41.032377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaefed-03d8-4248-8f1d-a14905c30b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:41.032377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaefed-03d8-4248-8f1d-a14905c30b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:41.032377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaefed-03d8-4248-8f1d-a14905c30b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:41.032377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaefed-03d8-4248-8f1d-a14905c30b27 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:41.043687 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1564/3100] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:41 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:14:41.047717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:41.060504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434c4e-2db6-4e30-9a17-51f37bd32777 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:41.068178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:41.069106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:41.069393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:41.069808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] PATH_INFO: `/v3/projects/7ed80be6e633499b9d1dc61c05014afc/users/d0383b7f61484347ba9875a2636e1057/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:41.097034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed80be6e633499b9d1dc61c05014afc, user_id=d0383b7f61484347ba9875a2636e1057, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:41.099735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:41.183734 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1537/3101] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:41 2021] PUT /identity/v3/projects/7ed80be6e633499b9d1dc61c05014afc/users/d0383b7f61484347ba9875a2636e1057/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:41.189249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:41.189544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:41.189878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:41.209430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:41.210656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:41.272039 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1565/3102] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:41.282137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:41.284043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:41.348900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047882-adb5-459d-ab5f-78f6ec3f209b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:41.359101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:41.359101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:41.359101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:41.359101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:41.363744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:41.365262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:41.376204 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1538/3103] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:43.541733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:43.543240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:43.669796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3538-dcfd-4573-ba46-acc32e2dae87 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:43.676034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50769f4-95f2-4757-8679-1a9bf3d392a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:43.677065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50769f4-95f2-4757-8679-1a9bf3d392a6 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:43.677355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50769f4-95f2-4757-8679-1a9bf3d392a6 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:43.677631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50769f4-95f2-4757-8679-1a9bf3d392a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:43.679679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e50769f4-95f2-4757-8679-1a9bf3d392a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:43.694448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50769f4-95f2-4757-8679-1a9bf3d392a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:43.696089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50769f4-95f2-4757-8679-1a9bf3d392a6 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:43.709801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1566/3104] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:46.849346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:46.851643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:46.878720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1accb-4cdc-4e32-8bce-24d5596b9498 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:46.899490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:46.903814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:46.903814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:46.903814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:46.907108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:46.938915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:46.941729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:46.958830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1539/3105] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:51.412637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:51.413255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:51.413255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:51.450604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] MFA Rules not processed for user `d0383b7f61484347ba9875a2636e1057`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:51.452228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:51.549398 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1567/3106] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:51 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:51.845561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:51.848290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:52.100558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c86d2-3044-42bb-989e-37a77ebcff46 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:52.108357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a39142-48a3-410a-a920-645b44727653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:52.109300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a39142-48a3-410a-a920-645b44727653 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:52.112339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a39142-48a3-410a-a920-645b44727653 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:52.112711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a39142-48a3-410a-a920-645b44727653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:52.126769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a39142-48a3-410a-a920-645b44727653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:52.129695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a39142-48a3-410a-a920-645b44727653 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:52.148101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1540/3107] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:51 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:53.024809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:53.026701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:53.056061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661d1a1-0cb3-4b56-b0cd-24bd55283870 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:53.070253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:53.071946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:53.072455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:53.073782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] PATH_INFO: `/v3/users/c59c9265b73d4f778c27de407dce255f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:53.077249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59c9265b73d4f778c27de407dce255f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:53.082633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:53.348232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59c9265b73d4f778c27de407dce255f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:53.368338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59c9265b73d4f778c27de407dce255f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:53.399443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59c9265b73d4f778c27de407dce255f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:53.401197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59c9265b73d4f778c27de407dce255f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:53.472281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59c9265b73d4f778c27de407dce255f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:53.481414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1568/3108] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:14:53 2021] DELETE /identity/v3/users/c59c9265b73d4f778c27de407dce255f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:53.485813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:53.486673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:53.487007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:53.518177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:53.525522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:53.659273 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1541/3109] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:53.684566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:53.686480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:53.803359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf45b2-d39d-4f82-8b80-8dae5fd03ba8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:53.813826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:53.814595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:53.814936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:53.815276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:53.834349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:53.837071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:53.849609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1569/3110] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:54.448378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:54.449877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:54.462842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbee058-e936-4607-88e8-0cb4420822cc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:54.473480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:54.474674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:54.475350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:54.475842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] PATH_INFO: `/v3/projects/646e75ab8f934ab7b7d2fab01bb800d9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:54.477960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=646e75ab8f934ab7b7d2fab01bb800d9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:54.480802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:54.613127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646e75ab8f934ab7b7d2fab01bb800d9', 'request_id': 'req-16c0e0d8-20f4-466d-872b-e2d56539e493'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:54.624361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646e75ab8f934ab7b7d2fab01bb800d9', 'request_id': 'req-16c0e0d8-20f4-466d-872b-e2d56539e493'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:54.774639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646e75ab8f934ab7b7d2fab01bb800d9', 'request_id': 'req-16c0e0d8-20f4-466d-872b-e2d56539e493'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:54.800684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] The token cache is being invalidate because project 646e75ab8f934ab7b7d2fab01bb800d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:14:54.800684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:54.801346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:54.807337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1542/3111] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:14:54 2021] DELETE /identity/v3/projects/646e75ab8f934ab7b7d2fab01bb800d9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:54.808384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:54.819299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af574096-f065-4894-a84a-52cd9139e67d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:54.904501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:54.905594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:54.905943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:54.906290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] PATH_INFO: `/v3/users/ea206b9760fc4cc89aa44234b9891f04` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:54.908416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea206b9760fc4cc89aa44234b9891f04)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:54.910505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:55.161400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea206b9760fc4cc89aa44234b9891f04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:55.173345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea206b9760fc4cc89aa44234b9891f04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:55.189162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea206b9760fc4cc89aa44234b9891f04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:55.190710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea206b9760fc4cc89aa44234b9891f04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:55.288741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-525a5743-d79a-4fc4-b920-b65ee3c63050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea206b9760fc4cc89aa44234b9891f04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:55.300091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1570/3112] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:14:54 2021] DELETE /identity/v3/users/ea206b9760fc4cc89aa44234b9891f04 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:56.317068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:56.318790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:56.347195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0e0d8-20f4-466d-872b-e2d56539e493 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:56.476917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:56.480129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:56.480672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:56.481154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] PATH_INFO: `/v3/projects/6d97041cde334198968e1ebc1a4a9834` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:56.484090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d97041cde334198968e1ebc1a4a9834)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:56.487533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:56.661099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d97041cde334198968e1ebc1a4a9834', 'request_id': 'req-02519c57-ae54-4283-988f-0b28cd8aa5ff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:56.668374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d97041cde334198968e1ebc1a4a9834', 'request_id': 'req-02519c57-ae54-4283-988f-0b28cd8aa5ff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:56.776209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d97041cde334198968e1ebc1a4a9834', 'request_id': 'req-02519c57-ae54-4283-988f-0b28cd8aa5ff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:56.798602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] The token cache is being invalidate because project 6d97041cde334198968e1ebc1a4a9834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:14:56.799622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:56.801881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02519c57-ae54-4283-988f-0b28cd8aa5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:56.806325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1543/3113] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:14:56 2021] DELETE /identity/v3/projects/6d97041cde334198968e1ebc1a4a9834 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:56.812156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262d39-386a-4872-8b09-0c0cb8b5b8dc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:56.813189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262d39-386a-4872-8b09-0c0cb8b5b8dc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:56.813687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262d39-386a-4872-8b09-0c0cb8b5b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:56.861519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-87262d39-386a-4872-8b09-0c0cb8b5b8dc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:56.863586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-87262d39-386a-4872-8b09-0c0cb8b5b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:56.969944 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1571/3114] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:56.977403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e7d65-dc5b-4d73-89dd-e647adcfcdb9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:56.977762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e7d65-dc5b-4d73-89dd-e647adcfcdb9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:56.978187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e7d65-dc5b-4d73-89dd-e647adcfcdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.004477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9e7e7d65-dc5b-4d73-89dd-e647adcfcdb9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:57.006300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9e7e7d65-dc5b-4d73-89dd-e647adcfcdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:57.017756 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1544/3115] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:14:57.021980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87262d39-386a-4872-8b09-0c0cb8b5b8dc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.034679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87262d39-386a-4872-8b09-0c0cb8b5b8dc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.039595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:57.040552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.043015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.043015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.043015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:14:57.043015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:57.044222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:57.060281 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1572/3116] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:14:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:14:57.064984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e7d65-dc5b-4d73-89dd-e647adcfcdb9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.082734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e7d65-dc5b-4d73-89dd-e647adcfcdb9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.089709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:57.090471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.090891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.091240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.092266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:57.094911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:57.114400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.117507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:57.147460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23c8ff-b1a8-4592-99fe-54753c55bddc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.162032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:57.163988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.165757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.166205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] PATH_INFO: `/v3/users/e79788d5030a44b9b522c73791f77233` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.169244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79788d5030a44b9b522c73791f77233)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:57.173046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:57.201856 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1545/3117] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:14:57 2021] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:57.205636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.301287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a704d-b0e3-407a-bba4-a563656816bd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.306951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:57.307650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.308063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.308342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.309079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:57.311245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:57.401526 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1546/3118] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:14:57 2021] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:14:57.404054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.419490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153be11-5bb8-45ab-a3e5-9f01281172a1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.422301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79788d5030a44b9b522c73791f77233'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:57.432635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79788d5030a44b9b522c73791f77233'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:57.435418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:57.436296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.437503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.444380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.448543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:57.450972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:57.466553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79788d5030a44b9b522c73791f77233'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:57.467766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79788d5030a44b9b522c73791f77233'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:57.476421 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1547/3119] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:57 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:57.480989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.490959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4829a-909f-4e06-8a60-bd1152c67c24 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.496500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:57.497302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.497659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.498013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.498918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:57.500546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:57.512950 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1548/3120] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:57.516980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.537516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf16f47-7cbc-46d8-a94e-317f0e19155a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.545567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254e4b-29d4-4a35-adba-8945fce2c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:57.546646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254e4b-29d4-4a35-adba-8945fce2c18c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.546929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254e4b-29d4-4a35-adba-8945fce2c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.547207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254e4b-29d4-4a35-adba-8945fce2c18c admin admin] PATH_INFO: `/v3/projects/30d627bd27a54039ab7eacbc0d2070ff/users/b815181f8b7842fdabd39ce395fb7ca5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.552047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-20f6e84f-1f8d-40fe-979c-5ab614b3f96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79788d5030a44b9b522c73791f77233'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:57.562059 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1573/3121] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:14:57 2021] DELETE /identity/v3/users/e79788d5030a44b9b522c73791f77233 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:14:57.563543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def51f-ab53-4fab-b7e7-950c11ea5961 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.563832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def51f-ab53-4fab-b7e7-950c11ea5961 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.564105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01def51f-ab53-4fab-b7e7-950c11ea5961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.569728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254e4b-29d4-4a35-adba-8945fce2c18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d627bd27a54039ab7eacbc0d2070ff, user_id=b815181f8b7842fdabd39ce395fb7ca5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:57.572538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254e4b-29d4-4a35-adba-8945fce2c18c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:57.585928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-01def51f-ab53-4fab-b7e7-950c11ea5961 None None] MFA Rules not processed for user `d0383b7f61484347ba9875a2636e1057`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:57.587288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01def51f-ab53-4fab-b7e7-950c11ea5961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:57.643077 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1574/3122] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:57.644398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.644688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.644998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.677095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:57.678387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:57.711534 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1549/3123] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:57 2021] PUT /identity/v3/projects/30d627bd27a54039ab7eacbc0d2070ff/users/b815181f8b7842fdabd39ce395fb7ca5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:14:57.728824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:57.728824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:57.728824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:57.792767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] MFA Rules not processed for user `b815181f8b7842fdabd39ce395fb7ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:57.795826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:57.811036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1575/3124] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:57.823195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.826760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:57.929570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2874e-1e72-46a1-8f39-accec068a0f8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:57.956160 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1550/3125] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:57.958566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:57.960627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:58.049299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.050650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.055408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.055698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.096909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfdb75-3607-44ec-9a27-17f0cd98f0b6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:58.101932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.103409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.103798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.104173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.109236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.115046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.184115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.186061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.198017 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1576/3126] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:14:58.221784 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1551/3127] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:14:57 2021] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:58.226116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:58.240051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de1dbb-a2f5-452b-b6e4-d60cc2e65eca service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:58.319974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.320717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.321096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.322345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.322900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.325379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.406187 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1577/3128] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:14:58 2021] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:14:58.410277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:58.425647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fb207-666e-45db-9bb5-1378273e3957 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:58.435641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.438097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.438097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.438097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.440024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.444088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.471227 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1552/3129] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:58 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:14:58.476195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:58.500002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:58.500732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28a1fc-6f92-4a43-8282-d46282d6a740 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:58.503838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:58.514612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.518799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.518799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.518799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] PATH_INFO: `/v3/projects/49dc8d59373f4470bd7eff795959b5f1/users/6a2d8bb045924b4b9ab44b2dd5be521e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.530971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f206a-a103-43a8-831e-ab991ea6518a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:58.542709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.543770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.544110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.544525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] PATH_INFO: `/v3/projects/c455cc0f858a452bb0b60cf0af0c453c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.547898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c455cc0f858a452bb0b60cf0af0c453c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.557074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dc8d59373f4470bd7eff795959b5f1, user_id=6a2d8bb045924b4b9ab44b2dd5be521e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.557451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.557552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.703439 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1578/3130] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:58 2021] PUT /identity/v3/projects/49dc8d59373f4470bd7eff795959b5f1/users/6a2d8bb045924b4b9ab44b2dd5be521e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:14:58.705438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:58.721843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c455cc0f858a452bb0b60cf0af0c453c', 'request_id': 'req-f3cf4f20-3723-454a-9389-31d05b247c8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:58.732410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c455cc0f858a452bb0b60cf0af0c453c', 'request_id': 'req-f3cf4f20-3723-454a-9389-31d05b247c8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:58.790357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ac84a-7ad1-4c14-99e4-64c410dc8bdc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:58.808840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c455cc0f858a452bb0b60cf0af0c453c', 'request_id': 'req-f3cf4f20-3723-454a-9389-31d05b247c8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:58.823499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] The token cache is being invalidate because project c455cc0f858a452bb0b60cf0af0c453c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:14:58.823864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:58.824561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:58.826537 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1553/3131] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:14:58 2021] DELETE /identity/v3/projects/c455cc0f858a452bb0b60cf0af0c453c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:58.830156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:58.831633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:58.864697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.865280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.865374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.865637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.866383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.867998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.894026 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1579/3132] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:14:58 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:14:58.898880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:58.900343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:58.925196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4e6af-4f98-4453-9101-5c9fa5074c00 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:58.953804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58a3f2-987f-477a-a4dd-64d705478a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:58.958067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a3f2-987f-477a-a4dd-64d705478a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:58.958563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a3f2-987f-477a-a4dd-64d705478a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:58.959249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a3f2-987f-477a-a4dd-64d705478a24 admin admin] PATH_INFO: `/v3/projects/49dc8d59373f4470bd7eff795959b5f1/users/6a2d8bb045924b4b9ab44b2dd5be521e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:58.970484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58a3f2-987f-477a-a4dd-64d705478a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dc8d59373f4470bd7eff795959b5f1, user_id=6a2d8bb045924b4b9ab44b2dd5be521e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:58.970484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58a3f2-987f-477a-a4dd-64d705478a24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:58.984613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4f20-3723-454a-9389-31d05b247c8a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:59.008137 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1580/3133] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:14:58 2021] PUT /identity/v3/projects/49dc8d59373f4470bd7eff795959b5f1/users/6a2d8bb045924b4b9ab44b2dd5be521e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:59.022180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:59.022180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:59.025147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:59.025418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:59.025800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] PATH_INFO: `/v3/users/1f3f4bc1d20b4089935e993a421f520c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:59.028291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:59.029637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3f4bc1d20b4089935e993a421f520c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:59.030019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:59.046685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:59.097490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] MFA Rules not processed for user `6a2d8bb045924b4b9ab44b2dd5be521e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:14:59.099490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:59.276973 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1581/3134] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:59 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:14:59.285859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3f4bc1d20b4089935e993a421f520c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:59.302638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3f4bc1d20b4089935e993a421f520c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:59.331546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3f4bc1d20b4089935e993a421f520c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:59.333430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3f4bc1d20b4089935e993a421f520c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:59.334421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-79e0b98d-bd23-47ce-b0d9-67dc9c5b6251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3f4bc1d20b4089935e993a421f520c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:14:59.430787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:14:59.432516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:59.474763 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1554/3135] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:14:58 2021] DELETE /identity/v3/users/1f3f4bc1d20b4089935e993a421f520c => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:14:59.635331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fde196-6e6c-4303-880c-d814c34fa99e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:14:59.792268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:14:59.793251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:59.793544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:59.793887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:14:59.796733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:14:59.958634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:14:59.965765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:14:59.978028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41549550-6950-4f79-88d5-660ee55dce4a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:14:59.978358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41549550-6950-4f79-88d5-660ee55dce4a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:14:59.990355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41549550-6950-4f79-88d5-660ee55dce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:00.040711 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1582/3136] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:14:59 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:00.052936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-41549550-6950-4f79-88d5-660ee55dce4a None None] MFA Rules not processed for user `f9e59d219fa640e48533e0efdf150b16`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:00.055477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-41549550-6950-4f79-88d5-660ee55dce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:00.234084 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1555/3137] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:14:59 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:00.302896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:00.304785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:00.546028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289fcb4-1788-40de-95ce-0c7443356698 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:00.553524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:00.554822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:00.559948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:00.559948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] PATH_INFO: `/v3/projects/bd6e775c3a324d7983ac405ab625923c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:00.559948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6e775c3a324d7983ac405ab625923c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:00.561188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:00.742692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6e775c3a324d7983ac405ab625923c', 'request_id': 'req-32928cfe-4976-4c67-8527-76fb7210699b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:00.814907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6e775c3a324d7983ac405ab625923c', 'request_id': 'req-32928cfe-4976-4c67-8527-76fb7210699b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:00.823640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6e775c3a324d7983ac405ab625923c', 'request_id': 'req-32928cfe-4976-4c67-8527-76fb7210699b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:00.835484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] The token cache is being invalidate because project bd6e775c3a324d7983ac405ab625923c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:00.835777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:00.837930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:00.839341 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1583/3138] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:00 2021] DELETE /identity/v3/projects/bd6e775c3a324d7983ac405ab625923c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:00.844504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:00.845019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:00.846823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:00.882779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:00.884353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:00.892277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:00.893521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:00.994804 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1556/3139] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:00.996016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:00.997556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:01.015143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583f0d7-2c2a-4aa6-bd14-b0c647c2451a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.020754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928cfe-4976-4c67-8527-76fb7210699b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.021602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.022742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.023408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.023859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] PATH_INFO: `/v3/users/6015b6dc2cbd4171a690602866d50ace` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.025943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6015b6dc2cbd4171a690602866d50ace)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.027431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.028379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.028642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.028779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.028963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] PATH_INFO: `/v3/users/b815181f8b7842fdabd39ce395fb7ca5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.030435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b815181f8b7842fdabd39ce395fb7ca5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.033225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.229219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b815181f8b7842fdabd39ce395fb7ca5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.236092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b815181f8b7842fdabd39ce395fb7ca5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.247759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b815181f8b7842fdabd39ce395fb7ca5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.248433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b815181f8b7842fdabd39ce395fb7ca5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.281092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6015b6dc2cbd4171a690602866d50ace'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.298440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6015b6dc2cbd4171a690602866d50ace'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.300658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8820bfeb-866c-467e-8067-8662fcf73649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b815181f8b7842fdabd39ce395fb7ca5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.311528 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1584/3140] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:00 2021] DELETE /identity/v3/users/b815181f8b7842fdabd39ce395fb7ca5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:01.313229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b01fc2-c183-44cc-aa26-cd8550541266 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.313792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b01fc2-c183-44cc-aa26-cd8550541266 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.314315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b01fc2-c183-44cc-aa26-cd8550541266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.315266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6015b6dc2cbd4171a690602866d50ace'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.316058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6015b6dc2cbd4171a690602866d50ace'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.329397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6015b6dc2cbd4171a690602866d50ace'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:01.335582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-15b01fc2-c183-44cc-aa26-cd8550541266 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:01.337889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-15b01fc2-c183-44cc-aa26-cd8550541266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:01.402618 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1585/3141] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:01.403955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.404253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.404542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.413084 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1557/3142] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:00 2021] DELETE /identity/v3/users/6015b6dc2cbd4171a690602866d50ace => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:01.413809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:01.422849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:01.424076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:01.491299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05d33f-e643-4788-bd28-007dd45bd4c7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.498306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.499003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.499242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.499584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.500610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:01.501196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.502770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.503113 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1586/3143] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:01.516028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:01.520797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:01.524347 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1558/3144] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:15:01.529235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:01.544135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329a3e8-aa13-4383-9afa-2d3e5fb21db4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.549951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.550838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.555185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.555185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.555185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.555185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.598297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df4153-8e9d-4514-953d-ee8e21d15f8a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.602739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.603450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.603766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.604046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.615140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.616619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.627172 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1587/3145] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:01.715038 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1559/3146] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:01 2021] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:15:01.719130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:01.729635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927afc-60fc-4a58-8fb7-44b06a33699f service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.778332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:01.780894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:01.794000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.794748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.795086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.796134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.796894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.799235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.865878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f4bf6-ef32-4c5e-b313-6b1118e6c55b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.870790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.871605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.871886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.872160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] PATH_INFO: `/v3/projects/af3f5665f009477385c524a3e23aedc6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.873481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3f5665f009477385c524a3e23aedc6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.875370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.935829 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1588/3147] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:01 2021] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:01.939490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:01.950130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3709-a5a1-4f54-8a0d-8d22a0e36f40 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.955496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.956169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.956453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.956728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.957509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.959098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:01.970530 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1589/3148] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:15:01.975733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:01.985840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d06b85-a0e1-489d-abb2-2a45cbbe59d3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:01.990863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:01.991516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:01.991825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:01.992103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:01.992838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:01.994570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.008050 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1590/3149] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:02.009668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:02.020949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cb5ae-ed27-470d-b403-c2bc7866d421 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:02.031237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02d44b-94f8-4779-b3b8-2314a1948c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:02.032580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d44b-94f8-4779-b3b8-2314a1948c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.032862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d44b-94f8-4779-b3b8-2314a1948c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.033171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02d44b-94f8-4779-b3b8-2314a1948c68 admin admin] PATH_INFO: `/v3/projects/919a00bb2d294ab291df4bbd212ae7fe/users/4039c9a053164b1685c6535b79a763a4/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.040322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3f5665f009477385c524a3e23aedc6', 'request_id': 'req-0fcb4433-a841-4a55-a1cb-bae7dce77b54'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.046483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3f5665f009477385c524a3e23aedc6', 'request_id': 'req-0fcb4433-a841-4a55-a1cb-bae7dce77b54'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.048358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d44b-94f8-4779-b3b8-2314a1948c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919a00bb2d294ab291df4bbd212ae7fe, user_id=4039c9a053164b1685c6535b79a763a4, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:02.051342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02d44b-94f8-4779-b3b8-2314a1948c68 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.117600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3f5665f009477385c524a3e23aedc6', 'request_id': 'req-0fcb4433-a841-4a55-a1cb-bae7dce77b54'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.124371 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1591/3150] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:02 2021] PUT /identity/v3/projects/919a00bb2d294ab291df4bbd212ae7fe/users/4039c9a053164b1685c6535b79a763a4/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:02.134656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410af1-564a-410c-8450-e0deb470d74e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.134953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410af1-564a-410c-8450-e0deb470d74e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.135235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410af1-564a-410c-8450-e0deb470d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.147506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] The token cache is being invalidate because project af3f5665f009477385c524a3e23aedc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:02.147843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.148458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.162907 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1560/3151] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:01 2021] DELETE /identity/v3/projects/af3f5665f009477385c524a3e23aedc6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:02.162907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:02.162907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:02.167962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2e410af1-564a-410c-8450-e0deb470d74e None None] MFA Rules not processed for user `4039c9a053164b1685c6535b79a763a4`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:02.169195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2e410af1-564a-410c-8450-e0deb470d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:02.290488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb4433-a841-4a55-a1cb-bae7dce77b54 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:02.303243 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1592/3152] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:02 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:02.309140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.309140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.309140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.334328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:02.335947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:02.385036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:02.386075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.386459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.386835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] PATH_INFO: `/v3/projects/30d627bd27a54039ab7eacbc0d2070ff` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.388943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d627bd27a54039ab7eacbc0d2070ff)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:02.391112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.425462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1593/3153] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:02.426114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:02.427493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:02.500160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78137f87-c1d2-436d-b087-0604f87a8d6a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:02.504582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775e0a8-a597-43a0-b291-c04cd565cc5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:02.505654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e0a8-a597-43a0-b291-c04cd565cc5a service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.505937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e0a8-a597-43a0-b291-c04cd565cc5a service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.506277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775e0a8-a597-43a0-b291-c04cd565cc5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.517226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775e0a8-a597-43a0-b291-c04cd565cc5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:02.518722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775e0a8-a597-43a0-b291-c04cd565cc5a service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.528921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1594/3154] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:02 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:02.530450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f360d6e-634d-4d0c-b5b0-5e5c5e74e77e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.530743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f360d6e-634d-4d0c-b5b0-5e5c5e74e77e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.531333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f360d6e-634d-4d0c-b5b0-5e5c5e74e77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.535345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d627bd27a54039ab7eacbc0d2070ff', 'request_id': 'req-716dc02b-7774-4b25-9bd3-906ba988fb6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.543033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d627bd27a54039ab7eacbc0d2070ff', 'request_id': 'req-716dc02b-7774-4b25-9bd3-906ba988fb6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.555377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9f360d6e-634d-4d0c-b5b0-5e5c5e74e77e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:02.557210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f360d6e-634d-4d0c-b5b0-5e5c5e74e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:02.625761 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1595/3155] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:02.631605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f360d6e-634d-4d0c-b5b0-5e5c5e74e77e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:02.640848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f360d6e-634d-4d0c-b5b0-5e5c5e74e77e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:02.645615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:02.646259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.646541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.646816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.647534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:02.647889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:02.649550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.654572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d627bd27a54039ab7eacbc0d2070ff', 'request_id': 'req-716dc02b-7774-4b25-9bd3-906ba988fb6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.662602 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1596/3156] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:15:02.667339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:02.676729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] The token cache is being invalidate because project 30d627bd27a54039ab7eacbc0d2070ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:02.677451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.682726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.683008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdcb73-816f-4fb1-bb3d-42a0fcd1e0a3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:02.685661 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1561/3157] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:02 2021] DELETE /identity/v3/projects/30d627bd27a54039ab7eacbc0d2070ff => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:02.686493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:02.687914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:02.692867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:02.695199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.696948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.697446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.698539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:02.702131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dc02b-7774-4b25-9bd3-906ba988fb6f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:02.704396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.707942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:02.709268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.709268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.709791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] PATH_INFO: `/v3/users/6a2d8bb045924b4b9ab44b2dd5be521e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.710780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2d8bb045924b4b9ab44b2dd5be521e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:02.712804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.831255 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1597/3158] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:02 2021] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:15:02.835211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:02.838650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:02.929274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe034a-196a-4f9c-9f4f-4c1ab6c3c746 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:02.935483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:02.936765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:02.937340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:02.937892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:02.938599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:02.940703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:02.942725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2d8bb045924b4b9ab44b2dd5be521e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.950253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2d8bb045924b4b9ab44b2dd5be521e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.964167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2d8bb045924b4b9ab44b2dd5be521e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.965560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2d8bb045924b4b9ab44b2dd5be521e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:02.966166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2d8bb045924b4b9ab44b2dd5be521e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:03.029850 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1598/3159] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:02 2021] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:03.031024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:03.032710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:03.045987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af5fc5-433d-4b2f-89d7-39aa2a87894b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:03.050710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:03.051365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:03.051649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:03.052796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:03.052796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:03.054256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:03.064260 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1599/3160] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:03.068088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:03.077426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1562/3161] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:02 2021] DELETE /identity/v3/users/6a2d8bb045924b4b9ab44b2dd5be521e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:15:03.080288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e47ab-68ba-4a24-ac7a-5e69549d70f7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:03.137070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdddfa9-0846-474f-9ef2-f5de2e4b3cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:03.137866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdddfa9-0846-474f-9ef2-f5de2e4b3cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:03.138149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdddfa9-0846-474f-9ef2-f5de2e4b3cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:03.138417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdddfa9-0846-474f-9ef2-f5de2e4b3cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:03.139135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdddfa9-0846-474f-9ef2-f5de2e4b3cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:03.140733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdddfa9-0846-474f-9ef2-f5de2e4b3cd6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:03.152663 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1600/3162] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:15:03.156409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:03.167039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447da0d-53da-47e0-a4f6-845ac2643bbc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:03.171921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:03.174180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:03.174644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:03.175188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] PATH_INFO: `/v3/projects/27d474dfd37c46f0aa14aa84e8b3ad41/users/819fcdf5d86a46399dfb7343639f3ea6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:03.202016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d474dfd37c46f0aa14aa84e8b3ad41, user_id=819fcdf5d86a46399dfb7343639f3ea6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:03.206733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:03.288212 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1563/3163] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:03 2021] PUT /identity/v3/projects/27d474dfd37c46f0aa14aa84e8b3ad41/users/819fcdf5d86a46399dfb7343639f3ea6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:03.294379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2509cf-23ab-4982-a9cc-35d78b374cd9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:03.294668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2509cf-23ab-4982-a9cc-35d78b374cd9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:03.294957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2509cf-23ab-4982-a9cc-35d78b374cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:03.356747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7b2509cf-23ab-4982-a9cc-35d78b374cd9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:03.358332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7b2509cf-23ab-4982-a9cc-35d78b374cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:03.513284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1601/3164] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:03.535588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:03.537569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:03.616374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef591c0-ffab-4b5b-ab73-645783248976 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:03.617915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:03.618652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:03.619012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:03.619370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:03.629806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:03.631579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:03.645326 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1564/3165] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:03.891148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:03.891447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:03.897534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:03.911204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:03.912402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:03.976631 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1602/3166] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:15:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:03.996080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:03.998812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:04.054664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:04.057726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:04.074047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3221-e02e-4123-83da-c9774c504f5c service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:04.096089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:04.097714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:04.102296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:04.102296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] PATH_INFO: `/v3/projects/49dc8d59373f4470bd7eff795959b5f1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:04.102296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49dc8d59373f4470bd7eff795959b5f1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:04.103827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:04.229243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25754629-fb6e-4128-86a3-2f9556a7811d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:04.234958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe584-495f-432d-95e7-0381d51f6117 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:04.235621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe584-495f-432d-95e7-0381d51f6117 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:04.235894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe584-495f-432d-95e7-0381d51f6117 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:04.236164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe584-495f-432d-95e7-0381d51f6117 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:04.246563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafe584-495f-432d-95e7-0381d51f6117 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:04.255324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafe584-495f-432d-95e7-0381d51f6117 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:04.273604 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1603/3167] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:15:04.325167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49dc8d59373f4470bd7eff795959b5f1', 'request_id': 'req-84f4eafb-1241-42bd-ac3f-651f2f410fe4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:04.332375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49dc8d59373f4470bd7eff795959b5f1', 'request_id': 'req-84f4eafb-1241-42bd-ac3f-651f2f410fe4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:04.437941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49dc8d59373f4470bd7eff795959b5f1', 'request_id': 'req-84f4eafb-1241-42bd-ac3f-651f2f410fe4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:04.458990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] The token cache is being invalidate because project 49dc8d59373f4470bd7eff795959b5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:04.459188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:04.460301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-84f4eafb-1241-42bd-ac3f-651f2f410fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:04.469413 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1565/3168] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:03 2021] DELETE /identity/v3/projects/49dc8d59373f4470bd7eff795959b5f1 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:04.471107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213af0e-9e76-43fe-a272-bc161dde83ed None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:04.471394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213af0e-9e76-43fe-a272-bc161dde83ed None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:04.471673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213af0e-9e76-43fe-a272-bc161dde83ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:04.504700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0213af0e-9e76-43fe-a272-bc161dde83ed None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:04.505993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0213af0e-9e76-43fe-a272-bc161dde83ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:04.616927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1604/3169] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:04.626811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcdf66-79e6-46ee-ad6c-ac67c6098eab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:04.626811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcdf66-79e6-46ee-ad6c-ac67c6098eab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:04.626811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcdf66-79e6-46ee-ad6c-ac67c6098eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:04.661934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c8fcdf66-79e6-46ee-ad6c-ac67c6098eab None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:04.663166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c8fcdf66-79e6-46ee-ad6c-ac67c6098eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:04.697609 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1566/3170] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:04.698570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213af0e-9e76-43fe-a272-bc161dde83ed None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:04.716104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213af0e-9e76-43fe-a272-bc161dde83ed None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:04.729123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:04.729798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:04.730074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:04.730341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:04.731068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:04.735383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:04.743197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:04.787324 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1605/3171] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:15:04.791963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcdf66-79e6-46ee-ad6c-ac67c6098eab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:04.811797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcdf66-79e6-46ee-ad6c-ac67c6098eab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:04.818377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:04.819320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:04.819767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:04.824359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:04.824359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:04.824359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:04.939702 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1567/3172] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:04 2021] POST /identity/v3/projects => generated 395 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:04.950910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:04.970776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b33de-4a09-4aa1-a92b-ad8ee42ab3ba admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:05.120692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:05.121593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:05.121940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:05.122281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:05.225002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:05.225002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:05.553501 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1606/3173] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:04 2021] POST /identity/v3/users => generated 298 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:05.557953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:05.577816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8abcd6-426a-4acc-a5b0-d3ab060acd03 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:05.582903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:05.585885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:05.585885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:05.585885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:05.585885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:05.586576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:05.598774 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1568/3174] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:05.603109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:05.614914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fafe98-eb27-4b11-9eaf-a0e01eec49f9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:05.621159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e87f-811a-4b25-874f-83400dd18ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:05.622552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e87f-811a-4b25-874f-83400dd18ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:05.623061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e87f-811a-4b25-874f-83400dd18ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:05.623530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e87f-811a-4b25-874f-83400dd18ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:05.624749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e87f-811a-4b25-874f-83400dd18ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:05.627826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e87f-811a-4b25-874f-83400dd18ae8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:05.640508 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1607/3175] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:05 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:15:05.651955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:05.666432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef4479-ea4e-4a99-804d-8d10457b03e8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:05.674242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:05.675199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:05.675486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:05.675759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] PATH_INFO: `/v3/projects/1c42f87e5b2244ccba3e4d3c325c1f5e/users/679ad9e3a3d04aef923123836faed2fe/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:05.702686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c42f87e5b2244ccba3e4d3c325c1f5e, user_id=679ad9e3a3d04aef923123836faed2fe, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:05.709935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:05.821656 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1569/3176] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:05 2021] PUT /identity/v3/projects/1c42f87e5b2244ccba3e4d3c325c1f5e/users/679ad9e3a3d04aef923123836faed2fe/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:05.833147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3789-827d-4083-a0fc-9a6a109e3d5c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:05.833603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3789-827d-4083-a0fc-9a6a109e3d5c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:05.833993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3789-827d-4083-a0fc-9a6a109e3d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:05.869336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bcdc3789-827d-4083-a0fc-9a6a109e3d5c None None] MFA Rules not processed for user `679ad9e3a3d04aef923123836faed2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:05.871658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bcdc3789-827d-4083-a0fc-9a6a109e3d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:05.981325 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1608/3177] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:05 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:05.985513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:06.066416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3becd0-4e73-41c8-9ace-f04a54285f6b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.067204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3becd0-4e73-41c8-9ace-f04a54285f6b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.067204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3becd0-4e73-41c8-9ace-f04a54285f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.073407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48be84-cb4b-4a5a-8f12-6df9d9d72b5f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:06.081176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:06.082374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.082900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.083439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.084400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:06.091335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:06.126249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ea3becd0-4e73-41c8-9ace-f04a54285f6b None None] MFA Rules not processed for user `819fcdf5d86a46399dfb7343639f3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:06.128611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ea3becd0-4e73-41c8-9ace-f04a54285f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:06.218092 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1609/3178] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:06.245141 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1570/3179] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:05 2021] POST /identity/v3/projects => generated 393 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:15:06.246319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:06.249160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece207-9b5a-46e8-9640-9cc48ae9f4a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.250069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece207-9b5a-46e8-9640-9cc48ae9f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.250601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece207-9b5a-46e8-9640-9cc48ae9f4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.288490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6dece207-9b5a-46e8-9640-9cc48ae9f4a3 None None] MFA Rules not processed for user `819fcdf5d86a46399dfb7343639f3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:06.293914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6dece207-9b5a-46e8-9640-9cc48ae9f4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:06.392581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6414-0aba-482f-8850-dfb93daf8fcd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:06.407814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:06.409112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.409638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.410123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.411382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:06.413656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:06.448005 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1610/3180] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:06.449677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72edb1f-cbbb-4674-9bc5-b993680c9edd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.450218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72edb1f-cbbb-4674-9bc5-b993680c9edd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.450704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72edb1f-cbbb-4674-9bc5-b993680c9edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.485996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a72edb1f-cbbb-4674-9bc5-b993680c9edd None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:06.487366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a72edb1f-cbbb-4674-9bc5-b993680c9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:06.507818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1571/3181] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:06 2021] POST /identity/v3/users => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:06.508632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:06.512175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:06.580563 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1611/3182] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:15:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:06.581771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72edb1f-cbbb-4674-9bc5-b993680c9edd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:06.626324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72edb1f-cbbb-4674-9bc5-b993680c9edd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:06.636027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:06.638440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.638623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.638909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.640231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:06.642011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:06.651240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f3daa-6b47-4454-ac2b-8f2b38f56d86 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:06.672726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:06.674190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.678578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.678578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.681431 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1612/3183] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:06.683273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:06.685408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:06.692405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:06.694521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:06.709291 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1572/3184] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:06 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:06.710304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:06.727746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef35ff3-29a6-4a0d-8908-973d7944b144 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:06.734538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:06.740177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.740177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.740177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] PATH_INFO: `/v3/projects/6dad2b253de24283a30bf0702f9f6d5d/users/58259c1286af403bb03988291e7a99b7/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.792089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dad2b253de24283a30bf0702f9f6d5d, user_id=58259c1286af403bb03988291e7a99b7, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:06.794829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:06.866975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7d46f-8a28-448f-a871-1a2beb8715aa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:06.878110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:06.879009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:06.879501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:06.879846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:06.886179 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1573/3185] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:06 2021] PUT /identity/v3/projects/6dad2b253de24283a30bf0702f9f6d5d/users/58259c1286af403bb03988291e7a99b7/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:06.890189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:06.898061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:06.903197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:06.921486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1613/3186] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:15:07.006145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84781-e1f5-4036-8bde-e77771d8a164 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:07.011803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c400d2-ee35-40a8-b4eb-d18345ecafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:07.012689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c400d2-ee35-40a8-b4eb-d18345ecafb0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:07.013004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c400d2-ee35-40a8-b4eb-d18345ecafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:07.013284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c400d2-ee35-40a8-b4eb-d18345ecafb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:07.014021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c400d2-ee35-40a8-b4eb-d18345ecafb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:07.015654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c400d2-ee35-40a8-b4eb-d18345ecafb0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:07.041709 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1574/3187] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:06 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:15:07.043354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:07.056464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6769e59-07c3-40cd-8729-68ad9f346017 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:07.063326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:07.063326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:07.063326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:07.063326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] PATH_INFO: `/v3/projects/6dad2b253de24283a30bf0702f9f6d5d/users/58259c1286af403bb03988291e7a99b7/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:07.065292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dad2b253de24283a30bf0702f9f6d5d, user_id=58259c1286af403bb03988291e7a99b7, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:07.067971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:07.082893 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1614/3188] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:07 2021] PUT /identity/v3/projects/6dad2b253de24283a30bf0702f9f6d5d/users/58259c1286af403bb03988291e7a99b7/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:07.093538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe60fb-3d1a-4c54-9f0a-b657990f217d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:07.093833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe60fb-3d1a-4c54-9f0a-b657990f217d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:07.094109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe60fb-3d1a-4c54-9f0a-b657990f217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:07.124343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9ebe60fb-3d1a-4c54-9f0a-b657990f217d None None] MFA Rules not processed for user `58259c1286af403bb03988291e7a99b7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:07.125965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9ebe60fb-3d1a-4c54-9f0a-b657990f217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:07.222620 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1575/3189] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:07 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:07.429070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:07.431648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:07.509775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eaca7-d693-46a8-b791-c6754bfdd20a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:07.515730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5cef-9857-421f-bf0a-dae8f2cf3dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:07.516502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5cef-9857-421f-bf0a-dae8f2cf3dbc service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:07.516793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5cef-9857-421f-bf0a-dae8f2cf3dbc service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:07.517101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5cef-9857-421f-bf0a-dae8f2cf3dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:07.527159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5cef-9857-421f-bf0a-dae8f2cf3dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:07.528732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5cef-9857-421f-bf0a-dae8f2cf3dbc service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:07.539976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1615/3190] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:07 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:07.819215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe60fb-3d1a-4c54-9f0a-b657990f217d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:07.923439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe60fb-3d1a-4c54-9f0a-b657990f217d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:07.929731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:07.930982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:07.931438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:07.931883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] PATH_INFO: `/v3/users/679ad9e3a3d04aef923123836faed2fe` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:07.933628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679ad9e3a3d04aef923123836faed2fe)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:07.938325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:08.205580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679ad9e3a3d04aef923123836faed2fe'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:08.213144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679ad9e3a3d04aef923123836faed2fe'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:08.224688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679ad9e3a3d04aef923123836faed2fe'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:08.226581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679ad9e3a3d04aef923123836faed2fe'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:08.226581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679ad9e3a3d04aef923123836faed2fe'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:08.284199 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1576/3191] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:07 2021] DELETE /identity/v3/users/679ad9e3a3d04aef923123836faed2fe => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:08.288744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:08.289066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:08.289342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:08.309369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:08.310674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:08.369584 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1616/3192] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:08.379448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:08.380843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:08.439472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7cb95-7320-49c3-806b-545d4f53ccc7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:08.443120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:08.443760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:08.444039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:08.444314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:08.459387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:08.459387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:08.465453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1577/3193] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:08.846553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:08.848105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:08.863429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5787583-7a11-478f-8e1c-6ef56d77d37b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:08.870534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:08.872247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:08.872644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:08.873785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] PATH_INFO: `/v3/projects/1c42f87e5b2244ccba3e4d3c325c1f5e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:08.875169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c42f87e5b2244ccba3e4d3c325c1f5e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:08.878090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:09.019520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c42f87e5b2244ccba3e4d3c325c1f5e', 'request_id': 'req-86adfd8c-b3db-45f3-832c-2fda5a728db9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.089065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c42f87e5b2244ccba3e4d3c325c1f5e', 'request_id': 'req-86adfd8c-b3db-45f3-832c-2fda5a728db9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.095800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c42f87e5b2244ccba3e4d3c325c1f5e', 'request_id': 'req-86adfd8c-b3db-45f3-832c-2fda5a728db9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.108913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] The token cache is being invalidate because project 1c42f87e5b2244ccba3e4d3c325c1f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:09.109229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.109879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86adfd8c-b3db-45f3-832c-2fda5a728db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.112384 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1617/3194] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:08 2021] DELETE /identity/v3/projects/1c42f87e5b2244ccba3e4d3c325c1f5e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:09.122146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:09.143181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb844d-c7a5-4427-b09a-cd13a23d5e55 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:09.189660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473608c0-c047-4614-b02a-799724cefd41 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:09.189959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473608c0-c047-4614-b02a-799724cefd41 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:09.190234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473608c0-c047-4614-b02a-799724cefd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:09.224072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-473608c0-c047-4614-b02a-799724cefd41 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:09.225325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-473608c0-c047-4614-b02a-799724cefd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:09.248782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:09.249990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:09.250453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:09.250726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] PATH_INFO: `/v3/users/58259c1286af403bb03988291e7a99b7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:09.252069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58259c1286af403bb03988291e7a99b7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:09.254338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:09.291454 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1618/3195] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:15:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:09.305280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473608c0-c047-4614-b02a-799724cefd41 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:09.307117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-473608c0-c047-4614-b02a-799724cefd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:09.377386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473608c0-c047-4614-b02a-799724cefd41 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:09.382422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dbd43-214f-4d82-8ef8-629ff2cee9b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:09.383061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbd43-214f-4d82-8ef8-629ff2cee9b5 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:09.383340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbd43-214f-4d82-8ef8-629ff2cee9b5 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:09.384168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbd43-214f-4d82-8ef8-629ff2cee9b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:09.392489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dbd43-214f-4d82-8ef8-629ff2cee9b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:09.394129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dbd43-214f-4d82-8ef8-629ff2cee9b5 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:09.403170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1619/3196] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:15:09.411137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58259c1286af403bb03988291e7a99b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.418881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58259c1286af403bb03988291e7a99b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.431178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58259c1286af403bb03988291e7a99b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.431972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58259c1286af403bb03988291e7a99b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.432631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58259c1286af403bb03988291e7a99b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:09.495766 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1578/3197] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:09 2021] DELETE /identity/v3/users/58259c1286af403bb03988291e7a99b7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:15:09.985850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e916-9381-4420-9af5-4ab766f1b064 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:09.986448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e916-9381-4420-9af5-4ab766f1b064 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:09.986448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e916-9381-4420-9af5-4ab766f1b064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:10.005858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6820e916-9381-4420-9af5-4ab766f1b064 None None] MFA Rules not processed for user `4039c9a053164b1685c6535b79a763a4`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:10.006814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6820e916-9381-4420-9af5-4ab766f1b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:10.031121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:10.032725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:10.087050 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1620/3198] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:10.141984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a8f1c-d504-4286-b95d-1b78e39d6376 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:10.150690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:10.151755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:10.152072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:10.152403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] PATH_INFO: `/v3/projects/6dad2b253de24283a30bf0702f9f6d5d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:10.154006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dad2b253de24283a30bf0702f9f6d5d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:10.157395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:10.258440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dad2b253de24283a30bf0702f9f6d5d', 'request_id': 'req-ee0c91f3-8595-4839-aee9-77030792c850'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:10.266212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dad2b253de24283a30bf0702f9f6d5d', 'request_id': 'req-ee0c91f3-8595-4839-aee9-77030792c850'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:10.340040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dad2b253de24283a30bf0702f9f6d5d', 'request_id': 'req-ee0c91f3-8595-4839-aee9-77030792c850'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:10.353416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] The token cache is being invalidate because project 6dad2b253de24283a30bf0702f9f6d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:10.353845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:10.354669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee0c91f3-8595-4839-aee9-77030792c850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:10.356417 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1579/3199] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:10 2021] DELETE /identity/v3/projects/6dad2b253de24283a30bf0702f9f6d5d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:10.362400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02567c-3414-403b-bae6-3d68cb19b65a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:10.362849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02567c-3414-403b-bae6-3d68cb19b65a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:10.363161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02567c-3414-403b-bae6-3d68cb19b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:10.396391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4d02567c-3414-403b-bae6-3d68cb19b65a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:10.397814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4d02567c-3414-403b-bae6-3d68cb19b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:10.483213 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1621/3200] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:10.492136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feec4f-41f9-47a1-9d0a-6a91fe1bc7a2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:10.492629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feec4f-41f9-47a1-9d0a-6a91fe1bc7a2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:10.493150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feec4f-41f9-47a1-9d0a-6a91fe1bc7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:10.526161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e6feec4f-41f9-47a1-9d0a-6a91fe1bc7a2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:10.527435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e6feec4f-41f9-47a1-9d0a-6a91fe1bc7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:10.541641 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1580/3201] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:10.545208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02567c-3414-403b-bae6-3d68cb19b65a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:10.573201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02567c-3414-403b-bae6-3d68cb19b65a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:10.590021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:10.591314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:10.591748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:10.592195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:10.592959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:10.593574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:10.595249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:10.625239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1622/3202] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:15:10.628334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feec4f-41f9-47a1-9d0a-6a91fe1bc7a2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:10.639516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feec4f-41f9-47a1-9d0a-6a91fe1bc7a2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:10.665670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed81132-fecb-43af-a20c-6dbdb69a0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:10.666356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81132-fecb-43af-a20c-6dbdb69a0e84 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:10.666630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81132-fecb-43af-a20c-6dbdb69a0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:10.666899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81132-fecb-43af-a20c-6dbdb69a0e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:10.667606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed81132-fecb-43af-a20c-6dbdb69a0e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:10.669538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed81132-fecb-43af-a20c-6dbdb69a0e84 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:10.902304 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1581/3203] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:10 2021] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:10.906443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:10.916362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28892ad-b909-4051-9e31-80e18375294d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:10.970862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:10.971526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:10.971802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:10.972073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:10.975327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:10.979076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:11.001869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b243f0-48c0-4328-8b96-8646a962a10b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:11.002372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b243f0-48c0-4328-8b96-8646a962a10b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:11.002918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b243f0-48c0-4328-8b96-8646a962a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:11.025038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-99b243f0-48c0-4328-8b96-8646a962a10b None None] MFA Rules not processed for user `4039c9a053164b1685c6535b79a763a4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:11.025038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-99b243f0-48c0-4328-8b96-8646a962a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:11.100517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1582/3204] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:10 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:11.176985 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1623/3205] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:10 2021] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:15:11.179092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b243f0-48c0-4328-8b96-8646a962a10b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:11.197946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b243f0-48c0-4328-8b96-8646a962a10b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:11.203090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:11.203857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:11.204236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:11.204604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:11.205673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:11.207483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:11.218945 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1583/3206] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:11 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:11.223168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:11.234838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0371b-9a1f-481e-b1a2-9be4e638ee19 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:11.240475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789d10c-0721-4084-939c-77c36a3833cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:11.241270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789d10c-0721-4084-939c-77c36a3833cb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:11.241647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789d10c-0721-4084-939c-77c36a3833cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:11.242530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789d10c-0721-4084-939c-77c36a3833cb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:11.243884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789d10c-0721-4084-939c-77c36a3833cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:11.245562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789d10c-0721-4084-939c-77c36a3833cb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:11.259544 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1624/3207] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:11 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:11.263538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:11.274471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf15a-9d4b-4f32-9a18-b6e585b3f7f5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:11.279427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:11.280920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:11.281297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:11.286781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] PATH_INFO: `/v3/projects/15ce761833da44ab96853ac15c9dd881/users/6fa19d2beb384f71ab5a173bfde53711/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:11.300073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ce761833da44ab96853ac15c9dd881, user_id=6fa19d2beb384f71ab5a173bfde53711, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:11.302846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:11.441215 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1584/3208] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:11 2021] PUT /identity/v3/projects/15ce761833da44ab96853ac15c9dd881/users/6fa19d2beb384f71ab5a173bfde53711/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:11.452637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71becba4-22d9-422c-b4ce-09212ba3001b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:11.453041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71becba4-22d9-422c-b4ce-09212ba3001b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:11.453769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71becba4-22d9-422c-b4ce-09212ba3001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:11.490919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-71becba4-22d9-422c-b4ce-09212ba3001b None None] MFA Rules not processed for user `6fa19d2beb384f71ab5a173bfde53711`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:11.493764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-71becba4-22d9-422c-b4ce-09212ba3001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:11.620777 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1625/3209] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:11.625506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:11.686555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30a643-eb5c-4bf0-a5c8-417c41649569 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:11.691159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65bbca-23dc-40f2-9f94-39c7a470b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:11.692233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bbca-23dc-40f2-9f94-39c7a470b0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:11.692360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bbca-23dc-40f2-9f94-39c7a470b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:11.697355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bbca-23dc-40f2-9f94-39c7a470b0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:11.697355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65bbca-23dc-40f2-9f94-39c7a470b0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:11.697355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65bbca-23dc-40f2-9f94-39c7a470b0b4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:11.910565 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1585/3210] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:11 2021] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:11.914464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71becba4-22d9-422c-b4ce-09212ba3001b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:11.944669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71becba4-22d9-422c-b4ce-09212ba3001b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:12.001355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.001647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.001931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:12.048998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:12.048998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:12.081420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:12.082435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.082783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.083164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:12.084279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:12.087132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:12.130809 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1586/3211] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:15:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:12.150345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:12.157415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:12.236823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39542a-a6be-4284-bc18-3852e75ed75b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:12.242109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:12.242761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.243068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.243339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:12.251847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:12.253479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:12.261865 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1587/3212] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:15:12.434521 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1626/3213] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:11 2021] POST /identity/v3/users => generated 294 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:12.435966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:12.448851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c41022-fec3-41a3-8180-b8201876cf68 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:12.453868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:12.454611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.455091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.455563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:12.456375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:12.458215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:12.473563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1588/3214] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:12.474951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:12.487712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bce38e-2a1d-4255-ad43-ac501c91c22c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:12.493743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:12.494635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.495158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.495476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] PATH_INFO: `/v3/projects/4478cf0defd5427ea8ac8a0d994a2726/users/f52cdb9dd7624418be5ab8bdb7763709/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:12.515901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4478cf0defd5427ea8ac8a0d994a2726, user_id=f52cdb9dd7624418be5ab8bdb7763709, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:12.518903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:12.757143 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1627/3215] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:12 2021] PUT /identity/v3/projects/4478cf0defd5427ea8ac8a0d994a2726/users/f52cdb9dd7624418be5ab8bdb7763709/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:12.761322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:12.775876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5dec-426e-4797-8759-b165b41883c4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:12.851011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21b224-8bc3-49d8-85b4-9f04583f27ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:12.851847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21b224-8bc3-49d8-85b4-9f04583f27ae admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.852296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21b224-8bc3-49d8-85b4-9f04583f27ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.852672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21b224-8bc3-49d8-85b4-9f04583f27ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:12.853887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21b224-8bc3-49d8-85b4-9f04583f27ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:12.855813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21b224-8bc3-49d8-85b4-9f04583f27ae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:12.873067 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1589/3216] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:12 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:12.878499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:12.897002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011ba94-a379-4eae-948b-a64abbf67933 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:12.911783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:12.914409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.914924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.915384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] PATH_INFO: `/v3/projects/4478cf0defd5427ea8ac8a0d994a2726/users/f52cdb9dd7624418be5ab8bdb7763709/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:12.917773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4478cf0defd5427ea8ac8a0d994a2726, user_id=f52cdb9dd7624418be5ab8bdb7763709, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:12.920599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:12.947405 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1628/3217] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:12 2021] PUT /identity/v3/projects/4478cf0defd5427ea8ac8a0d994a2726/users/f52cdb9dd7624418be5ab8bdb7763709/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:12.963299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ae55f-f627-4202-8a6f-c67b317e9e58 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:12.963607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ae55f-f627-4202-8a6f-c67b317e9e58 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:12.963886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ae55f-f627-4202-8a6f-c67b317e9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:13.014054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6a1ae55f-f627-4202-8a6f-c67b317e9e58 None None] MFA Rules not processed for user `f52cdb9dd7624418be5ab8bdb7763709`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:13.015837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6a1ae55f-f627-4202-8a6f-c67b317e9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:13.122380 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1590/3218] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:12 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:13.132796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:13.134648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:13.261781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4480-ae1f-4d64-8b9b-29bd71fc06f1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:13.273556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66414f70-9bbc-4e23-85dc-25dd08e1bd56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:13.274332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66414f70-9bbc-4e23-85dc-25dd08e1bd56 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:13.274611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66414f70-9bbc-4e23-85dc-25dd08e1bd56 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:13.274883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66414f70-9bbc-4e23-85dc-25dd08e1bd56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:13.285651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66414f70-9bbc-4e23-85dc-25dd08e1bd56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:13.287406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66414f70-9bbc-4e23-85dc-25dd08e1bd56 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:13.299837 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1629/3219] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:13 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:15:15.338654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ae55f-f627-4202-8a6f-c67b317e9e58 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:15.441474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ae55f-f627-4202-8a6f-c67b317e9e58 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:15.455194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:15.456088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:15.457284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:15.457577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] PATH_INFO: `/v3/users/6fa19d2beb384f71ab5a173bfde53711` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:15.459847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa19d2beb384f71ab5a173bfde53711)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:15.461933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:15.870867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa19d2beb384f71ab5a173bfde53711'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:15.878953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa19d2beb384f71ab5a173bfde53711'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:15.891811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa19d2beb384f71ab5a173bfde53711'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:15.892555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa19d2beb384f71ab5a173bfde53711'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:15.894052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa19d2beb384f71ab5a173bfde53711'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:16.006996 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1591/3220] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:15 2021] DELETE /identity/v3/users/6fa19d2beb384f71ab5a173bfde53711 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:16.011805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:16.012287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:16.012389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:16.030879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:16.032111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:16.100531 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1630/3221] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:16.108536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:16.111316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:16.186486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dfb7c-8e3a-4de6-ac30-c9a667ec5602 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:16.190238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a9a31-a01d-45d0-a818-55bbd434f0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:16.190901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9a31-a01d-45d0-a818-55bbd434f0fb service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:16.191182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9a31-a01d-45d0-a818-55bbd434f0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:16.191489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a9a31-a01d-45d0-a818-55bbd434f0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:16.204184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9a31-a01d-45d0-a818-55bbd434f0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:16.205596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a9a31-a01d-45d0-a818-55bbd434f0fb service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:16.216736 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1592/3222] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:16.704574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:16.706099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:16.720409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e8557-ed50-4bee-88b8-0264676d3df2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:16.726046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:16.726673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:16.730509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:16.730509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] PATH_INFO: `/v3/projects/15ce761833da44ab96853ac15c9dd881` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:16.730509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ce761833da44ab96853ac15c9dd881)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:16.731017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:16.754391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0a01-ee53-4e99-84f7-836eb9d1eecf None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:16.754935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0a01-ee53-4e99-84f7-836eb9d1eecf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:16.754935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0a01-ee53-4e99-84f7-836eb9d1eecf None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:16.756701 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1593/3223] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:15:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:15:16.762119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:16.762406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:16.764725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:16.796477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:16.797947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:16.874534 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1594/3224] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:15:16 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:16.910617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:16.910617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:16.924164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505fb5-8068-4a01-8e42-3f978ba09044 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:16.925679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ce761833da44ab96853ac15c9dd881', 'request_id': 'req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.004056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:17.005082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:17.005367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:17.005639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:17.015028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:17.019139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:17.029866 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1595/3225] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:17.037014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ce761833da44ab96853ac15c9dd881', 'request_id': 'req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.047661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ce761833da44ab96853ac15c9dd881', 'request_id': 'req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.063869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] The token cache is being invalidate because project 15ce761833da44ab96853ac15c9dd881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:17.064232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.064911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.069116 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1631/3226] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:16 2021] DELETE /identity/v3/projects/15ce761833da44ab96853ac15c9dd881 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:17.076546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:17.156492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee6b98-6caa-4c74-9a8e-9ca60a86d26f service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:17.162966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:17.163853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:17.164135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:17.164409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] PATH_INFO: `/v3/users/f52cdb9dd7624418be5ab8bdb7763709` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:17.165733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52cdb9dd7624418be5ab8bdb7763709)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:17.167643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:17.448045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52cdb9dd7624418be5ab8bdb7763709'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.468997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52cdb9dd7624418be5ab8bdb7763709'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.507941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52cdb9dd7624418be5ab8bdb7763709'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.508262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52cdb9dd7624418be5ab8bdb7763709'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.509482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5ec3a8b-2f8a-4c5f-8366-a60e930107f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52cdb9dd7624418be5ab8bdb7763709'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:17.597478 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1596/3227] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:17 2021] DELETE /identity/v3/users/f52cdb9dd7624418be5ab8bdb7763709 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:18.113142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:18.119524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:18.132086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576f8bf-bf8a-4216-9683-0f8fa854e9d9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:18.222242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:18.223108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:18.223522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:18.225311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] PATH_INFO: `/v3/projects/4478cf0defd5427ea8ac8a0d994a2726` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:18.226837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4478cf0defd5427ea8ac8a0d994a2726)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:18.231774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:18.416658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4478cf0defd5427ea8ac8a0d994a2726', 'request_id': 'req-082c8ad8-b2af-432f-aa2b-a428835fd87b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:18.494178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4478cf0defd5427ea8ac8a0d994a2726', 'request_id': 'req-082c8ad8-b2af-432f-aa2b-a428835fd87b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:18.502493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4478cf0defd5427ea8ac8a0d994a2726', 'request_id': 'req-082c8ad8-b2af-432f-aa2b-a428835fd87b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:18.515371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] The token cache is being invalidate because project 4478cf0defd5427ea8ac8a0d994a2726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:18.515725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:18.517043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-082c8ad8-b2af-432f-aa2b-a428835fd87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:18.519003 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1632/3228] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:18 2021] DELETE /identity/v3/projects/4478cf0defd5427ea8ac8a0d994a2726 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:18.526198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41a9ff-fee4-4704-92a2-000a4085976a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:18.527208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41a9ff-fee4-4704-92a2-000a4085976a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:18.527700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41a9ff-fee4-4704-92a2-000a4085976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:18.548226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8e41a9ff-fee4-4704-92a2-000a4085976a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:18.549561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e41a9ff-fee4-4704-92a2-000a4085976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:18.619078 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1597/3229] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:18.629284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0f3e5-e1f6-4e27-915d-e0ffd4af78a2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:18.630068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0f3e5-e1f6-4e27-915d-e0ffd4af78a2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:18.630264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0f3e5-e1f6-4e27-915d-e0ffd4af78a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:18.673983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2ba0f3e5-e1f6-4e27-915d-e0ffd4af78a2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:18.675956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2ba0f3e5-e1f6-4e27-915d-e0ffd4af78a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:18.694506 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1633/3230] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:18.695563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41a9ff-fee4-4704-92a2-000a4085976a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:18.717429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41a9ff-fee4-4704-92a2-000a4085976a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:18.732051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:18.733299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:18.733733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:18.735722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:18.737171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:18.738810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:18.743671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:18.775521 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1598/3231] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:15:18.779969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0f3e5-e1f6-4e27-915d-e0ffd4af78a2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:18.790833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0f3e5-e1f6-4e27-915d-e0ffd4af78a2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:18.800527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:18.803186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:18.803186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:18.803487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:18.804186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:18.807644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:18.902867 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1634/3232] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:18 2021] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:18.908362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:18.920212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87255d7c-4b2a-4c23-915f-dcc2c124770c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:19.035492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:19.036410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:19.036694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:19.037151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:19.037854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:19.040599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:19.128274 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1599/3233] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:18 2021] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:19.132401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:19.149323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25203b4-5d7a-4412-9cdd-44b0e2232b2e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:19.155453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:19.165272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:19.166330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:19.167699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:19.168678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:19.175702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:19.196188 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1635/3234] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:19.198322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:19.213412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67934f54-9b28-46fb-93ed-80ba4f87acd8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:19.219534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565276ea-d804-4df4-919f-c9455b12b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:19.220424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565276ea-d804-4df4-919f-c9455b12b70e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:19.220935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565276ea-d804-4df4-919f-c9455b12b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:19.222025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565276ea-d804-4df4-919f-c9455b12b70e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:19.222912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565276ea-d804-4df4-919f-c9455b12b70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:19.225052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565276ea-d804-4df4-919f-c9455b12b70e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:19.237409 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1600/3235] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:15:19.241645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:19.253235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a0966-0d30-43af-8807-e0daf9f39ec5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:19.261137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:19.262636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:19.263965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:19.264502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] PATH_INFO: `/v3/projects/2fe1a82960c8413095a4b833950e8b3f/users/41b30a9fab164735bfb1d19a83b66ce6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:19.290737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe1a82960c8413095a4b833950e8b3f, user_id=41b30a9fab164735bfb1d19a83b66ce6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:19.303389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:19.424478 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1636/3236] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:19 2021] PUT /identity/v3/projects/2fe1a82960c8413095a4b833950e8b3f/users/41b30a9fab164735bfb1d19a83b66ce6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:19.437927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc5c7f-7daf-499a-a592-aee13a48e03d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:19.437927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc5c7f-7daf-499a-a592-aee13a48e03d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:19.442025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc5c7f-7daf-499a-a592-aee13a48e03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:19.498144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a0bc5c7f-7daf-499a-a592-aee13a48e03d None None] MFA Rules not processed for user `41b30a9fab164735bfb1d19a83b66ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:19.499999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a0bc5c7f-7daf-499a-a592-aee13a48e03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:19.589805 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1601/3237] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:19 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:19.591284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:19.676246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e717e-b5a1-4fb6-aff4-654a15e2f153 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:19.685903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:19.687175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:19.688728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:19.689227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:19.694911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:19.694911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:19.857586 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1637/3238] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:19 2021] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:19.863486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc5c7f-7daf-499a-a592-aee13a48e03d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:19.885492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc5c7f-7daf-499a-a592-aee13a48e03d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:19.988795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:19.989412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:19.989761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:19.990120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:19.990883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:19.993479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:20.093827 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1602/3239] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:19 2021] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:20.096134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:20.111746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ee78c-e3f4-420e-a9d4-6e019a13fda1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:20.118595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:20.119813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:20.120439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:20.121797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:20.122661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:20.124398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:20.142104 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1638/3240] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:20.143328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:20.155104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45693e03-a51a-481b-8420-be99acb63738 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:20.178266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:20.179188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:20.179466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:20.179747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] PATH_INFO: `/v3/projects/d2c208f87a8d4c2496f4734f4e4fe7ff/users/6dd110a950974effbe12b33268c7f9e1/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:20.199813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c208f87a8d4c2496f4734f4e4fe7ff, user_id=6dd110a950974effbe12b33268c7f9e1, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:20.202544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:20.287676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1603/3241] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:20 2021] PUT /identity/v3/projects/d2c208f87a8d4c2496f4734f4e4fe7ff/users/6dd110a950974effbe12b33268c7f9e1/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:15:20.290760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:20.303012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84733196-1c7b-441c-90e7-fd7afb76d1b6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:20.376275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdeba6-79c0-4ae3-8d21-9ee879e80298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:20.377362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdeba6-79c0-4ae3-8d21-9ee879e80298 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:20.377646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdeba6-79c0-4ae3-8d21-9ee879e80298 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:20.377931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdeba6-79c0-4ae3-8d21-9ee879e80298 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:20.378676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdeba6-79c0-4ae3-8d21-9ee879e80298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:20.380661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdeba6-79c0-4ae3-8d21-9ee879e80298 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:20.393909 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1639/3242] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:20.397942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:20.409396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fc605-417c-4a24-9362-1cb1e6ea8e6d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:20.414384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac633b-3f5a-4921-8ee9-c716e87f5114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:20.415650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac633b-3f5a-4921-8ee9-c716e87f5114 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:20.415989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac633b-3f5a-4921-8ee9-c716e87f5114 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:20.416484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac633b-3f5a-4921-8ee9-c716e87f5114 admin admin] PATH_INFO: `/v3/projects/d2c208f87a8d4c2496f4734f4e4fe7ff/users/6dd110a950974effbe12b33268c7f9e1/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:20.420166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac633b-3f5a-4921-8ee9-c716e87f5114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c208f87a8d4c2496f4734f4e4fe7ff, user_id=6dd110a950974effbe12b33268c7f9e1, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:20.423215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac633b-3f5a-4921-8ee9-c716e87f5114 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:20.436954 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1604/3243] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:20 2021] PUT /identity/v3/projects/d2c208f87a8d4c2496f4734f4e4fe7ff/users/6dd110a950974effbe12b33268c7f9e1/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:20.448208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:20.448747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:20.449262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:20.481066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] MFA Rules not processed for user `6dd110a950974effbe12b33268c7f9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:20.482786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:20.569361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1640/3244] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:20 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:20.582321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:20.582729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:20.583488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:20.605334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] MFA Rules not processed for user `41b30a9fab164735bfb1d19a83b66ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:20.606765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:20.734934 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1605/3245] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:20 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:20.776471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:20.778650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:20.878760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e013813-14fb-4dcd-be38-568076391ef3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:20.885889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:20.886502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:20.886783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:20.888013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:20.908658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:20.914734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:20.932220 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1641/3246] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:20 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:32.211275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:32.212855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:32.279364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48274-5a86-43d6-b662-aa4e340cd696 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:32.283984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:32.284855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:32.285170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:32.285445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] PATH_INFO: `/v3/users/e3cb179749ef4bc786cc3059f72734f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:32.286639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cb179749ef4bc786cc3059f72734f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:32.288569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:32.427837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cb179749ef4bc786cc3059f72734f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:32.434763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cb179749ef4bc786cc3059f72734f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:32.446383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cb179749ef4bc786cc3059f72734f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:32.447043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cb179749ef4bc786cc3059f72734f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:32.447667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cb179749ef4bc786cc3059f72734f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:32.533000 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1606/3247] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:32 2021] DELETE /identity/v3/users/e3cb179749ef4bc786cc3059f72734f8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:32.849677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:32.860791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee74de-d38c-454a-ad05-4ba936996029 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:32.933146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:32.934271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:32.934553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:32.934828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] PATH_INFO: `/v3/projects/53cc391e03de44dbb245531288da2872` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:32.936051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cc391e03de44dbb245531288da2872)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:32.938236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:33.076038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cc391e03de44dbb245531288da2872', 'request_id': 'req-7ecb7a60-9a71-489d-9618-192a2a9e04bc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.144042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cc391e03de44dbb245531288da2872', 'request_id': 'req-7ecb7a60-9a71-489d-9618-192a2a9e04bc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.150462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cc391e03de44dbb245531288da2872', 'request_id': 'req-7ecb7a60-9a71-489d-9618-192a2a9e04bc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.160633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] The token cache is being invalidate because project 53cc391e03de44dbb245531288da2872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:33.160945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.161586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.163093 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1642/3248] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:32 2021] DELETE /identity/v3/projects/53cc391e03de44dbb245531288da2872 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:33.167319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:33.168699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:33.182045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641bc93-dce5-450d-917b-9899c9c160c8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:33.236449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:33.237357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:33.237641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:33.237934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] PATH_INFO: `/v3/users/bc3887c19533490a973e8c1775fe1c93` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:33.239198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3887c19533490a973e8c1775fe1c93)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:33.241153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:33.380980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3887c19533490a973e8c1775fe1c93'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.387639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3887c19533490a973e8c1775fe1c93'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.399305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3887c19533490a973e8c1775fe1c93'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.401278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3887c19533490a973e8c1775fe1c93'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.401278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d1f49391-0d2f-487d-bfc7-e7b9c2edd1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3887c19533490a973e8c1775fe1c93'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:33.501477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1607/3249] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:33 2021] DELETE /identity/v3/users/bc3887c19533490a973e8c1775fe1c93 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:33.877737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:33.880399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:33.913512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7a60-9a71-489d-9618-192a2a9e04bc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:33.980137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:33.981181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:33.981488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:33.981764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] PATH_INFO: `/v3/projects/93f66f3f38674111af80e14c33a3e39d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:33.982991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f66f3f38674111af80e14c33a3e39d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:33.985165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:34.115079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f66f3f38674111af80e14c33a3e39d', 'request_id': 'req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:34.201737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f66f3f38674111af80e14c33a3e39d', 'request_id': 'req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:34.208562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f66f3f38674111af80e14c33a3e39d', 'request_id': 'req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:34.219880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] The token cache is being invalidate because project 93f66f3f38674111af80e14c33a3e39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:34.220162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:34.220787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bbad35d-36b9-4fc5-b4f3-72f4f0b19aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:34.222330 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1643/3250] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:33 2021] DELETE /identity/v3/projects/93f66f3f38674111af80e14c33a3e39d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:34.230228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975345b-bcfb-4d52-a093-51bd5880183c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.230559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975345b-bcfb-4d52-a093-51bd5880183c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.235959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975345b-bcfb-4d52-a093-51bd5880183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.248206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5975345b-bcfb-4d52-a093-51bd5880183c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:34.249462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5975345b-bcfb-4d52-a093-51bd5880183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:34.309310 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1608/3251] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:34.316781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9686-ca9e-4163-ae92-d4ac01b56712 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.317142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9686-ca9e-4163-ae92-d4ac01b56712 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.317414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9686-ca9e-4163-ae92-d4ac01b56712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.338919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f4ff9686-ca9e-4163-ae92-d4ac01b56712 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:34.338919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f4ff9686-ca9e-4163-ae92-d4ac01b56712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:34.345453 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1644/3252] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:34.349469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975345b-bcfb-4d52-a093-51bd5880183c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:34.359989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975345b-bcfb-4d52-a093-51bd5880183c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:34.364618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:34.365327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.365610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.365887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.366648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:34.367032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:34.368630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:34.380082 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1609/3253] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:15:34.385011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff9686-ca9e-4163-ae92-d4ac01b56712 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:34.394287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff9686-ca9e-4163-ae92-d4ac01b56712 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:34.399617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:34.400256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.400534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.400805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.401522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:34.403392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:34.506692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1645/3254] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:34 2021] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:34.511206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:34.522404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa01267-f55c-49bd-b2d9-8ddb22bdb1b0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:34.578156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:34.578831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.579103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.579378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.580076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:34.582000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:34.700478 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1610/3255] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:34 2021] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:15:34.704672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:34.719789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94308d-70b1-44d6-af4c-ba336074a442 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:34.731221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:34.731906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.732189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.732461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.733237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:34.734870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:34.749822 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1646/3256] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:34.752020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:34.763163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb17f5-775a-4ee3-bc52-da54907fc736 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:34.769242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b675c-1079-4697-a83f-099fb65c432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:34.770154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b675c-1079-4697-a83f-099fb65c432a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.770591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b675c-1079-4697-a83f-099fb65c432a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.771403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b675c-1079-4697-a83f-099fb65c432a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.771699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b675c-1079-4697-a83f-099fb65c432a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:34.774274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b675c-1079-4697-a83f-099fb65c432a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:34.786961 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1611/3257] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:34 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:34.792022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:34.803537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822ac4-9dff-42e4-ac76-515ebff3c3a0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:34.811144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610232b-933c-4e74-bc22-24de2bc0f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:34.812039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610232b-933c-4e74-bc22-24de2bc0f496 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.812325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610232b-933c-4e74-bc22-24de2bc0f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.812629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610232b-933c-4e74-bc22-24de2bc0f496 admin admin] PATH_INFO: `/v3/projects/09501908783040bb8a8cc10281a09ca0/users/1eb3d60267fd475fb9d80b8fdfecb0e7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.837128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610232b-933c-4e74-bc22-24de2bc0f496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09501908783040bb8a8cc10281a09ca0, user_id=1eb3d60267fd475fb9d80b8fdfecb0e7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:34.839742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610232b-933c-4e74-bc22-24de2bc0f496 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:34.934204 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1647/3258] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:34 2021] PUT /identity/v3/projects/09501908783040bb8a8cc10281a09ca0/users/1eb3d60267fd475fb9d80b8fdfecb0e7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:34.945511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.946055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.946552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.947993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:34.948283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:34.948554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:34.966809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:34.968006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:34.974478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] MFA Rules not processed for user `1eb3d60267fd475fb9d80b8fdfecb0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:34.975669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.024472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1648/3259] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:15:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:35.037904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:35.040310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.042803 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1612/3260] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:34 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:35.055618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:35.057090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.123283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eea9f-d063-4124-8651-bf6eab204406 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:35.129512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:35.130348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:35.130811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:35.131519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:35.138988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85890bb-fdef-4a1d-97f5-d4717e806d92 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:35.142582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:35.144285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:35.145864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b11cdb-9cb3-411e-85c7-42429ec403e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:35.146206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b11cdb-9cb3-411e-85c7-42429ec403e0 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:35.146562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b11cdb-9cb3-411e-85c7-42429ec403e0 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:35.146932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b11cdb-9cb3-411e-85c7-42429ec403e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:35.152846 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1649/3261] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:15:35.156472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b11cdb-9cb3-411e-85c7-42429ec403e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:35.158043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b11cdb-9cb3-411e-85c7-42429ec403e0 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:35.168011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1613/3262] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:35 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:15:35.247251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:35.249232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.267965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551a730-ed48-4282-8f8b-af9a0bb149b1 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:35.276659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:35.277524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:35.277865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:35.278145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:35.280145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.362862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:35.364459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:35.379984 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1650/3263] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:35 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:35.454613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f2d85-c245-4b63-a63e-ccf4d1e02af1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:35.455126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f2d85-c245-4b63-a63e-ccf4d1e02af1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:35.455126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f2d85-c245-4b63-a63e-ccf4d1e02af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:35.489892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-243f2d85-c245-4b63-a63e-ccf4d1e02af1 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:35.490687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-243f2d85-c245-4b63-a63e-ccf4d1e02af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.516431 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1614/3264] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:15:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:15:35.533517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:35.547537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574b9c-b60d-499e-9050-91b292629078 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:35.566359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee734aab-c95b-4d01-8855-0c9adeda3c2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:35.567415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734aab-c95b-4d01-8855-0c9adeda3c2e service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:35.569004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734aab-c95b-4d01-8855-0c9adeda3c2e service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:35.570671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734aab-c95b-4d01-8855-0c9adeda3c2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:35.581860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee734aab-c95b-4d01-8855-0c9adeda3c2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:35.583919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee734aab-c95b-4d01-8855-0c9adeda3c2e service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:35.597014 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1651/3265] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:15:35.799635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e883a7-2145-4453-987f-511d5c7aa3ea None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:35.799923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e883a7-2145-4453-987f-511d5c7aa3ea None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:35.800408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e883a7-2145-4453-987f-511d5c7aa3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:35.826840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c0e883a7-2145-4453-987f-511d5c7aa3ea None None] MFA Rules not processed for user `41b30a9fab164735bfb1d19a83b66ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:35.828458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c0e883a7-2145-4453-987f-511d5c7aa3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.925412 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1615/3266] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:35 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:35.949872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c5924-2d89-4b68-8c6e-c75a8dd870a7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:35.950354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c5924-2d89-4b68-8c6e-c75a8dd870a7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:35.950493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c5924-2d89-4b68-8c6e-c75a8dd870a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:35.974824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-345c5924-2d89-4b68-8c6e-c75a8dd870a7 None None] MFA Rules not processed for user `1eb3d60267fd475fb9d80b8fdfecb0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:35.976253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-345c5924-2d89-4b68-8c6e-c75a8dd870a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:35.985242 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1652/3267] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:36.536783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46fce-2504-48a6-b7b8-e000847ecdf7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:36.537359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46fce-2504-48a6-b7b8-e000847ecdf7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:36.537906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46fce-2504-48a6-b7b8-e000847ecdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:36.557000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eef46fce-2504-48a6-b7b8-e000847ecdf7 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:36.558872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eef46fce-2504-48a6-b7b8-e000847ecdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:36.575666 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1616/3268] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:15:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:36.583935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c5924-2d89-4b68-8c6e-c75a8dd870a7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:36.601861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c5924-2d89-4b68-8c6e-c75a8dd870a7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:36.608480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446a633-a055-41b6-a861-06e0951221ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:36.609252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a633-a055-41b6-a861-06e0951221ba service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:36.609531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a633-a055-41b6-a861-06e0951221ba service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:36.609811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a633-a055-41b6-a861-06e0951221ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:36.622005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446a633-a055-41b6-a861-06e0951221ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:36.623846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446a633-a055-41b6-a861-06e0951221ba service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:36.635144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1653/3269] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:15:37.143651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46fce-2504-48a6-b7b8-e000847ecdf7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:37.247725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46fce-2504-48a6-b7b8-e000847ecdf7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:37.252341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:37.253254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:37.253534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:37.253806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] PATH_INFO: `/v3/users/1eb3d60267fd475fb9d80b8fdfecb0e7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:37.255662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb3d60267fd475fb9d80b8fdfecb0e7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:37.258154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:37.477863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb3d60267fd475fb9d80b8fdfecb0e7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:37.487554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb3d60267fd475fb9d80b8fdfecb0e7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:37.507921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb3d60267fd475fb9d80b8fdfecb0e7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:37.509195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb3d60267fd475fb9d80b8fdfecb0e7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:37.510199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb3d60267fd475fb9d80b8fdfecb0e7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:37.608935 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1617/3270] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:37 2021] DELETE /identity/v3/users/1eb3d60267fd475fb9d80b8fdfecb0e7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:37.613779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:37.614242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:37.614742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:37.654106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:37.655459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:37.739521 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1654/3271] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:37.745441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:37.746900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:37.839235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a0668-4dcb-4263-82c4-d09c8c495d4a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:37.844469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23522198-8025-4339-a1d3-a2c2c57a19b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:37.845146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522198-8025-4339-a1d3-a2c2c57a19b9 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:37.845433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522198-8025-4339-a1d3-a2c2c57a19b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:37.845708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23522198-8025-4339-a1d3-a2c2c57a19b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:37.856850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23522198-8025-4339-a1d3-a2c2c57a19b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:37.858394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23522198-8025-4339-a1d3-a2c2c57a19b9 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:37.871760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1618/3272] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:38.518396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:38.519619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:38.539254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2cc48-5247-44d6-b3fa-879b9b6324b0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:38.544639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:38.545635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:38.545957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:38.546209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] PATH_INFO: `/v3/projects/09501908783040bb8a8cc10281a09ca0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:38.547849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09501908783040bb8a8cc10281a09ca0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:38.550291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:38.963423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09501908783040bb8a8cc10281a09ca0', 'request_id': 'req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:39.058719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09501908783040bb8a8cc10281a09ca0', 'request_id': 'req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:39.067405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09501908783040bb8a8cc10281a09ca0', 'request_id': 'req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:39.088262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] The token cache is being invalidate because project 09501908783040bb8a8cc10281a09ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:39.089065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:39.089279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf259c3a-4f25-429e-a2ae-0cc20fec98c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:39.093520 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1655/3273] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:38 2021] DELETE /identity/v3/projects/09501908783040bb8a8cc10281a09ca0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:39.099962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a04d79-2edd-4383-9b59-6558f7273d0f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.100435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a04d79-2edd-4383-9b59-6558f7273d0f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.100557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a04d79-2edd-4383-9b59-6558f7273d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.133704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-88a04d79-2edd-4383-9b59-6558f7273d0f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:39.135400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-88a04d79-2edd-4383-9b59-6558f7273d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:39.223623 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1619/3274] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:39.225536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd5fa-06bf-41d6-a49a-142ab585c115 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.225828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd5fa-06bf-41d6-a49a-142ab585c115 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.226703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd5fa-06bf-41d6-a49a-142ab585c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.259226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1f5fd5fa-06bf-41d6-a49a-142ab585c115 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:39.261722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f5fd5fa-06bf-41d6-a49a-142ab585c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:39.273399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1656/3275] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:39.278015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a04d79-2edd-4383-9b59-6558f7273d0f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:39.289378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a04d79-2edd-4383-9b59-6558f7273d0f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:39.294410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:39.295082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.295365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.295639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.296376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:39.296682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:39.299205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:39.316808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1620/3276] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:15:39.321582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd5fa-06bf-41d6-a49a-142ab585c115 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:39.333540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd5fa-06bf-41d6-a49a-142ab585c115 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:39.345893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:39.348579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.348579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.348579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.349768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:39.352318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:39.494454 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1657/3277] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:39 2021] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:39.496604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:39.510612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca32e4-2b6e-40a3-8a62-9e259c948331 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:39.614856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:39.615749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.616132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.616518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.617443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:39.619764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:39.719292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1621/3278] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:39 2021] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:15:39.724025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:39.736201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a23b-f667-4b0a-b5b4-f81318611f1b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:39.750540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:39.753773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.754246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.754700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.755660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:39.768614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:39.791680 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1658/3279] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:39 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:39.796128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:39.812052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773774cf-778a-43da-aaf1-635fd9efcc0c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:39.821624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3646e4-8c1d-4630-9866-449fd3e93482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:39.827496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3646e4-8c1d-4630-9866-449fd3e93482 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.827496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3646e4-8c1d-4630-9866-449fd3e93482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.827496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3646e4-8c1d-4630-9866-449fd3e93482 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.827496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3646e4-8c1d-4630-9866-449fd3e93482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:39.827496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3646e4-8c1d-4630-9866-449fd3e93482 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:39.846663 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1622/3280] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:39 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:15:39.850174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:39.864018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b32359-7741-44a8-9286-85923923ec3b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:39.887123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:39.894710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:39.894710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:39.894710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] PATH_INFO: `/v3/projects/577ba8f0522d4cb7835b446932eca5aa/users/c0d16dd0e3894b639f6f472545392bd1/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:39.918828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577ba8f0522d4cb7835b446932eca5aa, user_id=c0d16dd0e3894b639f6f472545392bd1, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:39.922632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:40.018757 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1659/3281] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:15:39 2021] PUT /identity/v3/projects/577ba8f0522d4cb7835b446932eca5aa/users/c0d16dd0e3894b639f6f472545392bd1/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:40.024468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050bb9-1a8d-4ae0-8ef1-8a14bdb5f22e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:40.024468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050bb9-1a8d-4ae0-8ef1-8a14bdb5f22e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:40.024767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050bb9-1a8d-4ae0-8ef1-8a14bdb5f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:40.045699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3d050bb9-1a8d-4ae0-8ef1-8a14bdb5f22e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:40.046932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3d050bb9-1a8d-4ae0-8ef1-8a14bdb5f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:40.128273 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1623/3282] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:40.135505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:40.140355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:40.255887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6a7b-f7ec-4746-ab7a-1bcc9df51276 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:40.266902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:40.268196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:40.268481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:40.268812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:40.279684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:40.284632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:40.323898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1660/3283] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:15:51.052819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e47854-a912-46c8-b54a-34055d63bba1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:51.053330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e47854-a912-46c8-b54a-34055d63bba1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:51.053444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e47854-a912-46c8-b54a-34055d63bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:51.085733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-18e47854-a912-46c8-b54a-34055d63bba1 None None] MFA Rules not processed for user `c0d16dd0e3894b639f6f472545392bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:51.087296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-18e47854-a912-46c8-b54a-34055d63bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:51.160012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1624/3284] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:51 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:51.380976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:51.383994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:51.474161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8413e5-35dc-4c3d-b5c6-7298562ddd31 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:51.480595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:51.481535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:51.482012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:51.482280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:51.492092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:51.494010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:51.516336 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1661/3285] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:15:51 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:57.370576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117cffc-7b27-48d2-9f3e-da3740ac2ea2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:57.371739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117cffc-7b27-48d2-9f3e-da3740ac2ea2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:57.372087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117cffc-7b27-48d2-9f3e-da3740ac2ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:57.407274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e117cffc-7b27-48d2-9f3e-da3740ac2ea2 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:57.408611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e117cffc-7b27-48d2-9f3e-da3740ac2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:57.493304 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1625/3286] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:15:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:57.493962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:57.495430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:57.655114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da37ce2-3dbb-460a-9bc1-14cea782766f service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:57.664348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcb90b-68e2-4164-98a4-90a9b06ff146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:57.666620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcb90b-68e2-4164-98a4-90a9b06ff146 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:57.666620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcb90b-68e2-4164-98a4-90a9b06ff146 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:57.667945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcb90b-68e2-4164-98a4-90a9b06ff146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:57.697007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcb90b-68e2-4164-98a4-90a9b06ff146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:57.698861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcb90b-68e2-4164-98a4-90a9b06ff146 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:57.710541 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1662/3287] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:15:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:15:57.817278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117cffc-7b27-48d2-9f3e-da3740ac2ea2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:57.835555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117cffc-7b27-48d2-9f3e-da3740ac2ea2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:57.843997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:57.845223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:57.852167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:57.852167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] PATH_INFO: `/v3/users/c0d16dd0e3894b639f6f472545392bd1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:57.852167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d16dd0e3894b639f6f472545392bd1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:57.852167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:58.042104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d16dd0e3894b639f6f472545392bd1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:58.053960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d16dd0e3894b639f6f472545392bd1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:58.070094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d16dd0e3894b639f6f472545392bd1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:58.070941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d16dd0e3894b639f6f472545392bd1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:58.071668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d16dd0e3894b639f6f472545392bd1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:58.166240 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1626/3288] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:15:57 2021] DELETE /identity/v3/users/c0d16dd0e3894b639f6f472545392bd1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:15:58.379755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e1085-2e7c-4309-848e-11fb2dacc5b9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:58.380088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e1085-2e7c-4309-848e-11fb2dacc5b9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:58.380200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e1085-2e7c-4309-848e-11fb2dacc5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:58.435317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d53e1085-2e7c-4309-848e-11fb2dacc5b9 None None] MFA Rules not processed for user `f9e59d219fa640e48533e0efdf150b16`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:58.440354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d53e1085-2e7c-4309-848e-11fb2dacc5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:58.563910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:58.567050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:58.640039 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1663/3289] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:58 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:58.723184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49d381-71e1-46cc-9d46-d30510efcdfc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:58.739913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:58.743668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:58.744161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:58.744688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] PATH_INFO: `/v3/projects/577ba8f0522d4cb7835b446932eca5aa` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:58.746448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577ba8f0522d4cb7835b446932eca5aa)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:58.750155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:58.914707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577ba8f0522d4cb7835b446932eca5aa', 'request_id': 'req-6a2ce29e-c670-486f-8797-76e5f7c57bb9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:58.928328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577ba8f0522d4cb7835b446932eca5aa', 'request_id': 'req-6a2ce29e-c670-486f-8797-76e5f7c57bb9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:59.018554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577ba8f0522d4cb7835b446932eca5aa', 'request_id': 'req-6a2ce29e-c670-486f-8797-76e5f7c57bb9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:59.043977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] The token cache is being invalidate because project 577ba8f0522d4cb7835b446932eca5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:15:59.044565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:59.049324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a2ce29e-c670-486f-8797-76e5f7c57bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:15:59.054603 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1627/3290] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:58 2021] DELETE /identity/v3/projects/577ba8f0522d4cb7835b446932eca5aa => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:15:59.061217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe814-b748-4eae-afc5-a5c9c6271877 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:59.062690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe814-b748-4eae-afc5-a5c9c6271877 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:59.063060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe814-b748-4eae-afc5-a5c9c6271877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:59.105095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a4ebe814-b748-4eae-afc5-a5c9c6271877 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:59.106674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a4ebe814-b748-4eae-afc5-a5c9c6271877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:59.236374 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1664/3291] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:59.244011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d4d3-5b76-45d6-8222-5dcaaed97dd3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:59.245634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d4d3-5b76-45d6-8222-5dcaaed97dd3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:59.247092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d4d3-5b76-45d6-8222-5dcaaed97dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:59.310443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b493d4d3-5b76-45d6-8222-5dcaaed97dd3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:15:59.314299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b493d4d3-5b76-45d6-8222-5dcaaed97dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:15:59.327584 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1628/3292] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:15:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:15:59.331629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebe814-b748-4eae-afc5-a5c9c6271877 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:59.362892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebe814-b748-4eae-afc5-a5c9c6271877 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:59.372657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:59.373353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:59.373629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:59.373898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:59.376316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:15:59.376984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:59.379833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:59.399256 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1665/3293] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:15:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:15:59.403347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d4d3-5b76-45d6-8222-5dcaaed97dd3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:59.421463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d4d3-5b76-45d6-8222-5dcaaed97dd3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:59.438149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:59.438834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:59.439117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:59.439395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:59.440100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:59.442040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:59.580198 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1629/3294] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:15:59 2021] POST /identity/v3/projects => generated 391 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:59.584080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:59.602112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954744ca-fdb1-423f-8231-5b20f6a474b5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:59.701531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:59.702536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:59.702915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:59.703301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:59.704352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:59.708098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:59.840336 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1666/3295] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:15:59 2021] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:15:59.841521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:59.853154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f470dc-a977-44b6-99e6-a501ffe06d29 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:15:59.906994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:15:59.907685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:15:59.907959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:15:59.911027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:15:59.920187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:15:59.925504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:15:59.979093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:15:59.985845 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1630/3296] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:00.004499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003b70-ee06-4caa-b70f-b86f71cef2c5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:00.025891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2e053-cfda-4470-b0b2-5125c22a68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:00.026409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2e053-cfda-4470-b0b2-5125c22a68da admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:00.027497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2e053-cfda-4470-b0b2-5125c22a68da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:00.029127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2e053-cfda-4470-b0b2-5125c22a68da admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:00.029919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2e053-cfda-4470-b0b2-5125c22a68da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:00.046647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2e053-cfda-4470-b0b2-5125c22a68da admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:00.096767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1667/3297] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:00.108584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:00.170293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e6b2-6e36-403b-9900-ce02d20a1383 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:00.198736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:00.207721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:00.208017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:00.211333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] PATH_INFO: `/v3/projects/3ca23cb1ff0c496dbd653a1adb65a1e7/users/625053fe42df4525b6880882cc730fe2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:00.318199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca23cb1ff0c496dbd653a1adb65a1e7, user_id=625053fe42df4525b6880882cc730fe2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:00.333612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:00.425840 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1631/3298] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:00 2021] PUT /identity/v3/projects/3ca23cb1ff0c496dbd653a1adb65a1e7/users/625053fe42df4525b6880882cc730fe2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:00.437535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d48c-1aa6-48ce-b8c8-2728dbd47c49 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:00.437818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d48c-1aa6-48ce-b8c8-2728dbd47c49 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:00.438098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d48c-1aa6-48ce-b8c8-2728dbd47c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:00.494207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cff5d48c-1aa6-48ce-b8c8-2728dbd47c49 None None] MFA Rules not processed for user `625053fe42df4525b6880882cc730fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:00.495451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cff5d48c-1aa6-48ce-b8c8-2728dbd47c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:00.704814 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1668/3299] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:00 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:00.734846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:00.737797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:00.913543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9869c-53b8-4749-b52b-829372cc84bb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:00.926790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9be530-3e62-435f-9529-5a85a40de4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:00.926790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be530-3e62-435f-9529-5a85a40de4fe service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:00.926790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be530-3e62-435f-9529-5a85a40de4fe service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:00.926790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be530-3e62-435f-9529-5a85a40de4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:00.952192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9be530-3e62-435f-9529-5a85a40de4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:00.953551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9be530-3e62-435f-9529-5a85a40de4fe service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:00.965701 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1632/3300] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:00 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:01.338361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5d48c-1aa6-48ce-b8c8-2728dbd47c49 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:01.492429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5d48c-1aa6-48ce-b8c8-2728dbd47c49 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:01.506016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:01.506947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:01.507229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:01.507504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] PATH_INFO: `/v3/users/625053fe42df4525b6880882cc730fe2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:01.508835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625053fe42df4525b6880882cc730fe2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:01.512483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:01.716158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625053fe42df4525b6880882cc730fe2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:01.757538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625053fe42df4525b6880882cc730fe2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:01.780828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625053fe42df4525b6880882cc730fe2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:01.797865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625053fe42df4525b6880882cc730fe2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:01.864202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625053fe42df4525b6880882cc730fe2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:01.884172 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1669/3301] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:16:01 2021] DELETE /identity/v3/users/625053fe42df4525b6880882cc730fe2 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:01.892351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:01.892845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:01.893020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:01.919971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:01.921722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:02.099710 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1633/3302] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:02.099819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:02.102044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:02.201783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefa42b-54bf-4e48-8b82-88c7f6efbb19 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:02.205610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f323-ebfd-4d92-8b6a-06ea5251e2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:02.206561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f323-ebfd-4d92-8b6a-06ea5251e2ca service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:02.207031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f323-ebfd-4d92-8b6a-06ea5251e2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:02.207480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f323-ebfd-4d92-8b6a-06ea5251e2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:02.219917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f323-ebfd-4d92-8b6a-06ea5251e2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:02.221651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f323-ebfd-4d92-8b6a-06ea5251e2ca service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:02.236812 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1670/3303] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:16:03.029432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:03.030993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:03.044373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82f860-36c4-4f22-88a4-2b84cd27b8ed None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:03.052369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:03.056983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:03.056983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:03.056983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] PATH_INFO: `/v3/projects/3ca23cb1ff0c496dbd653a1adb65a1e7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:03.056983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca23cb1ff0c496dbd653a1adb65a1e7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:03.059174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:03.244709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca23cb1ff0c496dbd653a1adb65a1e7', 'request_id': 'req-9d9fa9dd-6096-4981-9072-8ebda7bd8140'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:03.269887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca23cb1ff0c496dbd653a1adb65a1e7', 'request_id': 'req-9d9fa9dd-6096-4981-9072-8ebda7bd8140'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:03.343645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca23cb1ff0c496dbd653a1adb65a1e7', 'request_id': 'req-9d9fa9dd-6096-4981-9072-8ebda7bd8140'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:03.373457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] The token cache is being invalidate because project 3ca23cb1ff0c496dbd653a1adb65a1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:16:03.374193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:03.375028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9d9fa9dd-6096-4981-9072-8ebda7bd8140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:03.376834 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1634/3304] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:03 2021] DELETE /identity/v3/projects/3ca23cb1ff0c496dbd653a1adb65a1e7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:03.382777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c64d0-71ea-4757-8b0c-feed7d63a7e8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:03.383299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c64d0-71ea-4757-8b0c-feed7d63a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:03.383299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c64d0-71ea-4757-8b0c-feed7d63a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:03.404477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-678c64d0-71ea-4757-8b0c-feed7d63a7e8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:03.407991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-678c64d0-71ea-4757-8b0c-feed7d63a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:03.533835 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1671/3305] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:03.543568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cae9a-7fe7-476d-aae0-5ebe27624d43 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:03.544138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cae9a-7fe7-476d-aae0-5ebe27624d43 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:03.544420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cae9a-7fe7-476d-aae0-5ebe27624d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:03.576434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0d9cae9a-7fe7-476d-aae0-5ebe27624d43 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:03.578261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0d9cae9a-7fe7-476d-aae0-5ebe27624d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:03.592029 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1635/3306] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:03.593519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c64d0-71ea-4757-8b0c-feed7d63a7e8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:03.609868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c64d0-71ea-4757-8b0c-feed7d63a7e8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:03.615008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:03.636966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:03.636966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:03.636966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:03.636966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:16:03.636966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:03.636966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:03.637604 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1672/3307] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:16:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:16:03.640589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cae9a-7fe7-476d-aae0-5ebe27624d43 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:03.659234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cae9a-7fe7-476d-aae0-5ebe27624d43 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:03.668250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:03.669013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:03.669341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:03.669699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:03.670412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:03.673370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:04.390771 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1636/3308] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:16:03 2021] POST /identity/v3/projects => generated 399 bytes in 751 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:04.395041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:04.409045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afa4d3-ea22-4827-9886-ae323dc4d6f9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:04.585606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:04.588681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:04.589286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:04.589645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:04.591069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:04.597217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:04.698977 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1673/3309] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:16:04 2021] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:04.699307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:04.707199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a0636-1a9d-474d-be24-2a03fcad50e9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:04.747997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:04.750424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:04.758781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:04.761970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:04.762976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:04.767314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:04.827149 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1637/3310] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:04 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:04.831350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:04.853860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bfe55-676e-438c-a528-aa478a8f1d75 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:04.866740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb47640-2a30-4292-974d-15909966c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:04.867976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47640-2a30-4292-974d-15909966c220 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:04.868531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47640-2a30-4292-974d-15909966c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:04.869351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb47640-2a30-4292-974d-15909966c220 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:04.871101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb47640-2a30-4292-974d-15909966c220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:04.873822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb47640-2a30-4292-974d-15909966c220 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:04.906276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:04.919605 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1674/3311] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:04 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:16:04.930223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703ff63-3662-46bc-9485-0b3a63d6db95 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:04.940862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:04.942102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:04.942554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:04.942998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] PATH_INFO: `/v3/projects/9dbe1e97c3f64bee9355ec5d1b424c8a/users/e7c7a9d6618448c9a5ade71c13a1758d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:04.964408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbe1e97c3f64bee9355ec5d1b424c8a, user_id=e7c7a9d6618448c9a5ade71c13a1758d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:04.973633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:05.086010 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1638/3312] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:04 2021] PUT /identity/v3/projects/9dbe1e97c3f64bee9355ec5d1b424c8a/users/e7c7a9d6618448c9a5ade71c13a1758d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:05.089404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26e418-8c79-44e5-a3ef-574791c390ea None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:05.090250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26e418-8c79-44e5-a3ef-574791c390ea None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:05.090716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26e418-8c79-44e5-a3ef-574791c390ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:05.117791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ef26e418-8c79-44e5-a3ef-574791c390ea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:05.122271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ef26e418-8c79-44e5-a3ef-574791c390ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:05.231324 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1675/3313] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:05.322500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:05.325611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:05.426987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7447e4-7295-432e-af12-309228c202ae admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:05.434382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:05.435731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:05.436359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:05.437109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:05.448393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:05.450948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:05.464243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1639/3314] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:06.207477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180724f1-d860-4560-9634-3fa798be70c4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:06.207477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180724f1-d860-4560-9634-3fa798be70c4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:06.207477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180724f1-d860-4560-9634-3fa798be70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:06.221141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-180724f1-d860-4560-9634-3fa798be70c4 None None] MFA Rules not processed for user `819fcdf5d86a46399dfb7343639f3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:06.222551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-180724f1-d860-4560-9634-3fa798be70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:06.369188 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1676/3315] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:08.003098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:08.006041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:08.031885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e518ef-1f1c-45a0-8c90-f22220493899 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:08.040585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:08.041829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:08.042351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:08.042815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] PATH_INFO: `/v3/users/41b30a9fab164735bfb1d19a83b66ce6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:08.044967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b30a9fab164735bfb1d19a83b66ce6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:08.048096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:08.310956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b30a9fab164735bfb1d19a83b66ce6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:08.333168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b30a9fab164735bfb1d19a83b66ce6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:08.370514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b30a9fab164735bfb1d19a83b66ce6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:08.372350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b30a9fab164735bfb1d19a83b66ce6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:08.375114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b30a9fab164735bfb1d19a83b66ce6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:08.464952 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1640/3316] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:16:08 2021] DELETE /identity/v3/users/41b30a9fab164735bfb1d19a83b66ce6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:08.471351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98950e-529f-4f88-87d0-08cfa2150d03 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:08.471351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98950e-529f-4f88-87d0-08cfa2150d03 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:08.471351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98950e-529f-4f88-87d0-08cfa2150d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:08.513465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fb98950e-529f-4f88-87d0-08cfa2150d03 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:08.515052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb98950e-529f-4f88-87d0-08cfa2150d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:08.653718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1677/3317] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:08.665421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:08.667207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:08.791723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9047b1-baca-454e-8abd-12a207295da0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:08.796219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:08.797341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:08.797863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:08.798326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:08.820132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:08.823471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:08.841227 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1641/3318] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:09.528944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb414d-90b9-483b-945e-1c10ef2706a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:09.534955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb414d-90b9-483b-945e-1c10ef2706a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:09.534955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb414d-90b9-483b-945e-1c10ef2706a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:09.586509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-74cb414d-90b9-483b-945e-1c10ef2706a3 None None] MFA Rules not processed for user `e7c7a9d6618448c9a5ade71c13a1758d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:09.587654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-74cb414d-90b9-483b-945e-1c10ef2706a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:09.626828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:09.626828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:09.665311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c436e2f-f7a0-4669-9361-2896f72e99c0 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:09.691986 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1678/3319] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:09 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:09.706872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:09.707313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:09.707885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:09.729932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:09.734733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:09.735022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:09.735310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] PATH_INFO: `/v3/projects/2fe1a82960c8413095a4b833950e8b3f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:09.749852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe1a82960c8413095a4b833950e8b3f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:09.755551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:09.755723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] MFA Rules not processed for user `e7c7a9d6618448c9a5ade71c13a1758d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:09.758293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:09.794479 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1679/3320] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:09 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:09.921940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:09.923576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:09.992577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe1a82960c8413095a4b833950e8b3f', 'request_id': 'req-e5489b10-fabe-4983-ad53-5adf829d72f2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.009192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe1a82960c8413095a4b833950e8b3f', 'request_id': 'req-e5489b10-fabe-4983-ad53-5adf829d72f2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.086749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe1a82960c8413095a4b833950e8b3f', 'request_id': 'req-e5489b10-fabe-4983-ad53-5adf829d72f2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.106751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] The token cache is being invalidate because project 2fe1a82960c8413095a4b833950e8b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:16:10.107713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.109802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.126662 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1642/3321] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:09 2021] DELETE /identity/v3/projects/2fe1a82960c8413095a4b833950e8b3f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:10.126662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:10.126662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:10.144763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389d4ca-34b5-4e72-9a4b-07f401df4aff None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:10.267007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5489b10-fabe-4983-ad53-5adf829d72f2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:10.274408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:10.275680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:10.281272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:10.281272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] PATH_INFO: `/v3/users/6dd110a950974effbe12b33268c7f9e1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:10.281272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd110a950974effbe12b33268c7f9e1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:10.281272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:10.298786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:10.299403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:10.299734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:10.300007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:10.305198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:10.476690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:10.479053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:10.498982 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1680/3322] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:09 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:16:10.501412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd110a950974effbe12b33268c7f9e1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.514552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd110a950974effbe12b33268c7f9e1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.548418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd110a950974effbe12b33268c7f9e1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.550258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd110a950974effbe12b33268c7f9e1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.551400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd110a950974effbe12b33268c7f9e1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:10.645635 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1643/3323] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:16:10 2021] DELETE /identity/v3/users/6dd110a950974effbe12b33268c7f9e1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:11.350094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:11.370909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04323c-9a25-431a-bc95-3193ab10a77d service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:11.521896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:11.522930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:11.523331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:11.523715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] PATH_INFO: `/v3/projects/d2c208f87a8d4c2496f4734f4e4fe7ff` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:11.525697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c208f87a8d4c2496f4734f4e4fe7ff)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:11.529213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:11.721264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c208f87a8d4c2496f4734f4e4fe7ff', 'request_id': 'req-295ef08f-5963-4bed-b803-965492275800'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:11.734804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:11.736477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:11.778386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1735-ae39-4c0c-9a6c-cc9ab8778037 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:11.874063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:11.875256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:11.875860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:11.876527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] PATH_INFO: `/v3/users/30652e6248664267895369366201816e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:11.877994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30652e6248664267895369366201816e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:11.897096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:12.283767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c208f87a8d4c2496f4734f4e4fe7ff', 'request_id': 'req-295ef08f-5963-4bed-b803-965492275800'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.289846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c208f87a8d4c2496f4734f4e4fe7ff', 'request_id': 'req-295ef08f-5963-4bed-b803-965492275800'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.329594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] The token cache is being invalidate because project d2c208f87a8d4c2496f4734f4e4fe7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:16:12.329898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.330648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ef08f-5963-4bed-b803-965492275800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.332488 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1681/3324] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:11 2021] DELETE /identity/v3/projects/d2c208f87a8d4c2496f4734f4e4fe7ff => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:12.338756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a945-a940-4795-b1e1-4ce9fa704942 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:12.339217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a945-a940-4795-b1e1-4ce9fa704942 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:12.339501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7a945-a940-4795-b1e1-4ce9fa704942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:12.391924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d7e7a945-a940-4795-b1e1-4ce9fa704942 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:12.392749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7e7a945-a940-4795-b1e1-4ce9fa704942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:12.423355 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1682/3325] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:12.432771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ef0a-a2cb-4154-9e2d-5bb18cf6afd5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:12.438112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ef0a-a2cb-4154-9e2d-5bb18cf6afd5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:12.438112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ef0a-a2cb-4154-9e2d-5bb18cf6afd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:12.442541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30652e6248664267895369366201816e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.453118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30652e6248664267895369366201816e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.472528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8566ef0a-a2cb-4154-9e2d-5bb18cf6afd5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:12.473777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8566ef0a-a2cb-4154-9e2d-5bb18cf6afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:12.475162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30652e6248664267895369366201816e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.476165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30652e6248664267895369366201816e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.477171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30652e6248664267895369366201816e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:12.491181 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1683/3326] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:12.493480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ef0a-a2cb-4154-9e2d-5bb18cf6afd5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:12.511344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ef0a-a2cb-4154-9e2d-5bb18cf6afd5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:12.520282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:12.522215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:12.523443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:12.523920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:12.524966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:16:12.525480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:12.528249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:12.547178 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1684/3327] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:16:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:16:12.548758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:12.560970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f11a-c9d8-4269-90ac-46f767fd2331 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:12.572759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:12.574708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:12.576267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:12.576681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:12.578105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:12.579497 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1644/3328] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:16:11 2021] DELETE /identity/v3/users/30652e6248664267895369366201816e => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:12.586832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:12.896852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1685/3329] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:16:12 2021] POST /identity/v3/projects => generated 393 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:12.899120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:13.086942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9d97f-b696-4ec8-80d8-08484fd0f1a4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:13.337741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:13.340200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:13.340657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:13.341153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:13.342598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:13.345644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:13.470253 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1645/3330] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:16:12 2021] POST /identity/v3/users => generated 297 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:13.475192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:13.488228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911ec6-5961-4ccb-b5a0-17386d968d9e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:13.512784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:13.513560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:13.513841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:13.514114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:13.514852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:13.521779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:13.539495 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1686/3331] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:13 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:16:13.543370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:13.558212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9de2f-b9cf-4e5b-9838-8bb1a71b8984 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:13.569373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:13.570089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:13.570342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:13.570633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:13.572490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:13.575131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:13.581721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:13.585199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:13.598015 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1646/3332] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:13 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:16:13.602071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:13.611506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941f377-5a9f-4487-80c9-7d930a12db57 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:13.622207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c46d0-8190-456f-924b-04b6d6b139c5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:13.625421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:13.626529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:13.626985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:13.627450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] PATH_INFO: `/v3/projects/00414bfe9d194c88b02d9664fdeaa217` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:13.629413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00414bfe9d194c88b02d9664fdeaa217)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:13.634761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:13.639019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5704a-5846-4e5f-858e-954c184910a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:13.640184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5704a-5846-4e5f-858e-954c184910a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:13.641067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5704a-5846-4e5f-858e-954c184910a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:13.642782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5704a-5846-4e5f-858e-954c184910a0 admin admin] PATH_INFO: `/v3/projects/f5cc01656ddf46e48857289e63f81a18/users/e2ce230775df45ea94c1b5f9b068d74c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:13.678454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5704a-5846-4e5f-858e-954c184910a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cc01656ddf46e48857289e63f81a18, user_id=e2ce230775df45ea94c1b5f9b068d74c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:13.684955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5704a-5846-4e5f-858e-954c184910a0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:13.798574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1647/3333] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:13 2021] PUT /identity/v3/projects/f5cc01656ddf46e48857289e63f81a18/users/e2ce230775df45ea94c1b5f9b068d74c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:13.809271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:13.809558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:13.810042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:13.853007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00414bfe9d194c88b02d9664fdeaa217', 'request_id': 'req-045b9513-321d-45b6-ba51-22c381f0b49c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:13.908415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] MFA Rules not processed for user `e2ce230775df45ea94c1b5f9b068d74c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:13.910850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:13.937688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00414bfe9d194c88b02d9664fdeaa217', 'request_id': 'req-045b9513-321d-45b6-ba51-22c381f0b49c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:13.950143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00414bfe9d194c88b02d9664fdeaa217', 'request_id': 'req-045b9513-321d-45b6-ba51-22c381f0b49c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:13.977804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] The token cache is being invalidate because project 00414bfe9d194c88b02d9664fdeaa217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:16:13.978096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:13.981744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-045b9513-321d-45b6-ba51-22c381f0b49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:13.984243 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1687/3334] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:13 2021] DELETE /identity/v3/projects/00414bfe9d194c88b02d9664fdeaa217 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:13.992502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e134-4032-4e80-b7e0-db318861adbc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:13.993087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e134-4032-4e80-b7e0-db318861adbc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:13.993554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703e134-4032-4e80-b7e0-db318861adbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.024132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a703e134-4032-4e80-b7e0-db318861adbc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:14.025796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a703e134-4032-4e80-b7e0-db318861adbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:14.112697 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1648/3335] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:13 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:14.118166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.121660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:14.179252 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1688/3336] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:14.186694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba0d4-8a8c-41d4-a397-9eac2f427cd7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.186981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba0d4-8a8c-41d4-a397-9eac2f427cd7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.187562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba0d4-8a8c-41d4-a397-9eac2f427cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.220235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7a8ba0d4-8a8c-41d4-a397-9eac2f427cd7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:14.226245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7a8ba0d4-8a8c-41d4-a397-9eac2f427cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:14.244811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3696b-efa3-4ded-851c-5db7cd7c6ee5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.246067 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1689/3337] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:14.255336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba0d4-8a8c-41d4-a397-9eac2f427cd7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.255517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.255517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.255517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.255517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.255991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.257551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.261942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba0d4-8a8c-41d4-a397-9eac2f427cd7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.267246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.268012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.268712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.272163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.273307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:16:14.273844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.275695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.293316 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1690/3338] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:16:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:16:14.299222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.338142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd134bc-8c13-450f-a3a2-6641f0c073e4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.344964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.345898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.347268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.347887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.348769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.351646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.394455 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1649/3339] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:16:14 2021] POST /identity/v3/projects => generated 391 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:16:14.399912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.488266 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1691/3340] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:16:14 2021] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:14.492528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.541265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b0f62-6ffc-4a45-b3a8-8b193e0a6540 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.646921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bca56-c557-40e5-a7a1-ac19111ef181 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.656385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.657363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.657846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.658175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.659038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.661743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.661988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.663280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.663704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.664089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.664949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.667688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.811526 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1692/3341] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:16:14 2021] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:14.812562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.828494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1611fb3-5a3f-4731-80a2-47a404b87717 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.836334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.838998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.839289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.839570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.840225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1650/3342] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:16:14 2021] POST /identity/v3/users => generated 302 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:14.844368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.845991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.849145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.869718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a30e-d5a9-4e1f-bd14-cb738a509a49 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.874400 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1693/3343] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:14.876084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.889307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f585f-e4b7-45e9-811f-ad2d0388297c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.895637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.899773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.899902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.900014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.900014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.900201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.900201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.900375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.900463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:14.901959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:14.903602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.905579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:14.922553 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1694/3344] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:14.923480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.942026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1651/3345] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:16:14.951832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:14.970327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccbff4-c940-4284-944b-804d73342c11 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.980400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdbbf-89d4-4b9b-aff4-49cc43bc944a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:14.982138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e9d1c-0c4d-4adc-8198-78f92905ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:14.983917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e9d1c-0c4d-4adc-8198-78f92905ccad admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:14.985011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e9d1c-0c4d-4adc-8198-78f92905ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:14.985614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e9d1c-0c4d-4adc-8198-78f92905ccad admin admin] PATH_INFO: `/v3/projects/8154e82a58434a60b677d150202a5312/users/ed831822eb3542a88f70914466c36603/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:15.014031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e9d1c-0c4d-4adc-8198-78f92905ccad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8154e82a58434a60b677d150202a5312, user_id=ed831822eb3542a88f70914466c36603, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:15.015755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:15.018258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e9d1c-0c4d-4adc-8198-78f92905ccad admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:15.021887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:15.022465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:15.024291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] PATH_INFO: `/v3/projects/bed0ee5535174cffbb7017f610cec366/users/2721c5a8595946e184351eff9f12f5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:15.067798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed0ee5535174cffbb7017f610cec366, user_id=2721c5a8595946e184351eff9f12f5d2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:15.072985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:15.208087 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1652/3346] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:14 2021] PUT /identity/v3/projects/bed0ee5535174cffbb7017f610cec366/users/2721c5a8595946e184351eff9f12f5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:16:15.210090 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1695/3347] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:14 2021] PUT /identity/v3/projects/8154e82a58434a60b677d150202a5312/users/ed831822eb3542a88f70914466c36603/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:15.212068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:15.215907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946441be-e797-4752-b96c-8b5eea0c8787 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:15.216737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946441be-e797-4752-b96c-8b5eea0c8787 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:15.217357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946441be-e797-4752-b96c-8b5eea0c8787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:15.254622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-946441be-e797-4752-b96c-8b5eea0c8787 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:15.257102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-946441be-e797-4752-b96c-8b5eea0c8787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:15.354881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c19c5-5652-48e9-a703-30192e3683e5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:15.374535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:15.375234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:15.375519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:15.375798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:15.376543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:15.378343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:15.396392 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1696/3348] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:15.404781 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1653/3349] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:15 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:15.405274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946441be-e797-4752-b96c-8b5eea0c8787 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:15.420536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946441be-e797-4752-b96c-8b5eea0c8787 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:15.425807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:15.428275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:15.429639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481a6b4-fd68-451d-ae79-8452156d3585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:15.431562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481a6b4-fd68-451d-ae79-8452156d3585 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:15.433228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481a6b4-fd68-451d-ae79-8452156d3585 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:15.433687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481a6b4-fd68-451d-ae79-8452156d3585 admin admin] PATH_INFO: `/v3/projects/bed0ee5535174cffbb7017f610cec366/users/2721c5a8595946e184351eff9f12f5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:15.437701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481a6b4-fd68-451d-ae79-8452156d3585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed0ee5535174cffbb7017f610cec366, user_id=2721c5a8595946e184351eff9f12f5d2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:15.447803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481a6b4-fd68-451d-ae79-8452156d3585 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:15.483957 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1697/3350] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:15 2021] PUT /identity/v3/projects/bed0ee5535174cffbb7017f610cec366/users/2721c5a8595946e184351eff9f12f5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:16:15.489691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:15.489691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:15.489691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:15.564415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] MFA Rules not processed for user `2721c5a8595946e184351eff9f12f5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:15.565686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:15.582449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324403-539d-4faa-b9c0-efd6e0add730 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:15.666511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:15.667177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:15.667464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:15.667918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:15.718185 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1698/3351] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:15.754116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:15.755799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:15.767378 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1654/3352] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:15.894843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:15.897194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:16.071465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006cf44-31e6-4637-9688-6e3ccad84173 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:16.090233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:16.092248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:16.093388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:16.093692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:16.128839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:16.140119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:16.168714 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1699/3353] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:15 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:16.302059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:16.323398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4edacd-14be-4e81-b6a4-b39f51db0105 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:16.340084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd1fd-3ace-4c02-97f7-f8220b3275af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:16.340756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd1fd-3ace-4c02-97f7-f8220b3275af service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:16.341077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd1fd-3ace-4c02-97f7-f8220b3275af service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:16.341371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd1fd-3ace-4c02-97f7-f8220b3275af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:16.424631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd1fd-3ace-4c02-97f7-f8220b3275af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:16.426352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd1fd-3ace-4c02-97f7-f8220b3275af service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:16.438598 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1655/3354] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:16 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:16.462173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:16.479053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fc6a-99ca-4571-8e5f-b065441cd47c service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:16.485137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:16.486111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:16.486411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:16.486814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] PATH_INFO: `/v3/users/e2ce230775df45ea94c1b5f9b068d74c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:16.488337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ce230775df45ea94c1b5f9b068d74c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:16.491425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:16.753104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ce230775df45ea94c1b5f9b068d74c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:16.774514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ce230775df45ea94c1b5f9b068d74c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:16.808011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ce230775df45ea94c1b5f9b068d74c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:16.811421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ce230775df45ea94c1b5f9b068d74c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:16.914834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ce230775df45ea94c1b5f9b068d74c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:16.934872 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1700/3355] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:16:16 2021] DELETE /identity/v3/users/e2ce230775df45ea94c1b5f9b068d74c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:16.939661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa8ead-1e42-4b7c-bdb8-17f61714390a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:16.939949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa8ead-1e42-4b7c-bdb8-17f61714390a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:16.940226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa8ead-1e42-4b7c-bdb8-17f61714390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:16.961197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-86fa8ead-1e42-4b7c-bdb8-17f61714390a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:16.962342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-86fa8ead-1e42-4b7c-bdb8-17f61714390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:17.072926 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1656/3356] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:17.086643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:17.088119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:17.166581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343fa30-0bb8-4cc4-93a6-d22dc4785c84 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:17.190020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bca6-f63c-44e0-a958-a876ed34916e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:17.190971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bca6-f63c-44e0-a958-a876ed34916e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:17.191443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bca6-f63c-44e0-a958-a876ed34916e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:17.191780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bca6-f63c-44e0-a958-a876ed34916e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:17.226174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2bca6-f63c-44e0-a958-a876ed34916e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:17.227906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2bca6-f63c-44e0-a958-a876ed34916e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:17.263495 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1701/3357] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:17.762639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:17.763524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:17.764023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:17.824183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:17.828048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:17.957021 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1657/3358] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:17 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:17.970105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:17.970691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:17.970691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:17.995588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:17.997126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:18.015223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:18.020566 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1702/3359] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:17 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:18.030082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:18.039090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:18.044162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:18.077211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c80b-2ba1-4d47-bd9d-f80315cc5bd1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:18.086719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:18.088901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:18.089421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:18.089904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] PATH_INFO: `/v3/projects/f5cc01656ddf46e48857289e63f81a18` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:18.101130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cc01656ddf46e48857289e63f81a18)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:18.111611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:18.212022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8716-bc9f-422c-a9fc-cdcc3c8dc484 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:18.220916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:18.221734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:18.221951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:18.222215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:18.232847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:18.234589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:18.256357 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1703/3360] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:18 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:18.314391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cc01656ddf46e48857289e63f81a18', 'request_id': 'req-fdb696e0-5a93-4630-94e7-3043731d4c2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:18.326998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cc01656ddf46e48857289e63f81a18', 'request_id': 'req-fdb696e0-5a93-4630-94e7-3043731d4c2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:18.429906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cc01656ddf46e48857289e63f81a18', 'request_id': 'req-fdb696e0-5a93-4630-94e7-3043731d4c2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:18.445189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] The token cache is being invalidate because project f5cc01656ddf46e48857289e63f81a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:16:18.445189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:18.446179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:18.448251 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1658/3361] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:18 2021] DELETE /identity/v3/projects/f5cc01656ddf46e48857289e63f81a18 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:18.452201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:18.465384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e65f3-d418-4e13-940e-9068fde36e7f service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:18.534486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:18.535274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:18.535552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:18.535823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] PATH_INFO: `/v3/users/2721c5a8595946e184351eff9f12f5d2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:18.537669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2721c5a8595946e184351eff9f12f5d2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:18.539591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:19.246579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2721c5a8595946e184351eff9f12f5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:19.259698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2721c5a8595946e184351eff9f12f5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:19.293470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2721c5a8595946e184351eff9f12f5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:19.301340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2721c5a8595946e184351eff9f12f5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:19.365931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f3547c72-369c-49cc-8342-8b97add4477d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2721c5a8595946e184351eff9f12f5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:19.377625 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1704/3362] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:16:18 2021] DELETE /identity/v3/users/2721c5a8595946e184351eff9f12f5d2 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:20.372993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:20.375028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:20.399911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb696e0-5a93-4630-94e7-3043731d4c2d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:20.491727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:20.494638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:20.494638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:20.494638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] PATH_INFO: `/v3/projects/bed0ee5535174cffbb7017f610cec366` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:20.495840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed0ee5535174cffbb7017f610cec366)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:20.504643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:20.680461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed0ee5535174cffbb7017f610cec366', 'request_id': 'req-d9d27b57-b860-4cf6-8636-5bd734746856'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:20.687763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed0ee5535174cffbb7017f610cec366', 'request_id': 'req-d9d27b57-b860-4cf6-8636-5bd734746856'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:20.795840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed0ee5535174cffbb7017f610cec366', 'request_id': 'req-d9d27b57-b860-4cf6-8636-5bd734746856'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:20.831982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] The token cache is being invalidate because project bed0ee5535174cffbb7017f610cec366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:16:20.832264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:20.836476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d9d27b57-b860-4cf6-8636-5bd734746856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:20.839989 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1659/3363] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:20 2021] DELETE /identity/v3/projects/bed0ee5535174cffbb7017f610cec366 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:20.850731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f47a5-1c5e-4db3-9de0-88ba279a06d2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:20.851139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f47a5-1c5e-4db3-9de0-88ba279a06d2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:20.851348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f47a5-1c5e-4db3-9de0-88ba279a06d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:20.893880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-024f47a5-1c5e-4db3-9de0-88ba279a06d2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:20.895110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-024f47a5-1c5e-4db3-9de0-88ba279a06d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:21.004201 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1705/3364] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:21.072720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dab83f-4623-4ec7-946d-2178bc8235f9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.073441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dab83f-4623-4ec7-946d-2178bc8235f9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.073719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dab83f-4623-4ec7-946d-2178bc8235f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.113519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-19dab83f-4623-4ec7-946d-2178bc8235f9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:21.115377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-19dab83f-4623-4ec7-946d-2178bc8235f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:21.128590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1660/3365] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:21.133608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f47a5-1c5e-4db3-9de0-88ba279a06d2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:21.147210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f47a5-1c5e-4db3-9de0-88ba279a06d2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:21.153255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:21.154303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.154655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.155000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.155869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:16:21.156241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:21.158074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:21.183309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dab83f-4623-4ec7-946d-2178bc8235f9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:21.183438 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1706/3366] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:16:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:16:21.191587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dab83f-4623-4ec7-946d-2178bc8235f9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:21.198838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:21.199666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.200015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.200399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.201223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:21.204114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:21.296057 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1661/3367] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:16:21 2021] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:21.300639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:21.314581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc1cb-6a68-429c-821e-4e760f686f77 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:21.408447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:21.409625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.410260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.410965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.412491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:21.415438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:21.529207 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1707/3368] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:16:21 2021] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:21.533215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:21.554265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fbce3-9e4b-4bac-9451-c450f1b239b4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:21.569657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:21.571265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.572377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.573515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.574514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:21.580448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:21.626879 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1662/3369] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:16:21.627113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:21.643287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4896041-425e-43f4-ac62-c49e8fb062d7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:21.660423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92076c54-431c-4c7d-bf90-1b7315600695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:21.661307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076c54-431c-4c7d-bf90-1b7315600695 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.662367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076c54-431c-4c7d-bf90-1b7315600695 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.668229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076c54-431c-4c7d-bf90-1b7315600695 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.668229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076c54-431c-4c7d-bf90-1b7315600695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:21.668229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076c54-431c-4c7d-bf90-1b7315600695 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:21.686038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1708/3370] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:16:21.693848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:21.756914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04d9b0-8475-4b75-ab6a-21ed2423c9c4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:21.806007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269429b7-9293-454c-9e23-e0273b0bf1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:21.810314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269429b7-9293-454c-9e23-e0273b0bf1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.810663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269429b7-9293-454c-9e23-e0273b0bf1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.810940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269429b7-9293-454c-9e23-e0273b0bf1ea admin admin] PATH_INFO: `/v3/projects/ef4a444bae614ca7b19f2e61052a4c6e/users/82ec9d2698bd4b3f811022f3d8c458b2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.818946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa781563-8c2e-4b68-b010-51e3edbbd36e None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.818946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa781563-8c2e-4b68-b010-51e3edbbd36e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.819315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa781563-8c2e-4b68-b010-51e3edbbd36e None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.821204 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1709/3371] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:16:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:16:21.829803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:21.829803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:21.829803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:21.889155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269429b7-9293-454c-9e23-e0273b0bf1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4a444bae614ca7b19f2e61052a4c6e, user_id=82ec9d2698bd4b3f811022f3d8c458b2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:21.900718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269429b7-9293-454c-9e23-e0273b0bf1ea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:21.901278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:21.910459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:22.007342 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1663/3372] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:21 2021] PUT /identity/v3/projects/ef4a444bae614ca7b19f2e61052a4c6e/users/82ec9d2698bd4b3f811022f3d8c458b2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:22.010306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:22.011746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:22.015136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:22.048509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:22.050044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:22.081301 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1710/3373] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:16:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:22.105718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:22.107363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:22.126433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc28c-250a-475e-a6f7-b3c7fec95549 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:22.138621 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1664/3374] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:22.154773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:22.156189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:22.254526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddac63-b1c4-42fc-9138-92dcc16e98e2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:22.266931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759aed8-9df9-450f-9889-dd58d8791464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:22.267604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759aed8-9df9-450f-9889-dd58d8791464 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:22.267892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759aed8-9df9-450f-9889-dd58d8791464 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:22.268258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759aed8-9df9-450f-9889-dd58d8791464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:22.291531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759aed8-9df9-450f-9889-dd58d8791464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:22.293036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759aed8-9df9-450f-9889-dd58d8791464 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:22.309884 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1665/3375] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:22.343387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:22.344366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:22.344892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:22.345334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:22.376806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:22.378875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:22.405034 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1711/3376] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:24.717320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fdba9-0285-431c-9209-9f72645bbee3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:24.717881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fdba9-0285-431c-9209-9f72645bbee3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:24.717881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fdba9-0285-431c-9209-9f72645bbee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:24.750634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-327fdba9-0285-431c-9209-9f72645bbee3 None None] MFA Rules not processed for user `82ec9d2698bd4b3f811022f3d8c458b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:24.752103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-327fdba9-0285-431c-9209-9f72645bbee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:24.837393 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1666/3377] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:24.841743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:24.853695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a2eed-4032-4228-a68a-789bc184ed73 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:24.861049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:24.861863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:24.862128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:24.862395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:24.863293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:24.865460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:24.977458 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1712/3378] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:16:24 2021] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:16:24.981355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fdba9-0285-431c-9209-9f72645bbee3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:24.994729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fdba9-0285-431c-9209-9f72645bbee3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:25.070789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:25.074044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:25.074044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:25.074044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:25.074044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:25.075510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:25.169780 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1667/3379] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:16:24 2021] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:25.173122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:25.189968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6fc6-7188-42a1-9593-181d43720f68 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:25.191528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:25.193121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:25.193663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:25.194119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:25.195224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:25.197115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:25.221978 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1713/3380] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:25 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:25.226136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:25.236726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9801b-7b33-4244-bf52-f45c04f01d96 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:25.242570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:25.247204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:25.247204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:25.247204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] PATH_INFO: `/v3/projects/759e68391a21437c981ea5c487262fdd/users/612091f79bd842639ed1edd28bd293ce/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:25.261424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759e68391a21437c981ea5c487262fdd, user_id=612091f79bd842639ed1edd28bd293ce, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:25.264235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:25.363265 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1668/3381] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:25 2021] PUT /identity/v3/projects/759e68391a21437c981ea5c487262fdd/users/612091f79bd842639ed1edd28bd293ce/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:25.364137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:25.377890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985d7f2-4071-4036-a523-e2c704c89f85 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:25.385793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:25.388717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:25.509112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:25.511284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:25.511780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:25.523157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:25.525655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:25.527808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:25.539843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1714/3382] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:25 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:16:25.545293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:25.560759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7649a-684e-412f-8014-247f589f4f56 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:25.573828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:25.574242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0a407-b3e8-49b2-a65a-628b45404144 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:25.575385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:25.575843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:25.576440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] PATH_INFO: `/v3/projects/759e68391a21437c981ea5c487262fdd/users/612091f79bd842639ed1edd28bd293ce/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:25.581344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759e68391a21437c981ea5c487262fdd, user_id=612091f79bd842639ed1edd28bd293ce, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:25.586688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:25.588987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:25.589896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:25.590180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:25.590598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] PATH_INFO: `/v3/users/3d55f68c111b4a388351c18551dd43ce` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:25.599553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d55f68c111b4a388351c18551dd43ce)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:25.600680 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1715/3383] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:25 2021] PUT /identity/v3/projects/759e68391a21437c981ea5c487262fdd/users/612091f79bd842639ed1edd28bd293ce/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:25.603439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:25.888457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d55f68c111b4a388351c18551dd43ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:25.913491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d55f68c111b4a388351c18551dd43ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:25.958457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d55f68c111b4a388351c18551dd43ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:25.959609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d55f68c111b4a388351c18551dd43ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:25.960438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-027f1be9-a1af-4ea5-b77e-b3d535cf1a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d55f68c111b4a388351c18551dd43ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:26.062064 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1669/3384] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:16:25 2021] DELETE /identity/v3/users/3d55f68c111b4a388351c18551dd43ce => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:26.508148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:26.510033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:26.666217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ff385-27b8-45ca-8526-c5c9fd132c21 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:26.784408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:26.785375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:26.785662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:26.785940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] PATH_INFO: `/v3/projects/f5ed5c4fc23d460e8d63226986b549bd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:26.787280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ed5c4fc23d460e8d63226986b549bd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:26.789424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:26.913866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ed5c4fc23d460e8d63226986b549bd', 'request_id': 'req-2dacc611-c37b-4d4f-896e-aba6a5512a9e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:26.994682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ed5c4fc23d460e8d63226986b549bd', 'request_id': 'req-2dacc611-c37b-4d4f-896e-aba6a5512a9e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:27.014215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ed5c4fc23d460e8d63226986b549bd', 'request_id': 'req-2dacc611-c37b-4d4f-896e-aba6a5512a9e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:27.025696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] The token cache is being invalidate because project f5ed5c4fc23d460e8d63226986b549bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:16:27.025977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:27.026862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dacc611-c37b-4d4f-896e-aba6a5512a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:16:27.028574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1716/3385] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:26 2021] DELETE /identity/v3/projects/f5ed5c4fc23d460e8d63226986b549bd => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:27.035024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc491-0515-4e7d-9f74-8c2e48f9c4ea None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.035544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc491-0515-4e7d-9f74-8c2e48f9c4ea None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.037618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc491-0515-4e7d-9f74-8c2e48f9c4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.054332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2accc491-0515-4e7d-9f74-8c2e48f9c4ea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:27.056021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2accc491-0515-4e7d-9f74-8c2e48f9c4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:27.141723 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1670/3386] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:27.159779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508535e8-3d0e-46b7-a347-1bf0697f530a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.160063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508535e8-3d0e-46b7-a347-1bf0697f530a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.160574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508535e8-3d0e-46b7-a347-1bf0697f530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.180514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-508535e8-3d0e-46b7-a347-1bf0697f530a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:27.182119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-508535e8-3d0e-46b7-a347-1bf0697f530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:27.190098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1717/3387] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:27.194435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accc491-0515-4e7d-9f74-8c2e48f9c4ea None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:27.204195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accc491-0515-4e7d-9f74-8c2e48f9c4ea None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:27.209429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:27.210193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.210480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.210759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.211541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:16:27.211852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:27.213469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:27.225846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1671/3388] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:16:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:16:27.230061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508535e8-3d0e-46b7-a347-1bf0697f530a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:27.239668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508535e8-3d0e-46b7-a347-1bf0697f530a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:27.246352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:27.247113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.247610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.248089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.249266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:27.251387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:27.337033 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1718/3389] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:16:27 2021] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:27.338149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:27.348192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310743-cb35-49a8-ba63-45b47bb4774f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:27.405750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9d01f-aaa3-42b4-a5fc-f8f3bbd277fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:27.406413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d01f-aaa3-42b4-a5fc-f8f3bbd277fe admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.406692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d01f-aaa3-42b4-a5fc-f8f3bbd277fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.406965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9d01f-aaa3-42b4-a5fc-f8f3bbd277fe admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.407659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9d01f-aaa3-42b4-a5fc-f8f3bbd277fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:27.409598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9d01f-aaa3-42b4-a5fc-f8f3bbd277fe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:27.525990 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1672/3390] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:16:27 2021] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:16:27.526580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:27.541958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd66c89-f0d3-41ab-890b-6ae1184c8851 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:27.553852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:27.554617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.554908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.555182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.556448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:27.559223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:27.571581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0393a7b-6edf-45d6-85d2-3ee84e58a20e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.572125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0393a7b-6edf-45d6-85d2-3ee84e58a20e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.572597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0393a7b-6edf-45d6-85d2-3ee84e58a20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.584518 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1719/3391] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:27 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:27.590021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:27.603720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8325b1-a8a8-452d-8381-cce40b696a18 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:27.609939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:27.610818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.611114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.611439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.612414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:27.614466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:27.630660 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1720/3392] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:16:27 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:16:27.631975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:27.638480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c0393a7b-6edf-45d6-85d2-3ee84e58a20e None None] MFA Rules not processed for user `612091f79bd842639ed1edd28bd293ce`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:27.640351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c0393a7b-6edf-45d6-85d2-3ee84e58a20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:27.643031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc24a88-f1dc-4c76-b75b-6cf0fbbfa5ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:27.649174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776488b-7293-46b6-9f39-6a27b54618a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:27.649812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776488b-7293-46b6-9f39-6a27b54618a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.650394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776488b-7293-46b6-9f39-6a27b54618a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.650882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776488b-7293-46b6-9f39-6a27b54618a7 admin admin] PATH_INFO: `/v3/projects/4c3545b07d0b4ccf9cd48a80c2d37521/users/d2cc54d7a742403f896dd71d222895c2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.710351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776488b-7293-46b6-9f39-6a27b54618a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3545b07d0b4ccf9cd48a80c2d37521, user_id=d2cc54d7a742403f896dd71d222895c2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:27.714000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776488b-7293-46b6-9f39-6a27b54618a7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:27.735786 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1673/3393] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:27 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:27.746654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.746945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.747225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.767546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] MFA Rules not processed for user `82ec9d2698bd4b3f811022f3d8c458b2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:27.768844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:27.845027 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1674/3394] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:27.879911 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1721/3395] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:16:27 2021] PUT /identity/v3/projects/4c3545b07d0b4ccf9cd48a80c2d37521/users/d2cc54d7a742403f896dd71d222895c2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:16:27.882193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:27.885791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:27.885975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:27.886488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:27.887041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:27.911814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:27.913266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:27.978835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b464f6a-4917-4ef6-9185-9ecf5b51112f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:28.001109 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1722/3396] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:28.014579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:28.016826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:28.062918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:28.063503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:28.063742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:28.064017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:28.065842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:28.082290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc912608-5306-4793-9274-7768a65c3f8e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:28.086061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3d6f0-c8b6-4e3c-ad65-55c65688b9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:28.086718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3d6f0-c8b6-4e3c-ad65-55c65688b9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:28.086995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3d6f0-c8b6-4e3c-ad65-55c65688b9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:28.087271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3d6f0-c8b6-4e3c-ad65-55c65688b9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:28.100262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3d6f0-c8b6-4e3c-ad65-55c65688b9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:28.101860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3d6f0-c8b6-4e3c-ad65-55c65688b9c4 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:28.112648 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1723/3397] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:16:28.119311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebea3f-47bf-4f71-8e1f-dee67cbee86a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:28.119487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebea3f-47bf-4f71-8e1f-dee67cbee86a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:28.119717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebea3f-47bf-4f71-8e1f-dee67cbee86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:28.141636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:28.143303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:28.145001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3cebea3f-47bf-4f71-8e1f-dee67cbee86a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:28.146254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3cebea3f-47bf-4f71-8e1f-dee67cbee86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:28.153811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1675/3398] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:28.210915 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1724/3399] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:16:28 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:28.224728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:28.226326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:28.316010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0a5c5-270e-44fe-832d-93f0b51ae51d service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:28.321458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:28.322110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:28.322395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:28.322722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:28.332312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:28.334030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:28.343187 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1676/3400] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:16:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:39.959392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9eb9e-6859-4e0e-a182-6cdd34c52328 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:39.959392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9eb9e-6859-4e0e-a182-6cdd34c52328 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:39.959392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9eb9e-6859-4e0e-a182-6cdd34c52328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:40.026358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-63f9eb9e-6859-4e0e-a182-6cdd34c52328 None None] MFA Rules not processed for user `d2cc54d7a742403f896dd71d222895c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:40.031389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-63f9eb9e-6859-4e0e-a182-6cdd34c52328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:40.155858 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1725/3401] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:39 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:40.417273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:40.419413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:40.435786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b21b2-98b1-41fc-90c4-900702d9d222 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:40.447436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78102004-0aba-4bab-b163-559ce4f049f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:40.448337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102004-0aba-4bab-b163-559ce4f049f7 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:40.448792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102004-0aba-4bab-b163-559ce4f049f7 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:40.449262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102004-0aba-4bab-b163-559ce4f049f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:40.473646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78102004-0aba-4bab-b163-559ce4f049f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:40.475666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78102004-0aba-4bab-b163-559ce4f049f7 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:40.505189 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1677/3402] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:40 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:42.037349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93567e-73e4-43fb-be5d-a76905d9d9f5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:42.045509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93567e-73e4-43fb-be5d-a76905d9d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:42.046030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93567e-73e4-43fb-be5d-a76905d9d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:42.101058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1e93567e-73e4-43fb-be5d-a76905d9d9f5 None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:42.103081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1e93567e-73e4-43fb-be5d-a76905d9d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:42.230574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1726/3403] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:42 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:45.703879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62846cc0-e4e7-4ce0-b1fc-3e7951ba40f9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:45.704383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62846cc0-e4e7-4ce0-b1fc-3e7951ba40f9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:45.704502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62846cc0-e4e7-4ce0-b1fc-3e7951ba40f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:45.755658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-62846cc0-e4e7-4ce0-b1fc-3e7951ba40f9 None None] MFA Rules not processed for user `d2cc54d7a742403f896dd71d222895c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:45.762074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-62846cc0-e4e7-4ce0-b1fc-3e7951ba40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:45.777439 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1678/3404] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:45 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:51.430673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf86ee-4a10-4f23-b09f-6bb3c4eafbaa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:51.433835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf86ee-4a10-4f23-b09f-6bb3c4eafbaa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:51.433835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf86ee-4a10-4f23-b09f-6bb3c4eafbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:51.454326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0dbf86ee-4a10-4f23-b09f-6bb3c4eafbaa None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:51.455814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0dbf86ee-4a10-4f23-b09f-6bb3c4eafbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:51.488993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62846cc0-e4e7-4ce0-b1fc-3e7951ba40f9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:51.505347 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1727/3405] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:16:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:51.519549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62846cc0-e4e7-4ce0-b1fc-3e7951ba40f9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:51.526548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:51.527506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:51.528306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:51.530788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:51.554066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:51.556465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:51.583447 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1679/3406] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:16:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:53.068738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba95b-1508-4b46-a10a-ca6e85e20ea3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:53.069349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba95b-1508-4b46-a10a-ca6e85e20ea3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:53.069821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba95b-1508-4b46-a10a-ca6e85e20ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:53.099605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fb2ba95b-1508-4b46-a10a-ca6e85e20ea3 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:53.101243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb2ba95b-1508-4b46-a10a-ca6e85e20ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:53.109171 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1728/3407] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:16:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:16:53.123229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:53.137810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebca70e-1808-41b0-a49a-052ce7907e34 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:53.143357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b483d5c-e712-4622-a94e-620337ba343b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:53.147819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b483d5c-e712-4622-a94e-620337ba343b service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:53.147819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b483d5c-e712-4622-a94e-620337ba343b service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:53.147819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b483d5c-e712-4622-a94e-620337ba343b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:53.154815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b483d5c-e712-4622-a94e-620337ba343b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:53.156502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b483d5c-e712-4622-a94e-620337ba343b service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:53.168793 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1680/3408] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:16:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:54.372597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba95b-1508-4b46-a10a-ca6e85e20ea3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:54.393542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba95b-1508-4b46-a10a-ca6e85e20ea3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:54.404560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460b46-59ec-4eca-b8cb-ca4effa790a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:54.405423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460b46-59ec-4eca-b8cb-ca4effa790a6 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:54.405733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460b46-59ec-4eca-b8cb-ca4effa790a6 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:54.406018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460b46-59ec-4eca-b8cb-ca4effa790a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:54.454859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d11ddb-cf20-421f-8b52-058cfd05fa89 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:54.455448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d11ddb-cf20-421f-8b52-058cfd05fa89 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:54.455448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d11ddb-cf20-421f-8b52-058cfd05fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:54.472346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460b46-59ec-4eca-b8cb-ca4effa790a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:54.474119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460b46-59ec-4eca-b8cb-ca4effa790a6 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:54.474379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f8d11ddb-cf20-421f-8b52-058cfd05fa89 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:54.475572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f8d11ddb-cf20-421f-8b52-058cfd05fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:54.484441 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1681/3409] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:16:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:16:54.484725 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1729/3410] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:16:54 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:16:54.508292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d11ddb-cf20-421f-8b52-058cfd05fa89 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:16:54.522413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d11ddb-cf20-421f-8b52-058cfd05fa89 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:16:54.527635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:16:54.528269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:54.528545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:54.528816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:54.538039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:16:54.539849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:16:54.548282 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1682/3411] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:16:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:56.405148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a864a5-e9df-4375-ac42-77b07bd641cf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:16:56.405656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a864a5-e9df-4375-ac42-77b07bd641cf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:16:56.405656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a864a5-e9df-4375-ac42-77b07bd641cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:16:56.423782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a9a864a5-e9df-4375-ac42-77b07bd641cf None None] MFA Rules not processed for user `e7c7a9d6618448c9a5ade71c13a1758d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:16:56.425007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a9a864a5-e9df-4375-ac42-77b07bd641cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:16:56.483379 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1730/3412] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:16:56 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:04.582935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:04.586750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:04.608380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39db425-7832-4110-9ee3-5df1f81c52b5 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:04.613687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:04.614327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:04.614730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:04.615333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:04.618077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:04.637909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:04.639888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:04.657611 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1683/3413] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:05.542261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6c92-8c29-44ad-a0f7-0f6f17e6b43a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:05.542773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6c92-8c29-44ad-a0f7-0f6f17e6b43a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:05.543260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae6c92-8c29-44ad-a0f7-0f6f17e6b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:05.568734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d0ae6c92-8c29-44ad-a0f7-0f6f17e6b43a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:05.570826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d0ae6c92-8c29-44ad-a0f7-0f6f17e6b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:05.582972 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1731/3414] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:17:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:05.609974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:05.626916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e5216-2884-4834-a140-4f652bb049fa service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:05.636611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:05.637398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:05.637765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:05.638132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:05.646888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:05.648492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:05.668446 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1684/3415] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:17:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:06.268508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cca90-050d-47b8-b4bf-d11704808b4d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:06.269327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cca90-050d-47b8-b4bf-d11704808b4d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:06.269923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cca90-050d-47b8-b4bf-d11704808b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:06.312933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-950cca90-050d-47b8-b4bf-d11704808b4d None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:06.326885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-950cca90-050d-47b8-b4bf-d11704808b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:06.343897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1732/3416] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:17:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:06.358369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:06.379840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732dc2-6308-4401-bd2f-0dd06a7f3798 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:06.386121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:06.387281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:06.387753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:06.388092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:06.403607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:06.405376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:06.423681 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1685/3417] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:17:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:06.852849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:06.853357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:06.853468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:06.873864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:06.875135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:06.887278 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1733/3418] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:17:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:06.901193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:06.918969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a6fdc-8ffa-4c04-8f1b-b54f55dea762 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:06.924949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:06.928507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:06.928507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:06.928507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:06.936072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:06.937731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:06.950227 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1686/3419] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:17:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:07.400408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:07.401842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:07.418740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55732d6a-a7e0-4388-9ad8-abbcbe0dd68d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:07.424929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:07.426572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:07.427109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:07.427755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] PATH_INFO: `/v3/users/4039c9a053164b1685c6535b79a763a4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:07.429455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4039c9a053164b1685c6535b79a763a4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:07.432038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:07.649101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:07.661762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b3e8b-4884-4134-951d-94e6f258ff35 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:07.680516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f1fa-ab76-4f18-ac51-c2c1efcf5b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:07.681828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f1fa-ab76-4f18-ac51-c2c1efcf5b09 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:07.684029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f1fa-ab76-4f18-ac51-c2c1efcf5b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:07.684479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f1fa-ab76-4f18-ac51-c2c1efcf5b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:07.690048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0d57f1fa-ab76-4f18-ac51-c2c1efcf5b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:07.719651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f1fa-ab76-4f18-ac51-c2c1efcf5b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:07.721511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4039c9a053164b1685c6535b79a763a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:07.722958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f1fa-ab76-4f18-ac51-c2c1efcf5b09 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:07.743691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4039c9a053164b1685c6535b79a763a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:07.753676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1687/3420] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:07.776286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4039c9a053164b1685c6535b79a763a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:07.779280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4039c9a053164b1685c6535b79a763a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:07.840112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4039c9a053164b1685c6535b79a763a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:07.849367 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1734/3421] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:07 2021] DELETE /identity/v3/users/4039c9a053164b1685c6535b79a763a4 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:07.854286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672700-0e51-495b-a8b7-1e0782c0557d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:07.854816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672700-0e51-495b-a8b7-1e0782c0557d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:07.855257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672700-0e51-495b-a8b7-1e0782c0557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:07.905171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e9672700-0e51-495b-a8b7-1e0782c0557d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:07.905933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e9672700-0e51-495b-a8b7-1e0782c0557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:08.047410 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1688/3422] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:08.058325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:08.059802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:08.079781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:08.080382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:08.080863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:08.104998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] MFA Rules not processed for user `f9e59d219fa640e48533e0efdf150b16`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:08.106582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:08.140390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab840e-2e8f-41bd-8c19-0cbc1108eae4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:08.146738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:08.148450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:08.150164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:08.151075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:08.168562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:08.170960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:08.185034 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1689/3423] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:08 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:08.194132 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1735/3424] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:08.887565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:08.893492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:08.897566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:08.899285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:08.986132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043e6f2-ff5b-4e8e-9d41-3eda3d83dc0f service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:09.000418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:09.001328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:09.001611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:09.001883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] PATH_INFO: `/v3/projects/919a00bb2d294ab291df4bbd212ae7fe` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:09.003152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] RBAC: Authorizing `identity:delete_project(project_id=919a00bb2d294ab291df4bbd212ae7fe)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:09.005701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:09.039375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b81c05-7559-4765-8833-ae1c25659f46 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:09.045381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dd9f6-5afd-47c3-8c40-837a651f8117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:09.046102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd9f6-5afd-47c3-8c40-837a651f8117 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:09.046570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd9f6-5afd-47c3-8c40-837a651f8117 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:09.046849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd9f6-5afd-47c3-8c40-837a651f8117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:09.048929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-da0dd9f6-5afd-47c3-8c40-837a651f8117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:09.075163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0dd9f6-5afd-47c3-8c40-837a651f8117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:09.077104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0dd9f6-5afd-47c3-8c40-837a651f8117 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:09.088334 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1690/3425] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:09.112134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919a00bb2d294ab291df4bbd212ae7fe', 'request_id': 'req-32fc536c-84b1-4671-b08e-8c4716df312a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:09.148488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad46e-5700-4d20-9f4f-18879f316c92 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:09.148768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad46e-5700-4d20-9f4f-18879f316c92 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:09.149370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad46e-5700-4d20-9f4f-18879f316c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:09.184442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0eaad46e-5700-4d20-9f4f-18879f316c92 None None] MFA Rules not processed for user `819fcdf5d86a46399dfb7343639f3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:09.185905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0eaad46e-5700-4d20-9f4f-18879f316c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:09.207216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919a00bb2d294ab291df4bbd212ae7fe', 'request_id': 'req-32fc536c-84b1-4671-b08e-8c4716df312a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:09.218750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919a00bb2d294ab291df4bbd212ae7fe', 'request_id': 'req-32fc536c-84b1-4671-b08e-8c4716df312a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:09.246353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] The token cache is being invalidate because project 919a00bb2d294ab291df4bbd212ae7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:09.246353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:09.246353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-32fc536c-84b1-4671-b08e-8c4716df312a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:09.246353 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1736/3426] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:08 2021] DELETE /identity/v3/projects/919a00bb2d294ab291df4bbd212ae7fe => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:09.251631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a8be-632b-4362-9ef0-223304c46270 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:09.252019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a8be-632b-4362-9ef0-223304c46270 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:09.252467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a8be-632b-4362-9ef0-223304c46270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:09.275022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5c43a8be-632b-4362-9ef0-223304c46270 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:09.276462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5c43a8be-632b-4362-9ef0-223304c46270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:09.283611 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1691/3427] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:09.383202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1737/3428] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:09.390774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1f5a0-e3da-4e0b-be61-e36244b6fe9b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:09.391064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1f5a0-e3da-4e0b-be61-e36244b6fe9b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:09.391344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1f5a0-e3da-4e0b-be61-e36244b6fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:09.412400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-38e1f5a0-e3da-4e0b-be61-e36244b6fe9b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:09.413682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-38e1f5a0-e3da-4e0b-be61-e36244b6fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:09.430331 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1692/3429] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:09.431561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43a8be-632b-4362-9ef0-223304c46270 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:09.443207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43a8be-632b-4362-9ef0-223304c46270 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:09.456311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:09.488411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:09.488411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:09.488411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:09.488411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:17:09.488411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:09.488411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:09.489655 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1738/3430] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:17:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:17:09.493042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1f5a0-e3da-4e0b-be61-e36244b6fe9b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:09.503472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1f5a0-e3da-4e0b-be61-e36244b6fe9b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:09.508694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:09.509941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:09.509941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:09.509941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:09.510827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:09.512751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:10.125727 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1693/3431] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:17:09 2021] POST /identity/v3/projects => generated 381 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:10.130172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:10.161339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fceea-00ac-483a-912f-baa9b1c1940b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:10.225048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:10.226573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:10.226573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:10.226573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:10.227246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:10.233649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:10.384339 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1739/3432] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:17:10 2021] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:17:10.388523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:10.412808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc52c3-24b1-47b1-acfa-3c3e0ddd3b82 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:10.418849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:10.419534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:10.419813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:10.420091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:10.421000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:10.426587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:10.434779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1694/3433] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:10 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:10.438976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:10.457663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929a6b-9eea-451b-9f8a-c6c3438a548b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:10.467850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dfa05-26e9-4fae-92e0-7ac7a545ed0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:10.468600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dfa05-26e9-4fae-92e0-7ac7a545ed0e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:10.468918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dfa05-26e9-4fae-92e0-7ac7a545ed0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:10.469197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dfa05-26e9-4fae-92e0-7ac7a545ed0e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:10.471078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dfa05-26e9-4fae-92e0-7ac7a545ed0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:10.472780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dfa05-26e9-4fae-92e0-7ac7a545ed0e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:10.491618 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1740/3434] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:10 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:10.491865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:10.510922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061d9c-d8e9-4358-af42-39e5c34e406a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:10.523732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:10.524641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:10.524950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:10.525230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] PATH_INFO: `/v3/projects/16a084940f024be8aee5807248918cb5/users/d9a0d56f4a364ba38235b7eccbd8db8a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:10.546661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a084940f024be8aee5807248918cb5, user_id=d9a0d56f4a364ba38235b7eccbd8db8a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:10.547478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:10.640553 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1695/3435] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:17:10 2021] PUT /identity/v3/projects/16a084940f024be8aee5807248918cb5/users/d9a0d56f4a364ba38235b7eccbd8db8a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:10.646301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589922c-4175-4743-a16d-d553151c3ea1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:10.646595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589922c-4175-4743-a16d-d553151c3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:10.655545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589922c-4175-4743-a16d-d553151c3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:10.678409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3589922c-4175-4743-a16d-d553151c3ea1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:10.680376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3589922c-4175-4743-a16d-d553151c3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:10.755993 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1741/3436] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:10.766822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:10.768648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:10.865689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34160-a5d7-4276-bd1f-2ccc8214871b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:10.871157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:10.871805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:10.872088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:10.872356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:10.886044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:10.888154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:10.902964 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1696/3437] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:12.580115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173587-7049-4df7-ae98-1e53c022fa2d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:12.581140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173587-7049-4df7-ae98-1e53c022fa2d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:12.581625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173587-7049-4df7-ae98-1e53c022fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:12.638364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6e173587-7049-4df7-ae98-1e53c022fa2d None None] MFA Rules not processed for user `d9a0d56f4a364ba38235b7eccbd8db8a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:12.640343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e173587-7049-4df7-ae98-1e53c022fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:12.724985 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1742/3438] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:12 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:12.739806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:12.741594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:12.840748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82330a3-4165-4e31-9932-2b8b563f4917 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:12.849366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8af13-3b1f-445e-9a48-b830cac00956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:12.850312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8af13-3b1f-445e-9a48-b830cac00956 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:12.850592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8af13-3b1f-445e-9a48-b830cac00956 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:12.850866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8af13-3b1f-445e-9a48-b830cac00956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:12.859543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8af13-3b1f-445e-9a48-b830cac00956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:12.861592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8af13-3b1f-445e-9a48-b830cac00956 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:12.881235 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1697/3439] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:12 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:14.049505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363043-00cb-407a-aaa3-569a1198cf2e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:14.050876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363043-00cb-407a-aaa3-569a1198cf2e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:14.051201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363043-00cb-407a-aaa3-569a1198cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:14.080010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a3363043-00cb-407a-aaa3-569a1198cf2e None None] MFA Rules not processed for user `d9a0d56f4a364ba38235b7eccbd8db8a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:14.081523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3363043-00cb-407a-aaa3-569a1198cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:14.090120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1743/3440] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:14.260108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a80f0-f9a2-4f7c-9551-d13f66a479a9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:14.260591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a80f0-f9a2-4f7c-9551-d13f66a479a9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:14.260702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a80f0-f9a2-4f7c-9551-d13f66a479a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:14.287364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f56a80f0-f9a2-4f7c-9551-d13f66a479a9 None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:14.294009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f56a80f0-f9a2-4f7c-9551-d13f66a479a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:14.373767 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1698/3441] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:14 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:17.238473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246047f-4637-4e57-94a5-a93aba114074 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:17.239061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246047f-4637-4e57-94a5-a93aba114074 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:17.239357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246047f-4637-4e57-94a5-a93aba114074 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:17.241802 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1744/3442] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:17:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:17:17.247565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56175-6e44-4b0e-8f03-1ea01956f081 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:17.248094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56175-6e44-4b0e-8f03-1ea01956f081 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:17.248190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56175-6e44-4b0e-8f03-1ea01956f081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:17.287334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8dd56175-6e44-4b0e-8f03-1ea01956f081 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:17.288631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8dd56175-6e44-4b0e-8f03-1ea01956f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:17.372235 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1699/3443] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:17:17 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:17.407281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246047f-4637-4e57-94a5-a93aba114074 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:17.411466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b246047f-4637-4e57-94a5-a93aba114074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:17.430600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246047f-4637-4e57-94a5-a93aba114074 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:17.435690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:17.436333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:17.436614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:17.436913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:17.446154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:17.457121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:17.457548 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1745/3444] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:18.263855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ce37-0ff5-404c-ba3f-1d3ad0895392 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:18.264998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ce37-0ff5-404c-ba3f-1d3ad0895392 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:18.265454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ce37-0ff5-404c-ba3f-1d3ad0895392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:18.286551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0572ce37-0ff5-404c-ba3f-1d3ad0895392 None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:18.288313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0572ce37-0ff5-404c-ba3f-1d3ad0895392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:18.297347 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1700/3445] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:18 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:19.665123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:19.667234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:19.685179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709493-f4a4-4ba9-b27a-94fa8b72a219 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:19.695994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:19.696867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:19.697226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:19.697506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] PATH_INFO: `/v3/users/82ec9d2698bd4b3f811022f3d8c458b2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:19.701562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ec9d2698bd4b3f811022f3d8c458b2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:19.705629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:19.954000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ec9d2698bd4b3f811022f3d8c458b2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:19.967834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ec9d2698bd4b3f811022f3d8c458b2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:19.988132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ec9d2698bd4b3f811022f3d8c458b2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:19.989175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ec9d2698bd4b3f811022f3d8c458b2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:20.039793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ec9d2698bd4b3f811022f3d8c458b2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:20.053323 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1746/3446] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:19 2021] DELETE /identity/v3/users/82ec9d2698bd4b3f811022f3d8c458b2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:20.388076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ce37-0ff5-404c-ba3f-1d3ad0895392 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:20.399059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ce37-0ff5-404c-ba3f-1d3ad0895392 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:20.477753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:20.478613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:20.478897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:20.479174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] PATH_INFO: `/v3/projects/ef4a444bae614ca7b19f2e61052a4c6e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:20.480370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4a444bae614ca7b19f2e61052a4c6e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:20.484047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:20.633340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4a444bae614ca7b19f2e61052a4c6e', 'request_id': 'req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:20.639497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4a444bae614ca7b19f2e61052a4c6e', 'request_id': 'req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:20.730648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4a444bae614ca7b19f2e61052a4c6e', 'request_id': 'req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:20.741889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] The token cache is being invalidate because project ef4a444bae614ca7b19f2e61052a4c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:20.742246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:20.742929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:20.744517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1701/3447] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:20 2021] DELETE /identity/v3/projects/ef4a444bae614ca7b19f2e61052a4c6e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:20.748555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:20.750081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:20.763590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33111e-9218-467c-943a-8958f5f65870 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:20.822243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:20.823180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:20.823493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:20.823812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] PATH_INFO: `/v3/users/612091f79bd842639ed1edd28bd293ce` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:20.825356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=612091f79bd842639ed1edd28bd293ce)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:20.827417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:21.026206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612091f79bd842639ed1edd28bd293ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.034635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612091f79bd842639ed1edd28bd293ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.054635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612091f79bd842639ed1edd28bd293ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.055760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612091f79bd842639ed1edd28bd293ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.134654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e15f8e30-5938-4a0f-9fc3-10c8576fcf3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612091f79bd842639ed1edd28bd293ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.142589 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1747/3448] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:20 2021] DELETE /identity/v3/users/612091f79bd842639ed1edd28bd293ce => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:21.492642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:21.494147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:21.511838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde118e9-1000-4f90-8b59-efb7f0ce2ac7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:21.586857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:21.588382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:21.588866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:21.589325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] PATH_INFO: `/v3/projects/759e68391a21437c981ea5c487262fdd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:21.592149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759e68391a21437c981ea5c487262fdd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:21.595045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:21.722739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759e68391a21437c981ea5c487262fdd', 'request_id': 'req-2c762db2-7124-473c-9d7c-8a12ee0bce17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.730228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759e68391a21437c981ea5c487262fdd', 'request_id': 'req-2c762db2-7124-473c-9d7c-8a12ee0bce17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.810668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759e68391a21437c981ea5c487262fdd', 'request_id': 'req-2c762db2-7124-473c-9d7c-8a12ee0bce17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.823581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] The token cache is being invalidate because project 759e68391a21437c981ea5c487262fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:21.824187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.825214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c762db2-7124-473c-9d7c-8a12ee0bce17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:21.827291 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1702/3449] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:21 2021] DELETE /identity/v3/projects/759e68391a21437c981ea5c487262fdd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:21.833353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bb5e-ec61-4efc-959f-c7437434e7e9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:21.833889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bb5e-ec61-4efc-959f-c7437434e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:21.836212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bb5e-ec61-4efc-959f-c7437434e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:21.898100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8fa6bb5e-ec61-4efc-959f-c7437434e7e9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:21.899784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8fa6bb5e-ec61-4efc-959f-c7437434e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:21.987427 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1748/3450] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:21.996289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15ea14-9697-4da3-bf75-6377fd9e236e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:21.996737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15ea14-9697-4da3-bf75-6377fd9e236e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:21.997404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15ea14-9697-4da3-bf75-6377fd9e236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.037665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2e15ea14-9697-4da3-bf75-6377fd9e236e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:22.039189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2e15ea14-9697-4da3-bf75-6377fd9e236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:22.048711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1703/3451] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:22.051618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6bb5e-ec61-4efc-959f-c7437434e7e9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:22.063470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6bb5e-ec61-4efc-959f-c7437434e7e9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:22.070564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:22.071620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:22.072109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:22.072557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.073503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:17:22.074093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:22.076442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:22.089726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1749/3452] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:17:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:17:22.094536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15ea14-9697-4da3-bf75-6377fd9e236e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:22.112258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15ea14-9697-4da3-bf75-6377fd9e236e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:22.116593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:22.118259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:22.118752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:22.119216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.120475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:22.123344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:22.266056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1704/3453] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:17:22 2021] POST /identity/v3/projects => generated 395 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:17:22.270827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:22.289552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba9a9e-462c-46f7-baa6-9e450d12df56 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:22.406441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:22.413017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:22.413017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:22.413017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.413017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:22.416449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:22.551402 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1750/3454] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:17:22 2021] POST /identity/v3/users => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:22.551644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:22.581787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34ae7b-750d-4510-8db8-a8eef05209f8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:22.604287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:22.605016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:22.605491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:22.605948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.606982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:22.608663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:22.620717 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1705/3455] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:22 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:17:22.625613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:22.638173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6803d-6b9d-4a6a-856f-2e8783540d13 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:22.644563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419a6a9-ab5e-4b8d-abdc-248e6d1d83b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:22.644563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419a6a9-ab5e-4b8d-abdc-248e6d1d83b0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:22.644563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419a6a9-ab5e-4b8d-abdc-248e6d1d83b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:22.644563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419a6a9-ab5e-4b8d-abdc-248e6d1d83b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.645315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419a6a9-ab5e-4b8d-abdc-248e6d1d83b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:22.646934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419a6a9-ab5e-4b8d-abdc-248e6d1d83b0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:22.659477 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1751/3456] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:22.663503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:22.674420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04658c-2cce-4a42-afba-4042f9ddd982 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:22.679437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:22.680324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:22.680607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:22.680907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] PATH_INFO: `/v3/projects/78c0254f98dd4b38bc1adc0a91b6e776/users/9062ea41eadc4778898fe11e7165e5c1/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.706721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c0254f98dd4b38bc1adc0a91b6e776, user_id=9062ea41eadc4778898fe11e7165e5c1, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:22.709836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:22.855366 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1706/3457] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:17:22 2021] PUT /identity/v3/projects/78c0254f98dd4b38bc1adc0a91b6e776/users/9062ea41eadc4778898fe11e7165e5c1/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:22.866538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538f85-a1e0-4266-842c-ab8ea7ff4ab4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:22.867132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538f85-a1e0-4266-842c-ab8ea7ff4ab4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:22.867132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538f85-a1e0-4266-842c-ab8ea7ff4ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:22.911705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ef538f85-a1e0-4266-842c-ab8ea7ff4ab4 None None] MFA Rules not processed for user `9062ea41eadc4778898fe11e7165e5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:22.913161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ef538f85-a1e0-4266-842c-ab8ea7ff4ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:23.013361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1752/3458] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:22 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:23.241045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:23.241045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:23.357239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d4283-4206-42b9-9b6a-82a719dd959b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:23.363425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297a380-544d-4057-b656-c723005e0653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:23.364087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a380-544d-4057-b656-c723005e0653 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:23.365037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a380-544d-4057-b656-c723005e0653 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:23.365329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297a380-544d-4057-b656-c723005e0653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:23.374277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297a380-544d-4057-b656-c723005e0653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:23.375858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297a380-544d-4057-b656-c723005e0653 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:23.387504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1707/3459] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:23 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:23.535789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea0dd4-19c3-4880-971e-36ac6a2b3f6d None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:23.536015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea0dd4-19c3-4880-971e-36ac6a2b3f6d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:23.536146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea0dd4-19c3-4880-971e-36ac6a2b3f6d None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:23.538196 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1753/3460] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:17:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:17:23.544458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:23.544836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:23.545222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:23.576614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:23.579050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:23.653288 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1708/3461] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:17:23 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:23.682648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea0dd4-19c3-4880-971e-36ac6a2b3f6d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:23.690494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-65ea0dd4-19c3-4880-971e-36ac6a2b3f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:23.715016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea0dd4-19c3-4880-971e-36ac6a2b3f6d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:23.720673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:23.721951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:23.722302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:23.722653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:23.732928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:23.735392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:23.749703 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1754/3462] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:24.301364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:24.303022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:24.421104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:24.423237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:24.481529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb021-99d6-4e66-9823-071ce5d9162f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:24.493009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:24.495028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:24.495603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:24.496039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:24.504514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:24.537963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:24.539826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:24.552580 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1709/3463] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:24.553691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:24.561401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a296-27b5-4c64-bd5b-3dd63ad8289c service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:24.576896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26573ec6-c39a-4de8-9569-8179c513d464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:24.577859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573ec6-c39a-4de8-9569-8179c513d464 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:24.578245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573ec6-c39a-4de8-9569-8179c513d464 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:24.578619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26573ec6-c39a-4de8-9569-8179c513d464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:24.583435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-26573ec6-c39a-4de8-9569-8179c513d464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:24.608216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573ec6-c39a-4de8-9569-8179c513d464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:24.610017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26573ec6-c39a-4de8-9569-8179c513d464 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:24.629880 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1755/3464] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:24.665064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392801-6e8c-491a-b141-64fd0a78d038 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:24.670441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:24.671601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:24.672078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:24.672527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] PATH_INFO: `/v3/users/9062ea41eadc4778898fe11e7165e5c1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:24.674073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9062ea41eadc4778898fe11e7165e5c1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:24.676156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:24.897241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3485-ab17-4236-b916-db975e172d5f None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:24.897532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3485-ab17-4236-b916-db975e172d5f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:24.897811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3485-ab17-4236-b916-db975e172d5f None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:24.899929 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1756/3465] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:17:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:17:24.905435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb1e01-d93c-41e9-84b0-e41622e4fe5e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:24.905823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb1e01-d93c-41e9-84b0-e41622e4fe5e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:24.906125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb1e01-d93c-41e9-84b0-e41622e4fe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:24.928557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8deb1e01-d93c-41e9-84b0-e41622e4fe5e None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:24.930218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8deb1e01-d93c-41e9-84b0-e41622e4fe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:24.940941 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1757/3466] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:17:24 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:24.941735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9062ea41eadc4778898fe11e7165e5c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:24.949979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9062ea41eadc4778898fe11e7165e5c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:24.965219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb1e01-d93c-41e9-84b0-e41622e4fe5e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:24.974660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9062ea41eadc4778898fe11e7165e5c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:24.975538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9062ea41eadc4778898fe11e7165e5c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:24.976147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9062ea41eadc4778898fe11e7165e5c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:24.978096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb1e01-d93c-41e9-84b0-e41622e4fe5e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:24.983414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbe088-f7d1-464c-a6d8-3c958a45b127 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:24.984094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe088-f7d1-464c-a6d8-3c958a45b127 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:24.984381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe088-f7d1-464c-a6d8-3c958a45b127 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:24.984657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbe088-f7d1-464c-a6d8-3c958a45b127 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:24.987255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-52cbe088-f7d1-464c-a6d8-3c958a45b127 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:25.000503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbe088-f7d1-464c-a6d8-3c958a45b127 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:25.002131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbe088-f7d1-464c-a6d8-3c958a45b127 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:25.018219 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1758/3467] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:25.057800 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1710/3468] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:24 2021] DELETE /identity/v3/users/9062ea41eadc4778898fe11e7165e5c1 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:25.062234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:25.062522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:25.062801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:25.090837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:25.092186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:25.217052 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1759/3469] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:25.240780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:25.240780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:25.320508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa2cc-cc8d-4bae-bd77-a831ca00db17 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:25.324898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a424e7-0b3a-4615-8bc0-dbd57e7dd75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:25.325966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a424e7-0b3a-4615-8bc0-dbd57e7dd75d service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:25.326727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a424e7-0b3a-4615-8bc0-dbd57e7dd75d service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:25.327237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a424e7-0b3a-4615-8bc0-dbd57e7dd75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:25.340025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a424e7-0b3a-4615-8bc0-dbd57e7dd75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:25.341854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a424e7-0b3a-4615-8bc0-dbd57e7dd75d service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:25.356483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1711/3470] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:26.162435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:26.163978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:26.180830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c530b98-1fb5-442d-b73e-98e35e2cbde9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:26.188501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:26.189446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:26.190078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:26.190360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] PATH_INFO: `/v3/projects/78c0254f98dd4b38bc1adc0a91b6e776` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:26.191616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c0254f98dd4b38bc1adc0a91b6e776)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:26.194005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:26.322311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c0254f98dd4b38bc1adc0a91b6e776', 'request_id': 'req-f24e187a-5977-410c-9f14-0054ebf5062c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:26.404296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c0254f98dd4b38bc1adc0a91b6e776', 'request_id': 'req-f24e187a-5977-410c-9f14-0054ebf5062c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:26.411678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c0254f98dd4b38bc1adc0a91b6e776', 'request_id': 'req-f24e187a-5977-410c-9f14-0054ebf5062c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:26.421919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] The token cache is being invalidate because project 78c0254f98dd4b38bc1adc0a91b6e776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:26.422207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:26.422835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f24e187a-5977-410c-9f14-0054ebf5062c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:26.424396 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1760/3471] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:26 2021] DELETE /identity/v3/projects/78c0254f98dd4b38bc1adc0a91b6e776 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:26.430552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f632de4-038e-4abd-8e0c-775dc24f2bd6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:26.431019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f632de4-038e-4abd-8e0c-775dc24f2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:26.431144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f632de4-038e-4abd-8e0c-775dc24f2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:26.448294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6f632de4-038e-4abd-8e0c-775dc24f2bd6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:26.449523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6f632de4-038e-4abd-8e0c-775dc24f2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:26.507180 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1712/3472] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:26.514988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60c148-b164-4a5b-b659-396cb2b016a9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:26.515279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60c148-b164-4a5b-b659-396cb2b016a9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:26.515554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60c148-b164-4a5b-b659-396cb2b016a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:26.534479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3b60c148-b164-4a5b-b659-396cb2b016a9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:26.535602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3b60c148-b164-4a5b-b659-396cb2b016a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:26.543647 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1761/3473] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:26.547788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f632de4-038e-4abd-8e0c-775dc24f2bd6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:26.557913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f632de4-038e-4abd-8e0c-775dc24f2bd6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:26.562851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:26.563598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:26.563998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:26.564301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:26.565785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:17:26.566546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:26.567855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:26.583968 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1713/3474] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:17:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:17:26.585126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60c148-b164-4a5b-b659-396cb2b016a9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:26.594850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60c148-b164-4a5b-b659-396cb2b016a9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:26.599645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:26.600461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:26.600587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:26.600822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:26.605872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:26.605872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:26.715640 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1762/3475] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:17:26 2021] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:17:26.719705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:26.732655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e9d02-73cd-4741-aeb2-cae276b21065 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:26.797501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:26.798205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:26.798469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:26.798742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:26.800183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:26.801549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:26.905111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1714/3476] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:17:26 2021] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:17:26.909387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:26.919804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b29ae2-aaef-4aed-bded-22320f5cce55 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:26.924510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:26.925205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:26.925486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:26.925762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:26.926491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:26.928072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:27.278091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1763/3477] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:27.282028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:27.282028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fd88c-8de4-4177-a743-3f3e81f00fc1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:27.282028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3161cd-f35d-41da-ba1a-40ddfaca9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:27.282028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3161cd-f35d-41da-ba1a-40ddfaca9bbb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:27.282383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3161cd-f35d-41da-ba1a-40ddfaca9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:27.282383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3161cd-f35d-41da-ba1a-40ddfaca9bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:27.282383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3161cd-f35d-41da-ba1a-40ddfaca9bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:27.282383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3161cd-f35d-41da-ba1a-40ddfaca9bbb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:27.282383 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1715/3478] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:26 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:27.282998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:27.282998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadc2ef-a3e9-4cc3-b1a1-e6fa446afa02 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:27.282998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d3127-d5cc-4806-ba01-b89f1731828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:27.282998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d3127-d5cc-4806-ba01-b89f1731828f admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:27.283362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d3127-d5cc-4806-ba01-b89f1731828f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:27.283362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d3127-d5cc-4806-ba01-b89f1731828f admin admin] PATH_INFO: `/v3/projects/5cda4085ba364f6394aa22b77fd7b795/users/f270bb03a7a74d54970fa63d3a4f4bbc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:27.283362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d3127-d5cc-4806-ba01-b89f1731828f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cda4085ba364f6394aa22b77fd7b795, user_id=f270bb03a7a74d54970fa63d3a4f4bbc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:27.283362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d3127-d5cc-4806-ba01-b89f1731828f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:27.283788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:27.283788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:27.283788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:27.283788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] MFA Rules not processed for user `e7c7a9d6618448c9a5ade71c13a1758d`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:27.283788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:27.287303 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1764/3479] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:17:26 2021] PUT /identity/v3/projects/5cda4085ba364f6394aa22b77fd7b795/users/f270bb03a7a74d54970fa63d3a4f4bbc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:27.287303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2e0b-ee3b-4db1-b9e4-9332b71cd3e4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:27.287303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2e0b-ee3b-4db1-b9e4-9332b71cd3e4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:27.287303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a2e0b-ee3b-4db1-b9e4-9332b71cd3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:27.292441 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1716/3480] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:27 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:27.292528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bb3a2e0b-ee3b-4db1-b9e4-9332b71cd3e4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:27.292528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bb3a2e0b-ee3b-4db1-b9e4-9332b71cd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:27.292528 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1765/3481] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:27.301815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:27.307197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:27.386024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad3661-65c6-4f5e-b7a6-1fc1e1bf163d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:27.436687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:27.437541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:27.437922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:27.438294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:27.459307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:27.461139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:27.474966 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1717/3482] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:29.071106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cf2d-1365-4af6-aa60-50d51ac38ab1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:29.071678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cf2d-1365-4af6-aa60-50d51ac38ab1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:29.071678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cf2d-1365-4af6-aa60-50d51ac38ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:29.108907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-99b3cf2d-1365-4af6-aa60-50d51ac38ab1 None None] MFA Rules not processed for user `f270bb03a7a74d54970fa63d3a4f4bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:29.110221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-99b3cf2d-1365-4af6-aa60-50d51ac38ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:29.187676 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1766/3483] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:29.436470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:29.439058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:29.564162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed0e5b-3c02-4d16-83f0-287e1fde8c72 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:29.578511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:29.581864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:29.582693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:29.583154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:29.607098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:29.609314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:29.625251 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1718/3484] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:31.954293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cf2d-1365-4af6-aa60-50d51ac38ab1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:31.966081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cf2d-1365-4af6-aa60-50d51ac38ab1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:31.971321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:31.972462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:31.972991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:31.973460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] PATH_INFO: `/v3/users/f270bb03a7a74d54970fa63d3a4f4bbc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:31.974984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f270bb03a7a74d54970fa63d3a4f4bbc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:31.977156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:32.212843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f270bb03a7a74d54970fa63d3a4f4bbc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:32.219745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f270bb03a7a74d54970fa63d3a4f4bbc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:32.233744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f270bb03a7a74d54970fa63d3a4f4bbc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:32.234523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f270bb03a7a74d54970fa63d3a4f4bbc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:32.290198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cbafaee1-eb12-46c9-83f4-ba6c5a3ea2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f270bb03a7a74d54970fa63d3a4f4bbc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:32.298095 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1767/3485] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:31 2021] DELETE /identity/v3/users/f270bb03a7a74d54970fa63d3a4f4bbc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:32.776599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:32.790482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804399-e360-4b58-8693-b04cf09d7653 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:32.858627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:32.859689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:32.860116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:32.860965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] PATH_INFO: `/v3/projects/5cda4085ba364f6394aa22b77fd7b795` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:32.862652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cda4085ba364f6394aa22b77fd7b795)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:32.864701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.007205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cda4085ba364f6394aa22b77fd7b795', 'request_id': 'req-310d6a99-2874-4f40-a41f-e50fcae6c9df'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:33.016844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cda4085ba364f6394aa22b77fd7b795', 'request_id': 'req-310d6a99-2874-4f40-a41f-e50fcae6c9df'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:33.076537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cda4085ba364f6394aa22b77fd7b795', 'request_id': 'req-310d6a99-2874-4f40-a41f-e50fcae6c9df'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:33.096295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] The token cache is being invalidate because project 5cda4085ba364f6394aa22b77fd7b795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:33.096615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:33.097280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-310d6a99-2874-4f40-a41f-e50fcae6c9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:33.099064 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1719/3486] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:32 2021] DELETE /identity/v3/projects/5cda4085ba364f6394aa22b77fd7b795 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:33.104590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e8b6-8e11-4975-a7ec-ee46d8bd885d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.105453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e8b6-8e11-4975-a7ec-ee46d8bd885d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.105739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e8b6-8e11-4975-a7ec-ee46d8bd885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.124694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9d58e8b6-8e11-4975-a7ec-ee46d8bd885d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:33.125946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d58e8b6-8e11-4975-a7ec-ee46d8bd885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:33.189896 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1768/3487] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:33.197834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba198a-b2ce-4493-af14-ffd83f59a6cb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.198148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba198a-b2ce-4493-af14-ffd83f59a6cb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.198427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba198a-b2ce-4493-af14-ffd83f59a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.229121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-32ba198a-b2ce-4493-af14-ffd83f59a6cb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:33.230787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32ba198a-b2ce-4493-af14-ffd83f59a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:33.249876 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1720/3488] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:33.256958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58e8b6-8e11-4975-a7ec-ee46d8bd885d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:33.270336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58e8b6-8e11-4975-a7ec-ee46d8bd885d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:33.283042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:33.284588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.285234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.286018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.286965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:17:33.287467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:33.295726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.311939 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1769/3489] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:17:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:17:33.313968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba198a-b2ce-4493-af14-ffd83f59a6cb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:33.323928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba198a-b2ce-4493-af14-ffd83f59a6cb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:33.329917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:33.331157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.331435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.331704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.332639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:33.335209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.474615 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1721/3490] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:17:33 2021] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:33.479087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:33.489725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87e44-3170-4ade-9675-d3219018b679 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:33.559153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:33.559888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.560167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.560558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.561168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:33.564315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.649540 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1770/3491] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:17:33 2021] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:33.650150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:33.651839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:33.652301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:33.664135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427141-ac89-45f4-94c2-a8f89eed5418 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:33.669344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:33.670172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.670598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.670875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.671608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:33.673402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.685990 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1771/3492] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:33.690473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:33.700408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b375-c0bd-430c-9729-123031812bf6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:33.706014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:33.706854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.707153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.707405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.708287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:33.710057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.728129 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1772/3493] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:33.731644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:33.738761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8aacf-c81c-460b-9dc1-3e2b3b04a939 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:33.745771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e0c7-e8cd-48ce-aa01-59e7cb5108db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:33.746365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba705708-e302-4719-a278-dc67d70fa4fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:33.746467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e0c7-e8cd-48ce-aa01-59e7cb5108db service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.746737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e0c7-e8cd-48ce-aa01-59e7cb5108db service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.747028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e0c7-e8cd-48ce-aa01-59e7cb5108db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.749173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2093e0c7-e8cd-48ce-aa01-59e7cb5108db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:33.751452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:33.753304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.753988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.755289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] PATH_INFO: `/v3/projects/38d7cbaffc1340f59e994569e8e33e1d/users/1d23db9414d34853ae04f7f032694f12/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.769535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e0c7-e8cd-48ce-aa01-59e7cb5108db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:33.771192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e0c7-e8cd-48ce-aa01-59e7cb5108db service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.777574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d7cbaffc1340f59e994569e8e33e1d, user_id=1d23db9414d34853ae04f7f032694f12, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:33.780821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:33.783359 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1722/3494] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:33.935198 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1773/3495] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:17:33 2021] PUT /identity/v3/projects/38d7cbaffc1340f59e994569e8e33e1d/users/1d23db9414d34853ae04f7f032694f12/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:33.941268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bd252-261a-4f46-8679-e5be5768d93a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:33.941955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bd252-261a-4f46-8679-e5be5768d93a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:33.942236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bd252-261a-4f46-8679-e5be5768d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:33.970012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ee1bd252-261a-4f46-8679-e5be5768d93a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:33.971466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee1bd252-261a-4f46-8679-e5be5768d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:34.049661 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1723/3496] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:34.072621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:34.074538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:34.162193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773272e-2465-4d15-bf0f-a8c75bc8f6b3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:34.167276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499719b-033e-4852-9d02-560cb8accd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:34.167955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499719b-033e-4852-9d02-560cb8accd7b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:34.174395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499719b-033e-4852-9d02-560cb8accd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:34.174395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499719b-033e-4852-9d02-560cb8accd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:34.180241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499719b-033e-4852-9d02-560cb8accd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:34.181775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499719b-033e-4852-9d02-560cb8accd7b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:34.199192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1774/3497] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:36.497593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9850d-346d-4cf9-91b4-9070f4d12d6c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:36.498062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9850d-346d-4cf9-91b4-9070f4d12d6c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:36.498568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9850d-346d-4cf9-91b4-9070f4d12d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:36.534422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5eb9850d-346d-4cf9-91b4-9070f4d12d6c None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:36.535941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5eb9850d-346d-4cf9-91b4-9070f4d12d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:36.619981 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1724/3498] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:36 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:36.631991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:36.632494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:36.632592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:36.651380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:36.652598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:36.660652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1775/3499] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:36 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:36.672285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9850d-346d-4cf9-91b4-9070f4d12d6c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:36.747936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9850d-346d-4cf9-91b4-9070f4d12d6c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:36.753549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:36.754221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:36.754504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:36.754776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:36.762498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:36.764129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:36.773654 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1725/3500] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:36 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:38.737718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:38.739312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:38.764841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea876d-a7e2-4b8b-b350-bd9f8cdb768d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:38.778849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:38.779733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:38.780018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:38.780292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] PATH_INFO: `/v3/users/819fcdf5d86a46399dfb7343639f3ea6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:38.781548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819fcdf5d86a46399dfb7343639f3ea6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:38.784169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:39.037049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819fcdf5d86a46399dfb7343639f3ea6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.044270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819fcdf5d86a46399dfb7343639f3ea6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.058653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819fcdf5d86a46399dfb7343639f3ea6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.059869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819fcdf5d86a46399dfb7343639f3ea6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.152615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819fcdf5d86a46399dfb7343639f3ea6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.159218 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1776/3501] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:38 2021] DELETE /identity/v3/users/819fcdf5d86a46399dfb7343639f3ea6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:39.418768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:39.420186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:39.435927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2585390-05fe-4a08-b640-0db636b375fd service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:39.490450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:39.492362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:39.512060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:39.512732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:39.515423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:39.515423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:39.515844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:39.544298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:39.544298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:39.556330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1726/3502] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:39.601641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac22d92-f7a3-46d8-bd49-f04bf87a9171 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:39.604107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:39.605025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:39.605305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:39.605578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] PATH_INFO: `/v3/projects/27d474dfd37c46f0aa14aa84e8b3ad41` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:39.607067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d474dfd37c46f0aa14aa84e8b3ad41)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:39.609191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:39.671893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:39.673489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:39.734644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548350b-9279-4c5b-b974-4bc480728078 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:39.752273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d474dfd37c46f0aa14aa84e8b3ad41', 'request_id': 'req-f69174da-aff9-4342-9105-b941225b4a60'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.792745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef01e8f-34ab-4286-b1ba-3399829171cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:39.793554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01e8f-34ab-4286-b1ba-3399829171cb service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:39.793903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01e8f-34ab-4286-b1ba-3399829171cb service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:39.794274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01e8f-34ab-4286-b1ba-3399829171cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:39.796545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0ef01e8f-34ab-4286-b1ba-3399829171cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:39.807435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef01e8f-34ab-4286-b1ba-3399829171cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:39.809149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef01e8f-34ab-4286-b1ba-3399829171cb service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:39.818150 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1727/3503] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:39.847790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d474dfd37c46f0aa14aa84e8b3ad41', 'request_id': 'req-f69174da-aff9-4342-9105-b941225b4a60'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.854915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d474dfd37c46f0aa14aa84e8b3ad41', 'request_id': 'req-f69174da-aff9-4342-9105-b941225b4a60'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.865486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] The token cache is being invalidate because project 27d474dfd37c46f0aa14aa84e8b3ad41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:39.865771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.866411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f69174da-aff9-4342-9105-b941225b4a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:39.867943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1777/3504] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:39 2021] DELETE /identity/v3/projects/27d474dfd37c46f0aa14aa84e8b3ad41 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:39.874157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2de675-0319-4a23-8c4d-221358f83508 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:39.874444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2de675-0319-4a23-8c4d-221358f83508 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:39.874775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2de675-0319-4a23-8c4d-221358f83508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:39.904026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dd2de675-0319-4a23-8c4d-221358f83508 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:39.905271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dd2de675-0319-4a23-8c4d-221358f83508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:39.973810 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1728/3505] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:39.982612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89ba8-8076-44b5-9b9d-273f29c47c8e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:39.982920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89ba8-8076-44b5-9b9d-273f29c47c8e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:39.983370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf89ba8-8076-44b5-9b9d-273f29c47c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.012484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ecf89ba8-8076-44b5-9b9d-273f29c47c8e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:40.013765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ecf89ba8-8076-44b5-9b9d-273f29c47c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:40.022994 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1778/3506] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:40.027011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2de675-0319-4a23-8c4d-221358f83508 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:40.038303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2de675-0319-4a23-8c4d-221358f83508 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:40.043038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:40.044319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.044607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.044899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.045648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:17:40.045953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:40.047588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:40.059389 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1729/3507] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:17:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:17:40.063851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf89ba8-8076-44b5-9b9d-273f29c47c8e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:40.073702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf89ba8-8076-44b5-9b9d-273f29c47c8e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:40.078418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:40.079064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.079346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.080511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.081243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:40.083142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:40.200349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:40.201340 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1779/3508] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:17:40 2021] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:40.214934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df1cd-80ab-450a-8cf0-4d5040f0f31b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:40.283432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bc359-5278-443f-b2ba-dcb1fc077244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:40.284108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc359-5278-443f-b2ba-dcb1fc077244 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.284388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc359-5278-443f-b2ba-dcb1fc077244 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.284661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bc359-5278-443f-b2ba-dcb1fc077244 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.285405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bc359-5278-443f-b2ba-dcb1fc077244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:40.287364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bc359-5278-443f-b2ba-dcb1fc077244 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:40.396360 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1730/3509] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:17:40 2021] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:17:40.398917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:40.409824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d60477-303d-41b1-b92e-4e0690d51af2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:40.415344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:40.415506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7cb7-25d9-4c40-9bf1-4a18690ea784 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.415812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7cb7-25d9-4c40-9bf1-4a18690ea784 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.416102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7cb7-25d9-4c40-9bf1-4a18690ea784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.416714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.417223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.417568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.418394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:40.420246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:40.433648 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1780/3510] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:40 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:17:40.438006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ad2c7cb7-25d9-4c40-9bf1-4a18690ea784 None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:40.439888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ad2c7cb7-25d9-4c40-9bf1-4a18690ea784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:40.440978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:40.456445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e2b7-69e8-4307-aaee-09b0e3d3e6a4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:40.463449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:40.464299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.464699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.465202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.466145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:40.468046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:40.480929 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1781/3511] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:40 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:40.484587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:40.496760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81210bb4-4a18-48ef-8a51-de5690719880 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:40.502669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:40.505185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.505185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.505185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] PATH_INFO: `/v3/projects/3b0881f03bcb42b2af8fbbc9bd84ca78/users/59c504bd6e654627a5d04f6e22be1b95/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.516493 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1731/3512] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:40 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:40.532176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0881f03bcb42b2af8fbbc9bd84ca78, user_id=59c504bd6e654627a5d04f6e22be1b95, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:40.535883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:40.636519 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1782/3513] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:17:40 2021] PUT /identity/v3/projects/3b0881f03bcb42b2af8fbbc9bd84ca78/users/59c504bd6e654627a5d04f6e22be1b95/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:40.641731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0322-fdb2-4d42-9e9f-81de264afea5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.642032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0322-fdb2-4d42-9e9f-81de264afea5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.642345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0322-fdb2-4d42-9e9f-81de264afea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.660524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-89bc0322-fdb2-4d42-9e9f-81de264afea5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:40.661879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89bc0322-fdb2-4d42-9e9f-81de264afea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:40.724271 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1732/3514] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:40.735019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:40.737400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:40.795151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d7f2-a1ec-4e89-9ea6-359ddf047eae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:40.799846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:40.800499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:40.800786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:40.801094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:40.812767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:40.814764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:40.824755 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1783/3515] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:41.461820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:41.462933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:41.463355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:41.504236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] MFA Rules not processed for user `d9a0d56f4a364ba38235b7eccbd8db8a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:41.505569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:41.591342 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1733/3516] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:41 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:43.535783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:43.537839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:43.650894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aa69a-83d8-40c0-88d4-0fc761bc12e7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:43.658615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:43.659709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:43.660128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:43.660406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:43.662820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:43.678519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:43.680147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:43.693167 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1784/3517] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:49.445613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:49.450007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:49.462110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5f83-57a8-4d4b-a895-68f2de74bb63 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:49.466808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:49.467769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:49.468179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:49.468526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] PATH_INFO: `/v3/users/e7c7a9d6618448c9a5ade71c13a1758d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:49.469895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c7a9d6618448c9a5ade71c13a1758d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:49.471870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:49.692643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c7a9d6618448c9a5ade71c13a1758d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:49.699573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c7a9d6618448c9a5ade71c13a1758d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:49.711515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c7a9d6618448c9a5ade71c13a1758d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:49.712136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c7a9d6618448c9a5ade71c13a1758d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:49.712742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6278033e-8783-437c-93f0-786842f821bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c7a9d6618448c9a5ade71c13a1758d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:49.795585 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1734/3518] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:49 2021] DELETE /identity/v3/users/e7c7a9d6618448c9a5ade71c13a1758d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:50.055058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:50.070008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155850b-c886-43b4-bda3-66bbe15bc3cb service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:50.173739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:50.175026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.175314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.175589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] PATH_INFO: `/v3/projects/9dbe1e97c3f64bee9355ec5d1b424c8a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.176799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbe1e97c3f64bee9355ec5d1b424c8a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:50.178982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:50.310737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'request_id': 'req-3d0ae40e-e820-4738-bbda-594116c0e887'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:50.367260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'request_id': 'req-3d0ae40e-e820-4738-bbda-594116c0e887'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:50.374386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'request_id': 'req-3d0ae40e-e820-4738-bbda-594116c0e887'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:50.385688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] The token cache is being invalidate because project 9dbe1e97c3f64bee9355ec5d1b424c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:50.385890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:50.386540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3d0ae40e-e820-4738-bbda-594116c0e887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:50.388192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1785/3519] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:50 2021] DELETE /identity/v3/projects/9dbe1e97c3f64bee9355ec5d1b424c8a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:50.396219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7d7e-16a5-4130-9b36-0a00343e4c04 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.396513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7d7e-16a5-4130-9b36-0a00343e4c04 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.396971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7d7e-16a5-4130-9b36-0a00343e4c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.426710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-82dd7d7e-16a5-4130-9b36-0a00343e4c04 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:50.428690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-82dd7d7e-16a5-4130-9b36-0a00343e4c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:50.480625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9179931-cc28-4c8e-a895-8c8138544049 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.481208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9179931-cc28-4c8e-a895-8c8138544049 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.481663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9179931-cc28-4c8e-a895-8c8138544049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.517564 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1735/3520] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:50.527481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23024d-84bd-46bc-9749-92ca652e00f9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.528168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23024d-84bd-46bc-9749-92ca652e00f9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.528565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23024d-84bd-46bc-9749-92ca652e00f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.535598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e9179931-cc28-4c8e-a895-8c8138544049 None None] MFA Rules not processed for user `59c504bd6e654627a5d04f6e22be1b95`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:50.539248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e9179931-cc28-4c8e-a895-8c8138544049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:50.556636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2e23024d-84bd-46bc-9749-92ca652e00f9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:50.558691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2e23024d-84bd-46bc-9749-92ca652e00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:50.572752 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1736/3521] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:50.578518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23024d-84bd-46bc-9749-92ca652e00f9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:50.593101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23024d-84bd-46bc-9749-92ca652e00f9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:50.600774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:50.601685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.602367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.602785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.603678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:17:50.604280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:50.606648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:50.627218 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1737/3522] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:17:50.640117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:50.647625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda7f8b-9257-46d1-81f0-e7e21841e1f4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:50.663126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:50.663935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.664314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.664694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.665535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:50.667641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:50.670782 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1786/3523] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:50 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:50.682561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.683862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.683862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.718954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] MFA Rules not processed for user `59c504bd6e654627a5d04f6e22be1b95`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:50.721532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:50.733995 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1787/3524] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:50 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:50.745558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:50.747067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:50.772388 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1738/3525] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:17:50 2021] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:50.773851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:50.868928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa7aeb-9151-4f39-90e7-3281e6590c8f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:50.875219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:50.877166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.877614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.878023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:50.878870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:50.881441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:50.905467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ac28-35cf-4f8d-9635-e98f4d319c9a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:50.998611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:50.998611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:50.998611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:50.998611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:51.033170 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1739/3526] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:17:50 2021] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:51.038314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:51.056334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d37e-43e4-4c2d-aa1e-345375c2f852 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:51.075042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:51.075042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:51.075042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:51.075502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:51.076358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:51.078098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:51.080483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:51.083632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:51.102599 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1740/3527] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:51 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:51.103710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:51.105220 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1788/3528] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:50 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:51.124061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4b47d-e9a4-47d4-a3ad-fe5872ec3035 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:51.130418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5970b1-3854-4139-b701-f6937ae5bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:51.131072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5970b1-3854-4139-b701-f6937ae5bf9c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:51.131421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5970b1-3854-4139-b701-f6937ae5bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:51.131749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5970b1-3854-4139-b701-f6937ae5bf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:51.132819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5970b1-3854-4139-b701-f6937ae5bf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:51.134628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5970b1-3854-4139-b701-f6937ae5bf9c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:51.150682 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1741/3529] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:51 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:51.151824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:51.168750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c90de-43d3-4a57-bd04-00a41969842d service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:51.174063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:51.174991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:51.175422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:51.175835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] PATH_INFO: `/v3/projects/9d760708c3d04eccb06f1e108da89ed8/users/bbdaf18fe63f40a7aaac9cf39095757a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:51.195005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d760708c3d04eccb06f1e108da89ed8, user_id=bbdaf18fe63f40a7aaac9cf39095757a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:51.197854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:51.307735 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1789/3530] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:17:51 2021] PUT /identity/v3/projects/9d760708c3d04eccb06f1e108da89ed8/users/bbdaf18fe63f40a7aaac9cf39095757a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:51.318537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40098b-bd0d-411b-92e7-a3455682f579 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:51.318822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40098b-bd0d-411b-92e7-a3455682f579 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:51.319103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40098b-bd0d-411b-92e7-a3455682f579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:51.349248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ea40098b-bd0d-411b-92e7-a3455682f579 None None] MFA Rules not processed for user `bbdaf18fe63f40a7aaac9cf39095757a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:51.350758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ea40098b-bd0d-411b-92e7-a3455682f579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:51.426459 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1742/3531] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:51 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:51.945313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:51.947177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:52.054022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1d08-c13d-4b05-b0f8-a4f69bb74144 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:52.087452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c015af-e450-4a4f-a99b-783dedf4ed92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:52.088285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c015af-e450-4a4f-a99b-783dedf4ed92 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:52.088724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c015af-e450-4a4f-a99b-783dedf4ed92 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:52.091309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c015af-e450-4a4f-a99b-783dedf4ed92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:52.099931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c015af-e450-4a4f-a99b-783dedf4ed92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:52.101714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c015af-e450-4a4f-a99b-783dedf4ed92 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:52.114206 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1790/3532] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:51 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:52.708635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0bee-76f6-4b36-9f50-6eab25a0e000 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:52.709593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0bee-76f6-4b36-9f50-6eab25a0e000 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:52.710053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0bee-76f6-4b36-9f50-6eab25a0e000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:52.746020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fbaa0bee-76f6-4b36-9f50-6eab25a0e000 None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:52.747258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fbaa0bee-76f6-4b36-9f50-6eab25a0e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:52.809926 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1743/3533] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:52 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:54.375160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918c184-3964-4d3e-80be-966a440a38de None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:54.375160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918c184-3964-4d3e-80be-966a440a38de None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:54.375702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918c184-3964-4d3e-80be-966a440a38de None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:54.383583 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1791/3534] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:17:54 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:17:54.390047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:54.390498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:54.390571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:54.420225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:54.421494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:54.482270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918c184-3964-4d3e-80be-966a440a38de None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:54.484297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9918c184-3964-4d3e-80be-966a440a38de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:54.488470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1744/3535] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:17:54 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:54.504845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918c184-3964-4d3e-80be-966a440a38de None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:54.510248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a42f9-309f-4a4a-b416-3f0a399b7929 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:54.510901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a42f9-309f-4a4a-b416-3f0a399b7929 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:54.511180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a42f9-309f-4a4a-b416-3f0a399b7929 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:54.511450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a42f9-309f-4a4a-b416-3f0a399b7929 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:54.513429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-444a42f9-309f-4a4a-b416-3f0a399b7929 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:54.517214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:54.519071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:54.525589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a42f9-309f-4a4a-b416-3f0a399b7929 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:54.527204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a42f9-309f-4a4a-b416-3f0a399b7929 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:54.534168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a00c5-984b-4676-a419-1e618e78fbf3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:54.538714 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1792/3536] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:54.546540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:54.547408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:54.547694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:54.549138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:54.559264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:54.560958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:54.570812 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1745/3537] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:55.031118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd125a1-1569-472c-9f29-5f7c1c7416a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:55.031511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd125a1-1569-472c-9f29-5f7c1c7416a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:55.031891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd125a1-1569-472c-9f29-5f7c1c7416a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:55.056241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7cd125a1-1569-472c-9f29-5f7c1c7416a3 None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:55.057355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7cd125a1-1569-472c-9f29-5f7c1c7416a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:55.069432 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1793/3538] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:55 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:55.494654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:55.496062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:55.553371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ceda2-b187-43cb-b0bf-333c4b82e26a service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:55.557104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad7ebc-e062-4b75-970e-cc2df3d9cb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:55.557842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7ebc-e062-4b75-970e-cc2df3d9cb31 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:55.558126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7ebc-e062-4b75-970e-cc2df3d9cb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:55.558400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7ebc-e062-4b75-970e-cc2df3d9cb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:55.560180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a0ad7ebc-e062-4b75-970e-cc2df3d9cb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:55.570463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad7ebc-e062-4b75-970e-cc2df3d9cb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:55.571908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad7ebc-e062-4b75-970e-cc2df3d9cb31 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:55.580148 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1746/3539] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:57.058069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd125a1-1569-472c-9f29-5f7c1c7416a3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:57.141244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd125a1-1569-472c-9f29-5f7c1c7416a3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:57.147309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:57.148394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:57.148744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:57.149852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] PATH_INFO: `/v3/users/bbdaf18fe63f40a7aaac9cf39095757a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:57.151732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbdaf18fe63f40a7aaac9cf39095757a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:57.153791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:57.295448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbdaf18fe63f40a7aaac9cf39095757a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:57.302980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbdaf18fe63f40a7aaac9cf39095757a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:57.315817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbdaf18fe63f40a7aaac9cf39095757a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:57.316906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbdaf18fe63f40a7aaac9cf39095757a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:57.390465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbdaf18fe63f40a7aaac9cf39095757a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:57.397756 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1794/3540] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:57 2021] DELETE /identity/v3/users/bbdaf18fe63f40a7aaac9cf39095757a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:57.402533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:57.402533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:57.403160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:57.420248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:57.421487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:57.484988 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1747/3541] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:57.495740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:57.497332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:57.555940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa101d2e-7fe7-4204-9b8c-b37c76dc8afd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:57.559831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89464f7-a819-4fec-9c43-50015a4eb426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:57.560542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89464f7-a819-4fec-9c43-50015a4eb426 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:57.560902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89464f7-a819-4fec-9c43-50015a4eb426 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:57.561255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89464f7-a819-4fec-9c43-50015a4eb426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:57.578365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89464f7-a819-4fec-9c43-50015a4eb426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:57.580635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89464f7-a819-4fec-9c43-50015a4eb426 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:57.605935 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1795/3542] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:17:58.134233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:58.136023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:58.150523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac73dd-4e26-420a-ba0a-71cd9e9d4caa None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:58.155492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:58.156384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:58.156667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:58.157524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] PATH_INFO: `/v3/projects/9d760708c3d04eccb06f1e108da89ed8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:58.158939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d760708c3d04eccb06f1e108da89ed8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:58.161143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:58.270621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d760708c3d04eccb06f1e108da89ed8', 'request_id': 'req-5e0a5348-9277-429a-8ffa-ab0c7251ee92'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:58.278018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d760708c3d04eccb06f1e108da89ed8', 'request_id': 'req-5e0a5348-9277-429a-8ffa-ab0c7251ee92'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:58.375102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d760708c3d04eccb06f1e108da89ed8', 'request_id': 'req-5e0a5348-9277-429a-8ffa-ab0c7251ee92'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:58.389484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] The token cache is being invalidate because project 9d760708c3d04eccb06f1e108da89ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:17:58.397926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:58.397926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e0a5348-9277-429a-8ffa-ab0c7251ee92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:58.397926 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1748/3543] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:58 2021] DELETE /identity/v3/projects/9d760708c3d04eccb06f1e108da89ed8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:17:58.400280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97705f08-514f-4cf1-a251-7bcfe49e0209 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:58.400715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97705f08-514f-4cf1-a251-7bcfe49e0209 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:58.401406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97705f08-514f-4cf1-a251-7bcfe49e0209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:58.438370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-97705f08-514f-4cf1-a251-7bcfe49e0209 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:58.439662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-97705f08-514f-4cf1-a251-7bcfe49e0209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:58.502515 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1796/3544] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:17:58.511350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663ed72-3975-4643-afe5-08bae2160cd3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:58.511829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663ed72-3975-4643-afe5-08bae2160cd3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:58.511944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663ed72-3975-4643-afe5-08bae2160cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:58.530816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8663ed72-3975-4643-afe5-08bae2160cd3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:58.532059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8663ed72-3975-4643-afe5-08bae2160cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:58.540776 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1749/3545] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:58.545539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97705f08-514f-4cf1-a251-7bcfe49e0209 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:58.555892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97705f08-514f-4cf1-a251-7bcfe49e0209 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:58.560487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:58.561167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:58.561443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:58.561735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:58.562452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:17:58.562752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:58.565022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:58.576614 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1797/3546] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:17:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:17:58.581156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663ed72-3975-4643-afe5-08bae2160cd3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:58.591821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663ed72-3975-4643-afe5-08bae2160cd3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:58.597314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:58.597965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:58.598244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:58.598518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:58.599249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:58.601209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:58.726232 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1750/3547] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:17:58 2021] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:17:58.736159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:58.747462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8306b-fc55-46dc-8be7-5e64016e402a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:58.816115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:58.817083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:58.817670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:58.818242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:58.819392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:58.821799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:58.970074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1798/3548] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:17:58 2021] POST /identity/v3/users => generated 281 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:17:58.971358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:58.981577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589cbb-e0e9-497f-81f6-9e57dd868739 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:58.986745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:58.987407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:58.987873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:58.988282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:58.989055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:58.990972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:59.006400 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1751/3549] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:17:59.008827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:59.021695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76e191-5bc5-483d-a8a8-cdea1b461514 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:59.027902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915fc6c-5ee9-4bad-92e2-a9a7e034e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:59.028360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915fc6c-5ee9-4bad-92e2-a9a7e034e8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:59.028680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915fc6c-5ee9-4bad-92e2-a9a7e034e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:59.029193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915fc6c-5ee9-4bad-92e2-a9a7e034e8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:59.030120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915fc6c-5ee9-4bad-92e2-a9a7e034e8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:59.037155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915fc6c-5ee9-4bad-92e2-a9a7e034e8f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:59.050414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1799/3550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:17:59 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:17:59.054928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:59.069049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4bdad-50b5-4031-8940-c393c1f39798 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:59.076112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:59.077376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:59.077859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:59.079410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] PATH_INFO: `/v3/projects/afb5e744bcf64b58b3f5ffc60e9f338e/users/2eb79092f6134c61b013e89e4c721cb3/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:59.100143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb5e744bcf64b58b3f5ffc60e9f338e, user_id=2eb79092f6134c61b013e89e4c721cb3, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:59.103462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:59.220449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1752/3551] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:17:59 2021] PUT /identity/v3/projects/afb5e744bcf64b58b3f5ffc60e9f338e/users/2eb79092f6134c61b013e89e4c721cb3/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:59.229849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9801c-bbe5-431a-9154-57beca84ebd5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:59.230176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9801c-bbe5-431a-9154-57beca84ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:59.230411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9801c-bbe5-431a-9154-57beca84ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:59.259061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-48e9801c-bbe5-431a-9154-57beca84ebd5 None None] MFA Rules not processed for user `2eb79092f6134c61b013e89e4c721cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:59.260255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-48e9801c-bbe5-431a-9154-57beca84ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:59.325480 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1800/3552] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:59 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:17:59.414413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:59.415674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:17:59.497236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38bc87-b020-4f20-8d46-fdd4031f1535 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:59.503141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f05df4-62c5-45b3-ae2f-db0c5481b276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:59.503807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05df4-62c5-45b3-ae2f-db0c5481b276 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:59.504088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05df4-62c5-45b3-ae2f-db0c5481b276 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:59.504363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f05df4-62c5-45b3-ae2f-db0c5481b276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:59.513210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f05df4-62c5-45b3-ae2f-db0c5481b276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:59.514820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f05df4-62c5-45b3-ae2f-db0c5481b276 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:59.525508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1753/3553] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:17:59 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:17:59.568908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9801c-bbe5-431a-9154-57beca84ebd5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:17:59.635705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9801c-bbe5-431a-9154-57beca84ebd5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:17:59.640618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:17:59.642087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:59.642363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:59.642637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] PATH_INFO: `/v3/users/2eb79092f6134c61b013e89e4c721cb3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:59.643868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb79092f6134c61b013e89e4c721cb3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:17:59.645874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:17:59.861870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb79092f6134c61b013e89e4c721cb3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:59.868657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb79092f6134c61b013e89e4c721cb3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:59.881421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb79092f6134c61b013e89e4c721cb3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:59.882130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb79092f6134c61b013e89e4c721cb3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:59.951880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb79092f6134c61b013e89e4c721cb3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:17:59.959085 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1801/3554] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:17:59 2021] DELETE /identity/v3/users/2eb79092f6134c61b013e89e4c721cb3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:17:59.971056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:17:59.971309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:17:59.971584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:17:59.989821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:17:59.991090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:00.077219 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1754/3555] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:17:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:00.083881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:00.085665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:00.161251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ead21d-20c0-46f8-a309-692984e2a6bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:00.165976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6eb6b-4579-4d01-bb66-69850456ad02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:00.166636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6eb6b-4579-4d01-bb66-69850456ad02 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:00.166923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6eb6b-4579-4d01-bb66-69850456ad02 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:00.167202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6eb6b-4579-4d01-bb66-69850456ad02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:00.179270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6eb6b-4579-4d01-bb66-69850456ad02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:00.180493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6eb6b-4579-4d01-bb66-69850456ad02 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:00.191228 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1802/3556] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:18:00.587962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:00.589657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:00.604475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a6de0-5ea5-421e-b10a-478313226d66 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:00.611509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:00.612398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:00.612828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:00.613793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] PATH_INFO: `/v3/projects/afb5e744bcf64b58b3f5ffc60e9f338e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:00.615372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb5e744bcf64b58b3f5ffc60e9f338e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:00.617819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:00.721823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb5e744bcf64b58b3f5ffc60e9f338e', 'request_id': 'req-2ab3321f-7acf-4253-8880-245adbaf5620'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:00.730557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb5e744bcf64b58b3f5ffc60e9f338e', 'request_id': 'req-2ab3321f-7acf-4253-8880-245adbaf5620'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:00.817523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb5e744bcf64b58b3f5ffc60e9f338e', 'request_id': 'req-2ab3321f-7acf-4253-8880-245adbaf5620'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:00.834584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] The token cache is being invalidate because project afb5e744bcf64b58b3f5ffc60e9f338e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:18:00.835283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:00.836377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2ab3321f-7acf-4253-8880-245adbaf5620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:00.859976 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1755/3557] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:18:00 2021] DELETE /identity/v3/projects/afb5e744bcf64b58b3f5ffc60e9f338e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:00.870119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdf97b-b2fc-4f69-b580-47d67dfd625d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:00.870119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdf97b-b2fc-4f69-b580-47d67dfd625d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:00.870119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdf97b-b2fc-4f69-b580-47d67dfd625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:00.898987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0ccdf97b-b2fc-4f69-b580-47d67dfd625d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:00.900203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ccdf97b-b2fc-4f69-b580-47d67dfd625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:01.014016 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1803/3558] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:01.022352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984932-86b4-4bf7-a4da-8b3165f522b4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:01.022834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984932-86b4-4bf7-a4da-8b3165f522b4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:01.023398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984932-86b4-4bf7-a4da-8b3165f522b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:01.048707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-10984932-86b4-4bf7-a4da-8b3165f522b4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:01.050206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-10984932-86b4-4bf7-a4da-8b3165f522b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:01.059517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1756/3559] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:01.063953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdf97b-b2fc-4f69-b580-47d67dfd625d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:01.076730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdf97b-b2fc-4f69-b580-47d67dfd625d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:01.083567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:01.084237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:01.084550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:01.084783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:01.085895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:18:01.086287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:01.087835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:01.101028 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1804/3560] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:18:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:18:01.105662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984932-86b4-4bf7-a4da-8b3165f522b4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:01.120545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984932-86b4-4bf7-a4da-8b3165f522b4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:01.145987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:01.147654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:01.148069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:01.148494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:01.149806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:01.154230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:01.618956 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1757/3561] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:18:01 2021] POST /identity/v3/projects => generated 385 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:01.623232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:01.639605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a975ac-b759-487e-a9ff-31d4353d6837 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:01.708602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:01.709421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:01.709727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:01.710047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:01.710768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:01.712793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:01.873593 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1805/3562] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:18:01 2021] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:01.874700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:01.886482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e4f2-4325-4839-b962-ae79fb7797ad admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:01.891336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2367800-d202-44cd-861e-519052777154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:01.892199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367800-d202-44cd-861e-519052777154 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:01.892488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367800-d202-44cd-861e-519052777154 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:01.892765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367800-d202-44cd-861e-519052777154 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:01.893712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2367800-d202-44cd-861e-519052777154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:01.895549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2367800-d202-44cd-861e-519052777154 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:01.910628 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1758/3563] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:01 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:01.914783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:01.931733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32951ad0-0496-48e5-98bc-bcfbd1d0f73e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:01.937309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f645-a13b-47ad-9e8d-acd141d36c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:01.938226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f645-a13b-47ad-9e8d-acd141d36c6c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:01.938905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f645-a13b-47ad-9e8d-acd141d36c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:01.939409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f645-a13b-47ad-9e8d-acd141d36c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:01.940296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f645-a13b-47ad-9e8d-acd141d36c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:01.942886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f645-a13b-47ad-9e8d-acd141d36c6c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:01.959764 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1806/3564] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:01 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:01.963673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2367800-d202-44cd-861e-519052777154 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:01.987714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2367800-d202-44cd-861e-519052777154 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:01.993683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:01.995402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:01.995793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:01.996140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] PATH_INFO: `/v3/projects/ba1ca2fcc2ce4d41b609fa6a753fc806/users/81821563e0034d1e9743c4ec82245ed6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:02.016226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1ca2fcc2ce4d41b609fa6a753fc806, user_id=81821563e0034d1e9743c4ec82245ed6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:02.019715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:02.123789 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1759/3565] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:01 2021] PUT /identity/v3/projects/ba1ca2fcc2ce4d41b609fa6a753fc806/users/81821563e0034d1e9743c4ec82245ed6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:02.129201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d80fbf-3d16-44b1-9d73-5198b3f1951a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:02.129498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d80fbf-3d16-44b1-9d73-5198b3f1951a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:02.129778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d80fbf-3d16-44b1-9d73-5198b3f1951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:02.148555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-64d80fbf-3d16-44b1-9d73-5198b3f1951a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:02.149747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-64d80fbf-3d16-44b1-9d73-5198b3f1951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:02.222035 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1807/3566] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:02.234972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:02.236725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:02.320026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b273-1e3b-4815-b7d8-2bfd3fbeb1f7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:02.329587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:02.330742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:02.331233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:02.331711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:02.347256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:02.348733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:02.360381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1760/3567] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:18:08.848303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658685f5-7f8b-4344-b1b2-46c1148669fb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:08.849186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658685f5-7f8b-4344-b1b2-46c1148669fb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:08.849465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658685f5-7f8b-4344-b1b2-46c1148669fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:08.879615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-658685f5-7f8b-4344-b1b2-46c1148669fb None None] MFA Rules not processed for user `81821563e0034d1e9743c4ec82245ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:08.881469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-658685f5-7f8b-4344-b1b2-46c1148669fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:08.954413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1808/3568] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:09.747860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:09.749611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:09.925545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae583e-97e4-42b9-8f08-560ad2b971e0 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:09.935940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5435d4-b05d-4758-bfa4-8c53e721c48d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:09.940143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5435d4-b05d-4758-bfa4-8c53e721c48d service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:09.940143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5435d4-b05d-4758-bfa4-8c53e721c48d service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:09.940143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5435d4-b05d-4758-bfa4-8c53e721c48d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:09.969250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5435d4-b05d-4758-bfa4-8c53e721c48d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:09.970861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5435d4-b05d-4758-bfa4-8c53e721c48d service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:09.984064 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1761/3569] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:09 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:18:13.973869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:13.974327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:13.974429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:13.994046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] MFA Rules not processed for user `81821563e0034d1e9743c4ec82245ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:13.995728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:14.009055 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1809/3570] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:13 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:18.986698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:18.993031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:18.993031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:19.009101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:19.010391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:19.091014 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1762/3571] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:18 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:20.641663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:20.643400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:20.655502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cd670-c39d-415a-ac36-5faf6a122783 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:20.659650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:20.660296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:20.660596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:20.660919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:20.663825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:20.674004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:20.675984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:20.685149 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1810/3572] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:18:31.332221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:31.333788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:31.349282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff2b1-1021-4922-a1b1-18d8670f2628 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:31.353843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:31.354706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:31.356893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:31.356893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] PATH_INFO: `/v3/users/d9a0d56f4a364ba38235b7eccbd8db8a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:31.356893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a0d56f4a364ba38235b7eccbd8db8a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:31.358303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:31.641649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a0d56f4a364ba38235b7eccbd8db8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:31.649339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a0d56f4a364ba38235b7eccbd8db8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:31.673112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a0d56f4a364ba38235b7eccbd8db8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:31.678456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a0d56f4a364ba38235b7eccbd8db8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:31.678456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805c9b3b-04fa-4ad1-b919-05f915442257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a0d56f4a364ba38235b7eccbd8db8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:31.759629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1763/3573] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:18:31 2021] DELETE /identity/v3/users/d9a0d56f4a364ba38235b7eccbd8db8a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:32.107032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:32.143007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee6271-b09d-4cb6-89c7-aa51d2654eac service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:32.243552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:32.385529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:32.385529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:32.385529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] PATH_INFO: `/v3/projects/16a084940f024be8aee5807248918cb5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:32.385529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a084940f024be8aee5807248918cb5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:32.385529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:32.498714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a084940f024be8aee5807248918cb5', 'request_id': 'req-a8d94b6a-1f34-4136-81ff-761f1d96a862'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:32.574953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a084940f024be8aee5807248918cb5', 'request_id': 'req-a8d94b6a-1f34-4136-81ff-761f1d96a862'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:32.577848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a084940f024be8aee5807248918cb5', 'request_id': 'req-a8d94b6a-1f34-4136-81ff-761f1d96a862'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:32.590156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] The token cache is being invalidate because project 16a084940f024be8aee5807248918cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:18:32.590601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:32.591277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a8d94b6a-1f34-4136-81ff-761f1d96a862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:32.593529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1811/3574] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:18:32 2021] DELETE /identity/v3/projects/16a084940f024be8aee5807248918cb5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:32.601433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1d874-3a33-4c93-97bc-d1e6fdf6af88 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:32.602430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1d874-3a33-4c93-97bc-d1e6fdf6af88 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:32.603928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1d874-3a33-4c93-97bc-d1e6fdf6af88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:32.629805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-aec1d874-3a33-4c93-97bc-d1e6fdf6af88 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:32.631030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aec1d874-3a33-4c93-97bc-d1e6fdf6af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:32.697019 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1764/3575] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:32.705078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0a29-5e15-4733-9d80-62bcb949a992 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:32.706823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0a29-5e15-4733-9d80-62bcb949a992 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:32.706823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0a29-5e15-4733-9d80-62bcb949a992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:32.724681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fd6d0a29-5e15-4733-9d80-62bcb949a992 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:32.725908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fd6d0a29-5e15-4733-9d80-62bcb949a992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:32.737461 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1812/3576] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:32.742000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1d874-3a33-4c93-97bc-d1e6fdf6af88 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:32.753950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1d874-3a33-4c93-97bc-d1e6fdf6af88 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:32.760230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:32.760920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:32.761229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:32.761473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:32.762399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:18:32.762694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:32.764293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:32.768431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:32.768701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:32.769050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:32.779732 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1765/3577] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:18:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:18:32.784674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:32.798090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1acb06-eaac-43b6-8dc1-8d4d38b28e86 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:32.804028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:32.804776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:32.805085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:32.805358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:32.806209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:32.808188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:32.845842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:32.847296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:32.911416 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1766/3578] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:18:32 2021] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:18:32.920591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:32.924096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1813/3579] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:18:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:18:32.996288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507d56f-8d8e-4845-9ac2-8f16079801e9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:33.001600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:33.002383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:33.002724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:33.003063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:33.003939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:33.005990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:33.087184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:33.088587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:33.105775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1767/3580] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:18:32 2021] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:18:33.109813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:33.119433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1c9c-2c0d-4bba-8725-20420a8b3dbf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:33.125097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:33.125097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:33.125097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:33.125426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:33.126002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:33.127693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:33.140714 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1768/3581] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:33 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:18:33.141697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:33.151069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fa83-1bcf-41e8-a560-99fcd75b1a2f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:33.156349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:33.157010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:33.157290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:33.157568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:33.158283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:33.159833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:33.169672 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1769/3582] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:33 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:33.174813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:33.181299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895fbf-3204-4a8b-8184-5c1d7074b845 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:33.185389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6f2ed-f097-416e-a707-89bc25b9eea0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:33.190443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009007cd-f813-428a-bc0a-705e2cea9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:33.191364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009007cd-f813-428a-bc0a-705e2cea9838 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:33.191643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009007cd-f813-428a-bc0a-705e2cea9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:33.191912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009007cd-f813-428a-bc0a-705e2cea9838 admin admin] PATH_INFO: `/v3/projects/d4571ece0fa3450b83fde221178518c8/users/a85842dabc3d4a219d28c154e36c293c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:33.208377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009007cd-f813-428a-bc0a-705e2cea9838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4571ece0fa3450b83fde221178518c8, user_id=a85842dabc3d4a219d28c154e36c293c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:33.211033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009007cd-f813-428a-bc0a-705e2cea9838 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:33.245781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:33.246436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:33.246715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:33.246985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:33.291028 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1770/3583] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:33 2021] PUT /identity/v3/projects/d4571ece0fa3450b83fde221178518c8/users/a85842dabc3d4a219d28c154e36c293c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:18:33.296054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:33.296650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:33.296966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:33.310818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:33.313080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:33.318065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:33.320276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:33.323273 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1814/3584] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:18:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:18:33.419360 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1771/3585] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:18:33.494701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:33.497020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:33.615108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08895763-8bb2-4825-bcee-79a40758a7dd service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:33.693574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80c08d-cebf-49db-9048-6921df17bb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:33.694437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c08d-cebf-49db-9048-6921df17bb9d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:33.694928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c08d-cebf-49db-9048-6921df17bb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:33.695950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c08d-cebf-49db-9048-6921df17bb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:33.710914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80c08d-cebf-49db-9048-6921df17bb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:33.713184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80c08d-cebf-49db-9048-6921df17bb9d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:33.726583 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1815/3586] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:18:40.879786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:40.882521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:40.903387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d1794-4a6a-41e0-bedc-ca4df93e6771 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:40.920685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:40.921913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:40.922401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:40.922850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] PATH_INFO: `/v3/users/f9e59d219fa640e48533e0efdf150b16` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:40.924386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e59d219fa640e48533e0efdf150b16)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:40.931039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:41.283526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e59d219fa640e48533e0efdf150b16'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:41.311909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e59d219fa640e48533e0efdf150b16'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:41.335072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e59d219fa640e48533e0efdf150b16'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:41.337975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e59d219fa640e48533e0efdf150b16'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:41.338598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e59d219fa640e48533e0efdf150b16'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:41.426984 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1772/3587] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:18:40 2021] DELETE /identity/v3/users/f9e59d219fa640e48533e0efdf150b16 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:41.431642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:41.432213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:41.435533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:41.486268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:41.489360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:41.609907 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1816/3588] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:41.621429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:41.622862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:41.746171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9de2e-6feb-4619-9749-0b85b33514b4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:41.756210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:41.757791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:41.758290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:41.759599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:41.774809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:41.776632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:41.791895 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1773/3589] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:18:42.246169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:42.248346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:42.289171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e9e10-1b7f-4490-bafc-35904ab7fb7b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:42.304724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:42.309658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:42.312462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:42.313066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] PATH_INFO: `/v3/projects/ed880d80bcfb4641b02f26da5fad21b8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:42.315114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed880d80bcfb4641b02f26da5fad21b8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:42.332947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:42.566771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed880d80bcfb4641b02f26da5fad21b8', 'request_id': 'req-a2aeb56b-5646-451a-baa7-7a5aadf618a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:42.697773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed880d80bcfb4641b02f26da5fad21b8', 'request_id': 'req-a2aeb56b-5646-451a-baa7-7a5aadf618a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:42.702538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed880d80bcfb4641b02f26da5fad21b8', 'request_id': 'req-a2aeb56b-5646-451a-baa7-7a5aadf618a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:42.746430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] The token cache is being invalidate because project ed880d80bcfb4641b02f26da5fad21b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:18:42.747586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:42.748459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:42.750651 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1817/3590] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:18:42 2021] DELETE /identity/v3/projects/ed880d80bcfb4641b02f26da5fad21b8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:42.754549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:42.776121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee24b74-9837-48f5-b20d-3cae9d48e47c service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:42.921786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:42.922966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:42.923518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:42.924777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] PATH_INFO: `/v3/users/68e2585485584fc59e9b72868227f2c8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:42.925583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e2585485584fc59e9b72868227f2c8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:42.927936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:43.158655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e2585485584fc59e9b72868227f2c8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:43.166773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e2585485584fc59e9b72868227f2c8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:43.214977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e2585485584fc59e9b72868227f2c8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:43.216196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e2585485584fc59e9b72868227f2c8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:43.217043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-257fc9d8-00b3-4a45-ba24-66677dd7ca48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e2585485584fc59e9b72868227f2c8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:43.294389 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1774/3591] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:18:42 2021] DELETE /identity/v3/users/68e2585485584fc59e9b72868227f2c8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:44.302500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:44.304062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:44.319027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeb56b-5646-451a-baa7-7a5aadf618a0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:44.499532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:44.500654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:44.501133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:44.501601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] PATH_INFO: `/v3/projects/cbd62ea5e59c47fc8d5c271934c6a120` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:44.519965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd62ea5e59c47fc8d5c271934c6a120)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:44.525293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:44.669407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:44.669890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:44.670121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:44.692041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd62ea5e59c47fc8d5c271934c6a120', 'request_id': 'req-b9db5c9e-5625-44a9-9a16-5f90fb982434'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:44.767098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] MFA Rules not processed for user `a85842dabc3d4a219d28c154e36c293c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:44.770309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:44.807852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd62ea5e59c47fc8d5c271934c6a120', 'request_id': 'req-b9db5c9e-5625-44a9-9a16-5f90fb982434'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:44.819114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd62ea5e59c47fc8d5c271934c6a120', 'request_id': 'req-b9db5c9e-5625-44a9-9a16-5f90fb982434'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:44.840699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] The token cache is being invalidate because project cbd62ea5e59c47fc8d5c271934c6a120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:18:44.841388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:44.842415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9db5c9e-5625-44a9-9a16-5f90fb982434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:44.845395 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1818/3592] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:18:44 2021] DELETE /identity/v3/projects/cbd62ea5e59c47fc8d5c271934c6a120 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:44.855065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3748b1d-8407-4523-8af2-e0111587d0c6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:44.855594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3748b1d-8407-4523-8af2-e0111587d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:44.857543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3748b1d-8407-4523-8af2-e0111587d0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:44.881708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a3748b1d-8407-4523-8af2-e0111587d0c6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:44.883624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3748b1d-8407-4523-8af2-e0111587d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:44.945364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1775/3593] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:44 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:44.946599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:44.949663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:44.962417 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1819/3594] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:44.974791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3f0f-a1d8-424b-8a79-4151d4e2ce48 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:44.978198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3f0f-a1d8-424b-8a79-4151d4e2ce48 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:44.978527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3f0f-a1d8-424b-8a79-4151d4e2ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:44.994417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea49d8-2131-4f89-9553-6955a9d67d45 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.004433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.005145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.005437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.005717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.006432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.008584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c17e3f0f-a1d8-424b-8a79-4151d4e2ce48 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:45.011646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c17e3f0f-a1d8-424b-8a79-4151d4e2ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:45.017547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.027965 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1820/3595] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:45.047331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3f0f-a1d8-424b-8a79-4151d4e2ce48 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.082779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3f0f-a1d8-424b-8a79-4151d4e2ce48 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.097451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.099473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.099926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.101697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.102268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:18:45.102597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.104283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.173121 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1776/3596] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:18:44 2021] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:45.176509 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1821/3597] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:18:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:18:45.177728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.181749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.216495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429386-961b-4c58-93d8-700abcb321eb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.273582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592967b-7439-4d64-bcd9-5b7617ae0dd6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.283004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a5a22-9308-46c8-a49f-fdb16cee4439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.284487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5a22-9308-46c8-a49f-fdb16cee4439 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.285359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5a22-9308-46c8-a49f-fdb16cee4439 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.286062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5a22-9308-46c8-a49f-fdb16cee4439 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.287204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a5a22-9308-46c8-a49f-fdb16cee4439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.289449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a5a22-9308-46c8-a49f-fdb16cee4439 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.349050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.349869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.350318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.350716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.351700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.354736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.410017 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1777/3598] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:18:45 2021] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:45.413027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab060-95b6-46d5-b3ae-bb5ae28d0358 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.413753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab060-95b6-46d5-b3ae-bb5ae28d0358 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.415536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab060-95b6-46d5-b3ae-bb5ae28d0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.459768 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1822/3599] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:18:45 2021] POST /identity/v3/projects => generated 409 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:45.460786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.501978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c78ab060-95b6-46d5-b3ae-bb5ae28d0358 None None] MFA Rules not processed for user `59c504bd6e654627a5d04f6e22be1b95`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:45.503450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c78ab060-95b6-46d5-b3ae-bb5ae28d0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:45.624235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36c054-7235-441c-bcd8-460894fb0422 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.631689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.631689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.632180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.632674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.633603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.635575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.645047 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1778/3600] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:45 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:45.645989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab060-95b6-46d5-b3ae-bb5ae28d0358 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.653726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1823/3601] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:45.655798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.667949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab060-95b6-46d5-b3ae-bb5ae28d0358 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.680270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.681005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.681299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.681609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.682320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.684409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.699774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a38d-e5a7-41ff-8fea-fde9499c4bde admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.722403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.723515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.724343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.724694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] PATH_INFO: `/v3/projects/498aad80bbd44b6e8fc8fd1b6ed08a4b/users/f12553f5c64c42579f99a0f2229dffa8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.749713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498aad80bbd44b6e8fc8fd1b6ed08a4b, user_id=f12553f5c64c42579f99a0f2229dffa8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.754864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.807913 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1779/3602] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:18:45 2021] POST /identity/v3/users => generated 305 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:45.811998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.843522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcb52-6b19-4a3b-8c19-48a658f01aa5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:45.863654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:45.864357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:45.864734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:45.869767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1824/3603] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:45 2021] PUT /identity/v3/projects/498aad80bbd44b6e8fc8fd1b6ed08a4b/users/f12553f5c64c42579f99a0f2229dffa8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:45.871050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.873133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:45.873505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:45.882149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:45.944769 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1780/3604] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:45.947399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:45.987072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc8c28-e188-4c08-8788-3171a896bf2a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:46.045245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19034f-e81f-4ec6-871b-a14026ae81e9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:46.054870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:46.055553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:46.055839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:46.056118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:46.056864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:46.067383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:46.096927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1825/3605] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:46.103471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:46.124546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f860a-a0ee-48ef-befd-a4c6a175322b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:46.137590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:46.138452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:46.138824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:46.139856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:46.141220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67f64c-e5e8-4613-b9ea-445df77a85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:46.141933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:46.142951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f64c-e5e8-4613-b9ea-445df77a85ed admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:46.144751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:46.145239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f64c-e5e8-4613-b9ea-445df77a85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:46.145629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67f64c-e5e8-4613-b9ea-445df77a85ed admin admin] PATH_INFO: `/v3/projects/498aad80bbd44b6e8fc8fd1b6ed08a4b/users/f12553f5c64c42579f99a0f2229dffa8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:46.152248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f64c-e5e8-4613-b9ea-445df77a85ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=498aad80bbd44b6e8fc8fd1b6ed08a4b, user_id=f12553f5c64c42579f99a0f2229dffa8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:46.160995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67f64c-e5e8-4613-b9ea-445df77a85ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:46.177122 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1781/3606] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:46.179873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:46.190767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1826/3607] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:46 2021] PUT /identity/v3/projects/498aad80bbd44b6e8fc8fd1b6ed08a4b/users/f12553f5c64c42579f99a0f2229dffa8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:46.200031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca2c8c-49d9-40f9-bb36-261ca5f6e19a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:46.413032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eda2e0-0a31-4f94-98a2-63747013ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:46.413948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eda2e0-0a31-4f94-98a2-63747013ab79 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:46.414232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eda2e0-0a31-4f94-98a2-63747013ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:46.414512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eda2e0-0a31-4f94-98a2-63747013ab79 admin admin] PATH_INFO: `/v3/projects/6dac266e7bb14fcd8248347dded3db77/users/2af12aedad4d4a5b98d32afeddf38490/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:46.458782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eda2e0-0a31-4f94-98a2-63747013ab79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dac266e7bb14fcd8248347dded3db77, user_id=2af12aedad4d4a5b98d32afeddf38490, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:46.466381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eda2e0-0a31-4f94-98a2-63747013ab79 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:46.533856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abf61-e307-4e50-b917-5e99f927eab7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:46.534606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abf61-e307-4e50-b917-5e99f927eab7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:46.534606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abf61-e307-4e50-b917-5e99f927eab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:46.542450 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1782/3608] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:46 2021] PUT /identity/v3/projects/6dac266e7bb14fcd8248347dded3db77/users/2af12aedad4d4a5b98d32afeddf38490/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:46.563852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac3e5c-a18b-46ef-ae79-e2cd3347dcc3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:46.564509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac3e5c-a18b-46ef-ae79-e2cd3347dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:46.566383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac3e5c-a18b-46ef-ae79-e2cd3347dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:46.594084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-175abf61-e307-4e50-b917-5e99f927eab7 None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:46.595743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-175abf61-e307-4e50-b917-5e99f927eab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:46.607313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a7ac3e5c-a18b-46ef-ae79-e2cd3347dcc3 None None] MFA Rules not processed for user `2af12aedad4d4a5b98d32afeddf38490`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:46.609965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7ac3e5c-a18b-46ef-ae79-e2cd3347dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:46.731880 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1783/3609] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:46 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:46.736517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac3e5c-a18b-46ef-ae79-e2cd3347dcc3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:46.846391 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1827/3610] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:46 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:46.852193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac3e5c-a18b-46ef-ae79-e2cd3347dcc3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:46.859249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:46.860288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:46.860738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:46.861191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:46.862060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:46.865221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:46.982650 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1784/3611] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:18:46 2021] POST /identity/v3/projects => generated 407 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:46.987367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abf61-e307-4e50-b917-5e99f927eab7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:47.025506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abf61-e307-4e50-b917-5e99f927eab7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:47.142189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:47.143190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:47.143642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:47.144865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:47.145884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:47.149803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:47.280130 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1828/3612] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:18:46 2021] POST /identity/v3/users => generated 310 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:47.281708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:47.297517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d8a1-8afb-4b6c-a6f7-539056fc78db admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:47.310687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:47.312238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:47.312690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:47.313148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:47.314037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:47.315830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:47.335295 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1785/3613] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:47 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:47.336521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:47.351862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febc257-97ef-42e3-ab1c-b2a308353cb8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:47.365624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:47.366887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:47.367167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:47.367885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] PATH_INFO: `/v3/projects/3c4908bee625451ba824fdb5096ab2be/users/f575f72dbdae484ca42c4055b1148d83/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:47.399288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4908bee625451ba824fdb5096ab2be, user_id=f575f72dbdae484ca42c4055b1148d83, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:47.402469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:47.495698 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1829/3614] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:47 2021] PUT /identity/v3/projects/3c4908bee625451ba824fdb5096ab2be/users/f575f72dbdae484ca42c4055b1148d83/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:47.499615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:47.517427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4cb91-d683-4590-8e1e-36fd98408901 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:47.693793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50221c17-f3d2-4670-8ffd-b3ba37c609d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:47.694494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221c17-f3d2-4670-8ffd-b3ba37c609d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:47.694775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221c17-f3d2-4670-8ffd-b3ba37c609d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:47.695057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221c17-f3d2-4670-8ffd-b3ba37c609d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:47.696047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50221c17-f3d2-4670-8ffd-b3ba37c609d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:47.697710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50221c17-f3d2-4670-8ffd-b3ba37c609d1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:47.725777 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1786/3615] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:47 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:47.728248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:47.750220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1534131-12ac-4c93-929c-e1433590acb7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:47.772500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:47.773426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:47.773720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:47.774119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] PATH_INFO: `/v3/projects/3c4908bee625451ba824fdb5096ab2be/users/f575f72dbdae484ca42c4055b1148d83/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:47.782582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4908bee625451ba824fdb5096ab2be, user_id=f575f72dbdae484ca42c4055b1148d83, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:47.788471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:47.816142 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1830/3616] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:47 2021] PUT /identity/v3/projects/3c4908bee625451ba824fdb5096ab2be/users/f575f72dbdae484ca42c4055b1148d83/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:47.828898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693646-0939-433d-b34c-7c725c1b7a03 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:47.828898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693646-0939-433d-b34c-7c725c1b7a03 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:47.828898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9693646-0939-433d-b34c-7c725c1b7a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:47.918880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b9693646-0939-433d-b34c-7c725c1b7a03 None None] MFA Rules not processed for user `f575f72dbdae484ca42c4055b1148d83`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:47.920273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b9693646-0939-433d-b34c-7c725c1b7a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:48.151665 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1787/3617] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:47 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:48.159498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:48.299192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d8425-5607-4681-922f-1eea0ef0944e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:48.304772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:48.305693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:48.305962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:48.306242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] PATH_INFO: `/v3/users/2af12aedad4d4a5b98d32afeddf38490` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:48.307542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af12aedad4d4a5b98d32afeddf38490)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:48.310473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:48.592800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af12aedad4d4a5b98d32afeddf38490'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:48.603516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af12aedad4d4a5b98d32afeddf38490'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:48.644554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af12aedad4d4a5b98d32afeddf38490'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:48.653667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af12aedad4d4a5b98d32afeddf38490'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:48.752507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af12aedad4d4a5b98d32afeddf38490'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:48.759689 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1831/3618] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:18:48 2021] DELETE /identity/v3/users/2af12aedad4d4a5b98d32afeddf38490 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:48.764236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:48.764530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:48.764811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:48.789463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:48.790852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:48.883851 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1788/3619] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:48.893788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:48.895456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:48.998200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56acd3b-46f6-4202-8659-247e901d1b76 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:49.002979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:49.003801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:49.004289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:49.004730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:49.019690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:49.023207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:49.043574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1832/3620] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:18:50.006215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:50.010227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:50.040444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e7f91-b961-4533-9855-f769ca75b60f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:50.069481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:50.070796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:50.072437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:50.072848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] PATH_INFO: `/v3/projects/6dac266e7bb14fcd8248347dded3db77` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:50.076152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dac266e7bb14fcd8248347dded3db77)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:50.080169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:50.270543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dac266e7bb14fcd8248347dded3db77', 'request_id': 'req-8e5214cd-46be-4880-bb80-20a2377f5ed9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.277650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dac266e7bb14fcd8248347dded3db77', 'request_id': 'req-8e5214cd-46be-4880-bb80-20a2377f5ed9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.369339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dac266e7bb14fcd8248347dded3db77', 'request_id': 'req-8e5214cd-46be-4880-bb80-20a2377f5ed9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.388057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] The token cache is being invalidate because project 6dac266e7bb14fcd8248347dded3db77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:18:50.388349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.389594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8e5214cd-46be-4880-bb80-20a2377f5ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.396456 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1789/3621] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:18:50 2021] DELETE /identity/v3/projects/6dac266e7bb14fcd8248347dded3db77 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:50.396711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:50.410665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ef43e-ce17-4419-a9d1-c307b1e3af27 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:50.484219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:50.485503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:50.485930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:50.486372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] PATH_INFO: `/v3/users/f575f72dbdae484ca42c4055b1148d83` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:50.487789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f575f72dbdae484ca42c4055b1148d83)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:50.493141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:50.818629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f575f72dbdae484ca42c4055b1148d83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.836747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f575f72dbdae484ca42c4055b1148d83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.878098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f575f72dbdae484ca42c4055b1148d83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.880080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f575f72dbdae484ca42c4055b1148d83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.959348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f575f72dbdae484ca42c4055b1148d83'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:50.984949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1833/3622] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:18:50 2021] DELETE /identity/v3/users/f575f72dbdae484ca42c4055b1148d83 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:18:51.316931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:51.318039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:51.318649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:51.370108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:51.375830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:51.573619 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1790/3623] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:18:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:51.589868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:51.592450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:51.758233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48950e-457c-4b0d-9a31-2b6e9317d8a1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:51.772673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2c707-f9e1-4698-96ba-29e432e68bf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:51.773657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c707-f9e1-4698-96ba-29e432e68bf3 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:51.774085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c707-f9e1-4698-96ba-29e432e68bf3 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:51.774548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c707-f9e1-4698-96ba-29e432e68bf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:51.787932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2c707-f9e1-4698-96ba-29e432e68bf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:51.804144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2c707-f9e1-4698-96ba-29e432e68bf3 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:51.853498 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1834/3624] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:18:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:53.483222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:53.484954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:53.668634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139ecaf-71dc-41a1-b679-0802d53c5382 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:53.681635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:53.684795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:53.686228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:53.686523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] PATH_INFO: `/v3/projects/3c4908bee625451ba824fdb5096ab2be` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:53.693784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4908bee625451ba824fdb5096ab2be)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:53.699967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:53.868753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4908bee625451ba824fdb5096ab2be', 'request_id': 'req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:53.888176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4908bee625451ba824fdb5096ab2be', 'request_id': 'req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:53.965564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4908bee625451ba824fdb5096ab2be', 'request_id': 'req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:53.988607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] The token cache is being invalidate because project 3c4908bee625451ba824fdb5096ab2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:18:53.989236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:53.990999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ceaa8fa4-bda5-4e9e-9311-5ca6b2b24f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:18:54.006504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1791/3625] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:18:53 2021] DELETE /identity/v3/projects/3c4908bee625451ba824fdb5096ab2be => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:54.013918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7812bad-d5c9-4e28-8a38-4fc3a244cef2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:54.015085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7812bad-d5c9-4e28-8a38-4fc3a244cef2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:54.015765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7812bad-d5c9-4e28-8a38-4fc3a244cef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:54.080000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a7812bad-d5c9-4e28-8a38-4fc3a244cef2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:54.087428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a7812bad-d5c9-4e28-8a38-4fc3a244cef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:54.297688 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1835/3626] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:54.306144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933141-7233-4c35-830f-873c395a2455 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:54.306585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933141-7233-4c35-830f-873c395a2455 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:54.309504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e933141-7233-4c35-830f-873c395a2455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:54.355822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7e933141-7233-4c35-830f-873c395a2455 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:54.358256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e933141-7233-4c35-830f-873c395a2455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:54.388976 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1792/3627] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:54.394050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7812bad-d5c9-4e28-8a38-4fc3a244cef2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:54.419072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7812bad-d5c9-4e28-8a38-4fc3a244cef2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:54.444509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:54.446021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:54.446413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:54.446802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:54.447714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:18:54.448224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:54.450110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:54.526442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1836/3628] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:18:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:18:54.532625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e933141-7233-4c35-830f-873c395a2455 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:54.543450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e933141-7233-4c35-830f-873c395a2455 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:54.551887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:54.553020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:54.553473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:54.554039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:54.554902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:54.557375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:54.705731 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1793/3629] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:18:54 2021] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:18:54.710297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:54.731028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc9fa6-72a6-4bb7-8a73-fdb992957d10 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:54.832741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:54.834429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:54.834731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:54.835057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:54.837161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:54.841278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:54.959715 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1837/3630] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:18:54 2021] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:54.963430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:54.980649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b844d-007e-4e32-b857-017d805be542 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:54.992005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:54.994076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:54.995863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:54.997134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:55.001424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:55.003444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:55.042252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1794/3631] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:54 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:55.043857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:55.057284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb278d4-e215-4a90-a655-fb769cccf863 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:55.065594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b3d67-d96d-4f5d-a852-65cb4323e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:55.070818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3d67-d96d-4f5d-a852-65cb4323e5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:55.072539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3d67-d96d-4f5d-a852-65cb4323e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:55.075046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3d67-d96d-4f5d-a852-65cb4323e5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:55.076587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b3d67-d96d-4f5d-a852-65cb4323e5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:55.082817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b3d67-d96d-4f5d-a852-65cb4323e5d5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:55.115075 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1838/3632] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:55 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:55.119362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:55.132953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024cee5-70c0-475b-8a39-770038180f7a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:55.166435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:55.167972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:55.168374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:55.168835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] PATH_INFO: `/v3/projects/0a9b4b2ed77041ca941a10d4f614efe0/users/420be1221dda4b8690f7152d593a1f1b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:55.215396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9b4b2ed77041ca941a10d4f614efe0, user_id=420be1221dda4b8690f7152d593a1f1b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:55.230767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:55.337116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1795/3633] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:55 2021] PUT /identity/v3/projects/0a9b4b2ed77041ca941a10d4f614efe0/users/420be1221dda4b8690f7152d593a1f1b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:55.337302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d47ef-5127-4737-a301-d012d0dbb4e3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:55.337448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d47ef-5127-4737-a301-d012d0dbb4e3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:55.337781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d47ef-5127-4737-a301-d012d0dbb4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:55.393083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-557d47ef-5127-4737-a301-d012d0dbb4e3 None None] MFA Rules not processed for user `420be1221dda4b8690f7152d593a1f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:55.394830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-557d47ef-5127-4737-a301-d012d0dbb4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:55.525820 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1839/3634] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:55 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:55.531672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:55.626994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2aa4-e1d0-40c9-afb8-c872cbd9e2ca admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:55.632807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:55.633198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:55.633479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:55.633742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:55.634562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:55.636506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:55.756547 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1796/3635] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:18:55 2021] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:18:55.756808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d47ef-5127-4737-a301-d012d0dbb4e3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:55.784625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d47ef-5127-4737-a301-d012d0dbb4e3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:55.956422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:55.957793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:55.957793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:55.960700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:55.960700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:55.966535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:56.077269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:56.079734 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1840/3636] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:18:55 2021] POST /identity/v3/users => generated 302 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:18:56.093638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715b2c-267f-4754-8fa7-b5bb0b13a889 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:56.106696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:56.108366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:56.110306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:56.111549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:56.118464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:56.123088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:56.169107 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1797/3637] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:56 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:18:56.171307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:56.196112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181dd4e-ce6f-4f1d-ba55-ac4c1ebe3a02 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:56.202056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:56.203165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:56.203520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:56.203866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] PATH_INFO: `/v3/projects/be6e984a93be4b058194af3eeb858b71/users/23bda447559b44d38b64f2be798b4bcf/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:56.245973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6e984a93be4b058194af3eeb858b71, user_id=23bda447559b44d38b64f2be798b4bcf, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:56.249120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:56.341628 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1841/3638] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:56 2021] PUT /identity/v3/projects/be6e984a93be4b058194af3eeb858b71/users/23bda447559b44d38b64f2be798b4bcf/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:56.343446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:56.357355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a1717-ac8b-4c8e-94ab-04303021e0fd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:56.499144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c88c-f055-487c-8db9-61b1015c7666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:56.502324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c88c-f055-487c-8db9-61b1015c7666 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:56.502627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c88c-f055-487c-8db9-61b1015c7666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:56.502905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c88c-f055-487c-8db9-61b1015c7666 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:56.507025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c88c-f055-487c-8db9-61b1015c7666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:56.509198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c88c-f055-487c-8db9-61b1015c7666 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:56.542705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1798/3639] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:18:56 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:18:56.543744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:56.560176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a21b00-e67e-41c0-a0c5-0953a3580179 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:56.596854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:56.600191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:56.603031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:56.603319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] PATH_INFO: `/v3/projects/be6e984a93be4b058194af3eeb858b71/users/23bda447559b44d38b64f2be798b4bcf/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:56.608268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6e984a93be4b058194af3eeb858b71, user_id=23bda447559b44d38b64f2be798b4bcf, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:56.615303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:56.649797 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1842/3640] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:18:56 2021] PUT /identity/v3/projects/be6e984a93be4b058194af3eeb858b71/users/23bda447559b44d38b64f2be798b4bcf/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:18:56.729999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803936-0b56-4f4c-871e-8151fb79802f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:56.730435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803936-0b56-4f4c-871e-8151fb79802f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:56.730527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1803936-0b56-4f4c-871e-8151fb79802f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:56.767848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c1803936-0b56-4f4c-871e-8151fb79802f None None] MFA Rules not processed for user `23bda447559b44d38b64f2be798b4bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:18:56.769125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c1803936-0b56-4f4c-871e-8151fb79802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:56.940664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1799/3641] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:18:56 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:18:56.947235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:18:56.949119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:18:57.117362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c57ddf-a373-4c68-ad93-f86ef4600fa6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:18:57.133343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d1292-a7f1-4617-af8d-2d2c07fba119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:18:57.134181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d1292-a7f1-4617-af8d-2d2c07fba119 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:18:57.134459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d1292-a7f1-4617-af8d-2d2c07fba119 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:18:57.134726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d1292-a7f1-4617-af8d-2d2c07fba119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:18:57.266621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d1292-a7f1-4617-af8d-2d2c07fba119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:18:57.268303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d1292-a7f1-4617-af8d-2d2c07fba119 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:18:57.296362 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1843/3642] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:18:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:00.064069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee633-0ff9-4b01-b8c9-a06556da5dae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:00.065763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee633-0ff9-4b01-b8c9-a06556da5dae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:00.066424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee633-0ff9-4b01-b8c9-a06556da5dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:00.129766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-041ee633-0ff9-4b01-b8c9-a06556da5dae None None] MFA Rules not processed for user `f12553f5c64c42579f99a0f2229dffa8`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:00.135220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-041ee633-0ff9-4b01-b8c9-a06556da5dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:00.287131 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1800/3643] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:00 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:00.292571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4753ce-5213-4479-94d3-17ce562c3c88 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:00.293079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4753ce-5213-4479-94d3-17ce562c3c88 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:00.293252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4753ce-5213-4479-94d3-17ce562c3c88 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:00.295178 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1844/3644] 10.222.0.32 () {54 vars in 963 bytes} [Sat Dec 25 21:19:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:19:00.304341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:00.304722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:00.305043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:00.410034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] MFA Rules not processed for user `0f668b27e2af43fd812f309f6908199c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:00.412145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:00.562287 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1801/3645] 10.222.0.32 () {58 vars in 1060 bytes} [Sat Dec 25 21:19:00 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:00.574030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4753ce-5213-4479-94d3-17ce562c3c88 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:00.587875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4753ce-5213-4479-94d3-17ce562c3c88 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:00.595658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5c5e5-3b95-4168-ab02-86bd78ecd759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:00.596670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c5e5-3b95-4168-ab02-86bd78ecd759 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:00.597396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c5e5-3b95-4168-ab02-86bd78ecd759 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:00.597816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5c5e5-3b95-4168-ab02-86bd78ecd759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:00.601764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d5f5c5e5-3b95-4168-ab02-86bd78ecd759 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:00.719255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5c5e5-3b95-4168-ab02-86bd78ecd759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:00.719255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5c5e5-3b95-4168-ab02-86bd78ecd759 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:00.749606 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1845/3646] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:00 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:01.351426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:01.354180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:01.389273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3586-e5ea-4e6c-b101-1cf077689035 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:01.417414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:01.417414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:01.417414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:01.417414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:01.442265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:01.444308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:01.463188 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1802/3647] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:01 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:02.995604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929123-4a10-4aff-a87f-69ece26ff97f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:02.996129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929123-4a10-4aff-a87f-69ece26ff97f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:02.996406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929123-4a10-4aff-a87f-69ece26ff97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:03.036544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-87929123-4a10-4aff-a87f-69ece26ff97f None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:03.038213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-87929123-4a10-4aff-a87f-69ece26ff97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:03.163501 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1846/3648] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:19:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:03.196504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:03.197806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:03.371297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a7924-25bd-4c69-81ac-2b57594717d2 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:03.384679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:03.387593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:03.388047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:03.388564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:03.409663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:03.412849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:03.430652 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1803/3649] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:19:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:19:07.585603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a624099-49b1-4f2c-ad5d-12dc22eb2115 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:07.586134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a624099-49b1-4f2c-ad5d-12dc22eb2115 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:07.586735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a624099-49b1-4f2c-ad5d-12dc22eb2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:07.608298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0a624099-49b1-4f2c-ad5d-12dc22eb2115 None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:07.609737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0a624099-49b1-4f2c-ad5d-12dc22eb2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:07.696818 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1847/3650] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:07 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:10.792408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:10.863232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f3b8-51ff-47b9-94bc-1b81a5a08f41 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:10.867965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:10.868791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:10.869111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:10.869391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] PATH_INFO: `/v3/users/420be1221dda4b8690f7152d593a1f1b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:10.870645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420be1221dda4b8690f7152d593a1f1b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:10.873103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:11.189612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420be1221dda4b8690f7152d593a1f1b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:11.201849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420be1221dda4b8690f7152d593a1f1b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:11.214890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420be1221dda4b8690f7152d593a1f1b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:11.216058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420be1221dda4b8690f7152d593a1f1b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:11.218299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420be1221dda4b8690f7152d593a1f1b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:11.370201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1804/3651] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:19:10 2021] DELETE /identity/v3/users/420be1221dda4b8690f7152d593a1f1b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:19:11.375146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:11.375631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:11.375757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:11.437191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:11.442874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:11.662790 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1848/3652] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:11.668735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:11.671520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:11.756399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b415ff-58cf-4192-819b-5ab5755fab38 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:11.760704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:11.761639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:11.762076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:11.767054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:11.773644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:11.775347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:11.801994 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1805/3653] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:12.063009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:12.064253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:12.085025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02f44c-f8f9-45b9-bdd7-e03b8ad7ba61 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:12.097426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:12.098388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:12.098931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:12.099217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] PATH_INFO: `/v3/projects/0a9b4b2ed77041ca941a10d4f614efe0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:12.100767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9b4b2ed77041ca941a10d4f614efe0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:12.116656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:12.306772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9b4b2ed77041ca941a10d4f614efe0', 'request_id': 'req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.399158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9b4b2ed77041ca941a10d4f614efe0', 'request_id': 'req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.410295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9b4b2ed77041ca941a10d4f614efe0', 'request_id': 'req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.430659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] The token cache is being invalidate because project 0a9b4b2ed77041ca941a10d4f614efe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:19:12.432862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.435445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9f6c958-ddaf-4bf4-8fab-9aa5ea66f339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.440078 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1849/3654] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:19:12 2021] DELETE /identity/v3/projects/0a9b4b2ed77041ca941a10d4f614efe0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:19:12.444236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:12.457624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563942a-db91-4b08-8c1c-8c47c6022010 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:12.535956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:12.536484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:12.536484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:12.592215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:12.594292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:12.609101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:12.610480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:12.610918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:12.611335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] PATH_INFO: `/v3/users/23bda447559b44d38b64f2be798b4bcf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:12.613612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23bda447559b44d38b64f2be798b4bcf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:12.616624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:12.683329 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1850/3655] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:12 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:12.954172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23bda447559b44d38b64f2be798b4bcf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.970696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23bda447559b44d38b64f2be798b4bcf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.985079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23bda447559b44d38b64f2be798b4bcf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.985821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23bda447559b44d38b64f2be798b4bcf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:12.986552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67093f19-22ac-43a9-8134-634c8187b299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23bda447559b44d38b64f2be798b4bcf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:13.231257 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1806/3656] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:19:12 2021] DELETE /identity/v3/users/23bda447559b44d38b64f2be798b4bcf => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:19:13.848197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:13.849994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:13.868152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fa830-9770-4951-ab01-0687c5e3b66e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:13.937392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:13.938699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:13.939173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:13.939588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] PATH_INFO: `/v3/projects/be6e984a93be4b058194af3eeb858b71` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:13.941670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6e984a93be4b058194af3eeb858b71)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:13.944839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:14.135450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6e984a93be4b058194af3eeb858b71', 'request_id': 'req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:14.226278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6e984a93be4b058194af3eeb858b71', 'request_id': 'req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:14.234177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6e984a93be4b058194af3eeb858b71', 'request_id': 'req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:14.244842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] The token cache is being invalidate because project be6e984a93be4b058194af3eeb858b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:19:14.245408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:14.246057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-64ca08fd-11c2-4c9d-a9da-8ef67c188d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:19:14.248193 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1851/3657] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:19:13 2021] DELETE /identity/v3/projects/be6e984a93be4b058194af3eeb858b71 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:19:14.254174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8225-9524-4d28-bc3f-106430ceb115 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.256930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8225-9524-4d28-bc3f-106430ceb115 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.256930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8225-9524-4d28-bc3f-106430ceb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:14.275351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ea3e8225-9524-4d28-bc3f-106430ceb115 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:14.276747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ea3e8225-9524-4d28-bc3f-106430ceb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:14.342391 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1807/3658] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:19:14.350241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ce11-4b26-4ad6-a7bc-8baa1c70e9f4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.350530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ce11-4b26-4ad6-a7bc-8baa1c70e9f4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.350808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ce11-4b26-4ad6-a7bc-8baa1c70e9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:14.382155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-02a0ce11-4b26-4ad6-a7bc-8baa1c70e9f4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:14.384040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-02a0ce11-4b26-4ad6-a7bc-8baa1c70e9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:14.399793 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1852/3659] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:14.400395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8225-9524-4d28-bc3f-106430ceb115 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:14.412001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8225-9524-4d28-bc3f-106430ceb115 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:14.416672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:14.417550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.417986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.418459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:14.420070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:19:14.420521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:14.422328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:14.435876 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1808/3660] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:19:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:19:14.440755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ce11-4b26-4ad6-a7bc-8baa1c70e9f4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:14.457393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ce11-4b26-4ad6-a7bc-8baa1c70e9f4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:14.463962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:14.465451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.465898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.466300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:14.467104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:14.469221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:14.617781 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1853/3661] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:19:14 2021] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:19:14.621795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:14.633764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f89818-05e5-4d46-acc4-4591f4240494 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:14.703697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:14.709178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.709683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.710211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:14.711174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:14.713400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:14.842822 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1809/3662] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:19:14 2021] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:19:14.844826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:14.855756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36a49-ac47-4138-baa2-3ffcd3fac266 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:14.864237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:14.864237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.864237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.864237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:14.864574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:14.866190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:14.879410 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1854/3663] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:19:14 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:19:14.884299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:14.908205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67fa3f-8777-4743-b5db-4aea850cdc41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:14.913539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfe26a-18e5-4fbc-908b-303822baa08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:14.914250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfe26a-18e5-4fbc-908b-303822baa08b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.914534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfe26a-18e5-4fbc-908b-303822baa08b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.914801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfe26a-18e5-4fbc-908b-303822baa08b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:14.915800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfe26a-18e5-4fbc-908b-303822baa08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:14.928561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfe26a-18e5-4fbc-908b-303822baa08b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:14.951131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:14.952679 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1810/3664] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:19:14 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:19:14.971339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcfbae-2991-4b77-abce-2cbed4ef5fd9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:14.984776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:14.985940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:14.986372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:14.986823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] PATH_INFO: `/v3/projects/0ecfd75e0530430eaad8f0531a3a5244/users/8c034f7076e74d55a96b99bebf22a343/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:15.009597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ecfd75e0530430eaad8f0531a3a5244, user_id=8c034f7076e74d55a96b99bebf22a343, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:15.012591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:15.152767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1855/3665] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:19:14 2021] PUT /identity/v3/projects/0ecfd75e0530430eaad8f0531a3a5244/users/8c034f7076e74d55a96b99bebf22a343/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:19:15.159411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00e1a7-0b8e-4ee7-9108-4b2f2f06cc9c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:15.159886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00e1a7-0b8e-4ee7-9108-4b2f2f06cc9c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:15.160501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00e1a7-0b8e-4ee7-9108-4b2f2f06cc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:15.190239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6f00e1a7-0b8e-4ee7-9108-4b2f2f06cc9c None None] MFA Rules not processed for user `8c034f7076e74d55a96b99bebf22a343`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:15.191624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6f00e1a7-0b8e-4ee7-9108-4b2f2f06cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:15.298817 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1811/3666] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:15 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:15.303539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:15.389194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a168d-ab0d-40b2-a17c-7610979ae805 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:15.396814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:15.397739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:15.398032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:15.398524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:15.399489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:15.401540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:15.576739 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1856/3667] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:19:15 2021] POST /identity/v3/projects => generated 393 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:19:15.580789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00e1a7-0b8e-4ee7-9108-4b2f2f06cc9c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:15.591264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00e1a7-0b8e-4ee7-9108-4b2f2f06cc9c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:15.656000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:15.657070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:15.657355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:15.657629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:15.658353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:15.662880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:15.889335 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1812/3668] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:19:15 2021] POST /identity/v3/users => generated 303 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:19:15.890495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:15.904436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e57aa4-29d9-442e-af58-ef9ea61b3353 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:15.909238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:15.909901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:15.910183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:15.910458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:15.911203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:15.912797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:15.928958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1857/3669] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:19:15 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:19:15.942404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:15.956912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892690a-8854-4859-b27f-7dae7c659719 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:15.965312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:15.966439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:15.967217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:15.967797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] PATH_INFO: `/v3/projects/1cf8aa86e22f4e25b3c7006f5ea4c074/users/52dadc60a0554f1eb90e51409cf80d3e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:15.993412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf8aa86e22f4e25b3c7006f5ea4c074, user_id=52dadc60a0554f1eb90e51409cf80d3e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:15.993412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:16.102869 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1813/3670] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:19:15 2021] PUT /identity/v3/projects/1cf8aa86e22f4e25b3c7006f5ea4c074/users/52dadc60a0554f1eb90e51409cf80d3e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:19:16.107343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:16.118874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069494-ce06-41ba-9252-396ffaae30e2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:16.180334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3bf81-f7c6-4c56-b769-e3e53f9c06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:16.181140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3bf81-f7c6-4c56-b769-e3e53f9c06e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:16.181501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3bf81-f7c6-4c56-b769-e3e53f9c06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:16.181886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3bf81-f7c6-4c56-b769-e3e53f9c06e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:16.182802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3bf81-f7c6-4c56-b769-e3e53f9c06e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:16.184348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3bf81-f7c6-4c56-b769-e3e53f9c06e4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:16.199134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:16.199652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1858/3671] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:19:16 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:19:16.209898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146968f2-5f7a-4400-8ed6-24fcd203933e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:16.215340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81801b-eb8f-4ab2-b414-73bf26736a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:16.216991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81801b-eb8f-4ab2-b414-73bf26736a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:16.217349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81801b-eb8f-4ab2-b414-73bf26736a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:16.217710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81801b-eb8f-4ab2-b414-73bf26736a9b admin admin] PATH_INFO: `/v3/projects/1cf8aa86e22f4e25b3c7006f5ea4c074/users/52dadc60a0554f1eb90e51409cf80d3e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:16.219904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81801b-eb8f-4ab2-b414-73bf26736a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf8aa86e22f4e25b3c7006f5ea4c074, user_id=52dadc60a0554f1eb90e51409cf80d3e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:16.222786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81801b-eb8f-4ab2-b414-73bf26736a9b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:16.235106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1814/3672] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:19:16 2021] PUT /identity/v3/projects/1cf8aa86e22f4e25b3c7006f5ea4c074/users/52dadc60a0554f1eb90e51409cf80d3e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:19:16.248034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:16.248259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:16.248536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:16.277764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] MFA Rules not processed for user `52dadc60a0554f1eb90e51409cf80d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:16.279528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:16.361496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1859/3673] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:16 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:16.373127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af69eb-700d-4571-bd96-566e547c2ea9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:16.373974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af69eb-700d-4571-bd96-566e547c2ea9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:16.374279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af69eb-700d-4571-bd96-566e547c2ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:16.410972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-56af69eb-700d-4571-bd96-566e547c2ea9 None None] MFA Rules not processed for user `8c034f7076e74d55a96b99bebf22a343`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:16.421162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-56af69eb-700d-4571-bd96-566e547c2ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:16.537388 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1815/3674] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:16 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:16.546565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:16.550591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:16.668723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955fca6-0d4a-4cbe-b818-9e5fbb55f32d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:16.677937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:16.678688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:16.678969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:16.679258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:16.696138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:16.698723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:16.711808 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1860/3675] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:16 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:17.413066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979d5e-1600-4cb9-88a7-196c20d9cd06 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:17.413066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979d5e-1600-4cb9-88a7-196c20d9cd06 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:17.413692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979d5e-1600-4cb9-88a7-196c20d9cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:17.446646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8e979d5e-1600-4cb9-88a7-196c20d9cd06 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:17.446905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e979d5e-1600-4cb9-88a7-196c20d9cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:17.548697 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1816/3676] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:19:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:17.563953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:17.565498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:17.656383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672733-64b8-4a6c-bc5e-59b222f7781b service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:17.663149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6447a5-249f-4dce-8e2a-74b7b1b3646d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:17.664338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6447a5-249f-4dce-8e2a-74b7b1b3646d service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:17.666302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6447a5-249f-4dce-8e2a-74b7b1b3646d service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:17.666302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6447a5-249f-4dce-8e2a-74b7b1b3646d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:17.681549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6447a5-249f-4dce-8e2a-74b7b1b3646d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:17.684917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6447a5-249f-4dce-8e2a-74b7b1b3646d service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:17.701613 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1861/3677] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:19:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:19:20.803976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451926-5ebd-4668-b1aa-297f68ecbc3e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:20.805074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451926-5ebd-4668-b1aa-297f68ecbc3e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:20.805641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451926-5ebd-4668-b1aa-297f68ecbc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:20.844558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d1451926-5ebd-4668-b1aa-297f68ecbc3e None None] MFA Rules not processed for user `d0383b7f61484347ba9875a2636e1057`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:20.846306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d1451926-5ebd-4668-b1aa-297f68ecbc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:20.932782 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1817/3678] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:20 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:33.914588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:33.914588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:33.914588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:33.943541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] MFA Rules not processed for user `a85842dabc3d4a219d28c154e36c293c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:33.944801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:34.038331 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1862/3679] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:33 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:34.088752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5302b-765e-42ce-aa1f-8bb0ac33bce0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:34.088752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5302b-765e-42ce-aa1f-8bb0ac33bce0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:34.088752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5302b-765e-42ce-aa1f-8bb0ac33bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:34.088752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-67f5302b-765e-42ce-aa1f-8bb0ac33bce0 None None] MFA Rules not processed for user `a85842dabc3d4a219d28c154e36c293c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:34.089594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-67f5302b-765e-42ce-aa1f-8bb0ac33bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:34.110467 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1818/3680] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:34 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:36.606917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:36.606917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:36.647583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d4eaa-06db-4c83-8202-d4ee75a1b748 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:36.647583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd3e59-2b97-4371-87ed-6ac466fe9762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:36.647583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd3e59-2b97-4371-87ed-6ac466fe9762 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:36.647583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd3e59-2b97-4371-87ed-6ac466fe9762 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:36.648185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd3e59-2b97-4371-87ed-6ac466fe9762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:36.655515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd3e59-2b97-4371-87ed-6ac466fe9762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:36.657967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd3e59-2b97-4371-87ed-6ac466fe9762 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:36.673203 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1863/3681] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:36 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:36.699820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff255b-8df0-43d3-b7e1-fdbc258e4d1f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:36.700310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff255b-8df0-43d3-b7e1-fdbc258e4d1f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:36.700403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff255b-8df0-43d3-b7e1-fdbc258e4d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:36.727803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e8ff255b-8df0-43d3-b7e1-fdbc258e4d1f None None] MFA Rules not processed for user `8c034f7076e74d55a96b99bebf22a343`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:36.729841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e8ff255b-8df0-43d3-b7e1-fdbc258e4d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:36.739444 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1819/3682] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:36 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:43.981621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:43.982534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:43.983019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:44.004992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:44.008572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:44.017711 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1864/3683] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:19:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:44.035669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff255b-8df0-43d3-b7e1-fdbc258e4d1f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:44.052743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff255b-8df0-43d3-b7e1-fdbc258e4d1f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:44.067997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a18d0a-eafa-4ce2-922f-56c79f2294b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:44.069485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18d0a-eafa-4ce2-922f-56c79f2294b6 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:44.069883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18d0a-eafa-4ce2-922f-56c79f2294b6 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:44.070390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a18d0a-eafa-4ce2-922f-56c79f2294b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:44.082095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18d0a-eafa-4ce2-922f-56c79f2294b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:44.084141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a18d0a-eafa-4ce2-922f-56c79f2294b6 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:44.094257 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1820/3684] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:19:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:19:44.132289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:44.134235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:44.352669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759bee-1cdc-43e3-add9-5241430b4267 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:44.369155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:44.370340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:44.370813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:44.371308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:44.376252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:44.405794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:44.409648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:44.431114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1865/3685] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:46.816073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e747-c826-4cbe-bac8-b63a26d232a6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:46.816614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e747-c826-4cbe-bac8-b63a26d232a6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:46.816697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25e747-c826-4cbe-bac8-b63a26d232a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:46.841273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5a25e747-c826-4cbe-bac8-b63a26d232a6 None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:19:46.842833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a25e747-c826-4cbe-bac8-b63a26d232a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:46.922589 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1821/3686] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:19:46 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:19:51.608576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:51.618504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1960b-8089-4286-861f-5b99ed2f1d8c service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:51.624807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37445a-8bf2-4f50-81e3-04e2bc11a6f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:51.625503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37445a-8bf2-4f50-81e3-04e2bc11a6f4 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:51.625787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37445a-8bf2-4f50-81e3-04e2bc11a6f4 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:51.626065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37445a-8bf2-4f50-81e3-04e2bc11a6f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:51.627922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9a37445a-8bf2-4f50-81e3-04e2bc11a6f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:51.640449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37445a-8bf2-4f50-81e3-04e2bc11a6f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:51.642192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37445a-8bf2-4f50-81e3-04e2bc11a6f4 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:51.664407 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1866/3687] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:51 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:19:52.663623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25e747-c826-4cbe-bac8-b63a26d232a6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:19:52.684338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25e747-c826-4cbe-bac8-b63a26d232a6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:19:52.690604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:19:52.691568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:19:52.692402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:19:52.692917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:19:52.695007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:19:52.713177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:19:52.716018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:19:52.732553 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1822/3688] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:19:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:20:00.681181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cc1a-7f82-4f98-9302-f13027424cdd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:00.681756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cc1a-7f82-4f98-9302-f13027424cdd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:00.681756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cc1a-7f82-4f98-9302-f13027424cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:00.710911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-28f2cc1a-7f82-4f98-9302-f13027424cdd None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:00.713513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-28f2cc1a-7f82-4f98-9302-f13027424cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:00.733419 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1867/3689] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:20:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:00.742540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:00.761921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb10c4-e65c-4375-8013-d8f3ebd0c44c service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:00.774736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:00.780465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:00.780465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:00.780465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:00.798271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:00.800243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:00.838406 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1823/3690] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:20:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:03.016678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057b558-bb36-4dc0-92e7-7f59f7c6f699 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:03.017184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057b558-bb36-4dc0-92e7-7f59f7c6f699 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:03.017324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057b558-bb36-4dc0-92e7-7f59f7c6f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:03.045226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2057b558-bb36-4dc0-92e7-7f59f7c6f699 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:03.046687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2057b558-bb36-4dc0-92e7-7f59f7c6f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:03.054849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1868/3691] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:20:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:03.082164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:03.096352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa6c1f-9244-4fbd-b2a8-e90150e7bfc1 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:03.104463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e50e1-28b9-48fa-b79a-bc1912e6f1bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:03.105158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e50e1-28b9-48fa-b79a-bc1912e6f1bd service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:03.105437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e50e1-28b9-48fa-b79a-bc1912e6f1bd service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:03.105709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e50e1-28b9-48fa-b79a-bc1912e6f1bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:03.118558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e50e1-28b9-48fa-b79a-bc1912e6f1bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:03.121481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e50e1-28b9-48fa-b79a-bc1912e6f1bd service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:03.134291 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1824/3692] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:20:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:03.225236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b3fb-d447-458b-a54e-2e9f5c3e5dfd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:03.225779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b3fb-d447-458b-a54e-2e9f5c3e5dfd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:03.226514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b3fb-d447-458b-a54e-2e9f5c3e5dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:03.247562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-df28b3fb-d447-458b-a54e-2e9f5c3e5dfd None None] MFA Rules not processed for user `ed831822eb3542a88f70914466c36603`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:03.250592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-df28b3fb-d447-458b-a54e-2e9f5c3e5dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:03.332158 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1869/3693] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:03 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:04.266241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8877b-b990-44e4-92ad-ba49912f4434 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:04.266729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8877b-b990-44e4-92ad-ba49912f4434 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:04.266805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8877b-b990-44e4-92ad-ba49912f4434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:04.286654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f4e8877b-b990-44e4-92ad-ba49912f4434 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:04.287886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f4e8877b-b990-44e4-92ad-ba49912f4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:04.297287 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1825/3694] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:20:04 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:04.315500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b3fb-d447-458b-a54e-2e9f5c3e5dfd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:04.340284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b3fb-d447-458b-a54e-2e9f5c3e5dfd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:04.347305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:04.348319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:04.348812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:04.349562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:04.360075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:04.362049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:04.373985 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1870/3695] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:20:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:11.301534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc52e7-e31a-47dc-b375-f35110c2789a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:11.302725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc52e7-e31a-47dc-b375-f35110c2789a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:11.303240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc52e7-e31a-47dc-b375-f35110c2789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:11.339774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-88fc52e7-e31a-47dc-b375-f35110c2789a None None] MFA Rules not processed for user `d2cc54d7a742403f896dd71d222895c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:11.341317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-88fc52e7-e31a-47dc-b375-f35110c2789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:11.441798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:11.471633 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1826/3696] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:11 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:11.557675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92aa17-86f6-4aef-8e91-b96e160b8c39 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:11.564163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:11.565568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:11.566100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:11.567661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] PATH_INFO: `/v3/users/8c034f7076e74d55a96b99bebf22a343` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:11.570279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c034f7076e74d55a96b99bebf22a343)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:11.573640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:11.786383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c034f7076e74d55a96b99bebf22a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:11.795848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c034f7076e74d55a96b99bebf22a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:11.819366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c034f7076e74d55a96b99bebf22a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:11.819366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c034f7076e74d55a96b99bebf22a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:11.905291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c034f7076e74d55a96b99bebf22a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:11.917195 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1871/3697] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:20:11 2021] DELETE /identity/v3/users/8c034f7076e74d55a96b99bebf22a343 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:20:11.919677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:11.919971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:11.920252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:11.941921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:11.943945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:12.042254 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1827/3698] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:12.063073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:12.064495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:12.135671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4966-5b84-4afe-abee-93e4a2251a65 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:12.139887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:12.141421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:12.141421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:12.141754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:12.152814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:12.154691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:12.168284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1872/3699] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:20:12.662386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:12.664253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:12.699765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876838c-8274-4e88-8f88-38286ccd3066 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:12.706696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:12.707830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:12.708305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:12.708931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] PATH_INFO: `/v3/projects/0ecfd75e0530430eaad8f0531a3a5244` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:12.710542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ecfd75e0530430eaad8f0531a3a5244)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:12.715209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:12.886806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ecfd75e0530430eaad8f0531a3a5244', 'request_id': 'req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:12.894934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ecfd75e0530430eaad8f0531a3a5244', 'request_id': 'req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.006598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ecfd75e0530430eaad8f0531a3a5244', 'request_id': 'req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.022028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] The token cache is being invalidate because project 0ecfd75e0530430eaad8f0531a3a5244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:20:13.022477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.023216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.026892 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1828/3700] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:20:12 2021] DELETE /identity/v3/projects/0ecfd75e0530430eaad8f0531a3a5244 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:13.034378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:13.050949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e979-b64a-4f07-ba19-9aa6e40c715e service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:13.151479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:13.153250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:13.153704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:13.154239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] PATH_INFO: `/v3/users/52dadc60a0554f1eb90e51409cf80d3e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:13.155974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52dadc60a0554f1eb90e51409cf80d3e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:13.161359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:13.379582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52dadc60a0554f1eb90e51409cf80d3e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.391871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52dadc60a0554f1eb90e51409cf80d3e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.405862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52dadc60a0554f1eb90e51409cf80d3e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.406965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52dadc60a0554f1eb90e51409cf80d3e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.492460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52dadc60a0554f1eb90e51409cf80d3e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:13.500371 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1873/3701] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:20:13 2021] DELETE /identity/v3/users/52dadc60a0554f1eb90e51409cf80d3e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:20:13.591852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:13.595425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:13.611775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8fd41-bbe9-4ee8-b9fe-f43e7d9e196c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:13.714543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:13.715598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:13.715894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:13.716176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] PATH_INFO: `/v3/users/59c504bd6e654627a5d04f6e22be1b95` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:13.717453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c504bd6e654627a5d04f6e22be1b95)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:13.719373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:14.042550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c504bd6e654627a5d04f6e22be1b95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.051070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c504bd6e654627a5d04f6e22be1b95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.067393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c504bd6e654627a5d04f6e22be1b95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.068847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c504bd6e654627a5d04f6e22be1b95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.069728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b96e14fa-ff67-4749-ba28-51b098d3070b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c504bd6e654627a5d04f6e22be1b95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.099639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:14.101365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:14.119101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ef76-4cf5-473c-83a9-f3c99eb90508 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:14.126194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:14.127837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.128220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.128598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] PATH_INFO: `/v3/projects/1cf8aa86e22f4e25b3c7006f5ea4c074` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:14.129993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf8aa86e22f4e25b3c7006f5ea4c074)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:14.132395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:14.188211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1829/3702] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:20:13 2021] DELETE /identity/v3/users/59c504bd6e654627a5d04f6e22be1b95 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:14.257210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf8aa86e22f4e25b3c7006f5ea4c074', 'request_id': 'req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.355139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf8aa86e22f4e25b3c7006f5ea4c074', 'request_id': 'req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.368742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf8aa86e22f4e25b3c7006f5ea4c074', 'request_id': 'req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.392348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] The token cache is being invalidate because project 1cf8aa86e22f4e25b3c7006f5ea4c074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:20:14.392670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.393385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3bf4061b-ab30-4e3e-9cd3-70a3f7cc9a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:14.395061 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1874/3703] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:20:14 2021] DELETE /identity/v3/projects/1cf8aa86e22f4e25b3c7006f5ea4c074 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:14.402645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3f3b6-c6d3-4b6b-8ac2-5d75fdbbc783 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.403116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3f3b6-c6d3-4b6b-8ac2-5d75fdbbc783 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.409948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3f3b6-c6d3-4b6b-8ac2-5d75fdbbc783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:14.427214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4dc3f3b6-c6d3-4b6b-8ac2-5d75fdbbc783 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:14.428727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4dc3f3b6-c6d3-4b6b-8ac2-5d75fdbbc783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:14.516336 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1830/3704] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:20:14.524806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad7728-5192-4325-a6bc-3529a1c9231d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.525991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad7728-5192-4325-a6bc-3529a1c9231d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.527267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad7728-5192-4325-a6bc-3529a1c9231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:14.551539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f1ad7728-5192-4325-a6bc-3529a1c9231d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:14.553471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f1ad7728-5192-4325-a6bc-3529a1c9231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:14.565316 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1875/3705] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:14.570163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3f3b6-c6d3-4b6b-8ac2-5d75fdbbc783 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:14.582114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3f3b6-c6d3-4b6b-8ac2-5d75fdbbc783 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:14.589053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:14.590032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.590407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.590939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:14.591850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:20:14.592251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:14.594039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:14.610704 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1831/3706] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:20:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:20:14.615651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad7728-5192-4325-a6bc-3529a1c9231d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:14.626202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad7728-5192-4325-a6bc-3529a1c9231d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:14.632721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:14.633951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.638632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.638632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:14.638632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:14.639538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:14.728127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1876/3707] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:20:14 2021] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:14.737009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:14.748533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c91f89-1efb-4218-ae0d-f333136efb41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:14.816409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:14.817473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.817907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.818336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:14.819169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:14.822877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:14.861498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:14.870006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:14.915879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3dbf-0ebf-46ba-86ab-65d8eb02c8a9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:14.941087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:14.950237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.950237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.959770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] PATH_INFO: `/v3/projects/3b0881f03bcb42b2af8fbbc9bd84ca78` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:14.962443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0881f03bcb42b2af8fbbc9bd84ca78)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:14.967566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:14.977930 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1832/3708] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:20:14 2021] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:14.979195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:14.990328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187462-43fe-43d1-82a6-386d7889a8ec admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:14.997039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:14.998340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:14.998768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:14.999212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.000685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.002713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.026424 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1833/3709] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:20:15.037015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:15.048433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe2a74-169f-4e65-b786-3f2cc662cf05 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:15.059472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:15.059472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.059472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.059472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.059799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.059799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.080161 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1834/3710] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:20:15.084433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:15.101519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c49b-85a4-4052-8889-763aec4c8a4b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:15.126962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cda9d-9482-4b19-bf89-e3a1c79d13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:15.127869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cda9d-9482-4b19-bf89-e3a1c79d13be admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.128153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cda9d-9482-4b19-bf89-e3a1c79d13be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.128482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cda9d-9482-4b19-bf89-e3a1c79d13be admin admin] PATH_INFO: `/v3/projects/d2b5edef5e3349c2bf221f47c5457b4f/users/17d7a8ba1616448f823d45787d82920f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.153919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'request_id': 'req-e2b488c2-ba9a-4697-bab5-18ecf343008f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:15.173120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cda9d-9482-4b19-bf89-e3a1c79d13be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b5edef5e3349c2bf221f47c5457b4f, user_id=17d7a8ba1616448f823d45787d82920f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.176205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cda9d-9482-4b19-bf89-e3a1c79d13be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.240459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'request_id': 'req-e2b488c2-ba9a-4697-bab5-18ecf343008f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:15.249632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'request_id': 'req-e2b488c2-ba9a-4697-bab5-18ecf343008f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:15.265435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] The token cache is being invalidate because project 3b0881f03bcb42b2af8fbbc9bd84ca78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:20:15.266119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:15.267195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2b488c2-ba9a-4697-bab5-18ecf343008f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:15.274624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1877/3711] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:20:14 2021] DELETE /identity/v3/projects/3b0881f03bcb42b2af8fbbc9bd84ca78 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:20:15.278262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380db53-3327-4af7-aa9e-2066bbc262c7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.278747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380db53-3327-4af7-aa9e-2066bbc262c7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.279230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380db53-3327-4af7-aa9e-2066bbc262c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.310215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d380db53-3327-4af7-aa9e-2066bbc262c7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:15.311564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d380db53-3327-4af7-aa9e-2066bbc262c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:15.339137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1835/3712] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:20:15 2021] PUT /identity/v3/projects/d2b5edef5e3349c2bf221f47c5457b4f/users/17d7a8ba1616448f823d45787d82920f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:15.359976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfb2ca-9e94-48e7-b6a2-942fb2ecca0c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.360488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfb2ca-9e94-48e7-b6a2-942fb2ecca0c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.361031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfb2ca-9e94-48e7-b6a2-942fb2ecca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.396552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4bdfb2ca-9e94-48e7-b6a2-942fb2ecca0c None None] MFA Rules not processed for user `17d7a8ba1616448f823d45787d82920f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:15.398181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4bdfb2ca-9e94-48e7-b6a2-942fb2ecca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:15.403769 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1878/3713] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:15.405419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3323eb0-85f1-467c-91ec-015967997b69 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.405714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3323eb0-85f1-467c-91ec-015967997b69 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.405991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3323eb0-85f1-467c-91ec-015967997b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.426189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a3323eb0-85f1-467c-91ec-015967997b69 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:15.427436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3323eb0-85f1-467c-91ec-015967997b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:15.489818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1836/3714] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:15 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:15.530041 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1879/3715] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:15.543534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfb2ca-9e94-48e7-b6a2-942fb2ecca0c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:15.544725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1e6b4-2db3-4d84-818d-e6ce49d54092 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.545059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1e6b4-2db3-4d84-818d-e6ce49d54092 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.545343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1e6b4-2db3-4d84-818d-e6ce49d54092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.559462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfb2ca-9e94-48e7-b6a2-942fb2ecca0c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:15.565365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:15.565901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b0f1e6b4-2db3-4d84-818d-e6ce49d54092 None None] MFA Rules not processed for user `17d7a8ba1616448f823d45787d82920f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:15.566328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.566678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.567017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.567138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0f1e6b4-2db3-4d84-818d-e6ce49d54092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:15.567867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:20:15.568263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.570038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.576475 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1880/3716] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:15 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:15.588047 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1837/3717] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:20:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:20:15.589428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1e6b4-2db3-4d84-818d-e6ce49d54092 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:15.592235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:15.594202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:15.603264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1e6b4-2db3-4d84-818d-e6ce49d54092 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:15.611137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:15.611914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.612273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.612625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.613454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.615497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.681148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adabac8-4d1d-4bc7-b3b7-a979f0d441cb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:15.690218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:15.690899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.691182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.691465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.703933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.707409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.716175 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1881/3718] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:20:15 2021] POST /identity/v3/projects => generated 395 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:15.717633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:15.726237 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1838/3719] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:15 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:20:15.806489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a629-3ab4-43ab-9327-f1069f5f7f66 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:15.811830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:15.812498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.813083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.813444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.814222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.816495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.937722 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1882/3720] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:20:15 2021] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:15.941419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:15.954327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d025db-01e1-46b1-9a20-f4a71582cded service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:15.972199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:15.972988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:15.974447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:15.976333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:15.977197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:15.980461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:15.999056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1839/3721] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:20:16.002393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:16.016135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02895-36fe-4fb6-9ed2-4304923e78b2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:16.024928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c662c6-e0d8-4e76-912e-f0b6a97ab6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:16.026198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c662c6-e0d8-4e76-912e-f0b6a97ab6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:16.026485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c662c6-e0d8-4e76-912e-f0b6a97ab6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:16.027637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c662c6-e0d8-4e76-912e-f0b6a97ab6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:16.028466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c662c6-e0d8-4e76-912e-f0b6a97ab6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:16.030445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c662c6-e0d8-4e76-912e-f0b6a97ab6a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:16.059044 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1883/3722] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:20:16.059261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:16.074748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80779e-9712-455e-a8ad-23a25b60de7a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:16.081404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:16.082427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:16.088567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:16.088567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] PATH_INFO: `/v3/projects/bfd1b67368c34701bcdc20105e48ad41/users/7ec911a0e281430f98062b734b3d4de3/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:16.101117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd1b67368c34701bcdc20105e48ad41, user_id=7ec911a0e281430f98062b734b3d4de3, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:16.104210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:16.203629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1840/3723] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:20:16 2021] PUT /identity/v3/projects/bfd1b67368c34701bcdc20105e48ad41/users/7ec911a0e281430f98062b734b3d4de3/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:20:16.208462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca34d41-c060-4e13-a3d6-39026c773c93 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:16.209000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca34d41-c060-4e13-a3d6-39026c773c93 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:16.209254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca34d41-c060-4e13-a3d6-39026c773c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:16.241944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cca34d41-c060-4e13-a3d6-39026c773c93 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:16.243741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cca34d41-c060-4e13-a3d6-39026c773c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:16.327335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1884/3724] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:16.334793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:16.341253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:16.438169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ad5fd-e52f-4b08-83ea-02c75af37248 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:16.442232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b62eea-a680-44dd-a668-ad289cefac9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:16.442962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b62eea-a680-44dd-a668-ad289cefac9f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:16.443309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b62eea-a680-44dd-a668-ad289cefac9f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:16.443652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b62eea-a680-44dd-a668-ad289cefac9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:16.456944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b62eea-a680-44dd-a668-ad289cefac9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:16.458489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b62eea-a680-44dd-a668-ad289cefac9f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:16.470195 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1841/3725] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:20:16.951986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025397-f045-4516-adea-b7091fa42dfe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:16.952277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025397-f045-4516-adea-b7091fa42dfe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:16.952567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025397-f045-4516-adea-b7091fa42dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:16.979482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-58025397-f045-4516-adea-b7091fa42dfe None None] MFA Rules not processed for user `1d23db9414d34853ae04f7f032694f12`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:16.980702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-58025397-f045-4516-adea-b7091fa42dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:17.061753 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1885/3726] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:16 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:25.012692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:25.015076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:25.015076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:25.055465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] MFA Rules not processed for user `7ec911a0e281430f98062b734b3d4de3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:25.056712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:25.206252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1842/3727] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:25 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:25.216579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:25.218057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:25.218492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:25.250707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] MFA Rules not processed for user `7ec911a0e281430f98062b734b3d4de3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:25.257741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:25.278210 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1886/3728] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:25 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:25.759167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:25.761832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:25.909545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b317-5388-4b73-9ee6-70ba56b9096c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:25.916625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:25.917319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:25.917601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:25.917876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:25.936949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:25.939432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:25.973508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1843/3729] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:25 2021] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:20:40.269134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:40.270953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:40.286475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56479f2d-5665-46d8-96fe-accb61a5b9ac None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:40.291081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:40.291945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:40.292222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:40.293222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] PATH_INFO: `/v3/users/ed831822eb3542a88f70914466c36603` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:40.294435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed831822eb3542a88f70914466c36603)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:40.296602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:40.447420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed831822eb3542a88f70914466c36603'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:40.457030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed831822eb3542a88f70914466c36603'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:40.470079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed831822eb3542a88f70914466c36603'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:40.470814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed831822eb3542a88f70914466c36603'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:40.564717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed831822eb3542a88f70914466c36603'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:40.572706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1887/3730] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:20:40 2021] DELETE /identity/v3/users/ed831822eb3542a88f70914466c36603 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:40.871429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:40.892536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b81ed-312f-423b-b318-57a284305baa service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:40.983096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:40.984157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:40.984603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:40.985045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] PATH_INFO: `/v3/projects/8154e82a58434a60b677d150202a5312` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:40.986946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8154e82a58434a60b677d150202a5312)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:40.990207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:41.142288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8154e82a58434a60b677d150202a5312', 'request_id': 'req-232dde99-828a-4773-978b-db25b478ebdc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.155749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8154e82a58434a60b677d150202a5312', 'request_id': 'req-232dde99-828a-4773-978b-db25b478ebdc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.262163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8154e82a58434a60b677d150202a5312', 'request_id': 'req-232dde99-828a-4773-978b-db25b478ebdc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.279806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] The token cache is being invalidate because project 8154e82a58434a60b677d150202a5312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:20:41.280220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.281902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:41.282633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-232dde99-828a-4773-978b-db25b478ebdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.283449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:41.286755 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1844/3731] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:20:40 2021] DELETE /identity/v3/projects/8154e82a58434a60b677d150202a5312 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:41.293232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c5c7b-7524-4e37-8685-563f6ae3f0c6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:41.293531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c5c7b-7524-4e37-8685-563f6ae3f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:41.293797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c5c7b-7524-4e37-8685-563f6ae3f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:41.304997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7d98-3801-4bbe-9d89-6bf333e83ae5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:41.332548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b90c5c7b-7524-4e37-8685-563f6ae3f0c6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:41.333982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b90c5c7b-7524-4e37-8685-563f6ae3f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:41.381001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:41.382116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:41.382540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:41.382971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] PATH_INFO: `/v3/users/17d7a8ba1616448f823d45787d82920f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:41.384776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d7a8ba1616448f823d45787d82920f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:41.387266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:41.438414 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1845/3732] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:20:41.446627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6366a6-3def-41dd-abfa-35aed5ed9b4a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:41.447017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6366a6-3def-41dd-abfa-35aed5ed9b4a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:41.447361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6366a6-3def-41dd-abfa-35aed5ed9b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:41.467266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ea6366a6-3def-41dd-abfa-35aed5ed9b4a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:41.468579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ea6366a6-3def-41dd-abfa-35aed5ed9b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:41.477210 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1846/3733] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:41.481964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6366a6-3def-41dd-abfa-35aed5ed9b4a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:41.494856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6366a6-3def-41dd-abfa-35aed5ed9b4a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:41.500728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:41.501420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:41.501701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:41.502004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:41.502779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:20:41.503086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:41.504750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:41.527948 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1847/3734] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:20:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:20:41.529278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:41.541844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840e08-a238-4114-9bb8-a3d796eb0107 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:41.550085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:41.551090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:41.552170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:41.552668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:41.553813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:41.557009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:41.615091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d7a8ba1616448f823d45787d82920f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.622481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d7a8ba1616448f823d45787d82920f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.635534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d7a8ba1616448f823d45787d82920f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.636249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d7a8ba1616448f823d45787d82920f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.665967 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1848/3735] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:20:41 2021] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:41.668636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:41.719006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-13a544f3-08ca-4b6c-a7cf-33a6b93a7e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d7a8ba1616448f823d45787d82920f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:41.727038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1888/3736] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:20:41 2021] DELETE /identity/v3/users/17d7a8ba1616448f823d45787d82920f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:41.731942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:41.731942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:41.731942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:41.759129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:41.760591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:41.782808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad22475-fa12-45cc-a775-4d25e67d7d9e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:41.874021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1889/3737] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:20:41.894613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:41.896595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:41.920506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:41.922138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:41.924271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:41.925346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:41.926744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:41.934033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.008160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a378-a98c-49d5-b14e-2d07f2893b1d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.013619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.014361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.014716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.015297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.026050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.036165 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1849/3738] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:20:41 2021] POST /identity/v3/users => generated 300 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:42.040187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.041350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:42.045938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:42.053714 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1890/3739] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:20:42.063877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51003e77-13bd-448d-8bac-24cbc31a8fc1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.068845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.069560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.069894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.070178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.071990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.074193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.085515 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1850/3740] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:20:42.090320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:42.100327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280914a2-2fc1-467f-bd19-120a75e5b47b service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.106290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf2480-c673-4c5f-9401-4cf37235161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.107208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf2480-c673-4c5f-9401-4cf37235161e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.107586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf2480-c673-4c5f-9401-4cf37235161e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.107955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf2480-c673-4c5f-9401-4cf37235161e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.108790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf2480-c673-4c5f-9401-4cf37235161e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.110762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf2480-c673-4c5f-9401-4cf37235161e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.124559 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1891/3741] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:20:42.131344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:42.143313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5de0d1-10f4-48fe-86ff-8b7d3e542727 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.148634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.149620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.149908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.150234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] PATH_INFO: `/v3/projects/4e25bb59aaf6463b813f8a47e00b807e/users/55b39997f2f648ca8329c1d17120b62c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.174375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e25bb59aaf6463b813f8a47e00b807e, user_id=55b39997f2f648ca8329c1d17120b62c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.174375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.311637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1851/3742] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:20:42 2021] PUT /identity/v3/projects/4e25bb59aaf6463b813f8a47e00b807e/users/55b39997f2f648ca8329c1d17120b62c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:42.312947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.313427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.313544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.350178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:42.351677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:42.402744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:42.407012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:42.460392 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1892/3743] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:42.479103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:42.483597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:42.538243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caa859-b274-4f34-8ffc-97ebd02e44aa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.544901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.545513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.545797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.546084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] PATH_INFO: `/v3/projects/d2b5edef5e3349c2bf221f47c5457b4f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.550378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b5edef5e3349c2bf221f47c5457b4f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.552552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.576862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2083aa-3511-4bb7-88ef-eee5caa7dc02 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.581311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d57366-78fb-4ac3-b780-10f9f3ff67dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.582031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d57366-78fb-4ac3-b780-10f9f3ff67dd service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.582236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d57366-78fb-4ac3-b780-10f9f3ff67dd service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.582516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d57366-78fb-4ac3-b780-10f9f3ff67dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.592194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d57366-78fb-4ac3-b780-10f9f3ff67dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.593657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d57366-78fb-4ac3-b780-10f9f3ff67dd service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.603931 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1893/3744] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:20:42.662223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b5edef5e3349c2bf221f47c5457b4f', 'request_id': 'req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:42.668646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b5edef5e3349c2bf221f47c5457b4f', 'request_id': 'req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:42.782369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b5edef5e3349c2bf221f47c5457b4f', 'request_id': 'req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:42.794045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] The token cache is being invalidate because project d2b5edef5e3349c2bf221f47c5457b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:20:42.795026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:42.795026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0bf2dcb3-fc0b-48e0-b803-3c888da1e85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:20:42.796781 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1852/3745] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:20:42 2021] DELETE /identity/v3/projects/d2b5edef5e3349c2bf221f47c5457b4f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:42.802519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee305f-906f-4eaa-81b4-46e15fe5b105 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.802860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee305f-906f-4eaa-81b4-46e15fe5b105 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.803144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee305f-906f-4eaa-81b4-46e15fe5b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.821435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-40ee305f-906f-4eaa-81b4-46e15fe5b105 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:42.822623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-40ee305f-906f-4eaa-81b4-46e15fe5b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:42.883696 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1894/3746] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:20:42.893171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b40d1-4b7b-4b1a-b1f7-075505264c61 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.893481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b40d1-4b7b-4b1a-b1f7-075505264c61 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.893705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b40d1-4b7b-4b1a-b1f7-075505264c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.915549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e50b40d1-4b7b-4b1a-b1f7-075505264c61 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:42.916951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e50b40d1-4b7b-4b1a-b1f7-075505264c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:42.927687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1853/3747] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:42.931904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee305f-906f-4eaa-81b4-46e15fe5b105 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:42.943084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee305f-906f-4eaa-81b4-46e15fe5b105 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.949518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.950191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.950475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.950753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.951481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:20:42.951825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.953456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:42.967141 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1895/3748] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:20:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:20:42.970846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b40d1-4b7b-4b1a-b1f7-075505264c61 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:42.981031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b40d1-4b7b-4b1a-b1f7-075505264c61 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:42.985710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:42.986411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:42.986685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:42.987091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:42.987795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:42.989687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:43.092007 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1854/3749] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:20:42 2021] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:43.100641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:43.112317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508734e6-bee0-47a7-8d58-cd5691b9ac0b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:43.184639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:43.185327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.185608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.185881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.186571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:43.188502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:43.304284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1896/3750] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:20:43 2021] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:20:43.308105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:43.319799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b20c-25a2-4e1d-ae0c-6d0335e852f5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:43.325744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:43.326447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.327598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.327598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.328265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:43.331129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:43.345024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1855/3751] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:20:43.347455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:43.357739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4efa9-c0a7-4e5b-a29c-5e09e8f5c1e4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:43.362534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3fa42-faaf-4c5b-bfaa-5f8533d9f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:43.363880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3fa42-faaf-4c5b-bfaa-5f8533d9f291 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.363880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3fa42-faaf-4c5b-bfaa-5f8533d9f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.363880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3fa42-faaf-4c5b-bfaa-5f8533d9f291 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.364605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3fa42-faaf-4c5b-bfaa-5f8533d9f291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:43.366279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3fa42-faaf-4c5b-bfaa-5f8533d9f291 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:43.377021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1897/3752] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:20:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:20:43.381270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:43.391970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992dfa0-fe96-4be1-ad95-6e5fdfe2d1f9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:43.396980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:43.398077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.398349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.398624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] PATH_INFO: `/v3/projects/363ad00286c74e49ac9d96aa0edebda1/users/89c051b1622c403da5c3fead733e051c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.419200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] RBAC: Authorizing `identity:create_grant(project_id=363ad00286c74e49ac9d96aa0edebda1, user_id=89c051b1622c403da5c3fead733e051c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:43.419200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:43.502540 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1856/3753] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:20:43 2021] PUT /identity/v3/projects/363ad00286c74e49ac9d96aa0edebda1/users/89c051b1622c403da5c3fead733e051c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:20:43.507586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a763-cd6f-4034-9fb1-89e54cf75c59 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.507952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a763-cd6f-4034-9fb1-89e54cf75c59 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.508318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7a763-cd6f-4034-9fb1-89e54cf75c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.527320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-80c7a763-cd6f-4034-9fb1-89e54cf75c59 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:43.528592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-80c7a763-cd6f-4034-9fb1-89e54cf75c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:43.588643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1898/3754] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:43.598676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:43.600371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:43.666698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693981f-1b36-4cac-9950-d92518fcefee admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:43.670500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1300b-e223-4119-aad6-76967a206032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:43.671512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1300b-e223-4119-aad6-76967a206032 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.671893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1300b-e223-4119-aad6-76967a206032 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.672404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1300b-e223-4119-aad6-76967a206032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.682821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1300b-e223-4119-aad6-76967a206032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:43.684383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1300b-e223-4119-aad6-76967a206032 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:43.701243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1857/3755] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:20:43.718450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.719279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.719589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.753216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] MFA Rules not processed for user `55b39997f2f648ca8329c1d17120b62c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:43.754479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:43.832595 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1899/3756] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:43 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:43.843328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d782c-37cc-4503-b358-9c187120e19f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.843686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d782c-37cc-4503-b358-9c187120e19f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.843963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d782c-37cc-4503-b358-9c187120e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.860865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b15d782c-37cc-4503-b358-9c187120e19f None None] MFA Rules not processed for user `55b39997f2f648ca8329c1d17120b62c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:43.862085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b15d782c-37cc-4503-b358-9c187120e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:43.869274 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1858/3757] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:43 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:43.880902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:43.882340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:43.964025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93453-8423-4601-96ab-f265a4ee422b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:43.969849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf708ee6-accf-4e7b-9c21-34590fdeee76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:43.970565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf708ee6-accf-4e7b-9c21-34590fdeee76 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:43.970845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf708ee6-accf-4e7b-9c21-34590fdeee76 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:43.971120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf708ee6-accf-4e7b-9c21-34590fdeee76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:43.979299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf708ee6-accf-4e7b-9c21-34590fdeee76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:43.981012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf708ee6-accf-4e7b-9c21-34590fdeee76 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:43.989997 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1900/3758] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:43 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:20:45.062858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d51a-ae1c-4002-be13-e221da5d4693 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:45.063766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d51a-ae1c-4002-be13-e221da5d4693 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:45.064404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d51a-ae1c-4002-be13-e221da5d4693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:45.092674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-47f2d51a-ae1c-4002-be13-e221da5d4693 None None] MFA Rules not processed for user `89c051b1622c403da5c3fead733e051c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:45.093939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-47f2d51a-ae1c-4002-be13-e221da5d4693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:45.160996 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1859/3759] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:45 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:45.171777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cf9f2-11d6-4e85-a10a-6a7ed993522d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:45.174370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cf9f2-11d6-4e85-a10a-6a7ed993522d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:45.174370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cf9f2-11d6-4e85-a10a-6a7ed993522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:45.194217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-396cf9f2-11d6-4e85-a10a-6a7ed993522d None None] MFA Rules not processed for user `89c051b1622c403da5c3fead733e051c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:20:45.195462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-396cf9f2-11d6-4e85-a10a-6a7ed993522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:20:45.202904 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1901/3760] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:20:45 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:20:45.216233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d51a-ae1c-4002-be13-e221da5d4693 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:20:45.234291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d51a-ae1c-4002-be13-e221da5d4693 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:20:45.241093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:20:45.241852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:20:45.242332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:20:45.242831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:20:45.252569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:20:45.254634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:20:45.266348 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1860/3761] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:20:45 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:03.414696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aaa62-a647-4de6-97f8-e4773283c380 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:03.415124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aaa62-a647-4de6-97f8-e4773283c380 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:03.415245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12aaa62-a647-4de6-97f8-e4773283c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:03.434171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d12aaa62-a647-4de6-97f8-e4773283c380 None None] MFA Rules not processed for user `d2cc54d7a742403f896dd71d222895c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:03.435390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d12aaa62-a647-4de6-97f8-e4773283c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:03.496096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1902/3762] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:03 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:03.669862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:03.671656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:03.685963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e1b4b-493d-43bc-9d8e-674e3cff8cad service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:03.692138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:03.693089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:03.693409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:03.693753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] PATH_INFO: `/v3/users/55b39997f2f648ca8329c1d17120b62c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:03.698846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b39997f2f648ca8329c1d17120b62c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:03.699437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:03.932258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b39997f2f648ca8329c1d17120b62c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:03.938997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b39997f2f648ca8329c1d17120b62c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:03.953247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b39997f2f648ca8329c1d17120b62c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:03.953995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b39997f2f648ca8329c1d17120b62c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:03.954674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a412c7e5-14a5-4ee0-8482-299bc13ccbb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b39997f2f648ca8329c1d17120b62c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:04.026322 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1861/3763] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:21:03 2021] DELETE /identity/v3/users/55b39997f2f648ca8329c1d17120b62c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:04.402409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aaa62-a647-4de6-97f8-e4773283c380 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:04.424424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12aaa62-a647-4de6-97f8-e4773283c380 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:04.495654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:04.496649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:04.497345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:04.497931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] PATH_INFO: `/v3/projects/4e25bb59aaf6463b813f8a47e00b807e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:04.499322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e25bb59aaf6463b813f8a47e00b807e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:04.501270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:04.712849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e25bb59aaf6463b813f8a47e00b807e', 'request_id': 'req-efa62f38-7773-4a55-91de-3a464ef15c9d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:04.833182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e25bb59aaf6463b813f8a47e00b807e', 'request_id': 'req-efa62f38-7773-4a55-91de-3a464ef15c9d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:04.840240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e25bb59aaf6463b813f8a47e00b807e', 'request_id': 'req-efa62f38-7773-4a55-91de-3a464ef15c9d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:04.854009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] The token cache is being invalidate because project 4e25bb59aaf6463b813f8a47e00b807e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:21:04.854892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:04.855616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efa62f38-7773-4a55-91de-3a464ef15c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:04.858888 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1903/3764] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:21:04 2021] DELETE /identity/v3/projects/4e25bb59aaf6463b813f8a47e00b807e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:04.876445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3818b4-3f30-405a-adb7-0eecb2f86b0a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:04.877003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3818b4-3f30-405a-adb7-0eecb2f86b0a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:04.877098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3818b4-3f30-405a-adb7-0eecb2f86b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:04.901398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9a3818b4-3f30-405a-adb7-0eecb2f86b0a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:04.902660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9a3818b4-3f30-405a-adb7-0eecb2f86b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:04.983617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1862/3765] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:04.991278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc51dc-8af1-4eb5-8577-3c9a8a07d6bd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:04.991564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc51dc-8af1-4eb5-8577-3c9a8a07d6bd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:04.991836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc51dc-8af1-4eb5-8577-3c9a8a07d6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.020649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b6cc51dc-8af1-4eb5-8577-3c9a8a07d6bd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:05.022923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b6cc51dc-8af1-4eb5-8577-3c9a8a07d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:05.040735 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1904/3766] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:05.045694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3818b4-3f30-405a-adb7-0eecb2f86b0a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:05.059018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3818b4-3f30-405a-adb7-0eecb2f86b0a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:05.063801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:05.064635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.064750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.065213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.065867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:21:05.066184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:05.067780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:05.080483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1863/3767] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:21:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:21:05.084583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc51dc-8af1-4eb5-8577-3c9a8a07d6bd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:05.094401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc51dc-8af1-4eb5-8577-3c9a8a07d6bd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:05.099427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:05.100084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.100364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.100634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.101394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:05.103356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:05.200580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1905/3768] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:21:05 2021] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:21:05.204755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:05.215617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1bec-5a2d-4795-b3df-1428bd3c0705 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:05.313896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:05.314076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.314252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.314531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.315223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:05.317219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:05.440193 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1864/3769] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:21:05 2021] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:21:05.444076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:05.454660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeffdf7-e020-4863-b777-a575e27884d4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:05.459258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:05.460038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.460347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.460622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.461405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:05.463482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:05.474866 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1906/3770] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:05.479986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:05.490357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a4900-f03a-42c6-b7cb-4fa8fa6dc188 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:05.495059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c840027-5a95-48ad-9a33-723fa434afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:05.495703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840027-5a95-48ad-9a33-723fa434afef admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.495980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840027-5a95-48ad-9a33-723fa434afef admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.496252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840027-5a95-48ad-9a33-723fa434afef admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.497070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c840027-5a95-48ad-9a33-723fa434afef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:05.498645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c840027-5a95-48ad-9a33-723fa434afef admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:05.508613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1865/3771] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:21:05.512636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:05.524566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae7cf-d064-4032-9e9c-955f3a59feb4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:05.530650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:05.531583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.531865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.532142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] PATH_INFO: `/v3/projects/e372a1fc5a7e45c39e9ebee6a776c081/users/a1bd5080663a4db4bc90d3ef605f721f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.548069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e372a1fc5a7e45c39e9ebee6a776c081, user_id=a1bd5080663a4db4bc90d3ef605f721f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:05.550898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:05.699655 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1907/3772] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:21:05 2021] PUT /identity/v3/projects/e372a1fc5a7e45c39e9ebee6a776c081/users/a1bd5080663a4db4bc90d3ef605f721f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:21:05.704966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264318-c193-49d7-996b-b32e6cfae6a0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.705273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264318-c193-49d7-996b-b32e6cfae6a0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.705538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264318-c193-49d7-996b-b32e6cfae6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.723747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1c264318-c193-49d7-996b-b32e6cfae6a0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:05.725060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1c264318-c193-49d7-996b-b32e6cfae6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:05.787973 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1866/3773] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:05.795017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:05.797057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:05.861273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153da1-37a4-40df-83be-05211d51b688 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:05.865395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59b9ff-0755-4e67-b286-19cd76d30f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:05.866117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59b9ff-0755-4e67-b286-19cd76d30f4d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:05.866475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59b9ff-0755-4e67-b286-19cd76d30f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:05.866946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59b9ff-0755-4e67-b286-19cd76d30f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:05.886747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59b9ff-0755-4e67-b286-19cd76d30f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:05.888364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59b9ff-0755-4e67-b286-19cd76d30f4d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:05.898737 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1908/3774] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:07.574085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb561af-3641-477f-932c-467a239b01ab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:07.574986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb561af-3641-477f-932c-467a239b01ab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:07.575274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb561af-3641-477f-932c-467a239b01ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:07.612996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bdb561af-3641-477f-932c-467a239b01ab None None] MFA Rules not processed for user `a1bd5080663a4db4bc90d3ef605f721f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:07.615077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bdb561af-3641-477f-932c-467a239b01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:07.732997 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1867/3775] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:07.740148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:07.740839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:07.740994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:07.768295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] MFA Rules not processed for user `a1bd5080663a4db4bc90d3ef605f721f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:07.769896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:07.779905 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1909/3776] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:07.793731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb561af-3641-477f-932c-467a239b01ab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:07.795761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bdb561af-3641-477f-932c-467a239b01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:07.936924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb561af-3641-477f-932c-467a239b01ab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:07.964267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:07.965125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:07.965415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:07.965682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:07.979714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:07.981644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:08.003262 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1868/3777] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:07 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:10.800331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:10.801880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:10.816778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b605b-f849-4c35-aaed-7b5268dd4e96 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:10.821979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:10.823478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:10.823964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:10.824320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] PATH_INFO: `/v3/users/89c051b1622c403da5c3fead733e051c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:10.826258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c051b1622c403da5c3fead733e051c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:10.828186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:11.002285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c051b1622c403da5c3fead733e051c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.010042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c051b1622c403da5c3fead733e051c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.021965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c051b1622c403da5c3fead733e051c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.022746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c051b1622c403da5c3fead733e051c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.066883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0ef1b767-dc9e-4ec9-8b65-574a01050e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c051b1622c403da5c3fead733e051c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.073389 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1910/3778] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:21:10 2021] DELETE /identity/v3/users/89c051b1622c403da5c3fead733e051c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:11.373156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:11.406317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ba2bd-360c-422d-a1f3-46ede4917b59 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:11.509671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:11.509671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:11.509671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:11.509671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] PATH_INFO: `/v3/projects/363ad00286c74e49ac9d96aa0edebda1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:11.513014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] RBAC: Authorizing `identity:delete_project(project_id=363ad00286c74e49ac9d96aa0edebda1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:11.515323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:11.661908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363ad00286c74e49ac9d96aa0edebda1', 'request_id': 'req-4437d8db-0719-44d6-bdcd-4b9af555edac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.675575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363ad00286c74e49ac9d96aa0edebda1', 'request_id': 'req-4437d8db-0719-44d6-bdcd-4b9af555edac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.797817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363ad00286c74e49ac9d96aa0edebda1', 'request_id': 'req-4437d8db-0719-44d6-bdcd-4b9af555edac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.809038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] The token cache is being invalidate because project 363ad00286c74e49ac9d96aa0edebda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:21:11.809325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.809967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4437d8db-0719-44d6-bdcd-4b9af555edac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:11.811493 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1869/3779] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:21:11 2021] DELETE /identity/v3/projects/363ad00286c74e49ac9d96aa0edebda1 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:11.817306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17621c-4f7b-4080-ba30-21087b87a823 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:11.817749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17621c-4f7b-4080-ba30-21087b87a823 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:11.817842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17621c-4f7b-4080-ba30-21087b87a823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:11.838413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2d17621c-4f7b-4080-ba30-21087b87a823 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:11.839672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2d17621c-4f7b-4080-ba30-21087b87a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:11.901958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1911/3780] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:11.915069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de895707-c975-4c38-a4c0-eae167d7a303 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:11.915358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de895707-c975-4c38-a4c0-eae167d7a303 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:11.915793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de895707-c975-4c38-a4c0-eae167d7a303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:11.940548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-de895707-c975-4c38-a4c0-eae167d7a303 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:11.941810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-de895707-c975-4c38-a4c0-eae167d7a303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:11.956781 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1870/3781] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:11.966006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17621c-4f7b-4080-ba30-21087b87a823 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:11.989039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17621c-4f7b-4080-ba30-21087b87a823 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:11.995149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:11.995818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:11.996231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:11.996796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.000628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:21:12.000628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:12.000628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:12.015618 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1912/3782] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:21:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:21:12.019523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de895707-c975-4c38-a4c0-eae167d7a303 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:12.029623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de895707-c975-4c38-a4c0-eae167d7a303 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:12.034663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:12.035400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:12.035745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:12.036157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.036973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:12.039187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:12.175605 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1871/3783] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:21:12 2021] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:21:12.177236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:12.189185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a5e52-ffa3-4e00-a7ed-2535dfd3d822 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:12.258111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:12.258775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:12.259057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:12.259387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.260590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:12.262545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:12.371541 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1913/3784] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:21:12 2021] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:21:12.375558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:12.387243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9281c0-0b5f-4f6b-b69a-c78c864576fe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:12.392810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:12.396649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:12.396964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:12.397238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.397989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:12.399612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:12.411396 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1872/3785] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:12 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:21:12.417498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:12.430348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b66dc9-1c84-45f5-b783-e202ae069b42 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:12.434490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee00762-19a0-4125-8e59-bd3ef661ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:12.435149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee00762-19a0-4125-8e59-bd3ef661ae0d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:12.435431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee00762-19a0-4125-8e59-bd3ef661ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:12.435706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee00762-19a0-4125-8e59-bd3ef661ae0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.436431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee00762-19a0-4125-8e59-bd3ef661ae0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:12.438044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee00762-19a0-4125-8e59-bd3ef661ae0d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:12.448009 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1914/3786] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:12.452249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:12.462930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b1c0b-951b-4dd1-9a70-5a7a59658f9a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:12.467676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:12.468542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:12.468822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:12.469129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] PATH_INFO: `/v3/projects/c803957e88834105985d5ad65dbc78eb/users/fab9ff8b8b8e4e4ea6e7654d2a05363f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.484077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c803957e88834105985d5ad65dbc78eb, user_id=fab9ff8b8b8e4e4ea6e7654d2a05363f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:12.486746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:12.594079 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1873/3787] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:21:12 2021] PUT /identity/v3/projects/c803957e88834105985d5ad65dbc78eb/users/fab9ff8b8b8e4e4ea6e7654d2a05363f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:12.602729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c661-5232-4138-822a-fc03d4040a9a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:12.603522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c661-5232-4138-822a-fc03d4040a9a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:12.603819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c661-5232-4138-822a-fc03d4040a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.626780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-98b7c661-5232-4138-822a-fc03d4040a9a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:12.628052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-98b7c661-5232-4138-822a-fc03d4040a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:12.712114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1915/3788] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:12.734602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:12.736391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:12.820562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e542de-d15b-4a9c-85b0-058d46918823 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:12.831877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:12.832798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:12.833127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:12.833538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:12.876580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:12.879137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:12.897692 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1874/3789] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:14.986560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf6bb-9028-4ccb-ba1a-ff9d0f7a504c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:14.987164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf6bb-9028-4ccb-ba1a-ff9d0f7a504c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:14.987640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baf6bb-9028-4ccb-ba1a-ff9d0f7a504c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:15.020437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:15.021950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:15.043297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae07d78-1ff8-4926-b603-7d87153fb5d8 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:15.050607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:15.051271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:15.055241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:15.055633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] PATH_INFO: `/v3/users/1d23db9414d34853ae04f7f032694f12` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:15.058580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d23db9414d34853ae04f7f032694f12)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:15.061288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:15.071225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-92baf6bb-9028-4ccb-ba1a-ff9d0f7a504c None None] MFA Rules not processed for user `fab9ff8b8b8e4e4ea6e7654d2a05363f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:15.072682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-92baf6bb-9028-4ccb-ba1a-ff9d0f7a504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:15.189814 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1916/3790] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:14 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:15.412546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d23db9414d34853ae04f7f032694f12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:15.429643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d23db9414d34853ae04f7f032694f12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:15.455769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d23db9414d34853ae04f7f032694f12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:15.456527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d23db9414d34853ae04f7f032694f12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:15.457539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d23db9414d34853ae04f7f032694f12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:15.572753 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1875/3791] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:21:15 2021] DELETE /identity/v3/users/1d23db9414d34853ae04f7f032694f12 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:15.943085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf6bb-9028-4ccb-ba1a-ff9d0f7a504c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:15.968225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baf6bb-9028-4ccb-ba1a-ff9d0f7a504c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.047414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.049612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.050081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.050525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] PATH_INFO: `/v3/projects/38d7cbaffc1340f59e994569e8e33e1d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.052000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d7cbaffc1340f59e994569e8e33e1d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.054514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:16.171073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:16.173790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:16.179312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d7cbaffc1340f59e994569e8e33e1d', 'request_id': 'req-322b6ae4-7810-474a-9516-ed60fd05bbbe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.188302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044244ca-e631-4302-8af4-5442b2ce0d4f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.271004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.271379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.271661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.271960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] PATH_INFO: `/v3/users/fab9ff8b8b8e4e4ea6e7654d2a05363f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.273221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab9ff8b8b8e4e4ea6e7654d2a05363f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.275788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:16.294282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d7cbaffc1340f59e994569e8e33e1d', 'request_id': 'req-322b6ae4-7810-474a-9516-ed60fd05bbbe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.304289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d7cbaffc1340f59e994569e8e33e1d', 'request_id': 'req-322b6ae4-7810-474a-9516-ed60fd05bbbe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.318565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] The token cache is being invalidate because project 38d7cbaffc1340f59e994569e8e33e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:21:16.319158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.322314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-322b6ae4-7810-474a-9516-ed60fd05bbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.322314 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1917/3792] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:21:15 2021] DELETE /identity/v3/projects/38d7cbaffc1340f59e994569e8e33e1d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:21:16.328577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1d86-287a-4fb6-8fdd-c7700b65cb31 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.328855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1d86-287a-4fb6-8fdd-c7700b65cb31 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.329171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f1d86-287a-4fb6-8fdd-c7700b65cb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.352051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8e8f1d86-287a-4fb6-8fdd-c7700b65cb31 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:16.353340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8e8f1d86-287a-4fb6-8fdd-c7700b65cb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:16.365145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1918/3793] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:16.373860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074b2e-57a1-4a05-8af6-9177fd5c87dd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.374184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074b2e-57a1-4a05-8af6-9177fd5c87dd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.374479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41074b2e-57a1-4a05-8af6-9177fd5c87dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.393786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-41074b2e-57a1-4a05-8af6-9177fd5c87dd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:16.395101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-41074b2e-57a1-4a05-8af6-9177fd5c87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:16.409471 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1919/3794] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:16.414379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074b2e-57a1-4a05-8af6-9177fd5c87dd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:16.423908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41074b2e-57a1-4a05-8af6-9177fd5c87dd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.428917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.429574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.431590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.431590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.431590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:21:16.431873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.433485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:16.445501 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1920/3795] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:21:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:21:16.450485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:16.460044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fbd13-54a8-47c4-80dc-6bc8c1cbb59b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.465610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.466253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.466551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.466810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.467497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.469578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:16.514497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab9ff8b8b8e4e4ea6e7654d2a05363f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.521413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab9ff8b8b8e4e4ea6e7654d2a05363f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.532830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab9ff8b8b8e4e4ea6e7654d2a05363f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.533679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab9ff8b8b8e4e4ea6e7654d2a05363f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.534453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab9ff8b8b8e4e4ea6e7654d2a05363f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:16.572535 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1921/3796] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:21:16 2021] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:21:16.576524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:16.578186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:16.633108 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1876/3797] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:21:16 2021] DELETE /identity/v3/users/fab9ff8b8b8e4e4ea6e7654d2a05363f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:21:16.644064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b6305-c392-4a80-b14d-655be3c8d28d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.709434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.711223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.711701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.712146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.713066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.715313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:16.807652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1922/3798] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:21:16 2021] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:21:16.811539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:16.828118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444560f9-dcf7-4a89-9762-51b69367c3df admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.834756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.835681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.836436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.836942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.837912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.841606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:16.860457 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1877/3799] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:16 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:16.860663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:16.875691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e21c17-f51d-4be0-8dc0-d68a41283aca admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.886984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134b01e-2b67-4f15-a8ed-d1c520ea363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.887694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b01e-2b67-4f15-a8ed-d1c520ea363d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.887972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b01e-2b67-4f15-a8ed-d1c520ea363d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.888238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b01e-2b67-4f15-a8ed-d1c520ea363d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.889108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b01e-2b67-4f15-a8ed-d1c520ea363d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.891699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b01e-2b67-4f15-a8ed-d1c520ea363d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:16.914598 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1923/3800] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:16 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:21:16.915912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:16.926610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d96b-0b07-4d68-a272-5b70381981ef admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:16.935986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:16.937081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:16.937472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:16.937857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] PATH_INFO: `/v3/projects/66319858228140b3841ef6c7c8cd5c14/users/257eeccacdc24f00a418cbb27204cf4f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:16.968264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66319858228140b3841ef6c7c8cd5c14, user_id=257eeccacdc24f00a418cbb27204cf4f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:16.973901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:17.183822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:17.184358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:17.184519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:17.191068 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1878/3801] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:21:16 2021] PUT /identity/v3/projects/66319858228140b3841ef6c7c8cd5c14/users/257eeccacdc24f00a418cbb27204cf4f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:17.205570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:17.207491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:17.208999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:17.209575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:17.283737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e647c-ca8d-43eb-af31-0b57d14c1088 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:17.289356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:17.290250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:17.291141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:17.291414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] PATH_INFO: `/v3/projects/c803957e88834105985d5ad65dbc78eb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:17.292996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c803957e88834105985d5ad65dbc78eb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:17.295316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:17.307034 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1924/3802] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:17.341125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:17.342662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:17.411447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c803957e88834105985d5ad65dbc78eb', 'request_id': 'req-b998e906-e242-4d86-bb40-769cec94ee8b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:17.423446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c803957e88834105985d5ad65dbc78eb', 'request_id': 'req-b998e906-e242-4d86-bb40-769cec94ee8b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:17.441655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f5e6f-a448-48ed-a8db-6a28d74afb8a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:17.504994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc9d15-425b-4104-9f89-80d59c4f3d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:17.506153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc9d15-425b-4104-9f89-80d59c4f3d96 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:17.506415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc9d15-425b-4104-9f89-80d59c4f3d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:17.506866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc9d15-425b-4104-9f89-80d59c4f3d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:17.507265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c803957e88834105985d5ad65dbc78eb', 'request_id': 'req-b998e906-e242-4d86-bb40-769cec94ee8b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:17.522913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] The token cache is being invalidate because project c803957e88834105985d5ad65dbc78eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:21:17.523292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:17.524333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b998e906-e242-4d86-bb40-769cec94ee8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:17.533097 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1879/3803] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:21:17 2021] DELETE /identity/v3/projects/c803957e88834105985d5ad65dbc78eb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:21:17.536357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba948d-8aa5-4293-bd92-975b7cf255a3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:17.536749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba948d-8aa5-4293-bd92-975b7cf255a3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:17.537138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba948d-8aa5-4293-bd92-975b7cf255a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:17.557768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b1ba948d-8aa5-4293-bd92-975b7cf255a3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:17.559016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1ba948d-8aa5-4293-bd92-975b7cf255a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:17.632038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc9d15-425b-4104-9f89-80d59c4f3d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:17.637111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc9d15-425b-4104-9f89-80d59c4f3d96 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:17.682702 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1925/3804] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:21:17.692415 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1880/3805] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:17.692598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841596d-ca6f-4660-aaa5-56d794912e86 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:17.692766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841596d-ca6f-4660-aaa5-56d794912e86 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:17.693168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841596d-ca6f-4660-aaa5-56d794912e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:17.729604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f841596d-ca6f-4660-aaa5-56d794912e86 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:17.731950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f841596d-ca6f-4660-aaa5-56d794912e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:17.754614 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1926/3806] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:17.757989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba948d-8aa5-4293-bd92-975b7cf255a3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:17.773472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba948d-8aa5-4293-bd92-975b7cf255a3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:17.792765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:17.792765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:17.792765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:17.792765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:17.793283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:21:17.793283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:17.793283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:17.812220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841596d-ca6f-4660-aaa5-56d794912e86 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:17.812775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1881/3807] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:21:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:21:17.824678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841596d-ca6f-4660-aaa5-56d794912e86 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:17.831857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:17.833647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:17.834175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:17.834651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:17.835682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:17.840493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:17.980938 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1927/3808] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:21:17 2021] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:21:17.982387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:17.999046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dec90-7a4b-4373-aa83-1603057ae074 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:18.123543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:18.127002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:18.127002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:18.127002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:18.127002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:18.128205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:18.258225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1882/3809] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:21:17 2021] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:21:18.263721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:18.274665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a39009-7ab9-4140-a7dd-f3a8ab667ff5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:18.280690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:18.283619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:18.283619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:18.283619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:18.283619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:18.288386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:18.301971 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1928/3810] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:18 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:18.308072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:18.323456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44442b36-e778-4427-922d-a8d9bb885be1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:18.331765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e665614-1adf-49d4-a1d7-70f79078e561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:18.333178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e665614-1adf-49d4-a1d7-70f79078e561 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:18.333907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e665614-1adf-49d4-a1d7-70f79078e561 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:18.334823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e665614-1adf-49d4-a1d7-70f79078e561 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:18.336319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e665614-1adf-49d4-a1d7-70f79078e561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:18.339793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e665614-1adf-49d4-a1d7-70f79078e561 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:18.360772 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1883/3811] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:18 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:18.364923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:18.376337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc90dd9-12c8-45f2-b426-f8bc2eb1e701 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:18.381414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:18.382323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:18.382603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:18.382878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] PATH_INFO: `/v3/projects/8dcf2517f61849cb9650682caf0c5712/users/d7df5c79b8ea4c6ea7cf84b381b29765/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:18.405359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcf2517f61849cb9650682caf0c5712, user_id=d7df5c79b8ea4c6ea7cf84b381b29765, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:18.405922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:18.518265 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1929/3812] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:21:18 2021] PUT /identity/v3/projects/8dcf2517f61849cb9650682caf0c5712/users/d7df5c79b8ea4c6ea7cf84b381b29765/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:18.522774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334dd3-5032-4c6b-ab7a-82eab68f009e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:18.522974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334dd3-5032-4c6b-ab7a-82eab68f009e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:18.523432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334dd3-5032-4c6b-ab7a-82eab68f009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:18.550652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-88334dd3-5032-4c6b-ab7a-82eab68f009e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:18.552740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-88334dd3-5032-4c6b-ab7a-82eab68f009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:18.626187 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1884/3813] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:18.637578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:18.641609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:18.702497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706f543-305e-4b81-810e-3930358feec1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:18.707124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0811e-f30b-4b27-9a03-9da884c71b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:18.716520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0811e-f30b-4b27-9a03-9da884c71b66 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:18.716520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0811e-f30b-4b27-9a03-9da884c71b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:18.716520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0811e-f30b-4b27-9a03-9da884c71b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:18.719425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0811e-f30b-4b27-9a03-9da884c71b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:18.720860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0811e-f30b-4b27-9a03-9da884c71b66 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:18.731766 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1930/3814] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:20.327604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:20.328450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:20.328865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:20.332805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf58cb-e11e-436f-aa7c-de7e03f0d7e6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:20.333628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf58cb-e11e-436f-aa7c-de7e03f0d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:20.334081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf58cb-e11e-436f-aa7c-de7e03f0d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:20.363870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-faaf58cb-e11e-436f-aa7c-de7e03f0d7e6 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:20.365398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-faaf58cb-e11e-436f-aa7c-de7e03f0d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:20.367678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] MFA Rules not processed for user `d7df5c79b8ea4c6ea7cf84b381b29765`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:20.369275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:20.439098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1931/3815] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:20.451090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b5831-5c66-4085-9a0f-51d0109862bc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:20.451751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b5831-5c66-4085-9a0f-51d0109862bc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:20.452208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b5831-5c66-4085-9a0f-51d0109862bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:20.476539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-096b5831-5c66-4085-9a0f-51d0109862bc None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:20.478596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-096b5831-5c66-4085-9a0f-51d0109862bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:20.486486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1932/3816] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:20 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:20.497552 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1885/3817] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:20 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:20.498030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437f56-10a2-41be-8602-e89d89c8eee6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:20.498322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437f56-10a2-41be-8602-e89d89c8eee6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:20.498670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25437f56-10a2-41be-8602-e89d89c8eee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:20.522254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-25437f56-10a2-41be-8602-e89d89c8eee6 None None] MFA Rules not processed for user `d7df5c79b8ea4c6ea7cf84b381b29765`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:20.534874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-25437f56-10a2-41be-8602-e89d89c8eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:20.546558 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1933/3818] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:20 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:20.663777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:20.665495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:20.742180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f32ff5-50ac-4af0-b05d-6ca1a4d2d968 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:20.747709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:20.748343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:20.748623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:20.748920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:20.756932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:20.761622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:20.768333 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1886/3819] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:20 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:21.662336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437f56-10a2-41be-8602-e89d89c8eee6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:21.682599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25437f56-10a2-41be-8602-e89d89c8eee6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:21.688457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:21.689130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:21.689410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:21.689678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:21.698356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:21.700059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:21.709153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1934/3820] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:21 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:30.015297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:30.017730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:30.040953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac6ee-687c-4783-bdf0-33616e8b987b service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:30.046785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:30.047989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:30.048420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:30.048835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] PATH_INFO: `/v3/users/a1bd5080663a4db4bc90d3ef605f721f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:30.053867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1bd5080663a4db4bc90d3ef605f721f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:30.056552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:30.281380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1bd5080663a4db4bc90d3ef605f721f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:30.289028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1bd5080663a4db4bc90d3ef605f721f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:30.302928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1bd5080663a4db4bc90d3ef605f721f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:30.303744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1bd5080663a4db4bc90d3ef605f721f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:30.304465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8bd3da6-db2f-4016-8d13-220fd8ef4706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1bd5080663a4db4bc90d3ef605f721f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:30.411482 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1887/3821] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:21:30 2021] DELETE /identity/v3/users/a1bd5080663a4db4bc90d3ef605f721f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:30.696625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:30.716918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eff57c-d8a3-4d51-aa3c-458add7a3559 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:30.786722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:30.787594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:30.787875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:30.788151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] PATH_INFO: `/v3/projects/e372a1fc5a7e45c39e9ebee6a776c081` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:30.789437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e372a1fc5a7e45c39e9ebee6a776c081)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:30.791950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:30.935229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e372a1fc5a7e45c39e9ebee6a776c081', 'request_id': 'req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:31.020729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e372a1fc5a7e45c39e9ebee6a776c081', 'request_id': 'req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:31.028868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e372a1fc5a7e45c39e9ebee6a776c081', 'request_id': 'req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:31.040931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] The token cache is being invalidate because project e372a1fc5a7e45c39e9ebee6a776c081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:21:31.041408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:31.042422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8157f0bb-85b0-4e8a-ad50-7e9453b036bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:31.044735 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1935/3822] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:21:30 2021] DELETE /identity/v3/projects/e372a1fc5a7e45c39e9ebee6a776c081 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:31.055924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb56f4-4607-40ff-b1c0-ad0c92adaa61 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.056907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb56f4-4607-40ff-b1c0-ad0c92adaa61 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.060367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb56f4-4607-40ff-b1c0-ad0c92adaa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.097550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-24bb56f4-4607-40ff-b1c0-ad0c92adaa61 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:31.101086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-24bb56f4-4607-40ff-b1c0-ad0c92adaa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:31.173003 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1888/3823] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:31.182616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c605961-120c-438e-8737-b5371df18e57 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.183462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c605961-120c-438e-8737-b5371df18e57 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.186634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c605961-120c-438e-8737-b5371df18e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.219887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4c605961-120c-438e-8737-b5371df18e57 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:31.222326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4c605961-120c-438e-8737-b5371df18e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:31.239621 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1936/3824] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:31.240439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb56f4-4607-40ff-b1c0-ad0c92adaa61 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:31.254391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb56f4-4607-40ff-b1c0-ad0c92adaa61 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:31.259925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:31.260601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.260907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.261215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.262207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:21:31.262519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:31.264382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:31.277609 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1889/3825] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:21:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:21:31.282773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c605961-120c-438e-8737-b5371df18e57 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:31.302015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c605961-120c-438e-8737-b5371df18e57 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:31.311970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:31.313084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.313464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.314011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.314894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:31.316799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:31.423566 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1937/3826] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:21:31 2021] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:21:31.424794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:31.437147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474086a1-90c9-4cf9-b853-bb7a8e4de6b5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:31.547543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:31.548967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.549738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.550226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.551074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:31.553290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:31.660483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1890/3827] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:21:31 2021] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:21:31.664539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:31.676692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c696c-2ec7-45c9-b232-92d7b4956002 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:31.681941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:31.682681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.682964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.683234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.683985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:31.685600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:31.698626 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1938/3828] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:31 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:31.702364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:31.713973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45468b-b21d-44ea-952a-1cf946af1b67 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:31.719730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b0ffb-087d-43a3-ab52-398f2da404e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:31.720534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b0ffb-087d-43a3-ab52-398f2da404e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.720915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b0ffb-087d-43a3-ab52-398f2da404e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.721393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b0ffb-087d-43a3-ab52-398f2da404e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.722132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b0ffb-087d-43a3-ab52-398f2da404e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:31.724068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b0ffb-087d-43a3-ab52-398f2da404e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:31.739115 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1891/3829] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:31 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:31.742387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:31.754195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cb536-6a70-4e67-917d-075b1bd9a4e7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:31.758979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:31.759864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.760139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.760407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] PATH_INFO: `/v3/projects/af127d2683f84f0682595fe8297db6b1/users/97abfab761214f10bb25fbf8ba958822/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.777469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af127d2683f84f0682595fe8297db6b1, user_id=97abfab761214f10bb25fbf8ba958822, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:31.780369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:31.884767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1939/3830] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:21:31 2021] PUT /identity/v3/projects/af127d2683f84f0682595fe8297db6b1/users/97abfab761214f10bb25fbf8ba958822/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:31.889919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2ac5-8ed5-477c-b588-58ad3890be45 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:31.890230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2ac5-8ed5-477c-b588-58ad3890be45 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:31.890504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2ac5-8ed5-477c-b588-58ad3890be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:31.908769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f68a2ac5-8ed5-477c-b588-58ad3890be45 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:31.910001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f68a2ac5-8ed5-477c-b588-58ad3890be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:31.968232 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1892/3831] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:31.978244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:31.979986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:32.038695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b414d73-c2f0-444e-b0f7-d39eced2f192 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:32.042379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2920-23d8-4aa0-a16e-73a26e2e0650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:32.043023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2920-23d8-4aa0-a16e-73a26e2e0650 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:32.043306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2920-23d8-4aa0-a16e-73a26e2e0650 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:32.043577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2920-23d8-4aa0-a16e-73a26e2e0650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:32.053172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2920-23d8-4aa0-a16e-73a26e2e0650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:32.054600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f2920-23d8-4aa0-a16e-73a26e2e0650 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:32.063948 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1940/3832] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:36.593031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7503fd-06a4-40a5-a867-f36266f851f9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:36.593614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7503fd-06a4-40a5-a867-f36266f851f9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:36.594223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7503fd-06a4-40a5-a867-f36266f851f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:36.622388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6e7503fd-06a4-40a5-a867-f36266f851f9 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:36.623700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6e7503fd-06a4-40a5-a867-f36266f851f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:36.709246 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1893/3833] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:36 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:40.123101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:40.123556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:40.123724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:40.163223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] MFA Rules not processed for user `97abfab761214f10bb25fbf8ba958822`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:40.164821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:40.255066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1941/3834] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:40.264772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:40.265301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:40.266174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:40.290064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] MFA Rules not processed for user `97abfab761214f10bb25fbf8ba958822`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:40.291681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:40.320357 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1894/3835] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:40.324755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:40.324755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:40.431282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24492-e5ca-4dff-90eb-eb16f4f74667 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:40.437601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:40.438259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:40.438543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:40.438819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:40.448666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:40.450466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:40.460886 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1942/3836] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:40 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:21:40.776355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:40.778279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:40.798758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480d871-f872-47ce-94b6-928ff9f81f00 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:40.805854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5019962-fe60-4fbf-872c-a62ef624bc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:40.806646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019962-fe60-4fbf-872c-a62ef624bc4f service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:40.807106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019962-fe60-4fbf-872c-a62ef624bc4f service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:40.807672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5019962-fe60-4fbf-872c-a62ef624bc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:40.810373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5019962-fe60-4fbf-872c-a62ef624bc4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:40.962062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5019962-fe60-4fbf-872c-a62ef624bc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:40.962062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5019962-fe60-4fbf-872c-a62ef624bc4f service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:40.967133 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1895/3837] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:40 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:41.604063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:41.605178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:41.636653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3935e-1481-4245-8107-a0a4c05c066d service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:41.662871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:41.665605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:41.665902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:41.666182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] PATH_INFO: `/v3/users/7ec911a0e281430f98062b734b3d4de3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:41.670123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec911a0e281430f98062b734b3d4de3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:41.676472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:41.828961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ad5a-84c5-4d91-8437-fd6cef919900 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:41.829546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ad5a-84c5-4d91-8437-fd6cef919900 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:41.829775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ad5a-84c5-4d91-8437-fd6cef919900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:41.849395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4945ad5a-84c5-4d91-8437-fd6cef919900 None None] MFA Rules not processed for user `97abfab761214f10bb25fbf8ba958822`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:41.851297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4945ad5a-84c5-4d91-8437-fd6cef919900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:41.860983 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1896/3838] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:41 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:42.046331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec911a0e281430f98062b734b3d4de3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:42.057047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec911a0e281430f98062b734b3d4de3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:42.073369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec911a0e281430f98062b734b3d4de3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:42.074250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec911a0e281430f98062b734b3d4de3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:42.182115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cb44fedd-2ef8-458b-8148-2cf2ffcb6e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec911a0e281430f98062b734b3d4de3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:42.194648 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1943/3839] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:21:41 2021] DELETE /identity/v3/users/7ec911a0e281430f98062b734b3d4de3 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:42.577850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945ad5a-84c5-4d91-8437-fd6cef919900 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:42.605168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945ad5a-84c5-4d91-8437-fd6cef919900 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:42.740295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:42.741408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:42.741706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:42.742037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] PATH_INFO: `/v3/projects/bfd1b67368c34701bcdc20105e48ad41` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:42.744026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd1b67368c34701bcdc20105e48ad41)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:42.746199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:42.891168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd1b67368c34701bcdc20105e48ad41', 'request_id': 'req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:42.899391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd1b67368c34701bcdc20105e48ad41', 'request_id': 'req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:43.020323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd1b67368c34701bcdc20105e48ad41', 'request_id': 'req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:43.034442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] The token cache is being invalidate because project bfd1b67368c34701bcdc20105e48ad41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:21:43.034730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:43.035634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27d3fab2-10d0-49a6-aa3d-b62ede00ea96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:21:43.048649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024a92-1d6d-4455-822d-76dc0c752366 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:43.052697 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1897/3840] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:21:42 2021] DELETE /identity/v3/projects/bfd1b67368c34701bcdc20105e48ad41 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:43.052839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024a92-1d6d-4455-822d-76dc0c752366 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:43.052839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e024a92-1d6d-4455-822d-76dc0c752366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:43.072360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1e024a92-1d6d-4455-822d-76dc0c752366 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:43.075621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1e024a92-1d6d-4455-822d-76dc0c752366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:43.172392 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1944/3841] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:43.181132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837b4a-76e9-4472-ae86-45e0a6e6b02e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:43.181426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837b4a-76e9-4472-ae86-45e0a6e6b02e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:43.181828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd837b4a-76e9-4472-ae86-45e0a6e6b02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:43.221088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cd837b4a-76e9-4472-ae86-45e0a6e6b02e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:43.227013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cd837b4a-76e9-4472-ae86-45e0a6e6b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:43.250555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e024a92-1d6d-4455-822d-76dc0c752366 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:43.250659 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1898/3842] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:43.278037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e024a92-1d6d-4455-822d-76dc0c752366 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:43.296403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:43.297408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:43.298399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:43.298836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:43.299839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:21:43.300585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:43.303365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:43.370767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1945/3843] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:21:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:21:43.386661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd837b4a-76e9-4472-ae86-45e0a6e6b02e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:43.399774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd837b4a-76e9-4472-ae86-45e0a6e6b02e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:43.415154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:43.415154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:43.415154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:43.415154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:43.415603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:43.415603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:43.609214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:43.614843 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1899/3844] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:21:43 2021] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:21:43.622393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d705dc-367c-493e-9037-b7e6a6b8489b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:43.828680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:43.829633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:43.830074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:43.830506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:43.831420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:43.836792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:43.925453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:43.926511 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1946/3845] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:21:43 2021] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:21:43.967611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010e970-0a65-4117-8b54-d2cf3aabf732 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:43.985228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:43.985923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:43.986200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:43.986877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:43.987622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:43.989252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:44.015657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:44.023514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1900/3846] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:43 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:44.038173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba0397-d959-4d1d-bc01-5a43d44b7e36 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:44.046869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61045654-c590-4697-af75-7d6176e6cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:44.048209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045654-c590-4697-af75-7d6176e6cd89 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:44.051329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045654-c590-4697-af75-7d6176e6cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:44.051329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045654-c590-4697-af75-7d6176e6cd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:44.051329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61045654-c590-4697-af75-7d6176e6cd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:44.054398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61045654-c590-4697-af75-7d6176e6cd89 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:44.077546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:44.077855 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1947/3847] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:21:44 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:21:44.093788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d5fae-8ffc-4fef-b5ec-9d63b1d256c8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:44.106841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3efbf-c348-410b-a9bd-e604b1b8b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:44.107917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3efbf-c348-410b-a9bd-e604b1b8b21a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:44.108193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3efbf-c348-410b-a9bd-e604b1b8b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:44.108728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3efbf-c348-410b-a9bd-e604b1b8b21a admin admin] PATH_INFO: `/v3/projects/8448b25167bd4f0facbde22bc77a818d/users/4f35acdc849b446f8564ce2666f2e17c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:44.132462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3efbf-c348-410b-a9bd-e604b1b8b21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8448b25167bd4f0facbde22bc77a818d, user_id=4f35acdc849b446f8564ce2666f2e17c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:44.135400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3efbf-c348-410b-a9bd-e604b1b8b21a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:44.217011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1901/3848] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:21:44 2021] PUT /identity/v3/projects/8448b25167bd4f0facbde22bc77a818d/users/4f35acdc849b446f8564ce2666f2e17c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:21:44.228273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:44.228665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:44.229092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:44.265682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] MFA Rules not processed for user `4f35acdc849b446f8564ce2666f2e17c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:44.266895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:44.464943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1948/3849] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:44 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:21:44.471629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f13cc-03ee-4735-bb40-11c41255fa5f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:44.473009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f13cc-03ee-4735-bb40-11c41255fa5f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:44.473431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f13cc-03ee-4735-bb40-11c41255fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:44.494124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8f8f13cc-03ee-4735-bb40-11c41255fa5f None None] MFA Rules not processed for user `4f35acdc849b446f8564ce2666f2e17c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:44.495603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8f8f13cc-03ee-4735-bb40-11c41255fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:44.504430 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1902/3850] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:44 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:44.516135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:21:44.518125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:44.629228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b650a71-e7dc-456c-9369-7ff5b3261e6f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:21:44.636625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecd7b5-5a04-4fc0-ac63-f556c133435f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:21:44.637011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecd7b5-5a04-4fc0-ac63-f556c133435f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:44.637434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecd7b5-5a04-4fc0-ac63-f556c133435f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:44.637798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecd7b5-5a04-4fc0-ac63-f556c133435f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:44.647652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecd7b5-5a04-4fc0-ac63-f556c133435f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:21:44.650610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecd7b5-5a04-4fc0-ac63-f556c133435f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:21:44.661288 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1949/3851] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:21:44 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:21:45.401181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0a7c-19ec-4b2b-b89e-bbeb5ad79f99 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:45.401687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0a7c-19ec-4b2b-b89e-bbeb5ad79f99 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:45.401788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0a7c-19ec-4b2b-b89e-bbeb5ad79f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:45.429133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a28d0a7c-19ec-4b2b-b89e-bbeb5ad79f99 None None] MFA Rules not processed for user `4f35acdc849b446f8564ce2666f2e17c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:45.431434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a28d0a7c-19ec-4b2b-b89e-bbeb5ad79f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:45.440958 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1903/3852] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:45 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:21:48.072978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:21:48.073462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:21:48.073554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:21:48.090860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] MFA Rules not processed for user `d7df5c79b8ea4c6ea7cf84b381b29765`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:21:48.091977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:21:48.154844 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1950/3853] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:21:48 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:01.962260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5312de-7ed5-47c8-ab79-233540aa09df None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:01.963094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5312de-7ed5-47c8-ab79-233540aa09df None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:01.963551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5312de-7ed5-47c8-ab79-233540aa09df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:01.982118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cc5312de-7ed5-47c8-ab79-233540aa09df None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:01.986821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc5312de-7ed5-47c8-ab79-233540aa09df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:02.042030 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1904/3854] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:01 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:04.774385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:04.775800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:04.838586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285244-e64e-4ef1-93d1-1ff4c1fd2973 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:04.842584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:04.843233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:04.843511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:04.843789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:04.845694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:04.861343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:04.862761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:04.874510 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1951/3855] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:05.663359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44e345-51d9-4395-b800-29beb6f286d7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:05.663898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44e345-51d9-4395-b800-29beb6f286d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:05.663898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44e345-51d9-4395-b800-29beb6f286d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:05.681419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1a44e345-51d9-4395-b800-29beb6f286d7 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:05.682607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1a44e345-51d9-4395-b800-29beb6f286d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:05.689531 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1905/3856] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:08.060313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:08.069788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20b594-30e9-450b-add5-27b3a36a2763 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:08.073581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a689eb-9334-4c97-8045-1400207d41eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:08.074238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a689eb-9334-4c97-8045-1400207d41eb service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:08.074519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a689eb-9334-4c97-8045-1400207d41eb service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:08.074877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a689eb-9334-4c97-8045-1400207d41eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:08.076665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8a689eb-9334-4c97-8045-1400207d41eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:08.090881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a689eb-9334-4c97-8045-1400207d41eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:08.092336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a689eb-9334-4c97-8045-1400207d41eb service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:08.104768 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1952/3857] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:08.962967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcece06-c936-4002-b649-8f808c0a7cc2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:08.963471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcece06-c936-4002-b649-8f808c0a7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:08.963566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcece06-c936-4002-b649-8f808c0a7cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:08.981732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8bcece06-c936-4002-b649-8f808c0a7cc2 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:08.988497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8bcece06-c936-4002-b649-8f808c0a7cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:08.989969 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1906/3858] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:08 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:09.104088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:09.104563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:09.104666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:09.122920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] MFA Rules not processed for user `d7df5c79b8ea4c6ea7cf84b381b29765`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:09.124187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:09.131390 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1953/3859] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:09.505253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e054-cb79-40fd-84ea-e05cbea8cc23 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:09.505540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e054-cb79-40fd-84ea-e05cbea8cc23 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:09.505816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e054-cb79-40fd-84ea-e05cbea8cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:09.524431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8de0e054-cb79-40fd-84ea-e05cbea8cc23 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:09.528546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8de0e054-cb79-40fd-84ea-e05cbea8cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:09.533749 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1907/3860] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:09.910307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:09.911985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:09.990928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9b729-0208-4674-b3dc-991d0a077cd5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:10.000263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06eadd5-22ea-43fe-b0cb-f3ae99031dad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:10.001189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eadd5-22ea-43fe-b0cb-f3ae99031dad service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:10.001468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eadd5-22ea-43fe-b0cb-f3ae99031dad service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:10.001747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06eadd5-22ea-43fe-b0cb-f3ae99031dad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:10.003501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c06eadd5-22ea-43fe-b0cb-f3ae99031dad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:10.016234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eadd5-22ea-43fe-b0cb-f3ae99031dad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:10.017907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06eadd5-22ea-43fe-b0cb-f3ae99031dad service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:10.028438 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1954/3861] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:10.117981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01118-fff7-4bfd-a9ce-3539cf11bdc0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:10.118493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01118-fff7-4bfd-a9ce-3539cf11bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:10.119299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01118-fff7-4bfd-a9ce-3539cf11bdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:10.138331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0aa01118-fff7-4bfd-a9ce-3539cf11bdc0 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:10.142166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0aa01118-fff7-4bfd-a9ce-3539cf11bdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:10.150398 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1908/3862] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:10.514700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e268-cabf-4e9f-b6c1-1195d23bc5f3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:10.515221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e268-cabf-4e9f-b6c1-1195d23bc5f3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:10.515344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447e268-cabf-4e9f-b6c1-1195d23bc5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:10.532990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0447e268-cabf-4e9f-b6c1-1195d23bc5f3 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:10.534225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0447e268-cabf-4e9f-b6c1-1195d23bc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:10.541949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1955/3863] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:10.927875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5af7c-9ab5-493c-9b6a-8e124d82e353 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:10.928159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5af7c-9ab5-493c-9b6a-8e124d82e353 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:10.928433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5af7c-9ab5-493c-9b6a-8e124d82e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:10.948999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c6d5af7c-9ab5-493c-9b6a-8e124d82e353 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:10.950277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c6d5af7c-9ab5-493c-9b6a-8e124d82e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:10.957320 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1909/3864] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:11.418521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c781ff-7e2c-4770-b73d-d8289a14bfe7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:11.418810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c781ff-7e2c-4770-b73d-d8289a14bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:11.424826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c781ff-7e2c-4770-b73d-d8289a14bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:11.437035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-68c781ff-7e2c-4770-b73d-d8289a14bfe7 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:11.438228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-68c781ff-7e2c-4770-b73d-d8289a14bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:11.445543 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1956/3865] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:11 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:11.807519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72349-ea90-412d-8886-db956848838f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:11.808108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72349-ea90-412d-8886-db956848838f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:11.808108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72349-ea90-412d-8886-db956848838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:11.825181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-83f72349-ea90-412d-8886-db956848838f None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:11.826282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-83f72349-ea90-412d-8886-db956848838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:11.833349 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1910/3866] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:11 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:12.842706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604461-c722-4cef-b896-9f31f0cfb6cf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:12.843310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604461-c722-4cef-b896-9f31f0cfb6cf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:12.843310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30604461-c722-4cef-b896-9f31f0cfb6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:12.861677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-30604461-c722-4cef-b896-9f31f0cfb6cf None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:12.862805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-30604461-c722-4cef-b896-9f31f0cfb6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:12.871036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1957/3867] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:12 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:17.106096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:17.106618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:17.106936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:17.132405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:17.132405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:17.140206 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1911/3868] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:17 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:17.607239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437a39-5e2b-479b-a14f-39528c0beea6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:17.613051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437a39-5e2b-479b-a14f-39528c0beea6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:17.613051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437a39-5e2b-479b-a14f-39528c0beea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:17.625451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-91437a39-5e2b-479b-a14f-39528c0beea6 None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:17.626633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91437a39-5e2b-479b-a14f-39528c0beea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:17.633647 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1958/3869] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:17 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:24.826554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:24.828091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:24.840276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93731c6a-7400-470a-b0f7-d40af337ace1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:24.844097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:24.844828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:24.845220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:24.845563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:24.847415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:24.920050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:24.921748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:24.932908 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1912/3870] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:25.457412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6e09-04ce-4969-9271-7e455430385b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:25.457412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6e09-04ce-4969-9271-7e455430385b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:25.457412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6e09-04ce-4969-9271-7e455430385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:25.473789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5edd6e09-04ce-4969-9271-7e455430385b None None] MFA Rules not processed for user `257eeccacdc24f00a418cbb27204cf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:25.475546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5edd6e09-04ce-4969-9271-7e455430385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:25.486816 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1959/3871] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:29.288204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:29.290609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:29.305279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd41cf-6596-4c7d-a92a-b7ac76f3089e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:29.316730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:29.317084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:29.317374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:29.317678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] PATH_INFO: `/v3/users/d0383b7f61484347ba9875a2636e1057` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:29.319122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0383b7f61484347ba9875a2636e1057)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:29.320982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:29.600383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0383b7f61484347ba9875a2636e1057'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:29.607190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0383b7f61484347ba9875a2636e1057'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:29.621340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0383b7f61484347ba9875a2636e1057'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:29.622381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0383b7f61484347ba9875a2636e1057'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:29.623068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f091a93-6dcb-44a7-9c29-b5fe6230b92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0383b7f61484347ba9875a2636e1057'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:29.692608 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1913/3872] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:22:29 2021] DELETE /identity/v3/users/d0383b7f61484347ba9875a2636e1057 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:22:29.917557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6e09-04ce-4969-9271-7e455430385b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:29.930908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6e09-04ce-4969-9271-7e455430385b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:29.998376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:29.999223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:29.999503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:29.999779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] PATH_INFO: `/v3/projects/7ed80be6e633499b9d1dc61c05014afc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.000976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed80be6e633499b9d1dc61c05014afc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:30.002847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:30.105422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed80be6e633499b9d1dc61c05014afc', 'request_id': 'req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:30.190691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed80be6e633499b9d1dc61c05014afc', 'request_id': 'req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:30.199562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed80be6e633499b9d1dc61c05014afc', 'request_id': 'req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:30.210921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] The token cache is being invalidate because project 7ed80be6e633499b9d1dc61c05014afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:22:30.211238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:30.212156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5eeef74e-bc4a-4be5-b74c-d906ae70d8f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:30.214377 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1960/3873] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:22:29 2021] DELETE /identity/v3/projects/7ed80be6e633499b9d1dc61c05014afc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:22:30.221393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931416ca-2fd1-498e-8dac-f1431b592313 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.222064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931416ca-2fd1-498e-8dac-f1431b592313 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.222418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931416ca-2fd1-498e-8dac-f1431b592313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.249653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-931416ca-2fd1-498e-8dac-f1431b592313 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:30.253444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-931416ca-2fd1-498e-8dac-f1431b592313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:30.343241 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1914/3874] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:30.349793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6276d-5726-4305-acde-1bf486489dd6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.350152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6276d-5726-4305-acde-1bf486489dd6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.350500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6276d-5726-4305-acde-1bf486489dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.369799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ddb6276d-5726-4305-acde-1bf486489dd6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:30.371273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ddb6276d-5726-4305-acde-1bf486489dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:30.380002 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1961/3875] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:22:30.390004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931416ca-2fd1-498e-8dac-f1431b592313 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:30.397250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931416ca-2fd1-498e-8dac-f1431b592313 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:30.402561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:30.403413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.404398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.404669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.405607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:22:30.405918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:30.407602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:30.421065 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1915/3876] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:22:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:22:30.425515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6276d-5726-4305-acde-1bf486489dd6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:30.435891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6276d-5726-4305-acde-1bf486489dd6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:30.441311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:30.442158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.442381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.442667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.443373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:30.445332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:30.529267 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1962/3877] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:22:30 2021] POST /identity/v3/projects => generated 361 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:22:30.533845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:30.546724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52aa30-b7ba-4272-948d-764317dd8915 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:30.606284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:30.607245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.607699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.608133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.609037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:30.611208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:30.724003 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1916/3878] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:22:30 2021] POST /identity/v3/users => generated 281 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:22:30.724372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:30.732557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e432-f087-491d-bc41-773175cfd38b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:30.737268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:30.737944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.738227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.738500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.739217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:30.740806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:30.750539 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1963/3879] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:22:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:22:30.758964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:30.769066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9d29-66f0-4c5e-9663-7363664bf572 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:30.774302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8750d5-530d-440b-8ae2-c8e699b3330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:30.774951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8750d5-530d-440b-8ae2-c8e699b3330f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.775233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8750d5-530d-440b-8ae2-c8e699b3330f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.775510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8750d5-530d-440b-8ae2-c8e699b3330f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.776239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8750d5-530d-440b-8ae2-c8e699b3330f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:30.777924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8750d5-530d-440b-8ae2-c8e699b3330f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:30.787782 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1917/3880] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:22:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:22:30.792763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:30.802733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69fc42-290f-4d3f-b5ff-faef0f999baf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:30.807643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:30.808512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.813714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.813714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] PATH_INFO: `/v3/projects/7f1423219da34180ab8a3017e5041b4a/users/f16e390fe6994af089c97b03c59ec61e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.823369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1423219da34180ab8a3017e5041b4a, user_id=f16e390fe6994af089c97b03c59ec61e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:30.826024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:30.941640 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1964/3881] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:22:30 2021] PUT /identity/v3/projects/7f1423219da34180ab8a3017e5041b4a/users/f16e390fe6994af089c97b03c59ec61e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:22:30.952306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a04e-d3ab-43e8-9561-0a7e670d1123 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:30.952589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a04e-d3ab-43e8-9561-0a7e670d1123 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:30.952863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a04e-d3ab-43e8-9561-0a7e670d1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:30.985924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3996a04e-d3ab-43e8-9561-0a7e670d1123 None None] MFA Rules not processed for user `f16e390fe6994af089c97b03c59ec61e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:30.987131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3996a04e-d3ab-43e8-9561-0a7e670d1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:31.054341 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1918/3882] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:30 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:31.063811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:31.065546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:31.133592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50725a13-2f1e-482e-881f-ac9996950ec0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:31.137677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:31.138325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:31.138605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:31.138882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:31.147623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:31.149674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:31.159152 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1965/3883] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:31 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:35.225576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:35.225978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:35.226565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:35.247349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] MFA Rules not processed for user `d7df5c79b8ea4c6ea7cf84b381b29765`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:35.247349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:35.310081 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1919/3884] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:37.987229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:37.988791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:38.050869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8bcc3-dbe9-42b0-b7b8-9e3b97103f02 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:38.054512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987b580-2d5d-4968-bbc8-b2395aa883c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:38.055223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987b580-2d5d-4968-bbc8-b2395aa883c9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:38.055504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987b580-2d5d-4968-bbc8-b2395aa883c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:38.055775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987b580-2d5d-4968-bbc8-b2395aa883c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:38.057662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1987b580-2d5d-4968-bbc8-b2395aa883c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:38.068238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987b580-2d5d-4968-bbc8-b2395aa883c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:38.069734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987b580-2d5d-4968-bbc8-b2395aa883c9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:38.078659 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1966/3885] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:22:38.378463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:38.379937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:38.450911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6928428-bc44-41aa-9e98-7e2c28e99b68 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:38.456381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:38.457122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:38.457408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:38.457684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] PATH_INFO: `/v3/users/4f35acdc849b446f8564ce2666f2e17c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:38.458944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f35acdc849b446f8564ce2666f2e17c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:38.460900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:38.703129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f35acdc849b446f8564ce2666f2e17c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:38.709939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f35acdc849b446f8564ce2666f2e17c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:38.722038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f35acdc849b446f8564ce2666f2e17c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:38.723073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f35acdc849b446f8564ce2666f2e17c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:38.723826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f35acdc849b446f8564ce2666f2e17c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:38.801756 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1920/3886] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:22:38 2021] DELETE /identity/v3/users/4f35acdc849b446f8564ce2666f2e17c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:22:38.806372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:38.806660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:38.806987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:38.824635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:38.825912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:38.887391 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1967/3887] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:38.897786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:38.899827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:38.984511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b055292-fc6f-47fa-bbd2-85a498ee6109 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:38.988749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df803d9-c173-45f5-ad61-b2a12862cbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:38.989501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df803d9-c173-45f5-ad61-b2a12862cbdb service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:38.989852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df803d9-c173-45f5-ad61-b2a12862cbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:38.990201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df803d9-c173-45f5-ad61-b2a12862cbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:39.001060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df803d9-c173-45f5-ad61-b2a12862cbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:39.002957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df803d9-c173-45f5-ad61-b2a12862cbdb service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:39.015138 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1921/3888] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:39.614820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:39.617081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:39.633207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae643e-e0cd-4b00-94ab-a4bebf0e50fc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:39.644693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:39.646769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:39.647039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:39.647313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] PATH_INFO: `/v3/projects/8448b25167bd4f0facbde22bc77a818d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:39.653415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8448b25167bd4f0facbde22bc77a818d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:39.655520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:39.812693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8448b25167bd4f0facbde22bc77a818d', 'request_id': 'req-4e192d79-df03-45ba-87ad-33808bb0ac84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:39.893830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8448b25167bd4f0facbde22bc77a818d', 'request_id': 'req-4e192d79-df03-45ba-87ad-33808bb0ac84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:39.903342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8448b25167bd4f0facbde22bc77a818d', 'request_id': 'req-4e192d79-df03-45ba-87ad-33808bb0ac84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:39.917696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] The token cache is being invalidate because project 8448b25167bd4f0facbde22bc77a818d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:22:39.918053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:39.919223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:22:39.921505 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1968/3889] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:22:39 2021] DELETE /identity/v3/projects/8448b25167bd4f0facbde22bc77a818d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:22:39.928116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f59e60-c0e4-4ee8-bb02-67c825199070 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:39.933800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f59e60-c0e4-4ee8-bb02-67c825199070 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:39.933800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f59e60-c0e4-4ee8-bb02-67c825199070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:39.967800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-38f59e60-c0e4-4ee8-bb02-67c825199070 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:39.969199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-38f59e60-c0e4-4ee8-bb02-67c825199070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:39.994302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:39.996852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:40.088131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192d79-df03-45ba-87ad-33808bb0ac84 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:40.092964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:40.100268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.100268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.100268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.100268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:40.101190 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1922/3890] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:40.109233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7380991-cc7c-44b0-ac27-d4cbe18215e0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.109929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7380991-cc7c-44b0-ac27-d4cbe18215e0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.110375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7380991-cc7c-44b0-ac27-d4cbe18215e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.118338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:40.120221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:40.131566 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1969/3891] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:40.139957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a7380991-cc7c-44b0-ac27-d4cbe18215e0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:40.141204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7380991-cc7c-44b0-ac27-d4cbe18215e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:40.151574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1923/3892] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:40.156000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:40.170245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977dc3-f76b-41cb-9aec-28175b5b5531 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:40.178652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:40.179388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.179874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.180332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.181278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:22:40.181639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:40.183559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:40.199158 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1970/3893] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:22:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:22:40.202686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7380991-cc7c-44b0-ac27-d4cbe18215e0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:40.214216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7380991-cc7c-44b0-ac27-d4cbe18215e0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:40.222794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:40.222794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.222794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.222794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.223183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:40.223937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:40.338292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1924/3894] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:22:40 2021] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:22:40.340023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:40.353800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11bdc-aace-4942-9d4c-351d01b4f039 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:40.450943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:40.456444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.456444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.456444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.456444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:40.456444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:40.605455 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1971/3895] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:22:40 2021] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:22:40.606441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:40.620718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf2fd-5374-446b-9b74-e99222c8b5b6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:40.626249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:40.627113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.627486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.627808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.628605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:40.630399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:40.642832 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1925/3896] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:22:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:22:40.647659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:40.662252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bdd2a-4d4a-4820-a88b-a7600360aacc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:40.686826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f46cb-0457-4420-9cd5-a75fedc6b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:40.687546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f46cb-0457-4420-9cd5-a75fedc6b51f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.687824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f46cb-0457-4420-9cd5-a75fedc6b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.688447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f46cb-0457-4420-9cd5-a75fedc6b51f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.689739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f46cb-0457-4420-9cd5-a75fedc6b51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:40.695170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f46cb-0457-4420-9cd5-a75fedc6b51f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:40.702542 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1972/3897] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:22:40 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:22:40.706686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:40.717014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a6688-c2fb-408d-9449-46cde19ed348 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:40.722673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624a39c-e499-48fe-a46c-7eb31b383577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:40.723656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a39c-e499-48fe-a46c-7eb31b383577 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.723858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a39c-e499-48fe-a46c-7eb31b383577 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.724170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624a39c-e499-48fe-a46c-7eb31b383577 admin admin] PATH_INFO: `/v3/projects/ffbc622c02414a999ab1d4f3752e9693/users/4fc176dc819f44649134b4ce7dca957e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.739271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624a39c-e499-48fe-a46c-7eb31b383577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbc622c02414a999ab1d4f3752e9693, user_id=4fc176dc819f44649134b4ce7dca957e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:40.742985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624a39c-e499-48fe-a46c-7eb31b383577 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:40.825088 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1926/3898] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:22:40 2021] PUT /identity/v3/projects/ffbc622c02414a999ab1d4f3752e9693/users/4fc176dc819f44649134b4ce7dca957e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:22:40.835405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.836457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.836457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:40.874256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] MFA Rules not processed for user `4fc176dc819f44649134b4ce7dca957e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:40.876453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:40.979937 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1973/3899] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:40 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:40.991304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa8cc-b3b4-40df-a680-9625771a036d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:40.991895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa8cc-b3b4-40df-a680-9625771a036d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:40.993146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa8cc-b3b4-40df-a680-9625771a036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:41.012210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cfafa8cc-b3b4-40df-a680-9625771a036d None None] MFA Rules not processed for user `4fc176dc819f44649134b4ce7dca957e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:41.013607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cfafa8cc-b3b4-40df-a680-9625771a036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:41.024385 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1927/3900] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:22:40 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:22:41.274524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:41.275942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:41.356626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5ad90-5e9b-49cd-927d-19b3b37a25cc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:41.365091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b14cbe-09e0-4fca-8734-996b45b8d89b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:41.365893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b14cbe-09e0-4fca-8734-996b45b8d89b service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:41.366249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b14cbe-09e0-4fca-8734-996b45b8d89b service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:41.366665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b14cbe-09e0-4fca-8734-996b45b8d89b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:41.375901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b14cbe-09e0-4fca-8734-996b45b8d89b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:41.377732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b14cbe-09e0-4fca-8734-996b45b8d89b service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:41.390041 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1974/3901] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:41 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:48.470337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa8cc-b3b4-40df-a680-9625771a036d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:48.487733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa8cc-b3b4-40df-a680-9625771a036d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:48.494254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:48.494957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:48.495240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:48.495582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:48.497425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:48.513749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:48.518171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:48.531884 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1928/3902] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:22:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:50.494583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:50.495065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:50.495065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:50.513385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:22:50.514582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:50.576005 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1975/3903] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:22:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:22:50.795119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:22:50.796537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:22:50.870325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978041-eaed-4700-a4b3-9c3146e289f7 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:22:50.875560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d309a-6457-4542-8653-de75ef8138df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:22:50.876197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d309a-6457-4542-8653-de75ef8138df service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:22:50.877198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d309a-6457-4542-8653-de75ef8138df service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:22:50.877493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d309a-6457-4542-8653-de75ef8138df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:22:50.887294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d309a-6457-4542-8653-de75ef8138df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:22:50.890288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d309a-6457-4542-8653-de75ef8138df service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:22:50.957137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1929/3904] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:22:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:06.823804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:06.825313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:06.931296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ad4e9-8a49-4694-ad8b-82b0f9c7c311 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:06.935343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6058d-56ed-4be4-a35c-b776c132f40c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:06.935978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6058d-56ed-4be4-a35c-b776c132f40c service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:06.936256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6058d-56ed-4be4-a35c-b776c132f40c service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:06.936540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6058d-56ed-4be4-a35c-b776c132f40c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:06.938316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eed6058d-56ed-4be4-a35c-b776c132f40c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:06.956050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6058d-56ed-4be4-a35c-b776c132f40c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:06.957571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6058d-56ed-4be4-a35c-b776c132f40c service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:06.973787 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1976/3905] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:07.228079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d309a-6457-4542-8653-de75ef8138df service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:07.282854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d309a-6457-4542-8653-de75ef8138df service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:07.286438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:07.287069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:07.287347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:07.287620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:07.289406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:07.299366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:07.300774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:07.309432 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1930/3906] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:09.976105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:09.976619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:09.976729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:09.994907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:09.996094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:10.003312 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1977/3907] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:23:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:10.017043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:10.023918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:10.025349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:10.030347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b88051-ba81-476d-beae-c1860ced21a5 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:10.035689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:10.036467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:10.037750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:10.038036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:10.042981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c730c5d-1f09-4934-a219-8bf861b95619 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:10.047791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:10.049428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:10.058599 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1931/3908] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:23:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:10.060388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085d7ac-7365-4843-8960-32cfa3a4db9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:10.061183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d7ac-7365-4843-8960-32cfa3a4db9e service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:10.061382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d7ac-7365-4843-8960-32cfa3a4db9e service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:10.061640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d7ac-7365-4843-8960-32cfa3a4db9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:10.065032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6085d7ac-7365-4843-8960-32cfa3a4db9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:10.124892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085d7ac-7365-4843-8960-32cfa3a4db9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:10.126509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085d7ac-7365-4843-8960-32cfa3a4db9e service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:10.135590 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1978/3909] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:10 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:23:13.438149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:13.439605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:13.512733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054de5b3-a5aa-4aa7-9303-e30c6560606b service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:13.519011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:13.519944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:13.520222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:13.520488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] PATH_INFO: `/v3/users/f16e390fe6994af089c97b03c59ec61e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:13.521958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16e390fe6994af089c97b03c59ec61e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:13.527735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:13.728928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16e390fe6994af089c97b03c59ec61e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:13.731027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16e390fe6994af089c97b03c59ec61e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:13.756945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16e390fe6994af089c97b03c59ec61e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:13.757818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16e390fe6994af089c97b03c59ec61e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:13.758380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16e390fe6994af089c97b03c59ec61e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:13.867973 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1932/3910] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:13 2021] DELETE /identity/v3/users/f16e390fe6994af089c97b03c59ec61e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:13.869331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:13.870333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:13.870791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:13.890387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:13.891638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:13.978573 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1979/3911] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:13.989892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:13.991849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:14.057966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788588e-1ba3-47d0-9b35-ad98af3a7dfc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:14.068475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f46478-9d77-4279-aad7-c2b276484a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:14.068475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46478-9d77-4279-aad7-c2b276484a27 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:14.068475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46478-9d77-4279-aad7-c2b276484a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:14.068475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46478-9d77-4279-aad7-c2b276484a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:14.074274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f46478-9d77-4279-aad7-c2b276484a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:14.075762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f46478-9d77-4279-aad7-c2b276484a27 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:14.097875 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1933/3912] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:14.599555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:14.601491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:14.618451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958914ac-64f2-4d94-9c3f-c8308452f43a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:14.623797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:14.624670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:14.624976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:14.625257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] PATH_INFO: `/v3/projects/7f1423219da34180ab8a3017e5041b4a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:14.627102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1423219da34180ab8a3017e5041b4a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:14.639678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:14.817439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1423219da34180ab8a3017e5041b4a', 'request_id': 'req-155524d9-c532-4fdd-8198-b7f91607d338'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:14.927297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1423219da34180ab8a3017e5041b4a', 'request_id': 'req-155524d9-c532-4fdd-8198-b7f91607d338'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:14.937709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1423219da34180ab8a3017e5041b4a', 'request_id': 'req-155524d9-c532-4fdd-8198-b7f91607d338'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:14.967421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] The token cache is being invalidate because project 7f1423219da34180ab8a3017e5041b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:14.967922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:14.973734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-155524d9-c532-4fdd-8198-b7f91607d338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:14.975605 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1980/3913] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:14 2021] DELETE /identity/v3/projects/7f1423219da34180ab8a3017e5041b4a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:14.984669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800a95e-e604-4acc-ae14-bafbcf079759 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:14.985426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800a95e-e604-4acc-ae14-bafbcf079759 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:14.985426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800a95e-e604-4acc-ae14-bafbcf079759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.005866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a800a95e-e604-4acc-ae14-bafbcf079759 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:15.007336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a800a95e-e604-4acc-ae14-bafbcf079759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:15.082486 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1934/3914] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:15.091424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163e3f-b5f7-4ced-a041-fa3df3d24d5b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.091968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163e3f-b5f7-4ced-a041-fa3df3d24d5b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.092251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6163e3f-b5f7-4ced-a041-fa3df3d24d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.120741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e6163e3f-b5f7-4ced-a041-fa3df3d24d5b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:15.122171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e6163e3f-b5f7-4ced-a041-fa3df3d24d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:15.131154 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1981/3915] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:15.135648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800a95e-e604-4acc-ae14-bafbcf079759 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:15.147950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800a95e-e604-4acc-ae14-bafbcf079759 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:15.153895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:15.154681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.155043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.155403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.156219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:15.156604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:15.160821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:15.172204 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1935/3916] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:15.176743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6163e3f-b5f7-4ced-a041-fa3df3d24d5b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:15.188245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6163e3f-b5f7-4ced-a041-fa3df3d24d5b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:15.198219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:15.199703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.199703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.199703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.227797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:15.227797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:15.295638 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1982/3917] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:15 2021] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:15.299694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:15.310721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975415-3a18-4bbd-9991-d809fe4ae9ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:15.392221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:15.393218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.393653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.394086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.395092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:15.397589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:15.510225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1936/3918] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:15 2021] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:15.511597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:15.523385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55412-a365-4209-aabd-f58b34b0701c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:15.528444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:15.532706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.532706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.532706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.532706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:15.532706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:15.544916 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1983/3919] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:15.548980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:15.561051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0fddc-4db3-4392-9b81-40ce8308661e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:15.570061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540a61a-372a-429a-aeb8-5fd839896ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:15.570061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a61a-372a-429a-aeb8-5fd839896ccf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.570061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a61a-372a-429a-aeb8-5fd839896ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.570061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540a61a-372a-429a-aeb8-5fd839896ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.570485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540a61a-372a-429a-aeb8-5fd839896ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:15.570485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540a61a-372a-429a-aeb8-5fd839896ccf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:15.592915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1937/3920] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:15 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:15.596387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:15.629694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5c8f-79fc-49ef-a0d8-ffb2b6769eb9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:15.634376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:15.635404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.636503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.636913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] PATH_INFO: `/v3/projects/b70b86d8ed694af4a9b976e4289f2b27/users/4ba614251de54263a664b75e333dff27/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.654059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70b86d8ed694af4a9b976e4289f2b27, user_id=4ba614251de54263a664b75e333dff27, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:15.658439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:15.773600 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1984/3921] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:15 2021] PUT /identity/v3/projects/b70b86d8ed694af4a9b976e4289f2b27/users/4ba614251de54263a664b75e333dff27/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:15.785034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45910-a222-4ed1-9995-14b2befe0e8f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:15.785619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45910-a222-4ed1-9995-14b2befe0e8f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:15.796577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45910-a222-4ed1-9995-14b2befe0e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:15.822533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d2f45910-a222-4ed1-9995-14b2befe0e8f None None] MFA Rules not processed for user `4ba614251de54263a664b75e333dff27`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:15.824837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2f45910-a222-4ed1-9995-14b2befe0e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:15.937246 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1938/3922] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:15 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:15.941890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:16.049357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9ea59-8a54-4954-9443-c28942d2df0e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:16.057797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:16.058615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:16.058900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:16.059184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:16.059905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:16.062047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:16.181108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1985/3923] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:15 2021] POST /identity/v3/projects => generated 381 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:16.181965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45910-a222-4ed1-9995-14b2befe0e8f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:16.210223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45910-a222-4ed1-9995-14b2befe0e8f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:16.314999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:16.315914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:16.316199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:16.316474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:16.318713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:16.320670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:16.454209 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1939/3924] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:16 2021] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:16.458216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:16.479995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee578e-1b32-446a-9b4e-0de5fa34c2e0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:16.499294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:16.500957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:16.505876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:16.507276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:16.508515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:16.513761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:16.531964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1986/3925] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:16.536043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:16.556146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a29f18-7ba7-4f04-a6fe-c2b8ea244b85 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:16.577561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2bdb4-4f15-4c70-bfc8-a6631f5ac928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:16.577561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2bdb4-4f15-4c70-bfc8-a6631f5ac928 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:16.577561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2bdb4-4f15-4c70-bfc8-a6631f5ac928 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:16.577561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2bdb4-4f15-4c70-bfc8-a6631f5ac928 admin admin] PATH_INFO: `/v3/projects/f7033e430c4b456ca780135406f0f43f/users/bdaea453ae804070b1c6cf7fef76984a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:16.608964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2bdb4-4f15-4c70-bfc8-a6631f5ac928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7033e430c4b456ca780135406f0f43f, user_id=bdaea453ae804070b1c6cf7fef76984a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:16.613051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2bdb4-4f15-4c70-bfc8-a6631f5ac928 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:16.738018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:16.738507 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1940/3926] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:16 2021] PUT /identity/v3/projects/f7033e430c4b456ca780135406f0f43f/users/bdaea453ae804070b1c6cf7fef76984a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:16.751273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340c2b0-651b-4ce9-860a-95d9a55ea01c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:16.754582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8a5a2-5388-48f7-b45d-a665239b6044 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:16.754870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8a5a2-5388-48f7-b45d-a665239b6044 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:16.755195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8a5a2-5388-48f7-b45d-a665239b6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:16.782218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d1c8a5a2-5388-48f7-b45d-a665239b6044 None None] MFA Rules not processed for user `d2cc54d7a742403f896dd71d222895c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:16.784615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d1c8a5a2-5388-48f7-b45d-a665239b6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:16.898192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:16.899148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:16.899473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:16.899763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:16.900508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:16.902833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:16.916368 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1987/3927] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:16.922360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:16.923281 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1941/3928] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:16 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:16.942373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e2b17-ce3a-4366-bd27-8460340357f8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:16.955841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:16.956852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:16.972408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:16.972623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] PATH_INFO: `/v3/projects/f7033e430c4b456ca780135406f0f43f/users/bdaea453ae804070b1c6cf7fef76984a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:16.986652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7033e430c4b456ca780135406f0f43f, user_id=bdaea453ae804070b1c6cf7fef76984a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:16.995580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:17.028598 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1988/3929] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:16 2021] PUT /identity/v3/projects/f7033e430c4b456ca780135406f0f43f/users/bdaea453ae804070b1c6cf7fef76984a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:17.041433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c65f8-91ac-43d4-bb3e-7f891dfc20fc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:17.042269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c65f8-91ac-43d4-bb3e-7f891dfc20fc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:17.042524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c65f8-91ac-43d4-bb3e-7f891dfc20fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:17.112784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5c7c65f8-91ac-43d4-bb3e-7f891dfc20fc None None] MFA Rules not processed for user `bdaea453ae804070b1c6cf7fef76984a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:17.114663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5c7c65f8-91ac-43d4-bb3e-7f891dfc20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:17.162305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:17.164140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:17.195601 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1942/3930] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:17 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:17.200334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c65f8-91ac-43d4-bb3e-7f891dfc20fc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:17.211410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c65f8-91ac-43d4-bb3e-7f891dfc20fc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:17.216392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:17.217098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:17.217383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:17.217659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:17.218404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:17.219999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:17.239018 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invalid input for field 'name': '' is too short Dec 25 21:23:17.239018 ncdv-master-1 devstack@keystone.service[96732]: Failed validating 'minLength' in schema['properties']['name']: Dec 25 21:23:17.239018 ncdv-master-1 devstack@keystone.service[96732]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 25 21:23:17.239018 ncdv-master-1 devstack@keystone.service[96732]: On instance['name']: Dec 25 21:23:17.239018 ncdv-master-1 devstack@keystone.service[96732]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Dec 25 21:23:17.244647 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1943/3931] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:17 2021] POST /identity/v3/domains => generated 283 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Dec 25 21:23:17.247342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:17.261552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148fcfc-5fa6-4da2-a742-916a7b280de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:17.267123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:17.267843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:17.270786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:17.270786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:17.270786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:17.271160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:17.276923 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 25 21:23:17.276923 ncdv-master-1 devstack@keystone.service[96732]: Failed validating 'maxLength' in schema['properties']['name']: Dec 25 21:23:17.276923 ncdv-master-1 devstack@keystone.service[96732]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 25 21:23:17.276923 ncdv-master-1 devstack@keystone.service[96732]: On instance['name']: Dec 25 21:23:17.276923 ncdv-master-1 devstack@keystone.service[96732]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 25 21:23:17.278615 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1944/3932] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:17 2021] POST /identity/v3/domains => generated 412 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:23:17.284159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:17.298156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222ab3e-7d27-4e45-ab1b-fb2bac474166 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:17.302871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11ce06-1d2d-4280-8c7e-da1fa86b4d82 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:17.309123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:17.310292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:17.314200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:17.314200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:17.314394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:17.314511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:17.314620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:17.314620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:17.314620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:17.314847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:17.315385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:17.331454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:17.333170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:17.344821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1989/3933] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:17.409327 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1945/3934] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:17 2021] POST /identity/v3/domains => generated 276 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:17.409893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:17.429232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc095e-d0a7-4ab9-90b9-d90f90b4c9f2 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:17.534799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:17.535943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:17.536243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:17.536532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains/2139dbbb56064012bb09de1330d2017a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:17.572501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2139dbbb56064012bb09de1330d2017a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:17.574345 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:17.574345 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:17.574345 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:17.575526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:17.601718 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Dec 25 21:23:17.621787 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1990/3935] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:17 2021] DELETE /identity/v3/domains/2139dbbb56064012bb09de1330d2017a => generated 120 bytes in 194 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:23:17.623801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:17.636585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1089b-9ed5-48a0-91b4-d8eab0644799 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:17.642283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:17.643453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:17.643813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:17.644174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains/2139dbbb56064012bb09de1330d2017a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:17.645683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2139dbbb56064012bb09de1330d2017a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:17.646872 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:17.646872 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:17.646872 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:17.647983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:17.711309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2139dbbb56064012bb09de1330d2017a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:17.717883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2139dbbb56064012bb09de1330d2017a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.019127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2139dbbb56064012bb09de1330d2017a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.019869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2139dbbb56064012bb09de1330d2017a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.024022 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1946/3936] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:17 2021] PATCH /identity/v3/domains/2139dbbb56064012bb09de1330d2017a => generated 277 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:18.032937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:18.036058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:18.053471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f20aa-0d6f-48a4-a946-825b42385de2 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:18.158374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:18.161901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:18.162118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:18.162467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains/2139dbbb56064012bb09de1330d2017a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:18.177131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2139dbbb56064012bb09de1330d2017a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:18.178933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:18.207135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2139dbbb56064012bb09de1330d2017a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.228463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2139dbbb56064012bb09de1330d2017a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.347755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2139dbbb56064012bb09de1330d2017a', 'request_id': 'req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.467215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2139dbbb56064012bb09de1330d2017a', 'request_id': 'req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.478955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2139dbbb56064012bb09de1330d2017a', 'request_id': 'req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.503860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] The token cache is being invalidate because project 2139dbbb56064012bb09de1330d2017a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:18.504153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.507117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.533557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2139dbbb56064012bb09de1330d2017a', 'request_id': 'req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.536502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2139dbbb56064012bb09de1330d2017a', 'request_id': 'req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.536502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2139dbbb56064012bb09de1330d2017a', 'request_id': 'req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:18.575465 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1991/3937] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:18 2021] DELETE /identity/v3/domains/2139dbbb56064012bb09de1330d2017a => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:18.577517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:18.599430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd0563-8c03-4ac4-9d5d-9d1a8fc453d5 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:18.664452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:18.665646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:18.666008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:18.666358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains/ff7f35ce19b2470c9af1239c4370381b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:18.684246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:23:18.695033 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Could not find domain: ff7f35ce19b2470c9af1239c4370381b.: keystone.exception.DomainNotFound: Could not find domain: ff7f35ce19b2470c9af1239c4370381b. Dec 25 21:23:18.696529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1947/3938] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:18 2021] DELETE /identity/v3/domains/ff7f35ce19b2470c9af1239c4370381b => generated 112 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:23:18.701772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:18.703427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:18.717569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb284b-aad6-490d-8b07-75f3b6ffe8ad tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:18.722666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:18.723339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:18.723625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:18.723905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:18.724701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:18.725767 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:18.725767 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:18.725767 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:18.726653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:18.843957 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1992/3939] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:18 2021] POST /identity/v3/domains => generated 253 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:18.847561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:18.857983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cb0b0-b2d3-4850-8686-5819c509a982 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:18.987108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:18.987800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:18.988158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:18.988506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:18.989506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:19.002578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:19.075650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.sql.core [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1463611733' for key 'project.ixu_project_name_domain_id'") Dec 25 21:23:19.075650 ncdv-master-1 devstack@keystone.service[96732]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 25 21:23:19.075650 ncdv-master-1 devstack@keystone.service[96732]: [parameters: {'id': '5d047fe1dc3a465b9b600cdad47aa843', 'name': 'tempest-domain-dup-1463611733', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Dec 25 21:23:19.075650 ncdv-master-1 devstack@keystone.service[96732]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96732) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 25 21:23:19.083793 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1463611733.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1463611733. Dec 25 21:23:19.092361 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1948/3940] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:18 2021] POST /identity/v3/domains => generated 212 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 25 21:23:19.093610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:19.105994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e08b2-dd4a-4c5d-b631-811a4a908ae6 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:19.117474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:19.118705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:19.119159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:19.120131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains/585ca4bb9dbc41d6a8ed4fd90f3463a3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:19.149651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=585ca4bb9dbc41d6a8ed4fd90f3463a3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:19.150732 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:19.150732 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:19.150732 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:19.152277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:19.204925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:19.204925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.166098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.167770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.174854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:20.177145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:20.183684 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1993/3941] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:19 2021] PATCH /identity/v3/domains/585ca4bb9dbc41d6a8ed4fd90f3463a3 => generated 254 bytes in 1090 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:20.199450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eab580-db89-4db3-9d35-7b70553874ec tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:20.271164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:20.272177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:20.272677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:20.272976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains/585ca4bb9dbc41d6a8ed4fd90f3463a3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:20.285584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=585ca4bb9dbc41d6a8ed4fd90f3463a3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:20.286706 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:20.286706 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:20.286706 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:20.287759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:20.336305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.359126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.484369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3', 'request_id': 'req-1f27109a-255b-46b1-b59e-1b191101d7ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.491717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3', 'request_id': 'req-1f27109a-255b-46b1-b59e-1b191101d7ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.583104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3', 'request_id': 'req-1f27109a-255b-46b1-b59e-1b191101d7ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.595429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] The token cache is being invalidate because project 585ca4bb9dbc41d6a8ed4fd90f3463a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:20.598833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.598833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.606365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3', 'request_id': 'req-1f27109a-255b-46b1-b59e-1b191101d7ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.607052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3', 'request_id': 'req-1f27109a-255b-46b1-b59e-1b191101d7ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.607675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '585ca4bb9dbc41d6a8ed4fd90f3463a3', 'request_id': 'req-1f27109a-255b-46b1-b59e-1b191101d7ce'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:20.619387 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1949/3942] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:20 2021] DELETE /identity/v3/domains/585ca4bb9dbc41d6a8ed4fd90f3463a3 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:20.625176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:20.635153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fbda3-b7e2-4792-a165-e80fee04ebdb tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:20.693192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fad2a7-917e-447e-9746-affa29ebc692 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaea453ae804070b1c6cf7fef76984a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7033e430c4b456ca780135406f0f43f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:20.695442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad2a7-917e-447e-9746-affa29ebc692 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:20.695442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad2a7-917e-447e-9746-affa29ebc692 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:20.695442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fad2a7-917e-447e-9746-affa29ebc692 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] PATH_INFO: `/v3/domains/2139dbbb56064012bb09de1330d2017a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:20.702039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fad2a7-917e-447e-9746-affa29ebc692 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:23:20.711246 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-24fad2a7-917e-447e-9746-affa29ebc692 tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Could not find domain: 2139dbbb56064012bb09de1330d2017a.: keystone.exception.DomainNotFound: Could not find domain: 2139dbbb56064012bb09de1330d2017a. Dec 25 21:23:20.712457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1994/3943] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:20 2021] PATCH /identity/v3/domains/2139dbbb56064012bb09de1330d2017a => generated 112 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:23:20.717180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:20.727716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:20.786880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27109a-255b-46b1-b59e-1b191101d7ce tempest-DomainsNegativeTestJSON-805065983 tempest-DomainsNegativeTestJSON-805065983-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:20.791694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:20.792773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:20.793230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:20.793555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] PATH_INFO: `/v3/users/4ba614251de54263a664b75e333dff27` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:20.794942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba614251de54263a664b75e333dff27)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:20.797000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:21.017494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba614251de54263a664b75e333dff27'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:21.024097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba614251de54263a664b75e333dff27'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:21.037248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba614251de54263a664b75e333dff27'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:21.037869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba614251de54263a664b75e333dff27'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:21.038467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba614251de54263a664b75e333dff27'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:21.104091 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1950/3944] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:20 2021] DELETE /identity/v3/users/4ba614251de54263a664b75e333dff27 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:21.111522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:21.111817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:21.112091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:21.130577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:21.131773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:21.198425 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1995/3945] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:21.209213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:21.210656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:21.280632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed224b-10fa-437f-bc1f-d414d4e7637f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:21.290599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:21.290888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:21.291168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:21.291470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:21.313447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:21.314934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:21.325656 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1951/3946] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:21.833209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:21.834742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:21.849268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc3e33-c7f5-4b47-ad2a-aa052f98c065 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:21.853017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:21.853905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:21.854800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:21.855094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] PATH_INFO: `/v3/projects/b70b86d8ed694af4a9b976e4289f2b27` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:21.856342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70b86d8ed694af4a9b976e4289f2b27)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:21.858280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:21.977154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70b86d8ed694af4a9b976e4289f2b27', 'request_id': 'req-19a1882d-0ae6-4164-ad2f-3e780dca1f02'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.048706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70b86d8ed694af4a9b976e4289f2b27', 'request_id': 'req-19a1882d-0ae6-4164-ad2f-3e780dca1f02'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.055694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70b86d8ed694af4a9b976e4289f2b27', 'request_id': 'req-19a1882d-0ae6-4164-ad2f-3e780dca1f02'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.067914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] The token cache is being invalidate because project b70b86d8ed694af4a9b976e4289f2b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:22.068247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.068849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.070667 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1996/3947] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:21 2021] DELETE /identity/v3/projects/b70b86d8ed694af4a9b976e4289f2b27 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:22.075048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:22.086987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9028c5-64a3-4f31-8522-156963a07b74 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:22.148606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:22.149464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:22.149741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:22.150010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] PATH_INFO: `/v3/users/bdaea453ae804070b1c6cf7fef76984a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:22.151293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdaea453ae804070b1c6cf7fef76984a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:22.159904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:22.387163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdaea453ae804070b1c6cf7fef76984a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.395013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdaea453ae804070b1c6cf7fef76984a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.408710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdaea453ae804070b1c6cf7fef76984a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.409486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdaea453ae804070b1c6cf7fef76984a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.410131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8422f06c-b27f-4dab-a5a0-a8603e947e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdaea453ae804070b1c6cf7fef76984a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:22.488596 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1952/3948] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:22 2021] DELETE /identity/v3/users/bdaea453ae804070b1c6cf7fef76984a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:23.062679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:23.064176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:23.078276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1882d-0ae6-4164-ad2f-3e780dca1f02 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:23.138553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:23.139538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:23.139816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:23.140086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] PATH_INFO: `/v3/projects/f7033e430c4b456ca780135406f0f43f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:23.141514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7033e430c4b456ca780135406f0f43f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:23.143734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:23.254845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7033e430c4b456ca780135406f0f43f', 'request_id': 'req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:23.357094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7033e430c4b456ca780135406f0f43f', 'request_id': 'req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:23.364798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7033e430c4b456ca780135406f0f43f', 'request_id': 'req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:23.377607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] The token cache is being invalidate because project f7033e430c4b456ca780135406f0f43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:23.377607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:23.377607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e83b9bc4-6dd7-4b64-8c4f-b6298e03f0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:23.385216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf574b-04b5-445a-bf56-bd4d4f027952 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:23.386033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf574b-04b5-445a-bf56-bd4d4f027952 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:23.386308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf574b-04b5-445a-bf56-bd4d4f027952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:23.387684 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1997/3949] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:23 2021] DELETE /identity/v3/projects/f7033e430c4b456ca780135406f0f43f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:23.429501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ccbf574b-04b5-445a-bf56-bd4d4f027952 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:23.437671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ccbf574b-04b5-445a-bf56-bd4d4f027952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:23.533166 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1953/3950] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:23.536037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18091-cc2c-4333-8166-9b8cbef811ae None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:23.536334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18091-cc2c-4333-8166-9b8cbef811ae None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:23.536631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18091-cc2c-4333-8166-9b8cbef811ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:23.563822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-23d18091-cc2c-4333-8166-9b8cbef811ae None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:23.566450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23d18091-cc2c-4333-8166-9b8cbef811ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:23.593113 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1998/3951] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:23.596535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf574b-04b5-445a-bf56-bd4d4f027952 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:23.613576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf574b-04b5-445a-bf56-bd4d4f027952 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:23.631651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:23.633395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:23.633605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:23.633881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:23.635918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:23.636248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:23.640637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:23.680946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18091-cc2c-4333-8166-9b8cbef811ae None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:23.681287 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1954/3952] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:23.699096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18091-cc2c-4333-8166-9b8cbef811ae None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:23.705374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:23.706226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:23.707056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:23.707429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:23.708233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:23.710824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:23.851886 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 1999/3953] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:23 2021] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:23.857363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:23.878096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1965-b6ab-45a0-aabc-b4e83cecdac3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:23.968557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:23.969289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:23.969571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:23.969949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:23.970570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:23.972525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:24.084915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1955/3954] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:23 2021] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:24.090457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:24.109970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9375cb0-d788-4648-b903-acdf5893e0e1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:24.115544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:24.116495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.117238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.117734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.118764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:24.121313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:24.146939 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2000/3955] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:24 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:24.148437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:24.166910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e9679-248a-4342-acba-3914e9bfa539 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:24.175129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4b4af-a5c6-4649-8f91-d4260884dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:24.175817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b4af-a5c6-4649-8f91-d4260884dec9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.176095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b4af-a5c6-4649-8f91-d4260884dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.176451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4b4af-a5c6-4649-8f91-d4260884dec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.177135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4b4af-a5c6-4649-8f91-d4260884dec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:24.178728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4b4af-a5c6-4649-8f91-d4260884dec9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:24.199432 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1956/3956] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:24 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:24.199640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:24.209094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa85b1-7577-4e1f-9bfc-c11f7a957713 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:24.214660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:24.215545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.215829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.216128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] PATH_INFO: `/v3/projects/784119b833ae41fd87334f4ddab7bb02/users/5e11cc5b5ad7425e80abe2becbbf6285/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.235587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784119b833ae41fd87334f4ddab7bb02, user_id=5e11cc5b5ad7425e80abe2becbbf6285, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:24.238717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:24.328222 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2001/3957] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:24 2021] PUT /identity/v3/projects/784119b833ae41fd87334f4ddab7bb02/users/5e11cc5b5ad7425e80abe2becbbf6285/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:24.339335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51416a98-21c5-4cf2-a57f-f8f35aca2a81 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.339559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51416a98-21c5-4cf2-a57f-f8f35aca2a81 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.339841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51416a98-21c5-4cf2-a57f-f8f35aca2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.368535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-51416a98-21c5-4cf2-a57f-f8f35aca2a81 None None] MFA Rules not processed for user `5e11cc5b5ad7425e80abe2becbbf6285`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:24.369854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51416a98-21c5-4cf2-a57f-f8f35aca2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:24.469814 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1957/3958] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:24 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:24.472264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:24.571482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0ece4-a7f0-4686-898f-d53c9f91ecc3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:24.581569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:24.582253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.582537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.582817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.583528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:24.586008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:24.667970 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2002/3959] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:24 2021] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:24.672195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51416a98-21c5-4cf2-a57f-f8f35aca2a81 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:24.684081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51416a98-21c5-4cf2-a57f-f8f35aca2a81 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:24.745132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:24.745817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.746106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.746370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.747135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:24.754207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:24.828728 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1958/3960] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:24 2021] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:24.830327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:24.841033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6f794-8015-46de-8c07-cb3420a3f623 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:24.845581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:24.846253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.846530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.846802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.847750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:24.849382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:24.860590 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2003/3961] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:24.868911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:24.879673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8e7da-98ba-44c6-9ac2-5ba14eda0487 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:24.884625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:24.885576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:24.885852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:24.886292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] PATH_INFO: `/v3/projects/d263b9903168443d9c89ac648e0bb658/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:24.904580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d263b9903168443d9c89ac648e0bb658, user_id=429b328699f14a3eb3f11f801692a21d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:24.907229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.012765 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1959/3962] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:24 2021] PUT /identity/v3/projects/d263b9903168443d9c89ac648e0bb658/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:25.016946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:25.028123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444f871-dbbc-44eb-b793-cf88efdfd8f8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:25.107682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d312eb-43aa-4e33-9b6d-a2c6f9aec869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:25.112400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d312eb-43aa-4e33-9b6d-a2c6f9aec869 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.112400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d312eb-43aa-4e33-9b6d-a2c6f9aec869 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.112400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d312eb-43aa-4e33-9b6d-a2c6f9aec869 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.112400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d312eb-43aa-4e33-9b6d-a2c6f9aec869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:25.112400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d312eb-43aa-4e33-9b6d-a2c6f9aec869 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.124561 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2004/3963] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:25 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:25.129402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:25.141465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2048af-eb5b-4f6c-8f06-f496ab82da80 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:25.146324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:25.147298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.147643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.147984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] PATH_INFO: `/v3/projects/d263b9903168443d9c89ac648e0bb658/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.150247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d263b9903168443d9c89ac648e0bb658, user_id=429b328699f14a3eb3f11f801692a21d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:25.155218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.163745 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1960/3964] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:25 2021] PUT /identity/v3/projects/d263b9903168443d9c89ac648e0bb658/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:25.175420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f56935-3c81-4909-8399-414425e42390 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.175691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f56935-3c81-4909-8399-414425e42390 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.175963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f56935-3c81-4909-8399-414425e42390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.203244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c5f56935-3c81-4909-8399-414425e42390 None None] MFA Rules not processed for user `429b328699f14a3eb3f11f801692a21d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:25.204589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c5f56935-3c81-4909-8399-414425e42390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:25.285543 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2005/3965] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:25 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:25.287944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:25.366598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d052c64-3a62-42dd-8c3e-442e13a04b80 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:25.372110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:25.372785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.373237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.373521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.374241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:25.376325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.506747 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1961/3966] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:25 2021] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:25.507393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f56935-3c81-4909-8399-414425e42390 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:25.517950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f56935-3c81-4909-8399-414425e42390 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:25.587272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:25.587945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.588254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.588529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.589278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:25.591930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.705643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2006/3967] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:25 2021] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:25.709689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:25.721628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05360d6c-66bf-46da-9765-1cc65503f563 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:25.727230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:25.728382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.728955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.729488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.730448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:25.732534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.747664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1962/3968] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:25 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:25.751724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:25.768935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbd9bb-c41d-457f-af2f-881e73e78f94 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:25.768935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04922b72-037b-4bc0-8ad7-d0139df49e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:25.769456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922b72-037b-4bc0-8ad7-d0139df49e9e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.769795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922b72-037b-4bc0-8ad7-d0139df49e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.770085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922b72-037b-4bc0-8ad7-d0139df49e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.770798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922b72-037b-4bc0-8ad7-d0139df49e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:25.772389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922b72-037b-4bc0-8ad7-d0139df49e9e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.783306 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2007/3969] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:25.787840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:25.799702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4595214-edb7-45bb-981c-cd21c0793a4a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:25.811703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:25.815173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.815173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.815173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] PATH_INFO: `/v3/projects/41dc285eee734b16af09bda3e0426dcd/users/b1cddd70971d42699f40676bba80747f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.830748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41dc285eee734b16af09bda3e0426dcd, user_id=b1cddd70971d42699f40676bba80747f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:25.834005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:25.946388 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1963/3970] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:25 2021] PUT /identity/v3/projects/41dc285eee734b16af09bda3e0426dcd/users/b1cddd70971d42699f40676bba80747f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:25.960137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c0e3-b06e-4c83-acfc-61dd4b62e856 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:25.960740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c0e3-b06e-4c83-acfc-61dd4b62e856 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:25.961294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c0e3-b06e-4c83-acfc-61dd4b62e856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:25.996004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-33b5c0e3-b06e-4c83-acfc-61dd4b62e856 None None] MFA Rules not processed for user `b1cddd70971d42699f40676bba80747f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:25.997728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-33b5c0e3-b06e-4c83-acfc-61dd4b62e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:26.081001 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2008/3971] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:25 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:26.085931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:26.187466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d7f46-c899-47f0-b515-6b6544f38672 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:26.194750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:26.195506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:26.195860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:26.196226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:26.197087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:26.199288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:26.284762 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1964/3972] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:26 2021] POST /identity/v3/domains => generated 277 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:26.289315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c0e3-b06e-4c83-acfc-61dd4b62e856 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:26.301359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c0e3-b06e-4c83-acfc-61dd4b62e856 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:26.361142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:26.362162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:26.362162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:26.362431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:26.363084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:26.364741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:26.426882 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2009/3973] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:23:26 2021] POST /identity/v3/roles => generated 239 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:26.428200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:26.439083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002491f-e842-42cb-9c6e-800ca6622442 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:26.444515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:26.445462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:26.445770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:26.446050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f/users/b1cddd70971d42699f40676bba80747f/roles/b7e1f737de9e43dea1bb56c7361b4b7b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:26.458562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e1c4a6f924504a5aafa3fe4b3701b57f, user_id=b1cddd70971d42699f40676bba80747f, role_id=b7e1f737de9e43dea1bb56c7361b4b7b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:26.461216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:26.512116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1965/3974] 10.222.0.32 () {60 vars in 1479 bytes} [Sat Dec 25 21:23:26 2021] PUT /identity/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f/users/b1cddd70971d42699f40676bba80747f/roles/b7e1f737de9e43dea1bb56c7361b4b7b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:26.515858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:26.527165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9c25c-4ce5-49a3-a7be-88fccd747fbb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:26.582282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:26.582873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:26.583361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:26.583649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:26.584391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:26.586019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:26.687997 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2010/3975] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:26 2021] POST /identity/v3/domains => generated 276 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:26.692305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:26.707621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca46061-198b-4d4d-93b2-1be86f2fb805 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:26.765354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:26.766019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:26.766299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:26.766579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:26.767316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:26.768998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:26.886206 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1966/3976] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:23:26 2021] POST /identity/v3/roles => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:26.890581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:26.902333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164de57-d70c-435b-ad94-955e49f91a1b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:26.907949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:26.908643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:26.908957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:26.917014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:26.917014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:26.917014 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:26.917014 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:26.917014 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:26.917014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.017879 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2011/3977] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:23:26 2021] POST /identity/v3/groups => generated 327 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:27.022000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.032352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c615b01-3367-4553-aa22-ac230e496e42 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.037344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a880901-745b-4cd0-b4ff-e804c2160d93 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.038561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a880901-745b-4cd0-b4ff-e804c2160d93 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.039184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a880901-745b-4cd0-b4ff-e804c2160d93 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.039825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a880901-745b-4cd0-b4ff-e804c2160d93 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups/a199f8f49cac422e94b59146546f74fa/users/b1cddd70971d42699f40676bba80747f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.046673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a880901-745b-4cd0-b4ff-e804c2160d93 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a199f8f49cac422e94b59146546f74fa, user_id=b1cddd70971d42699f40676bba80747f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.049008 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-2a880901-745b-4cd0-b4ff-e804c2160d93 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:27.049008 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:27.049008 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:27.049008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a880901-745b-4cd0-b4ff-e804c2160d93 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.168677 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1967/3978] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:23:27 2021] PUT /identity/v3/groups/a199f8f49cac422e94b59146546f74fa/users/b1cddd70971d42699f40676bba80747f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:27.171886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.183589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b830d86-2395-49b4-b3ab-50d7c40359ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.243621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.247068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.247068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.247068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/3cc5341da28d44568902110637680f40/groups/a199f8f49cac422e94b59146546f74fa/roles/ae5eefbd706e4f5b8770e328ea9227ec` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.248341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3cc5341da28d44568902110637680f40, group_id=a199f8f49cac422e94b59146546f74fa, role_id=ae5eefbd706e4f5b8770e328ea9227ec)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.251191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.336487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.336903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.337920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.344739 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2012/3979] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:27 2021] PUT /identity/v3/domains/3cc5341da28d44568902110637680f40/groups/a199f8f49cac422e94b59146546f74fa/roles/ae5eefbd706e4f5b8770e328ea9227ec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:27.349422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.358243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:27.359549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:27.420580 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1968/3980] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:23:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:27.434495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.436750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:27.441219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2afe24-82d0-43f2-aa56-7a38dbd283d9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.446649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.447936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.448036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.448272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.449040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.450744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.523510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ed77-f8e9-4197-86b1-70d86e0d0c68 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.529312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.529959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.530244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.530519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.539141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.540716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.549500 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1969/3981] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:23:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:23:27.574047 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2013/3982] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:27 2021] POST /identity/v3/domains => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:27.578238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.590443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104be43c-2997-4294-9397-7de4d3729247 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.647962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.648625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.648963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.649211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.649950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.652111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.750922 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1970/3983] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:23:27 2021] POST /identity/v3/roles => generated 239 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:27.755221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.756227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.757314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:27.766811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8fcd2-2aea-4ff1-b5b8-ac1f4fcf51e0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.771558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.772457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.774653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.774653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e077e8f4214e4625980a8a0700cb5695/users/b1cddd70971d42699f40676bba80747f/roles/0f654933268848ba8206ec64dbe280a2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.786011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e077e8f4214e4625980a8a0700cb5695, user_id=b1cddd70971d42699f40676bba80747f, role_id=0f654933268848ba8206ec64dbe280a2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.788640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.826382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccabcdd-4fb0-49ac-8762-c68c2995b650 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.831070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.831923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.832197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.832469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] PATH_INFO: `/v3/users/4fc176dc819f44649134b4ce7dca957e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.833726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc176dc819f44649134b4ce7dca957e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.835597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:27.892721 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1971/3984] 10.222.0.32 () {60 vars in 1479 bytes} [Sat Dec 25 21:23:27 2021] PUT /identity/v3/domains/e077e8f4214e4625980a8a0700cb5695/users/b1cddd70971d42699f40676bba80747f/roles/0f654933268848ba8206ec64dbe280a2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:27.896778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:27.960234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55554c8-747a-4e50-9ecf-c0e3fa1b6038 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:27.965352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:27.966063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:27.966279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:27.966553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:27.967375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:27.968998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:28.014120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc176dc819f44649134b4ce7dca957e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:28.020711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc176dc819f44649134b4ce7dca957e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:28.032639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc176dc819f44649134b4ce7dca957e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:28.043731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc176dc819f44649134b4ce7dca957e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:28.043857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1972/3985] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:27 2021] POST /identity/v3/domains => generated 275 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:28.043857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:28.103556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f118-3ee2-4d3b-a3c8-7c6b08ca6a7b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:28.109539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:28.109539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:28.109539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:28.109885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:28.110345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:28.111929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:28.120506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-276c5af4-efe8-41f0-adb2-a3078f50a297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc176dc819f44649134b4ce7dca957e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:28.128050 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2014/3986] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:27 2021] DELETE /identity/v3/users/4fc176dc819f44649134b4ce7dca957e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:28.132425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:28.132715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:28.133017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:28.166410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:28.167685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:28.184586 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1973/3987] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:23:28 2021] POST /identity/v3/roles => generated 238 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:28.189953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:28.191904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:28.207184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac3fb-0fb9-4c54-84a8-4b217af67cbe tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:28.233425 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2015/3988] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:28.242875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:28.244464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:28.278176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:28.284011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:28.284011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:28.284011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:28.284011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:28.284011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:28.306292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ba646-b2a7-4c1c-9f34-a485a4f6f061 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:28.310580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:28.311268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:28.311583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:28.311872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:28.320852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:28.322352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:28.331763 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2016/3989] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:28.407562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1974/3990] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:23:28 2021] POST /identity/v3/groups => generated 326 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:28.411634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:28.422708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987138f-6352-4c66-872e-8bb26120b6d2 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:28.427535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:28.428480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:28.428761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:28.429060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups/6c6cfd8564564fd8be48fa06f17b1637/users/b1cddd70971d42699f40676bba80747f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:28.436198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6c6cfd8564564fd8be48fa06f17b1637, user_id=b1cddd70971d42699f40676bba80747f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:28.437268 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:28.437268 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:28.437268 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:28.438475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:28.569908 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2017/3991] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:23:28 2021] PUT /identity/v3/groups/6c6cfd8564564fd8be48fa06f17b1637/users/b1cddd70971d42699f40676bba80747f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:28.570575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:28.581716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c411e5-cb9f-48b6-bc95-beb08d59c7e8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:28.653869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:28.654815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:28.655098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:28.655373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/50db546c7a2b45ef9dcfbf76832430c1/groups/6c6cfd8564564fd8be48fa06f17b1637/roles/859d296e984747e0ac5b50c28eb2e032` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:28.658208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=50db546c7a2b45ef9dcfbf76832430c1, group_id=6c6cfd8564564fd8be48fa06f17b1637, role_id=859d296e984747e0ac5b50c28eb2e032)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:28.660989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:28.755687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1975/3992] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:28 2021] PUT /identity/v3/domains/50db546c7a2b45ef9dcfbf76832430c1/groups/6c6cfd8564564fd8be48fa06f17b1637/roles/859d296e984747e0ac5b50c28eb2e032 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:28.757993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:28.760155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:28.865580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58651-8682-4633-9033-dd16e14b3bc0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:28.929786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:28.931523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:28.946422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1cddd70971d42699f40676bba80747f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41dc285eee734b16af09bda3e0426dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:28.950713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:28.950713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:28.950713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] PATH_INFO: `/v3/auth/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:28.950713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:28.950713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.032204 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2018/3993] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:23:28 2021] GET /identity/v3/auth/domains => generated 1171 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:29.032484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641c4f-f673-4829-b80c-4a14066701e2 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.036932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.037399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.038269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.038595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.038820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] PATH_INFO: `/v3/projects/ffbc622c02414a999ab1d4f3752e9693` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.040320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbc622c02414a999ab1d4f3752e9693)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.042259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.110072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e6e47-32a9-43fb-baa9-31c724b10993 tempest-TokensV3TestJSON-742066410 tempest-TokensV3TestJSON-742066410-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.115025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.115964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.116257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.116623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/50db546c7a2b45ef9dcfbf76832430c1/groups/6c6cfd8564564fd8be48fa06f17b1637/roles/859d296e984747e0ac5b50c28eb2e032` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.119925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=50db546c7a2b45ef9dcfbf76832430c1, group_id=6c6cfd8564564fd8be48fa06f17b1637, role_id=859d296e984747e0ac5b50c28eb2e032)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.121752 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:29.121752 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:29.121752 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:29.125735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.133923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role 859d296e984747e0ac5b50c28eb2e032 was removed from group 6c6cfd8564564fd8be48fa06f17b1637 on domain 50db546c7a2b45ef9dcfbf76832430c1. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:29.134215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.134929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.213828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbc622c02414a999ab1d4f3752e9693', 'request_id': 'req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.220390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbc622c02414a999ab1d4f3752e9693', 'request_id': 'req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.231821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2019/3994] 10.222.0.32 () {58 vars in 1466 bytes} [Sat Dec 25 21:23:29 2021] DELETE /identity/v3/domains/50db546c7a2b45ef9dcfbf76832430c1/groups/6c6cfd8564564fd8be48fa06f17b1637/roles/859d296e984747e0ac5b50c28eb2e032 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:29.235939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.237474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:29.303752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c9273-da1f-4de2-be51-b4a04580607b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.310074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.310964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.311240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.311514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups/6c6cfd8564564fd8be48fa06f17b1637/users/b1cddd70971d42699f40676bba80747f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.313250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6c6cfd8564564fd8be48fa06f17b1637, user_id=b1cddd70971d42699f40676bba80747f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.314261 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:29.314261 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:29.314261 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:29.315468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.334039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbc622c02414a999ab1d4f3752e9693', 'request_id': 'req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.346138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] The token cache is being invalidate because project ffbc622c02414a999ab1d4f3752e9693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:29.346504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.347227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-973f381a-ae28-4cb1-9dcb-ed71c35c9bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.348822 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1976/3995] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:28 2021] DELETE /identity/v3/projects/ffbc622c02414a999ab1d4f3752e9693 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:29.354431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1705f-efe5-41cf-b83c-1d60f5724cb2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.354788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1705f-efe5-41cf-b83c-1d60f5724cb2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.355197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1705f-efe5-41cf-b83c-1d60f5724cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.374758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a8d1705f-efe5-41cf-b83c-1d60f5724cb2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:29.376015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a8d1705f-efe5-41cf-b83c-1d60f5724cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:29.378846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b1cddd70971d42699f40676bba80747f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.439783 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1977/3996] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:29.447850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb4f41-68d5-4d1f-ad27-1be08127f2f3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.448217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb4f41-68d5-4d1f-ad27-1be08127f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.448493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb4f41-68d5-4d1f-ad27-1be08127f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.461574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2020/3997] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:23:29 2021] DELETE /identity/v3/groups/6c6cfd8564564fd8be48fa06f17b1637/users/b1cddd70971d42699f40676bba80747f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:29.462762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.470805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fefb4f41-68d5-4d1f-ad27-1be08127f2f3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:29.471107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:29.472446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fefb4f41-68d5-4d1f-ad27-1be08127f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:29.543611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b8443-c4be-4a5a-b1f3-b3fd54b18d7c tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.550097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.551140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.551522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.552181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups/6c6cfd8564564fd8be48fa06f17b1637` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.554665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6c6cfd8564564fd8be48fa06f17b1637)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.556025 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:29.556025 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:29.556025 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:29.558011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.568991 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1978/3998] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:29.579040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb4f41-68d5-4d1f-ad27-1be08127f2f3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.594388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb4f41-68d5-4d1f-ad27-1be08127f2f3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.611930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.612785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.613540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.613540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.614109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:29.614421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.616031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.639593 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1979/3999] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:29.643425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.658246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa2fe5-9a8c-4423-9e9e-4dd1f42822cf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.666196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.667144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.673708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.673708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.673708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.673708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.718013 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2021/4000] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:23:29 2021] DELETE /identity/v3/groups/6c6cfd8564564fd8be48fa06f17b1637 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:29.722955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.804223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e996c-e9af-4021-9ea8-fdc7b866ecd9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.811046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.811918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.812258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.812513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles/859d296e984747e0ac5b50c28eb2e032` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.814060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_role(role_id=859d296e984747e0ac5b50c28eb2e032)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.815100 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:29.815100 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:29.815100 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:29.816148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.835515 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1980/4001] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:29 2021] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:29.840157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.908062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba4a0b-40e6-48ad-9752-c71200ffd76f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:29.919427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:29.920518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:29.921160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:29.921770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:29.922135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:29.924189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:29.938409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role 859d296e984747e0ac5b50c28eb2e032 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:29.938750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.941851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:29.941851 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2022/4002] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:29 2021] DELETE /identity/v3/roles/859d296e984747e0ac5b50c28eb2e032 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:29.945756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:29.950460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.035078 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1981/4003] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:29 2021] POST /identity/v3/users => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:30.036380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:30.038334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.045793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c70fd-ab40-4969-8079-5b6339e3a0fc tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.053650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.053968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931836-ccfd-48b7-91be-d144419ba8c4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.054073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.054073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.054073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/50db546c7a2b45ef9dcfbf76832430c1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.055396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=50db546c7a2b45ef9dcfbf76832430c1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.057594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:30.093960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.094732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.141630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.142383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.142738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.143088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.143896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.145696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:30.160912 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1982/4004] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:30 2021] GET /identity/v3/roles => generated 2111 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:30.163889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:30.165935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.180004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5ec5-1258-4f0b-8c85-1ab71eea431c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.217562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.218344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.228922 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2023/4005] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:29 2021] PATCH /identity/v3/domains/50db546c7a2b45ef9dcfbf76832430c1 => generated 276 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:30.229890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:30.231979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.251383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.252175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.253006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.253281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.254924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.257035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:30.274288 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1983/4006] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:30 2021] GET /identity/v3/roles => generated 2111 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:30.278654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:30.280482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.296843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404d77-fef7-4804-b585-2c4af617ff5d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.302262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46180cb-683d-45a5-b3e0-c8e94d811be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.303353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46180cb-683d-45a5-b3e0-c8e94d811be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.303747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46180cb-683d-45a5-b3e0-c8e94d811be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.304113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46180cb-683d-45a5-b3e0-c8e94d811be8 admin admin] PATH_INFO: `/v3/projects/45be6ec4bd2140ad8d3cb8f39c086c81/users/e948bc65dfad48df96da92ef3688055e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.341657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0ad46-d20e-4949-a903-ccdbe2956ab9 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.341889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46180cb-683d-45a5-b3e0-c8e94d811be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45be6ec4bd2140ad8d3cb8f39c086c81, user_id=e948bc65dfad48df96da92ef3688055e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.341889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46180cb-683d-45a5-b3e0-c8e94d811be8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:30.342304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.343267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.343623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.344088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/50db546c7a2b45ef9dcfbf76832430c1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.371475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=50db546c7a2b45ef9dcfbf76832430c1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.371475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:30.392101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.402799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.406402 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1984/4007] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:30 2021] PUT /identity/v3/projects/45be6ec4bd2140ad8d3cb8f39c086c81/users/e948bc65dfad48df96da92ef3688055e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:30.419074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b81ec-ed6e-4bb8-b617-d2dab631c1c0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.419869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b81ec-ed6e-4bb8-b617-d2dab631c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.420373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b81ec-ed6e-4bb8-b617-d2dab631c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.452321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fd8b81ec-ed6e-4bb8-b617-d2dab631c1c0 None None] MFA Rules not processed for user `e948bc65dfad48df96da92ef3688055e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:30.453580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd8b81ec-ed6e-4bb8-b617-d2dab631c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.499202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1', 'request_id': 'req-a5507f5e-fdc4-413e-9818-98fcd954a300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.521109 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1985/4008] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:30 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:30.533843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b81ec-ed6e-4bb8-b617-d2dab631c1c0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:30.557321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1', 'request_id': 'req-a5507f5e-fdc4-413e-9818-98fcd954a300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.567809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1', 'request_id': 'req-a5507f5e-fdc4-413e-9818-98fcd954a300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.580188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] The token cache is being invalidate because project 50db546c7a2b45ef9dcfbf76832430c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:30.580473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.581185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.590976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1', 'request_id': 'req-a5507f5e-fdc4-413e-9818-98fcd954a300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.594351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1', 'request_id': 'req-a5507f5e-fdc4-413e-9818-98fcd954a300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.594351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '50db546c7a2b45ef9dcfbf76832430c1', 'request_id': 'req-a5507f5e-fdc4-413e-9818-98fcd954a300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.602121 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2024/4009] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:30 2021] DELETE /identity/v3/domains/50db546c7a2b45ef9dcfbf76832430c1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:30.606345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:30.607973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.610636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b81ec-ed6e-4bb8-b617-d2dab631c1c0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.676903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.678118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.678633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.678979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] PATH_INFO: `/v3/users/e948bc65dfad48df96da92ef3688055e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.680333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e948bc65dfad48df96da92ef3688055e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.682283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:30.684920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5507f5e-fdc4-413e-9818-98fcd954a300 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.693838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.694755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.695075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.695518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e077e8f4214e4625980a8a0700cb5695/users/b1cddd70971d42699f40676bba80747f/roles/0f654933268848ba8206ec64dbe280a2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.698066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e077e8f4214e4625980a8a0700cb5695, user_id=b1cddd70971d42699f40676bba80747f, role_id=0f654933268848ba8206ec64dbe280a2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.703376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:30.707022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role 0f654933268848ba8206ec64dbe280a2 was removed from user b1cddd70971d42699f40676bba80747f on domain e077e8f4214e4625980a8a0700cb5695. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:30.707352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.708136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.848563 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2025/4010] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 21:23:30 2021] DELETE /identity/v3/domains/e077e8f4214e4625980a8a0700cb5695/users/b1cddd70971d42699f40676bba80747f/roles/0f654933268848ba8206ec64dbe280a2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:30.852673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:30.854072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:30.912125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e948bc65dfad48df96da92ef3688055e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.928208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e948bc65dfad48df96da92ef3688055e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.929132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df747e74-79a0-4a86-ab69-6b4083076a30 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:30.937387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:30.938592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:30.939041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:30.939677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles/0f654933268848ba8206ec64dbe280a2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:30.944056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0f654933268848ba8206ec64dbe280a2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:30.947166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e948bc65dfad48df96da92ef3688055e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.948008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e948bc65dfad48df96da92ef3688055e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.948907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a736e7a-817a-4d78-b8f7-a6a6e1322d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e948bc65dfad48df96da92ef3688055e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:30.956017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:31.007953 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1986/4011] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:30 2021] DELETE /identity/v3/users/e948bc65dfad48df96da92ef3688055e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:31.012799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:31.013117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:31.013398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:31.039976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:31.039976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:31.088404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role 0f654933268848ba8206ec64dbe280a2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:31.088404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.089199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.091652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2026/4012] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:30 2021] DELETE /identity/v3/roles/0f654933268848ba8206ec64dbe280a2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:31.095744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:31.097255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:31.098846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1987/4013] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:31.111163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:31.112913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:31.186487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5630ed-7697-47c4-94d8-5995e05d17bd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:31.194528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635332-8670-47d8-85ae-15d900600883 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:31.200703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:31.202115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:31.202607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:31.203061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e077e8f4214e4625980a8a0700cb5695` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:31.205575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e077e8f4214e4625980a8a0700cb5695)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:31.207892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:31.232019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.232915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.253475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:31.253475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:31.253475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:31.253475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:31.254771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:31.340856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.341478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.344736 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2027/4014] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:31 2021] PATCH /identity/v3/domains/e077e8f4214e4625980a8a0700cb5695 => generated 276 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:31.346360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:31.348744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:31.348960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:31.350243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:31.364958 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1988/4015] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:31.443603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39139c58-4d6b-410b-9f6b-901b1c897a2a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:31.448645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:31.450132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:31.450417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:31.450690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e077e8f4214e4625980a8a0700cb5695` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:31.462342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e077e8f4214e4625980a8a0700cb5695)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:31.464133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:31.488857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.499193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.673007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695', 'request_id': 'req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.782711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695', 'request_id': 'req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.791371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695', 'request_id': 'req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.823888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] The token cache is being invalidate because project e077e8f4214e4625980a8a0700cb5695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:31.824166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.825837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.838939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695', 'request_id': 'req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.840688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695', 'request_id': 'req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.841560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e077e8f4214e4625980a8a0700cb5695', 'request_id': 'req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:31.851927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2028/4016] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:31 2021] DELETE /identity/v3/domains/e077e8f4214e4625980a8a0700cb5695 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:31.860095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:31.861576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:31.875874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042dc42-0fd6-481a-b44f-0d96c71bb424 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:31.896124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:31.902645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:32.005852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.006997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.007409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.007853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/3cc5341da28d44568902110637680f40/groups/a199f8f49cac422e94b59146546f74fa/roles/ae5eefbd706e4f5b8770e328ea9227ec` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.011807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3cc5341da28d44568902110637680f40, group_id=a199f8f49cac422e94b59146546f74fa, role_id=ae5eefbd706e4f5b8770e328ea9227ec)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.013269 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:32.013269 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:32.013269 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:32.018846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.028523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role ae5eefbd706e4f5b8770e328ea9227ec was removed from group a199f8f49cac422e94b59146546f74fa on domain 3cc5341da28d44568902110637680f40. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:32.028944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.030055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.046992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a1a2-f28b-4ff2-8a46-992fca01ea29 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:32.055446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.056791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.057742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.058108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] PATH_INFO: `/v3/projects/45be6ec4bd2140ad8d3cb8f39c086c81` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.060967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45be6ec4bd2140ad8d3cb8f39c086c81)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.063633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.124739 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1989/4017] 10.222.0.32 () {58 vars in 1466 bytes} [Sat Dec 25 21:23:31 2021] DELETE /identity/v3/domains/3cc5341da28d44568902110637680f40/groups/a199f8f49cac422e94b59146546f74fa/roles/ae5eefbd706e4f5b8770e328ea9227ec => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:32.126058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:32.127406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:32.194492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e81c-cf26-4112-bd2b-24b6cfecde62 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:32.200199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45be6ec4bd2140ad8d3cb8f39c086c81', 'request_id': 'req-148610d8-be30-45cf-8144-cea47375ba65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.257089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.258951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.259102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.259275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups/a199f8f49cac422e94b59146546f74fa/users/b1cddd70971d42699f40676bba80747f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.261620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a199f8f49cac422e94b59146546f74fa, user_id=b1cddd70971d42699f40676bba80747f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.262644 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:32.262644 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:32.262644 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:32.263876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.274170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45be6ec4bd2140ad8d3cb8f39c086c81', 'request_id': 'req-148610d8-be30-45cf-8144-cea47375ba65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.282531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45be6ec4bd2140ad8d3cb8f39c086c81', 'request_id': 'req-148610d8-be30-45cf-8144-cea47375ba65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.293709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] The token cache is being invalidate because project 45be6ec4bd2140ad8d3cb8f39c086c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:32.293998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.294664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-148610d8-be30-45cf-8144-cea47375ba65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.296319 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2029/4018] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:31 2021] DELETE /identity/v3/projects/45be6ec4bd2140ad8d3cb8f39c086c81 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:32.313767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e59ab9-50e7-4396-b942-f1de6c7c265e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.314225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e59ab9-50e7-4396-b942-f1de6c7c265e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.314574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e59ab9-50e7-4396-b942-f1de6c7c265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.337381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d2e59ab9-50e7-4396-b942-f1de6c7c265e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:32.338807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d2e59ab9-50e7-4396-b942-f1de6c7c265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:32.356156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b1cddd70971d42699f40676bba80747f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:32.437852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2030/4019] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:32.441475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77074908-0796-4518-8eda-eb5109573b49 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.441880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77074908-0796-4518-8eda-eb5109573b49 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.446136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77074908-0796-4518-8eda-eb5109573b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.457046 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1990/4020] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:23:32 2021] DELETE /identity/v3/groups/a199f8f49cac422e94b59146546f74fa/users/b1cddd70971d42699f40676bba80747f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:32.461760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:32.465698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:32.491351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-77074908-0796-4518-8eda-eb5109573b49 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:32.493067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-77074908-0796-4518-8eda-eb5109573b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:32.602661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd59b6-d6b1-4da0-b278-ed2b0fc4618f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:32.606781 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2031/4021] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:32.610809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77074908-0796-4518-8eda-eb5109573b49 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:32.613343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.614280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.615430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.615430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/groups/a199f8f49cac422e94b59146546f74fa` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.616578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a199f8f49cac422e94b59146546f74fa)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.617734 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:32.617734 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:32.617734 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:32.619177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.622216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77074908-0796-4518-8eda-eb5109573b49 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:32.628684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.629775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.630061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.630335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.631395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:32.631699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.633823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.658709 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2032/4022] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:32.659458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:32.670777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89177eef-f073-4c0c-a431-4b7f2e462035 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:32.679543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.679543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.679543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.679543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.680481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.681967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.791373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1991/4023] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:23:32 2021] DELETE /identity/v3/groups/a199f8f49cac422e94b59146546f74fa => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:32.795525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:32.818589 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2033/4024] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:32 2021] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:32.822722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:32.864135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83ccb-8b49-4c3a-93a1-eca39c93b8a0 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:32.893550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17aa24-78e0-47d1-be73-21dc6fcbfe2d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:32.902567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.902567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.902567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.902567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.902941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.904813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.932943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:32.933947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:32.934335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:32.934671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles/ae5eefbd706e4f5b8770e328ea9227ec` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:32.936576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ae5eefbd706e4f5b8770e328ea9227ec)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:32.938208 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:32.938208 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:32.938208 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:32.938827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:32.989166 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2034/4025] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:32 2021] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:32.992960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.009639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69951ce-7bdd-48a9-b7b2-119db924d6f2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:33.015129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:33.015880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.016225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.016595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.017438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:33.019092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:33.031347 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2035/4026] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:32 2021] GET /identity/v3/roles => generated 1881 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:33.035314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.045723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260a3fa-5d7b-4638-adc4-32ec4a33273b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:33.050714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:33.054764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.054764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.054764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.054764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:33.055253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role ae5eefbd706e4f5b8770e328ea9227ec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:33.055253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.055454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:33.055545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.057358 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1992/4027] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:32 2021] DELETE /identity/v3/roles/ae5eefbd706e4f5b8770e328ea9227ec => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:33.062268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.064670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:33.066042 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2036/4028] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:33 2021] GET /identity/v3/roles => generated 1650 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:33.070555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.074216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:33.090107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f391a1-e7c8-4d71-ad9a-f8b1723180d6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:33.153364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd3148-db17-4e6f-ab9f-76371968deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:33.154322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd3148-db17-4e6f-ab9f-76371968deb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.155282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd3148-db17-4e6f-ab9f-76371968deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.155282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd3148-db17-4e6f-ab9f-76371968deb3 admin admin] PATH_INFO: `/v3/projects/d40ba42d58974876a230d63a0e077c68/users/56a018037d5a4620b73e52aa4b537026/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.164891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f1770-dead-45f6-bd58-f16b82e4b1be tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:33.169698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:33.170637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.170928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.171994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/3cc5341da28d44568902110637680f40` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.173077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd3148-db17-4e6f-ab9f-76371968deb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40ba42d58974876a230d63a0e077c68, user_id=56a018037d5a4620b73e52aa4b537026, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:33.173359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3cc5341da28d44568902110637680f40)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:33.174974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:33.175721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd3148-db17-4e6f-ab9f-76371968deb3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:33.197135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3cc5341da28d44568902110637680f40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.198084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3cc5341da28d44568902110637680f40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.289115 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2037/4029] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:33 2021] PUT /identity/v3/projects/d40ba42d58974876a230d63a0e077c68/users/56a018037d5a4620b73e52aa4b537026/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:33.300206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.300494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.304321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.328233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] MFA Rules not processed for user `56a018037d5a4620b73e52aa4b537026`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:33.330250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:33.339169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3cc5341da28d44568902110637680f40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.340265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3cc5341da28d44568902110637680f40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.346351 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1993/4030] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:33 2021] PATCH /identity/v3/domains/3cc5341da28d44568902110637680f40 => generated 277 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:33.347540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.349001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:33.409810 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2038/4031] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:33 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:33.414599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.416265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:33.422989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4cbb7-75dc-4b79-9363-4570ebf40fbd tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:33.492682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:33.493654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.494065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.494351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/3cc5341da28d44568902110637680f40` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.508131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd24903-fee2-4aab-a53a-3aee57c2c460 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:33.510354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3cc5341da28d44568902110637680f40)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:33.512071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:33.513337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:33.513998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.514626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.514742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.515371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:33.517297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:33.541222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3cc5341da28d44568902110637680f40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.554612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3cc5341da28d44568902110637680f40'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.691654 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2039/4032] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:33 2021] POST /identity/v3/projects => generated 377 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:33.696222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.770253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc5341da28d44568902110637680f40', 'request_id': 'req-7445227e-e4c8-4684-aeee-bc05e69b4d49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.780992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc5341da28d44568902110637680f40', 'request_id': 'req-7445227e-e4c8-4684-aeee-bc05e69b4d49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.797852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78bae8-b53d-44b5-923c-39ef98b66796 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:33.858731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:33.859461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:33.859741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:33.860135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:33.860707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:33.862674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:33.919941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc5341da28d44568902110637680f40', 'request_id': 'req-7445227e-e4c8-4684-aeee-bc05e69b4d49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.931146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] The token cache is being invalidate because project 3cc5341da28d44568902110637680f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:33.932055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.932718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.941505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3cc5341da28d44568902110637680f40', 'request_id': 'req-7445227e-e4c8-4684-aeee-bc05e69b4d49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.942429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3cc5341da28d44568902110637680f40', 'request_id': 'req-7445227e-e4c8-4684-aeee-bc05e69b4d49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.943043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3cc5341da28d44568902110637680f40', 'request_id': 'req-7445227e-e4c8-4684-aeee-bc05e69b4d49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:33.954187 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1994/4033] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:33 2021] DELETE /identity/v3/domains/3cc5341da28d44568902110637680f40 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:33.958318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.959737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:33.982094 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2040/4034] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:33 2021] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:33.987028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:33.989117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.003714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc274ff0-d3c8-4d66-9675-85b76f195be7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.010577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.029438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.029438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.029438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.029438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.029438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.029438 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2041/4035] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:33 2021] GET /identity/v3/roles => generated 1650 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:34.037374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.057528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e62c5-5c7d-4cf3-bc1b-1344d1a6d334 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.066576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445227e-e4c8-4684-aeee-bc05e69b4d49 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.069636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.070600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.070883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.071162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] PATH_INFO: `/v3/projects/a52856794f214b7e8f4e96decd2bd3e8/users/58ca1b4be9c54864ae256a4a55f1e97a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.080947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.081882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.082170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.082452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f/users/b1cddd70971d42699f40676bba80747f/roles/b7e1f737de9e43dea1bb56c7361b4b7b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.084836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e1c4a6f924504a5aafa3fe4b3701b57f, user_id=b1cddd70971d42699f40676bba80747f, role_id=b7e1f737de9e43dea1bb56c7361b4b7b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.088218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.095560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role b7e1f737de9e43dea1bb56c7361b4b7b was removed from user b1cddd70971d42699f40676bba80747f on domain e1c4a6f924504a5aafa3fe4b3701b57f. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:34.095853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.096579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.106288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52856794f214b7e8f4e96decd2bd3e8, user_id=58ca1b4be9c54864ae256a4a55f1e97a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.109735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.196951 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1995/4036] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 21:23:33 2021] DELETE /identity/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f/users/b1cddd70971d42699f40676bba80747f/roles/b7e1f737de9e43dea1bb56c7361b4b7b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:34.201694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.203058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.239466 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2042/4037] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:34 2021] PUT /identity/v3/projects/a52856794f214b7e8f4e96decd2bd3e8/users/58ca1b4be9c54864ae256a4a55f1e97a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:34.243723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.246847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.273573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5433b-c5b4-43fc-bdac-3b9aa8a84200 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.317911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d93d1a-74a2-4646-8e12-6ec1e6d1b7c7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.323429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.324528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.324528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.325645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.325766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.328040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.342197 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2043/4038] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:34 2021] GET /identity/v3/roles => generated 1650 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:34.346586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.347037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.348109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.348597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.349066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles/b7e1f737de9e43dea1bb56c7361b4b7b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.350980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b7e1f737de9e43dea1bb56c7361b4b7b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.352869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.360417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea63e6-261b-4898-8236-b200382bad5b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.366650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4e8f1-221c-4087-955a-8a139d47f2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.367872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e8f1-221c-4087-955a-8a139d47f2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.368216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e8f1-221c-4087-955a-8a139d47f2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.369028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e8f1-221c-4087-955a-8a139d47f2c5 admin admin] PATH_INFO: `/v3/projects/a52856794f214b7e8f4e96decd2bd3e8/users/58ca1b4be9c54864ae256a4a55f1e97a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.371597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4e8f1-221c-4087-955a-8a139d47f2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52856794f214b7e8f4e96decd2bd3e8, user_id=58ca1b4be9c54864ae256a4a55f1e97a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.374329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4e8f1-221c-4087-955a-8a139d47f2c5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.386127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2044/4039] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:34 2021] PUT /identity/v3/projects/a52856794f214b7e8f4e96decd2bd3e8/users/58ca1b4be9c54864ae256a4a55f1e97a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:34.396857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213152-5bc6-456b-8d22-9e853910470e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.397181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213152-5bc6-456b-8d22-9e853910470e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.397512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213152-5bc6-456b-8d22-9e853910470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.427031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cd213152-5bc6-456b-8d22-9e853910470e None None] MFA Rules not processed for user `58ca1b4be9c54864ae256a4a55f1e97a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:34.428284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cd213152-5bc6-456b-8d22-9e853910470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.473357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role b7e1f737de9e43dea1bb56c7361b4b7b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:34.473607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.474428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.477037 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1996/4040] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:34 2021] DELETE /identity/v3/roles/b7e1f737de9e43dea1bb56c7361b4b7b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:34.481846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.485416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.521013 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2045/4041] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:34 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:34.524431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213152-5bc6-456b-8d22-9e853910470e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.538766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213152-5bc6-456b-8d22-9e853910470e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.587139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d91e-d125-4d44-a641-70587e95686f tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.596309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.597499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.597790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.598231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.600599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e1c4a6f924504a5aafa3fe4b3701b57f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.602259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.625354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.628338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.628338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.628338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.628338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.629912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.630083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.630651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.738679 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2046/4042] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:34 2021] POST /identity/v3/domains => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:34.743014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.744658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.797407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.798086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:34.807189 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1997/4043] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:34 2021] PATCH /identity/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f => generated 278 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:34.819083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.819083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.828029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fa62e-40c6-4eca-a8b8-de5e200e90ad tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.836025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.836025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.836025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.836346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.836346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:34.838984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:34.883568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1f3b5-d335-4858-8458-f50fb04c8723 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:34.943002 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2047/4044] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:34 2021] POST /identity/v3/projects => generated 408 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:34.946826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:34.950550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:34.972049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:34.974988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:34.974988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:34.974988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:34.997186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e1c4a6f924504a5aafa3fe4b3701b57f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.007663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.066854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ed131-6a1d-4296-8983-2f81222bf695 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.079008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.079705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.079987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.080258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.081035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.081275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.083884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.104597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.229899 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2048/4045] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:34 2021] POST /identity/v3/users => generated 347 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:35.233976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.248479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a1af8-a78f-4a65-bac4-39df45594f61 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.257078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f', 'request_id': 'req-f9ae23d2-db6d-4067-9850-c2902907b5b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.265705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f', 'request_id': 'req-f9ae23d2-db6d-4067-9850-c2902907b5b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.338767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f', 'request_id': 'req-f9ae23d2-db6d-4067-9850-c2902907b5b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.355685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] The token cache is being invalidate because project e1c4a6f924504a5aafa3fe4b3701b57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:35.356806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.358418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.369625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.369832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f', 'request_id': 'req-f9ae23d2-db6d-4067-9850-c2902907b5b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.370214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.370540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.370811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.370922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f', 'request_id': 'req-f9ae23d2-db6d-4067-9850-c2902907b5b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.371609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.371943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e1c4a6f924504a5aafa3fe4b3701b57f', 'request_id': 'req-f9ae23d2-db6d-4067-9850-c2902907b5b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.378600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.400236 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1998/4046] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:34 2021] DELETE /identity/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:35.406707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.408658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:35.412815 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2049/4047] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:35 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:35.420963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.425297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:35.452513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074de8b2-fddb-450d-b525-75c4478d1251 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.466409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aed66e-dc0a-4dfa-a676-7a28509cea62 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.470502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed66e-dc0a-4dfa-a676-7a28509cea62 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.471481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed66e-dc0a-4dfa-a676-7a28509cea62 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.471934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aed66e-dc0a-4dfa-a676-7a28509cea62 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/projects/17a91add2a09469c9133f05562195e36/users/451a954bd8b14111a71224e626b053be/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.499203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae23d2-db6d-4067-9850-c2902907b5b7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.501974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aed66e-dc0a-4dfa-a676-7a28509cea62 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:create_grant(project_id=17a91add2a09469c9133f05562195e36, user_id=451a954bd8b14111a71224e626b053be, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.504647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aed66e-dc0a-4dfa-a676-7a28509cea62 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.509432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.510901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.510901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.510901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.512488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.514324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.526522 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 1999/4048] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:35 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:35.530183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.540771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f728ad-c9e1-4d7e-932e-1f85ea83ad1e tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.545981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.546944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.547288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.547565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects/784119b833ae41fd87334f4ddab7bb02/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.549642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_grant(project_id=784119b833ae41fd87334f4ddab7bb02, user_id=429b328699f14a3eb3f11f801692a21d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.554923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.617135 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2050/4049] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:35 2021] PUT /identity/v3/projects/17a91add2a09469c9133f05562195e36/users/451a954bd8b14111a71224e626b053be/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:35.619263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f91f3-9569-4ae9-a8e0-ff259db9ce1c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.619558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f91f3-9569-4ae9-a8e0-ff259db9ce1c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.619839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f91f3-9569-4ae9-a8e0-ff259db9ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.642211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2000/4050] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:35 2021] PUT /identity/v3/projects/784119b833ae41fd87334f4ddab7bb02/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:35.646412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.717138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76455671-052f-4b5a-8696-1ec42658b0d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.722297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.722956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.723242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.723520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.724189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.725301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.754193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-816f91f3-9569-4ae9-a8e0-ff259db9ce1c None None] MFA Rules not processed for user `451a954bd8b14111a71224e626b053be`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:35.755510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-816f91f3-9569-4ae9-a8e0-ff259db9ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:35.781049 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2051/4051] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:35 2021] POST /identity/v3/auth/tokens => generated 3351 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:35.787207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8a0ca-83d5-4aca-b05b-7c219fec67da None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.787958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8a0ca-83d5-4aca-b05b-7c219fec67da None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.788479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8a0ca-83d5-4aca-b05b-7c219fec67da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.800610 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2001/4052] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:23:35 2021] GET /identity/v3/auth/projects => generated 826 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:35.801551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.812159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f5f8a0ca-83d5-4aca-b05b-7c219fec67da None None] MFA Rules not processed for user `451a954bd8b14111a71224e626b053be`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:35.812735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad079ef-5d50-4f2f-bdc7-02bb3429c5d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.813872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f5f8a0ca-83d5-4aca-b05b-7c219fec67da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:35.818524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.819592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.821213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.821213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects/784119b833ae41fd87334f4ddab7bb02/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.822584 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2052/4053] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:35 2021] POST /identity/v3/auth/tokens => generated 3351 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:35.826936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=784119b833ae41fd87334f4ddab7bb02, user_id=429b328699f14a3eb3f11f801692a21d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.827118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8a0ca-83d5-4aca-b05b-7c219fec67da None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.830558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.837203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8a0ca-83d5-4aca-b05b-7c219fec67da None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.837939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role ea5f089fb3e14674bf5b72ebed6e787a was removed from user 429b328699f14a3eb3f11f801692a21d on project 784119b833ae41fd87334f4ddab7bb02. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:35.838582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.840676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:35.843331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451a954bd8b14111a71224e626b053be', 'user_domain_id': '384f140a9f9f44ae9493445f4970b9ad', 'system_scope': None, 'project_id': '17a91add2a09469c9133f05562195e36', 'project_domain_id': '384f140a9f9f44ae9493445f4970b9ad', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.844634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.850496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.850496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.850496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:35.861532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.863569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:35.876947 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2053/4054] 10.222.0.32 () {56 vars in 1283 bytes} [Sat Dec 25 21:23:35 2021] GET /identity/v3/auth/tokens => generated 3351 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:35.879681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.881468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:35.949668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669637a-e299-4353-ac95-30316f830606 tempest-test_project-698070350 tempest-user-542432515] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:35.971598 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2002/4055] 10.222.0.32 () {58 vars in 1466 bytes} [Sat Dec 25 21:23:35 2021] DELETE /identity/v3/projects/784119b833ae41fd87334f4ddab7bb02/users/429b328699f14a3eb3f11f801692a21d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:35.973595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:35.975330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:35.976093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:35.976278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:35.977009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:35.977288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/users/451a954bd8b14111a71224e626b053be` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:35.978724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:delete_user(user_id=451a954bd8b14111a71224e626b053be)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:35.980758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:36.077740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afd93e-6d85-4ff1-8738-50f4b408e2d8 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:36.087732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:36.088741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:36.089619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:36.089911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:36.090635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:36.092569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:36.213976 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2003/4056] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:35 2021] POST /identity/v3/users => generated 321 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:36.223485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:36.248582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749db4b-831c-4cd9-8d03-bb0b2509a2b4 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:36.251117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451a954bd8b14111a71224e626b053be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.261233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:36.263029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:36.263573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:36.264219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451a954bd8b14111a71224e626b053be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.264972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:36.266621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:36.270073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:36.290686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451a954bd8b14111a71224e626b053be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.294820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451a954bd8b14111a71224e626b053be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.394190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d2bd8a32-cf41-44c6-86ac-a08ba7810d5a tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451a954bd8b14111a71224e626b053be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.401574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2054/4057] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:35 2021] DELETE /identity/v3/users/451a954bd8b14111a71224e626b053be => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:36.402946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:36.403241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:36.403648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:36.436490 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2004/4058] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:36 2021] POST /identity/v3/projects => generated 362 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:36.440487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:36.443175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] MFA Rules not processed for user `d2cc54d7a742403f896dd71d222895c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:36.444510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:36.452596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:36.516139 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2055/4059] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:36 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:36.517271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:36.519028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:36.540904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311d961-eb6e-489d-9c84-5e665364bff5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:36.546996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:36.547883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:36.548166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:36.548439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/projects/17a91add2a09469c9133f05562195e36` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:36.556762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17a91add2a09469c9133f05562195e36)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:36.559395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:36.674871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00175c-7bd5-45bd-b746-ea13cb5cdc4d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:36.681098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:36.681784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:36.682079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:36.682345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:36.683592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:36.700760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:36.721755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a91add2a09469c9133f05562195e36', 'request_id': 'req-6dd14934-a923-4277-9f0c-797680398cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.729906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a91add2a09469c9133f05562195e36', 'request_id': 'req-6dd14934-a923-4277-9f0c-797680398cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.891026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a91add2a09469c9133f05562195e36', 'request_id': 'req-6dd14934-a923-4277-9f0c-797680398cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.902704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] The token cache is being invalidate because project 17a91add2a09469c9133f05562195e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:36.902988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.903726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:36.905537 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2005/4060] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:36 2021] DELETE /identity/v3/projects/17a91add2a09469c9133f05562195e36 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:36.906463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:36.909499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:36.932275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2056/4061] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:36 2021] POST /identity/v3/projects => generated 361 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:36.935720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:36.938107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.004709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd14934-a923-4277-9f0c-797680398cf3 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:37.024588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318489c-c878-4e77-9f77-28741209c607 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:37.030499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:37.031629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.031977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.032323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/domains/384f140a9f9f44ae9493445f4970b9ad` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.034145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=384f140a9f9f44ae9493445f4970b9ad)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:37.035862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:37.062896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.064366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.082472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:37.086845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.086845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.086845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.088395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.102340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:37.103951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:37.115578 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2006/4062] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:37.116355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:37.117655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.176170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.176920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.179561 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2057/4063] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:36 2021] PATCH /identity/v3/domains/384f140a9f9f44ae9493445f4970b9ad => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:37.180268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:37.181771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.188964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2387d99-9b51-43bb-b4a8-2dc8def99e05 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:37.248939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5c884-fb18-447e-a4d8-6fed5699691c tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:37.252625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:37.253355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.253580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.253846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.256105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.256619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:37.257319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.257847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.258237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.259096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:37.260695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:37.276388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:37.276388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:37.281156 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2058/4064] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:37.282115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:37.283489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.351467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08890506-d2aa-44c1-8622-9ea66afbcff9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:37.356913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58ca1b4be9c54864ae256a4a55f1e97a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a52856794f214b7e8f4e96decd2bd3e8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:37.357774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.358059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.358606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] PATH_INFO: `/v3/domains/384f140a9f9f44ae9493445f4970b9ad` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.371101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2007/4065] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:23:37 2021] POST /identity/v3/roles => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:37.371290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=384f140a9f9f44ae9493445f4970b9ad)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:37.372195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:37.372802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:37.374878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.397040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038398f-81b1-47df-b111-74f5e3addfe5 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:37.400561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.408355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:37.409449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.409836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.410158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects/35ec4d15c6b14acd870ced20f0094ac2/users/20a90fb740b64536aeedda4688b13187/roles/1d1f0ff7edd344839eb142e86acb48ef` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.416009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.430262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_grant(project_id=35ec4d15c6b14acd870ced20f0094ac2, user_id=20a90fb740b64536aeedda4688b13187, role_id=1d1f0ff7edd344839eb142e86acb48ef)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:37.433898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:37.585507 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2008/4066] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:37 2021] PUT /identity/v3/projects/35ec4d15c6b14acd870ced20f0094ac2/users/20a90fb740b64536aeedda4688b13187/roles/1d1f0ff7edd344839eb142e86acb48ef => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:37.590544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:37.596311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad', 'request_id': 'req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.669024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383664-5af3-42f9-8030-d800007d512a tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:37.725953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea24a8-722f-43b5-9a27-bbd55e7702d7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:37.726883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea24a8-722f-43b5-9a27-bbd55e7702d7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.727170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea24a8-722f-43b5-9a27-bbd55e7702d7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.727450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea24a8-722f-43b5-9a27-bbd55e7702d7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects/2d66d1215a744ec2b67a53c00d9d53cd/users/20a90fb740b64536aeedda4688b13187/roles/1d1f0ff7edd344839eb142e86acb48ef` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.730394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea24a8-722f-43b5-9a27-bbd55e7702d7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d66d1215a744ec2b67a53c00d9d53cd, user_id=20a90fb740b64536aeedda4688b13187, role_id=1d1f0ff7edd344839eb142e86acb48ef)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:37.733105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea24a8-722f-43b5-9a27-bbd55e7702d7 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:37.876628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad', 'request_id': 'req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.883613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad', 'request_id': 'req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.894204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] The token cache is being invalidate because project 384f140a9f9f44ae9493445f4970b9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:37.894476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.895123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.903132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad', 'request_id': 'req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.904557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad', 'request_id': 'req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.908290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '384f140a9f9f44ae9493445f4970b9ad', 'request_id': 'req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:37.913626 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2059/4067] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:37 2021] DELETE /identity/v3/domains/384f140a9f9f44ae9493445f4970b9ad => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:37.919892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:37.921405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:37.938688 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2009/4068] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:37 2021] PUT /identity/v3/projects/2d66d1215a744ec2b67a53c00d9d53cd/users/20a90fb740b64536aeedda4688b13187/roles/1d1f0ff7edd344839eb142e86acb48ef => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:37.940277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ba28-7554-4d82-8a56-65c3c8011fb6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:37.940657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ba28-7554-4d82-8a56-65c3c8011fb6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:37.940994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ba28-7554-4d82-8a56-65c3c8011fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:37.989826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c8c0f-d81b-4c35-9d02-04ab84ade2d7 tempest-TestDefaultProjectId-1322002100 tempest-TestDefaultProjectId-1322002100-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:38.029092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3d95ba28-7554-4d82-8a56-65c3c8011fb6 None None] MFA Rules not processed for user `20a90fb740b64536aeedda4688b13187`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:38.030620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3d95ba28-7554-4d82-8a56-65c3c8011fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.035842 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2010/4069] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:37 2021] POST /identity/v3/auth/tokens => generated 334 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:23:38.040529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.041040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.041316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.054029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:38.055054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.055489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.055861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] PATH_INFO: `/v3/users/56a018037d5a4620b73e52aa4b537026` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.056125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] MFA Rules not processed for user `20a90fb740b64536aeedda4688b13187`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:38.057510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.058661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a018037d5a4620b73e52aa4b537026)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:38.060909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:38.142227 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2011/4070] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:38 2021] POST /identity/v3/auth/tokens => generated 3214 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Dec 25 21:23:38.146599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:38.148261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.248445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba3d9b-4204-4928-9012-6d8a49f522c0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:38.255329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a80fd-2fe8-4587-9d9a-21db040ddf0b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:38.256358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a80fd-2fe8-4587-9d9a-21db040ddf0b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.256700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a80fd-2fe8-4587-9d9a-21db040ddf0b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.257409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a80fd-2fe8-4587-9d9a-21db040ddf0b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.268009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a80fd-2fe8-4587-9d9a-21db040ddf0b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:38.270300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a80fd-2fe8-4587-9d9a-21db040ddf0b tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:38.281884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a018037d5a4620b73e52aa4b537026'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:38.290678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a018037d5a4620b73e52aa4b537026'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:38.303345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a018037d5a4620b73e52aa4b537026'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:38.304237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a018037d5a4620b73e52aa4b537026'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:38.406354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2012/4071] 10.222.0.32 () {56 vars in 1307 bytes} [Sat Dec 25 21:23:38 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:38.413168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe6c43-e382-45e4-a037-fc9365a7b370 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.413532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe6c43-e382-45e4-a037-fc9365a7b370 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.413965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe6c43-e382-45e4-a037-fc9365a7b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.426156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0afe6c43-e382-45e4-a037-fc9365a7b370 None None] MFA Rules not processed for user `20a90fb740b64536aeedda4688b13187`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:38.427350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0afe6c43-e382-45e4-a037-fc9365a7b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.491294 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2013/4072] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:38 2021] POST /identity/v3/auth/tokens => generated 3214 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Dec 25 21:23:38.497086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe6c43-e382-45e4-a037-fc9365a7b370 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:38.507818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe6c43-e382-45e4-a037-fc9365a7b370 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:38.512953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:38.513814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.514097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.514372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/roles/1d1f0ff7edd344839eb142e86acb48ef` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.516229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1d1f0ff7edd344839eb142e86acb48ef)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:38.516659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe4d9090-e723-4b94-a2a5-6e8fa82045d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a018037d5a4620b73e52aa4b537026'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:38.517859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:38.524801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2060/4073] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:37 2021] DELETE /identity/v3/users/56a018037d5a4620b73e52aa4b537026 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:38.530621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.531308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.531790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.569392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:38.576813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.662183 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2061/4074] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:38.675102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:38.676626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.732559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invalidating the token cache because role 1d1f0ff7edd344839eb142e86acb48ef has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:38.733152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:38.735005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:38.738224 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2014/4075] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:38 2021] DELETE /identity/v3/roles/1d1f0ff7edd344839eb142e86acb48ef => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:38.742333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:38.743690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.751623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6472-f69a-4cce-a990-c8cec1f801d1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:38.809487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:38.810444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.810688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.810939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.819742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7d51f-3d7f-4fbe-8791-af71787064ce tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:38.821893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:38.826294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:38.827237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:38.827600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:38.827966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects/2d66d1215a744ec2b67a53c00d9d53cd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:38.829245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d66d1215a744ec2b67a53c00d9d53cd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:38.831194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:38.887732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:38.890391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:38.903424 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2062/4076] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:23:39.000913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d66d1215a744ec2b67a53c00d9d53cd', 'request_id': 'req-728621d7-aa66-46c4-8aca-508a398d1da1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.007854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d66d1215a744ec2b67a53c00d9d53cd', 'request_id': 'req-728621d7-aa66-46c4-8aca-508a398d1da1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.105883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d66d1215a744ec2b67a53c00d9d53cd', 'request_id': 'req-728621d7-aa66-46c4-8aca-508a398d1da1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.119905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] The token cache is being invalidate because project 2d66d1215a744ec2b67a53c00d9d53cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:39.120867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.121829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.126891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2015/4077] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:38 2021] DELETE /identity/v3/projects/2d66d1215a744ec2b67a53c00d9d53cd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:39.128078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:39.140431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222508af-2c66-48f8-9b8a-d9d358383a77 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:39.211216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:39.212130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:39.212415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:39.212694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects/2d66d1215a744ec2b67a53c00d9d53cd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:39.220982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d66d1215a744ec2b67a53c00d9d53cd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:39.222830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:39.239256 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Could not find project: 2d66d1215a744ec2b67a53c00d9d53cd.: keystone.exception.ProjectNotFound: Could not find project: 2d66d1215a744ec2b67a53c00d9d53cd. Dec 25 21:23:39.243635 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2063/4078] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:39 2021] DELETE /identity/v3/projects/2d66d1215a744ec2b67a53c00d9d53cd => generated 113 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:23:39.244887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:39.251053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:39.282760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728621d7-aa66-46c4-8aca-508a398d1da1 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:39.288127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:39.299260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:39.302553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:39.302849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/projects/35ec4d15c6b14acd870ced20f0094ac2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:39.304996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35ec4d15c6b14acd870ced20f0094ac2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:39.307664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:39.457600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ec4d15c6b14acd870ced20f0094ac2', 'request_id': 'req-176979a2-5ef7-4779-aec0-228ca476f2cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.463996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ec4d15c6b14acd870ced20f0094ac2', 'request_id': 'req-176979a2-5ef7-4779-aec0-228ca476f2cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.582981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ec4d15c6b14acd870ced20f0094ac2', 'request_id': 'req-176979a2-5ef7-4779-aec0-228ca476f2cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.588648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:39.591205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:39.597621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] The token cache is being invalidate because project 35ec4d15c6b14acd870ced20f0094ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:39.598142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.600082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.605770 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2016/4079] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:39 2021] DELETE /identity/v3/projects/35ec4d15c6b14acd870ced20f0094ac2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:39.611025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:39.612544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:39.716930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09705-c10b-4cd8-a7f6-1e00d97a8207 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:39.730742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176979a2-5ef7-4779-aec0-228ca476f2cb tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:39.739873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:39.740920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:39.741371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:39.742023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/users/20a90fb740b64536aeedda4688b13187` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:39.743373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorizing `identity:delete_user(user_id=20a90fb740b64536aeedda4688b13187)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:39.746149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:39.796805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:39.798136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:39.798572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:39.799032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] PATH_INFO: `/v3/projects/d40ba42d58974876a230d63a0e077c68` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:39.800536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40ba42d58974876a230d63a0e077c68)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:39.802456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:39.886632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a90fb740b64536aeedda4688b13187'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.893545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a90fb740b64536aeedda4688b13187'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.905884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a90fb740b64536aeedda4688b13187'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.906622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a90fb740b64536aeedda4688b13187'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.907248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a90fb740b64536aeedda4688b13187'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.977901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40ba42d58974876a230d63a0e077c68', 'request_id': 'req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:39.988206 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2017/4080] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:39 2021] DELETE /identity/v3/users/20a90fb740b64536aeedda4688b13187 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:39.993264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:39.994801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:40.066152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8262fb2-2921-4c5f-8ac2-eb1ab4f6846d tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:40.076554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:40.077491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:40.077774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:40.078105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/50db546c7a2b45ef9dcfbf76832430c1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:40.082873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40ba42d58974876a230d63a0e077c68', 'request_id': 'req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.086702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:23:40.093948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40ba42d58974876a230d63a0e077c68', 'request_id': 'req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.096939 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Could not find domain: 50db546c7a2b45ef9dcfbf76832430c1.: keystone.exception.DomainNotFound: Could not find domain: 50db546c7a2b45ef9dcfbf76832430c1. Dec 25 21:23:40.098275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2018/4081] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:39 2021] PATCH /identity/v3/domains/50db546c7a2b45ef9dcfbf76832430c1 => generated 112 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:23:40.106111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:40.108179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] The token cache is being invalidate because project d40ba42d58974876a230d63a0e077c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:40.108605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.109422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.111066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2064/4082] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:39 2021] DELETE /identity/v3/projects/d40ba42d58974876a230d63a0e077c68 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:40.114868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:40.115491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fd288-1c9b-4972-b21a-89f1229d8b03 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:40.116517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:40.120728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:40.122001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:40.122464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:40.123494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e077e8f4214e4625980a8a0700cb5695` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:40.134601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:23:40.147943 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Could not find domain: e077e8f4214e4625980a8a0700cb5695.: keystone.exception.DomainNotFound: Could not find domain: e077e8f4214e4625980a8a0700cb5695. Dec 25 21:23:40.152294 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2019/4083] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:40 2021] PATCH /identity/v3/domains/e077e8f4214e4625980a8a0700cb5695 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:23:40.153902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:40.155884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:40.170293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee448a-b709-4aa8-b4d0-08ad0fe1ee97 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:40.175754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:40.176717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:40.177040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:40.177318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/3cc5341da28d44568902110637680f40` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:40.185671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:23:40.201729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639ca55-5db5-4d1a-a8bb-eba9e0e22ef8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:40.204261 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Could not find domain: 3cc5341da28d44568902110637680f40.: keystone.exception.DomainNotFound: Could not find domain: 3cc5341da28d44568902110637680f40. Dec 25 21:23:40.205756 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2020/4084] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:40 2021] PATCH /identity/v3/domains/3cc5341da28d44568902110637680f40 => generated 112 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:23:40.210719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:40.226146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ec6f-e360-4005-8d15-c50599073a54 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:40.231337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '429b328699f14a3eb3f11f801692a21d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd263b9903168443d9c89ac648e0bb658', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:40.232194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:40.232478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:40.232755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] PATH_INFO: `/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:40.241206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:23:40.250859 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Could not find domain: e1c4a6f924504a5aafa3fe4b3701b57f.: keystone.exception.DomainNotFound: Could not find domain: e1c4a6f924504a5aafa3fe4b3701b57f. Dec 25 21:23:40.252355 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2021/4085] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:40 2021] PATCH /identity/v3/domains/e1c4a6f924504a5aafa3fe4b3701b57f => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:23:40.257338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:40.260314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:40.290295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:40.291913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:40.292728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:40.293797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] PATH_INFO: `/v3/users/58ca1b4be9c54864ae256a4a55f1e97a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:40.295435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ca1b4be9c54864ae256a4a55f1e97a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:40.297408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:40.353332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080127a-d829-4860-af2f-2ab61ed8d4f3 tempest-TokensV3TestJSON-1912251392 tempest-TokensV3TestJSON-1912251392-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:40.358584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:40.359468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:40.359762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:40.360047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] PATH_INFO: `/v3/users/5e11cc5b5ad7425e80abe2becbbf6285` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:40.361333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e11cc5b5ad7425e80abe2becbbf6285)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:40.363407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:40.524080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ca1b4be9c54864ae256a4a55f1e97a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.544087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ca1b4be9c54864ae256a4a55f1e97a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.559648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ca1b4be9c54864ae256a4a55f1e97a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.560088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ca1b4be9c54864ae256a4a55f1e97a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.597095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e11cc5b5ad7425e80abe2becbbf6285'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.603795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e11cc5b5ad7425e80abe2becbbf6285'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.616438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e11cc5b5ad7425e80abe2becbbf6285'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.617145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e11cc5b5ad7425e80abe2becbbf6285'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.617874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e11cc5b5ad7425e80abe2becbbf6285'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.681839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2eb5ac8-407a-4a9a-bb98-c7ebd83266b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ca1b4be9c54864ae256a4a55f1e97a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:40.689145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2065/4086] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:40 2021] DELETE /identity/v3/users/58ca1b4be9c54864ae256a4a55f1e97a => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:40.803657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:40.803953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:40.804234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:40.805606 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2022/4087] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:40 2021] DELETE /identity/v3/users/5e11cc5b5ad7425e80abe2becbbf6285 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:40.824693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:40.825952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:40.908458 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2066/4088] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:40.920725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:40.927007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:41.007303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f4b78-4b62-4309-b92f-8b0873ecc4da admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:41.011656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45aae0-4a41-4917-b6a1-ab897a02ce63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:41.012320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45aae0-4a41-4917-b6a1-ab897a02ce63 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:41.012913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45aae0-4a41-4917-b6a1-ab897a02ce63 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:41.012913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45aae0-4a41-4917-b6a1-ab897a02ce63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:41.022133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45aae0-4a41-4917-b6a1-ab897a02ce63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:41.023611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45aae0-4a41-4917-b6a1-ab897a02ce63 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:41.033985 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2023/4089] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:23:41.178866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:41.180515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:41.194248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3f9b8-0900-46c3-8a34-74668e1ee32e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:41.200370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:41.201317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:41.201603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:41.202791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] PATH_INFO: `/v3/projects/a52856794f214b7e8f4e96decd2bd3e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:41.204083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52856794f214b7e8f4e96decd2bd3e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:41.208940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:41.372339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52856794f214b7e8f4e96decd2bd3e8', 'request_id': 'req-38c5e8fd-0679-4d65-b2df-6471a9458655'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:41.500169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52856794f214b7e8f4e96decd2bd3e8', 'request_id': 'req-38c5e8fd-0679-4d65-b2df-6471a9458655'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:41.507371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52856794f214b7e8f4e96decd2bd3e8', 'request_id': 'req-38c5e8fd-0679-4d65-b2df-6471a9458655'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:41.519983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] The token cache is being invalidate because project a52856794f214b7e8f4e96decd2bd3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:41.520320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:41.521063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38c5e8fd-0679-4d65-b2df-6471a9458655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:41.528528 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2067/4090] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:41 2021] DELETE /identity/v3/projects/a52856794f214b7e8f4e96decd2bd3e8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:41.529727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab692e-a8d7-4817-ba38-562ac5b606a9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:41.531025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab692e-a8d7-4817-ba38-562ac5b606a9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:41.532334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab692e-a8d7-4817-ba38-562ac5b606a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:41.559635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d3ab692e-a8d7-4817-ba38-562ac5b606a9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:41.560931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d3ab692e-a8d7-4817-ba38-562ac5b606a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:41.643134 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2024/4091] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:41.651047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9eefe-f7e2-4026-b3a0-10cdd9b22302 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:41.651982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9eefe-f7e2-4026-b3a0-10cdd9b22302 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:41.652269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9eefe-f7e2-4026-b3a0-10cdd9b22302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:41.675977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-88b9eefe-f7e2-4026-b3a0-10cdd9b22302 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:41.678372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-88b9eefe-f7e2-4026-b3a0-10cdd9b22302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:41.689742 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2068/4092] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:41.702581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab692e-a8d7-4817-ba38-562ac5b606a9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:41.707326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab692e-a8d7-4817-ba38-562ac5b606a9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:41.717858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:41.718812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:41.719020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:41.719446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:41.720347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:41.720837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:41.723101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:41.738837 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2025/4093] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:41.743305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9eefe-f7e2-4026-b3a0-10cdd9b22302 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:41.756514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9eefe-f7e2-4026-b3a0-10cdd9b22302 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:41.762442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:41.765482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:41.765482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:41.765482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:41.765482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:41.769809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:41.779019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:41.785007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:41.800562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86dd6a-8b0e-42ef-9a33-83b08ba69513 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:41.805844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:41.806811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:41.807028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:41.807482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] PATH_INFO: `/v3/projects/784119b833ae41fd87334f4ddab7bb02` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:41.809792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=784119b833ae41fd87334f4ddab7bb02)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:41.817622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:41.880580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2069/4094] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:41 2021] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:41.885732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:41.993646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f0709-3f07-4a3d-8c69-f00f0435d92f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:42.000698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:42.005514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.005514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.005514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.005514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:42.005514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:42.024890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784119b833ae41fd87334f4ddab7bb02', 'request_id': 'req-3a7e6288-e0ce-428a-ae08-eb6443c083ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.032968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784119b833ae41fd87334f4ddab7bb02', 'request_id': 'req-3a7e6288-e0ce-428a-ae08-eb6443c083ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.150827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784119b833ae41fd87334f4ddab7bb02', 'request_id': 'req-3a7e6288-e0ce-428a-ae08-eb6443c083ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.159842 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2070/4095] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:41 2021] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:42.163650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:42.167340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] The token cache is being invalidate because project 784119b833ae41fd87334f4ddab7bb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:42.167853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.168753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.170665 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2026/4096] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:41 2021] DELETE /identity/v3/projects/784119b833ae41fd87334f4ddab7bb02 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:42.174445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:42.175865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:42.184082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5e6be-25d0-48f4-91fd-95441e4e907e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:42.247483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e6288-e0ce-428a-ae08-eb6443c083ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:42.251082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:42.251892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.252182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.252354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:42.252473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.253213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:42.253336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.253539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.253814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] PATH_INFO: `/v3/users/429b328699f14a3eb3f11f801692a21d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.254929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:42.255064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429b328699f14a3eb3f11f801692a21d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:42.256929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:42.269296 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2071/4097] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:42 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:42.270817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:42.273815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:42.286503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41420-ea30-4c7f-8e59-c851215c7a72 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:42.291538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:42.292785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.293098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.293372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.294103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:42.295692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:42.309882 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2072/4098] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:42 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:42.310650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:42.320593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0452f4-a6b1-44f6-a6b5-4e26a7ff83f2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:42.326328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6424b-7ff3-4040-bcdd-d7387a024269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:42.327909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6424b-7ff3-4040-bcdd-d7387a024269 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.327909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6424b-7ff3-4040-bcdd-d7387a024269 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.327909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6424b-7ff3-4040-bcdd-d7387a024269 admin admin] PATH_INFO: `/v3/projects/de61fede3d6348e59dbd910e0b2f0476/users/cf1cee9218d4438786fd63b82f9454d9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.344011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6424b-7ff3-4040-bcdd-d7387a024269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de61fede3d6348e59dbd910e0b2f0476, user_id=cf1cee9218d4438786fd63b82f9454d9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:42.347076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6424b-7ff3-4040-bcdd-d7387a024269 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:42.441874 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2073/4099] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:42 2021] PUT /identity/v3/projects/de61fede3d6348e59dbd910e0b2f0476/users/cf1cee9218d4438786fd63b82f9454d9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:42.453183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee537c5-bcc4-4f25-899b-b137d1265de3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.453471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee537c5-bcc4-4f25-899b-b137d1265de3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.453782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee537c5-bcc4-4f25-899b-b137d1265de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.487953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-eee537c5-bcc4-4f25-899b-b137d1265de3 None None] MFA Rules not processed for user `cf1cee9218d4438786fd63b82f9454d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:42.489173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eee537c5-bcc4-4f25-899b-b137d1265de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:42.552313 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2074/4100] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:42 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:42.556750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee537c5-bcc4-4f25-899b-b137d1265de3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:42.576656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429b328699f14a3eb3f11f801692a21d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.587911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429b328699f14a3eb3f11f801692a21d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.613167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429b328699f14a3eb3f11f801692a21d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.614719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429b328699f14a3eb3f11f801692a21d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.614719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429b328699f14a3eb3f11f801692a21d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:42.627032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee537c5-bcc4-4f25-899b-b137d1265de3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:42.631806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:42.632464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.632743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.637649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.637649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:42.637649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:42.784346 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2027/4101] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:42 2021] DELETE /identity/v3/users/429b328699f14a3eb3f11f801692a21d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:42.808627 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2075/4102] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:42 2021] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:42.809319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:42.810725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:42.885030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677e198-961a-412a-9f0b-69f1cc4b1384 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:42.981087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:42.983308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:42.983308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:42.983308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:42.983308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:42.985631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.146639 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2028/4103] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:42 2021] POST /identity/v3/users => generated 290 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:43.152232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.176910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31a19a-9260-474d-b4d8-25d5d0ff7e8c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.189692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.201578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.201578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.201578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.201578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.203182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.219423 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2076/4104] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:43 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:43.223689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.236904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10398ae-4655-4065-8998-63afa0d17834 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.243640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.244565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.244850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.245716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] PATH_INFO: `/v3/projects/a972b72a2c97470583ee9fa38f0c2f09/users/e1f08d2d2ace4e89a6c49479b0f4ccda/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.264907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a972b72a2c97470583ee9fa38f0c2f09, user_id=e1f08d2d2ace4e89a6c49479b0f4ccda, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.267853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.360568 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2029/4105] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:43 2021] PUT /identity/v3/projects/a972b72a2c97470583ee9fa38f0c2f09/users/e1f08d2d2ace4e89a6c49479b0f4ccda/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:43.365548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.375889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974aed3-88ea-469a-a3cf-74e8c9356084 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.443220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd463-0d00-40e8-bb8c-912219afe7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.443968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd463-0d00-40e8-bb8c-912219afe7cc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.444305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd463-0d00-40e8-bb8c-912219afe7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.444585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd463-0d00-40e8-bb8c-912219afe7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.445660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dd463-0d00-40e8-bb8c-912219afe7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.447262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dd463-0d00-40e8-bb8c-912219afe7cc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.458964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2077/4106] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:43 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:43.463015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.475166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d0d4e-4ebc-4e0d-b3dc-563e26fb8d53 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.481282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.482181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.482479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.482813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] PATH_INFO: `/v3/projects/a972b72a2c97470583ee9fa38f0c2f09/users/e1f08d2d2ace4e89a6c49479b0f4ccda/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.485400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a972b72a2c97470583ee9fa38f0c2f09, user_id=e1f08d2d2ace4e89a6c49479b0f4ccda, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.488068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.499629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2030/4107] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:43 2021] PUT /identity/v3/projects/a972b72a2c97470583ee9fa38f0c2f09/users/e1f08d2d2ace4e89a6c49479b0f4ccda/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:43.509893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fccb4-6959-4ff9-96e5-c90b62f4f32d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.510196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fccb4-6959-4ff9-96e5-c90b62f4f32d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.510482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fccb4-6959-4ff9-96e5-c90b62f4f32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.538249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-488fccb4-6959-4ff9-96e5-c90b62f4f32d None None] MFA Rules not processed for user `e1f08d2d2ace4e89a6c49479b0f4ccda`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:43.539741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-488fccb4-6959-4ff9-96e5-c90b62f4f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:43.621320 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2078/4108] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:43 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:43.622411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.634001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482840d-d34a-460d-bc9f-db70e3312b37 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.639885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.640659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.641163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.641559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.642393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.644161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.747223 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2031/4109] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:23:43 2021] POST /identity/v3/domains => generated 276 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:43.751677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fccb4-6959-4ff9-96e5-c90b62f4f32d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.761468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fccb4-6959-4ff9-96e5-c90b62f4f32d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.819111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.819784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.820073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.820467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.821223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.823125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.833661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.836064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:43.907575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008e3d-74d2-4ec8-ab10-3ef7165e8cc1 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.913746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.914882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.915161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.915431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] PATH_INFO: `/v3/projects/d263b9903168443d9c89ac648e0bb658` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.916666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d263b9903168443d9c89ac648e0bb658)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.919179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:43.940748 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2079/4110] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:43 2021] POST /identity/v3/users => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:43.944817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:43.959193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443afcc-b784-4e4c-8aff-67bec3c4fc7d tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:43.967499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:43.968214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:43.969434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:43.970253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:43.971220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:43.975203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.095333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd263b9903168443d9c89ac648e0bb658', 'request_id': 'req-2b6f709f-c078-42f0-bedd-f65d6d3557b2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.103819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd263b9903168443d9c89ac648e0bb658', 'request_id': 'req-2b6f709f-c078-42f0-bedd-f65d6d3557b2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.109915 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2080/4111] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:43 2021] POST /identity/v3/users => generated 324 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:44.114391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.125971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c36d5-30e5-4195-a96a-a315b91f5c77 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.181129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd263b9903168443d9c89ac648e0bb658', 'request_id': 'req-2b6f709f-c078-42f0-bedd-f65d6d3557b2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.184560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.185927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.186431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.186943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users/961b34e3dc974473aff4bf704a1c15bf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.190846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] The token cache is being invalidate because project d263b9903168443d9c89ac648e0bb658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:44.191129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.191776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.193366 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2032/4112] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:43 2021] DELETE /identity/v3/projects/d263b9903168443d9c89ac648e0bb658 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:44.197067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.198962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:44.203712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:get_user(user_id=961b34e3dc974473aff4bf704a1c15bf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.206073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.212522 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2081/4113] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:23:44 2021] GET /identity/v3/users/961b34e3dc974473aff4bf704a1c15bf => generated 346 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:44.213523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.216000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:44.229121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e88fd3-4f8d-4bc8-97e8-bafaf1c8ae5f tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.243230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.244329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.249608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.250226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.253639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Adding query filter params (domain_id=47f0c17fc7af4dcdba895b44afe8c934) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:44.253639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.253856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.272551 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2082/4114] 10.222.0.32 () {58 vars in 1206 bytes} [Sat Dec 25 21:23:44 2021] GET /identity/v3/users?domain_id=47f0c17fc7af4dcdba895b44afe8c934 => generated 483 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:44.272758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f709f-c078-42f0-bedd-f65d6d3557b2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.273687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.276113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.277641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.277990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.278348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] PATH_INFO: `/v3/users/b1cddd70971d42699f40676bba80747f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.279654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cddd70971d42699f40676bba80747f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.281674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.284375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fb70-2a2e-4fc8-a0a2-e6653d9551af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.290188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.291047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.291162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.291382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.292180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.294013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.495303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cddd70971d42699f40676bba80747f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.498436 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2083/4115] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:44 2021] GET /identity/v3/users => generated 8596 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:44.500183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.505328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cddd70971d42699f40676bba80747f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.511234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4bc7a-e4ce-4904-8461-0449e0c35e18 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.516221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.518559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.518989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.519247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cddd70971d42699f40676bba80747f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.519390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.520544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Adding query filter params (name=tempest-test_user-21926205) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:44.520689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cddd70971d42699f40676bba80747f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.520860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.521376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cddd70971d42699f40676bba80747f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.522779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.546064 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2084/4116] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:23:44 2021] GET /identity/v3/users?name=tempest-test_user-21926205 => generated 472 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:44.550854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.552758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:44.566159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c036aa-c142-4c97-9754-0244e458c0c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.572144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.572808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.573173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.573514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.574316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:44.574625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.576436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.599399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2085/4117] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:23:44 2021] GET /identity/v3/users?enabled=False => generated 432 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:44.604006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.613112 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2033/4118] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:44 2021] DELETE /identity/v3/users/b1cddd70971d42699f40676bba80747f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:44.614426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf78b14-b150-43ec-9f33-4cd5d445e0af tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.672090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.673150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.673509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.673785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users/54bc0911ceeb412f9a8b2ccb28399ed8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.687895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:delete_user(user_id=54bc0911ceeb412f9a8b2ccb28399ed8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.689887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:44.819010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bc0911ceeb412f9a8b2ccb28399ed8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.825816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bc0911ceeb412f9a8b2ccb28399ed8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.838383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bc0911ceeb412f9a8b2ccb28399ed8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.839344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bc0911ceeb412f9a8b2ccb28399ed8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.907855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bc0911ceeb412f9a8b2ccb28399ed8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:44.915230 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2086/4119] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:44 2021] DELETE /identity/v3/users/54bc0911ceeb412f9a8b2ccb28399ed8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:44.919540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:44.932402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513f35c-de4a-4bc7-88ae-47d71f39836c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:44.990234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:44.991114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:44.991401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:44.991678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/users/961b34e3dc974473aff4bf704a1c15bf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:44.992898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:delete_user(user_id=961b34e3dc974473aff4bf704a1c15bf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:44.994837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:45.046662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:45.048159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:45.118920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a256e-472e-4399-a6f7-1400721caffd tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:45.124203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:45.125147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.125436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:45.125709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] PATH_INFO: `/v3/projects/41dc285eee734b16af09bda3e0426dcd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:45.126899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41dc285eee734b16af09bda3e0426dcd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:45.128821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:45.164908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961b34e3dc974473aff4bf704a1c15bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.173702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961b34e3dc974473aff4bf704a1c15bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.186221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961b34e3dc974473aff4bf704a1c15bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.187067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961b34e3dc974473aff4bf704a1c15bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.187823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961b34e3dc974473aff4bf704a1c15bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.299420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41dc285eee734b16af09bda3e0426dcd', 'request_id': 'req-5d3d4527-0f08-47c5-8e85-b2c6df476203'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.333893 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2034/4120] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:44 2021] DELETE /identity/v3/users/961b34e3dc974473aff4bf704a1c15bf => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:45.337468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:45.339589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:45.409678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6746-f603-4da3-a3b1-943f3bc284c0 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:45.414862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:45.415723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.416021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:45.416295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/domains/47f0c17fc7af4dcdba895b44afe8c934` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:45.418265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=47f0c17fc7af4dcdba895b44afe8c934)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:45.419893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:45.439041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.439793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.447049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41dc285eee734b16af09bda3e0426dcd', 'request_id': 'req-5d3d4527-0f08-47c5-8e85-b2c6df476203'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.455493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41dc285eee734b16af09bda3e0426dcd', 'request_id': 'req-5d3d4527-0f08-47c5-8e85-b2c6df476203'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.466779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] The token cache is being invalidate because project 41dc285eee734b16af09bda3e0426dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:45.466908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.467573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d3d4527-0f08-47c5-8e85-b2c6df476203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.469212 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2087/4121] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:45 2021] DELETE /identity/v3/projects/41dc285eee734b16af09bda3e0426dcd => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:45.476654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac798-d8a6-40f8-a4ec-e35736fc938b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.476971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac798-d8a6-40f8-a4ec-e35736fc938b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:45.477248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac798-d8a6-40f8-a4ec-e35736fc938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:45.496676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-eacac798-d8a6-40f8-a4ec-e35736fc938b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:45.497900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eacac798-d8a6-40f8-a4ec-e35736fc938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:45.521313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.521934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.528169 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2035/4122] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:23:45 2021] PATCH /identity/v3/domains/47f0c17fc7af4dcdba895b44afe8c934 => generated 277 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:45.529228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:45.530574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:45.561892 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2088/4123] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:45.569798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a04e8-0240-4582-a556-76f3de76b8c7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.570001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a04e8-0240-4582-a556-76f3de76b8c7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:45.570237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a04e8-0240-4582-a556-76f3de76b8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:45.591989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-283a04e8-0240-4582-a556-76f3de76b8c7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:45.593294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-283a04e8-0240-4582-a556-76f3de76b8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:45.603809 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2089/4124] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:45.608303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a04e8-0240-4582-a556-76f3de76b8c7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:45.614574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62959fc-df67-4b6f-926a-27e136fc980b tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:45.618539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a04e8-0240-4582-a556-76f3de76b8c7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:45.622430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1f08d2d2ace4e89a6c49479b0f4ccda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a972b72a2c97470583ee9fa38f0c2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:45.623975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.623975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:45.624286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] PATH_INFO: `/v3/domains/47f0c17fc7af4dcdba895b44afe8c934` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:45.624703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:45.625428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.625696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:45.625968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:45.626866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:45.627179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:45.628830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:45.638443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=47f0c17fc7af4dcdba895b44afe8c934)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:45.640086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:45.643424 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2090/4125] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:45.647971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:45.658654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5d42-391c-421a-8499-fd8ad578617f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:45.664104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:45.665024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.665488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:45.665767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:45.666210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.666449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:45.669000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:45.684509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.843935 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2091/4126] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:45 2021] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:45.847785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:45.886764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934', 'request_id': 'req-804483fc-fd57-479a-b4e7-116ed703f089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.897536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934', 'request_id': 'req-804483fc-fd57-479a-b4e7-116ed703f089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.923817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27811259-f6eb-436a-99b7-3ea55cb9ff8f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:45.984796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934', 'request_id': 'req-804483fc-fd57-479a-b4e7-116ed703f089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.997032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] The token cache is being invalidate because project 47f0c17fc7af4dcdba895b44afe8c934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:45.997415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.998138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:45.998822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:45.999513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:45.999908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.000229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.001019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.002983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.006503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934', 'request_id': 'req-804483fc-fd57-479a-b4e7-116ed703f089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.007828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934', 'request_id': 'req-804483fc-fd57-479a-b4e7-116ed703f089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.009194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '47f0c17fc7af4dcdba895b44afe8c934', 'request_id': 'req-804483fc-fd57-479a-b4e7-116ed703f089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.019711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2036/4127] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:23:45 2021] DELETE /identity/v3/domains/47f0c17fc7af4dcdba895b44afe8c934 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:46.023587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:46.025070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:46.038999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804483fc-fd57-479a-b4e7-116ed703f089 tempest-UsersV3TestJSON-1232968630 tempest-UsersV3TestJSON-1232968630-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:46.045795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:46.046927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.047257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.047625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] PATH_INFO: `/v3/users/cf1cee9218d4438786fd63b82f9454d9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.049140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1cee9218d4438786fd63b82f9454d9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.051098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.113806 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2092/4128] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:45 2021] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:46.117860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:46.119484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:46.131294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e4b6-15d2-476c-9ae2-05cc9f5ac579 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:46.136488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:46.137191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.140692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.140692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.140692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.140692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.150885 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2093/4129] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:46.155253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:46.165719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5db1cc-7422-4656-8c74-ba111240e995 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:46.173201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:46.173866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.174140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.174410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.175135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.176709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.187070 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2094/4130] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:46.192612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:46.203413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc7de9-5bd5-4ea7-b7ab-6eb0c6f8df86 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:46.208296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6624b2-a8e8-4127-9608-3a05121b555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:46.209556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6624b2-a8e8-4127-9608-3a05121b555e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.209848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6624b2-a8e8-4127-9608-3a05121b555e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.210099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6624b2-a8e8-4127-9608-3a05121b555e admin admin] PATH_INFO: `/v3/projects/b165825f78894ff589c492c3b2d78b09/users/67d0e8e6e9d241cba5ba15f5e7c8cf95/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.225730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6624b2-a8e8-4127-9608-3a05121b555e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b165825f78894ff589c492c3b2d78b09, user_id=67d0e8e6e9d241cba5ba15f5e7c8cf95, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.228334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6624b2-a8e8-4127-9608-3a05121b555e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.293082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1cee9218d4438786fd63b82f9454d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.299833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1cee9218d4438786fd63b82f9454d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.313956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1cee9218d4438786fd63b82f9454d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.313956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1cee9218d4438786fd63b82f9454d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.322232 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2095/4131] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:46 2021] PUT /identity/v3/projects/b165825f78894ff589c492c3b2d78b09/users/67d0e8e6e9d241cba5ba15f5e7c8cf95/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:46.329544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f322d6b2-b191-4025-88d5-d1c5f2dedee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1cee9218d4438786fd63b82f9454d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.334373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfe55d-bc8e-4164-84ce-1dab22f8fd12 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.334666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfe55d-bc8e-4164-84ce-1dab22f8fd12 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.334955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfe55d-bc8e-4164-84ce-1dab22f8fd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.371911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fdcfe55d-bc8e-4164-84ce-1dab22f8fd12 None None] MFA Rules not processed for user `67d0e8e6e9d241cba5ba15f5e7c8cf95`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:46.373925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fdcfe55d-bc8e-4164-84ce-1dab22f8fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:46.419191 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2037/4132] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:46 2021] DELETE /identity/v3/users/cf1cee9218d4438786fd63b82f9454d9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:46.427208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.427496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.428406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.446424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:46.447689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:46.463186 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2096/4133] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:46 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:46.468684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfe55d-bc8e-4164-84ce-1dab22f8fd12 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:46.477015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfe55d-bc8e-4164-84ce-1dab22f8fd12 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:46.515727 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2038/4134] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:46.526125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:46.528063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:46.549288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67d0e8e6e9d241cba5ba15f5e7c8cf95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b165825f78894ff589c492c3b2d78b09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:46.550398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.550757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.551101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] PATH_INFO: `/v3/domains/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.552402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.554206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.558125 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2097/4135] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:23:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:46.564627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:46.566855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:46.585831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828370a-8341-4f18-8fe6-70ea934aea29 tempest-DefaultDomainTestJSON-1666410877 tempest-DefaultDomainTestJSON-1666410877-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:46.593210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:46.594163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.594514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.594855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] PATH_INFO: `/v3/users/67d0e8e6e9d241cba5ba15f5e7c8cf95` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.596452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d0e8e6e9d241cba5ba15f5e7c8cf95)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.596941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93dbb2-9420-4ae8-9564-0042af54fafd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:46.598532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.601474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9bae0-15c9-4d2b-8f95-f5d93f4b4352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:46.602129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bae0-15c9-4d2b-8f95-f5d93f4b4352 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.602416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bae0-15c9-4d2b-8f95-f5d93f4b4352 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.602697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bae0-15c9-4d2b-8f95-f5d93f4b4352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.614024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9bae0-15c9-4d2b-8f95-f5d93f4b4352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:46.615733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9bae0-15c9-4d2b-8f95-f5d93f4b4352 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:46.626880 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2039/4136] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:46.832262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d0e8e6e9d241cba5ba15f5e7c8cf95'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.840672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d0e8e6e9d241cba5ba15f5e7c8cf95'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.853163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d0e8e6e9d241cba5ba15f5e7c8cf95'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.853882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d0e8e6e9d241cba5ba15f5e7c8cf95'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.928848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d0e8e6e9d241cba5ba15f5e7c8cf95'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:46.936110 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2098/4137] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:46 2021] DELETE /identity/v3/users/67d0e8e6e9d241cba5ba15f5e7c8cf95 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:46.940580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:46.940901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:46.941548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:46.968466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:46.969753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:47.055062 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2040/4138] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:47.065999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:47.067454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:47.128683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78f8b-b5f8-4c0d-90e7-be4588eba85c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:47.132397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:47.133088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:47.133371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:47.133638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:47.142769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:47.144182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:47.153806 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2099/4139] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:47.243847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:47.245414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:47.258311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14015be-ac24-4f90-a3d5-4115591657b6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:47.263779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:47.264939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:47.265352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:47.265622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] PATH_INFO: `/v3/projects/de61fede3d6348e59dbd910e0b2f0476` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:47.267601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de61fede3d6348e59dbd910e0b2f0476)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:47.269694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:47.455356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de61fede3d6348e59dbd910e0b2f0476', 'request_id': 'req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.461733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de61fede3d6348e59dbd910e0b2f0476', 'request_id': 'req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.562516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de61fede3d6348e59dbd910e0b2f0476', 'request_id': 'req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.574186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] The token cache is being invalidate because project de61fede3d6348e59dbd910e0b2f0476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:47.574474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.575687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.578449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2041/4140] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:47 2021] DELETE /identity/v3/projects/de61fede3d6348e59dbd910e0b2f0476 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:47.582366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:47.593381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb80b42-335a-4e6a-a763-40cb475e2c02 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:47.648908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:47.649832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:47.650116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:47.650413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] PATH_INFO: `/v3/users/e1f08d2d2ace4e89a6c49479b0f4ccda` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:47.652126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f08d2d2ace4e89a6c49479b0f4ccda)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:47.654075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:47.755050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:47.756468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:47.772610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de794f0b-15d3-4e19-b6ea-683d3dcbe1c3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:47.779656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:47.782439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:47.782439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:47.782439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] PATH_INFO: `/v3/projects/b165825f78894ff589c492c3b2d78b09` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:47.782439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b165825f78894ff589c492c3b2d78b09)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:47.784383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:47.860981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f08d2d2ace4e89a6c49479b0f4ccda'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.867590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f08d2d2ace4e89a6c49479b0f4ccda'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.881602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f08d2d2ace4e89a6c49479b0f4ccda'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.882359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f08d2d2ace4e89a6c49479b0f4ccda'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.888010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b165825f78894ff589c492c3b2d78b09', 'request_id': 'req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.894532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b165825f78894ff589c492c3b2d78b09', 'request_id': 'req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.956230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8f0e7607-7b09-4ad2-9c78-2cfd9171a9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f08d2d2ace4e89a6c49479b0f4ccda'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:47.965707 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2100/4141] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:47 2021] DELETE /identity/v3/users/e1f08d2d2ace4e89a6c49479b0f4ccda => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:48.002783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b165825f78894ff589c492c3b2d78b09', 'request_id': 'req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.015204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] The token cache is being invalidate because project b165825f78894ff589c492c3b2d78b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:48.015556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.016156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9f5f3a4-2fe9-4149-895d-11ba1ea747ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.029157 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2042/4142] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:47 2021] DELETE /identity/v3/projects/b165825f78894ff589c492c3b2d78b09 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:48.035061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d9ed-1583-4b78-98ef-61307eb9ccea None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.035061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d9ed-1583-4b78-98ef-61307eb9ccea None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.035061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d9ed-1583-4b78-98ef-61307eb9ccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.056397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a208d9ed-1583-4b78-98ef-61307eb9ccea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:48.058410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a208d9ed-1583-4b78-98ef-61307eb9ccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:48.119110 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2101/4143] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:48.127430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4477-e899-4c52-a9cc-7f2382ba2717 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.127980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4477-e899-4c52-a9cc-7f2382ba2717 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.128223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4477-e899-4c52-a9cc-7f2382ba2717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.147830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-09ba4477-e899-4c52-a9cc-7f2382ba2717 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:48.149098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-09ba4477-e899-4c52-a9cc-7f2382ba2717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:48.157489 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2043/4144] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:48.161879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208d9ed-1583-4b78-98ef-61307eb9ccea None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:48.173761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208d9ed-1583-4b78-98ef-61307eb9ccea None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:48.179123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:48.179791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.180073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.180342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.181122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:48.181427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:48.189138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:48.203521 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2102/4145] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:48.207497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba4477-e899-4c52-a9cc-7f2382ba2717 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:48.217438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba4477-e899-4c52-a9cc-7f2382ba2717 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:48.232783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:48.232783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.233059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.233351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.234136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:48.239040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:48.346593 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2044/4146] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:48 2021] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:48.350921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:48.361238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f04c7-a6f8-4121-8dc1-9eb38ec7be53 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:48.420868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:48.421569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.421857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.422261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.422816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:48.424726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:48.581831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:48.583661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:48.601354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e587239-0564-4b82-8993-25be2a3bff1a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:48.612431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:48.613877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.614393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.614894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] PATH_INFO: `/v3/projects/a972b72a2c97470583ee9fa38f0c2f09` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.617619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a972b72a2c97470583ee9fa38f0c2f09)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:48.621160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:48.634955 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2103/4147] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:48 2021] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:48.636595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:48.660417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91293fc-dcc2-45cd-9a2a-689a4e0c9ec8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:48.663224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:48.664223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.664613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.664980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.665814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:48.667682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:48.680911 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2104/4148] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:48 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:48.683396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:48.694039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87504e-9199-4347-9d48-882e1fc5bb01 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:48.699303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:48.700171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.700895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.701124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] PATH_INFO: `/v3/projects/6b738c8b5d99478b89c36f60180b4aa8/users/bba170d1e3f24eff80014662508faf01/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:48.717546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b738c8b5d99478b89c36f60180b4aa8, user_id=bba170d1e3f24eff80014662508faf01, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:48.720173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:48.846029 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2105/4149] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:48 2021] PUT /identity/v3/projects/6b738c8b5d99478b89c36f60180b4aa8/users/bba170d1e3f24eff80014662508faf01/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:48.856418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:48.859386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a972b72a2c97470583ee9fa38f0c2f09', 'request_id': 'req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.880495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a972b72a2c97470583ee9fa38f0c2f09', 'request_id': 'req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.947166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1d08b-6d61-4fba-98bb-c6d2a9d4a41a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:48.953531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a972b72a2c97470583ee9fa38f0c2f09', 'request_id': 'req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.974236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] The token cache is being invalidate because project a972b72a2c97470583ee9fa38f0c2f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:48.974236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.974761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc1ffe08-a1c4-4b9c-9c12-c662754d19fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:48.977901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2045/4150] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:48 2021] DELETE /identity/v3/projects/a972b72a2c97470583ee9fa38f0c2f09 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:48.983860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e582-a6ce-470a-ae3d-2b464e44f415 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:48.984198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e582-a6ce-470a-ae3d-2b464e44f415 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:48.984551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e582-a6ce-470a-ae3d-2b464e44f415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.027959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a8d7e582-a6ce-470a-ae3d-2b464e44f415 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:49.029993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a8d7e582-a6ce-470a-ae3d-2b464e44f415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:49.043999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.045682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.045985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.046182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.048149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.050455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.068926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2106/4151] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:48 2021] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:49.074335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.076289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:49.095371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb135-7d09-4dab-bdc6-343710ef646e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.106240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d30eb6-2a10-40ed-b33f-f553f0cd0933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.107146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d30eb6-2a10-40ed-b33f-f553f0cd0933 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.107431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d30eb6-2a10-40ed-b33f-f553f0cd0933 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.107706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d30eb6-2a10-40ed-b33f-f553f0cd0933 admin admin] PATH_INFO: `/v3/projects/6b738c8b5d99478b89c36f60180b4aa8/users/bba170d1e3f24eff80014662508faf01/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.109768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d30eb6-2a10-40ed-b33f-f553f0cd0933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b738c8b5d99478b89c36f60180b4aa8, user_id=bba170d1e3f24eff80014662508faf01, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.112378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d30eb6-2a10-40ed-b33f-f553f0cd0933 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.113443 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2046/4152] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:49.121945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261479a-4556-406d-9496-08ccd1c87e5a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.122235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261479a-4556-406d-9496-08ccd1c87e5a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.122510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261479a-4556-406d-9496-08ccd1c87e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.123411 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2107/4153] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:49 2021] PUT /identity/v3/projects/6b738c8b5d99478b89c36f60180b4aa8/users/bba170d1e3f24eff80014662508faf01/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:49.134246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268beef-f447-417f-885b-b809e5648ef6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.134539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268beef-f447-417f-885b-b809e5648ef6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.134821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268beef-f447-417f-885b-b809e5648ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.143154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2261479a-4556-406d-9496-08ccd1c87e5a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:49.147998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2261479a-4556-406d-9496-08ccd1c87e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:49.162407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8268beef-f447-417f-885b-b809e5648ef6 None None] MFA Rules not processed for user `bba170d1e3f24eff80014662508faf01`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:49.163601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8268beef-f447-417f-885b-b809e5648ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:49.205519 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2047/4154] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:49.209960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261479a-4556-406d-9496-08ccd1c87e5a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.218647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261479a-4556-406d-9496-08ccd1c87e5a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.223285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.224340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.224550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.224826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.225578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:49.225882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.227484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.235338 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2108/4155] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:49.239673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268beef-f447-417f-885b-b809e5648ef6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.239965 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2048/4156] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:49.244015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.254285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268beef-f447-417f-885b-b809e5648ef6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.254554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5b294-417c-42fe-9141-807e7cca8471 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.259239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.259957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.260241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.260568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.261306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.261500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.262151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.262498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.262820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.263434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.263590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.265485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.426143 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2109/4157] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:49.429897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.448577 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2049/4158] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:49.452743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.488843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7b45-5672-4e9b-94c8-5a116b30c806 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.514771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcc164-48e3-4a7a-b011-5bf99124db24 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.519461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.520188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.520477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.520754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.521484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.523390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.559060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.565193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.567713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.567713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.567713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.571211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.616478 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2050/4159] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:49.617810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.629178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4018a04-64ca-49ec-98b6-80d8999f05cd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.635319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.637212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.637500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.637776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.638649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.640572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.650760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2051/4160] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:49 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:49.667657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.677944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879d603-ff73-4013-a954-95989203e4bc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.683572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.684285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.684565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.684839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.685589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.687158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.697043 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2052/4161] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:49.701861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.711016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79715ba-f655-46c5-a6a5-c279f7ca959e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.715856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8902ec-9044-443d-87e5-b87809cac758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.716674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8902ec-9044-443d-87e5-b87809cac758 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.717245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8902ec-9044-443d-87e5-b87809cac758 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.717345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8902ec-9044-443d-87e5-b87809cac758 admin admin] PATH_INFO: `/v3/projects/113c2fc01bdf40bd902b658d044e8892/users/cafa3945d98f459d9e8dbc3af5ffac5d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.731642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8902ec-9044-443d-87e5-b87809cac758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113c2fc01bdf40bd902b658d044e8892, user_id=cafa3945d98f459d9e8dbc3af5ffac5d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.734301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8902ec-9044-443d-87e5-b87809cac758 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.742533 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2110/4162] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:49.746803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.756753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58004b0b-34f3-4c65-9899-5997bfc7692a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.762548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.763197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.763477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.765907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.765907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.766167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.776825 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2111/4163] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:49.780693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.790650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a255-a46a-403d-acfe-841c74ab2973 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.796086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.796716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.797048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.797324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.798038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.799782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.811409 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2112/4164] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:49.814048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:49.824035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0eda5-706d-4c23-b726-4f82dc375dd0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:49.831339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:49.834431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.834431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.834431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] PATH_INFO: `/v3/projects/7738237db9ce43b9adc0c1c1e45679ca/users/1dc0d98763d2453dbc32e75cd6a73503/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.852175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7738237db9ce43b9adc0c1c1e45679ca, user_id=1dc0d98763d2453dbc32e75cd6a73503, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:49.855301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:49.866954 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2053/4165] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:49 2021] PUT /identity/v3/projects/113c2fc01bdf40bd902b658d044e8892/users/cafa3945d98f459d9e8dbc3af5ffac5d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:49.878951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060986e0-0302-4088-b6cf-ab5ef11fbf2f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:49.879292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060986e0-0302-4088-b6cf-ab5ef11fbf2f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:49.879570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060986e0-0302-4088-b6cf-ab5ef11fbf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:49.906272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-060986e0-0302-4088-b6cf-ab5ef11fbf2f None None] MFA Rules not processed for user `cafa3945d98f459d9e8dbc3af5ffac5d`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:49.907462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-060986e0-0302-4088-b6cf-ab5ef11fbf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:49.974852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2113/4166] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:49 2021] PUT /identity/v3/projects/7738237db9ce43b9adc0c1c1e45679ca/users/1dc0d98763d2453dbc32e75cd6a73503/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:49.984495 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2054/4167] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:49.995720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:50.053130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:50.053468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:50.053697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:50.081763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] MFA Rules not processed for user `1dc0d98763d2453dbc32e75cd6a73503`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:50.082972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:50.085262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e58995-d317-44f7-998a-a56d9218901f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:50.090644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:50.091310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:50.101957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:50.101957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:50.101957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:50.101957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:50.154252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2055/4168] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:50 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:50.169222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:50.170609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:50.215286 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2114/4169] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:49 2021] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:50.219297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:50.233553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd425a0a-20e8-49fc-afcd-3ade4e402f17 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:50.294422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:50.294949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:50.295218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:50.295488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:50.302577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b8f0-3898-42bd-a1aa-acb41ea3473f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:50.309250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:50.309821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:50.310106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:50.310502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:50.311127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:50.313684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:50.361583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:50.363087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:50.373538 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2056/4170] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:50 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:50.567377 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2115/4171] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:50 2021] POST /identity/v3/users => generated 295 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:50.577118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:50.583921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff410b-5cbe-4ed2-b990-bafbc1944291 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:50.588850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:50.589534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:50.589820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:50.590096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:50.590823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:50.592447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:50.602697 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2057/4172] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:50.606910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:50.616829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed58da-ab66-4d1a-aa17-bdb1f9cba041 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:50.622105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:50.623048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:50.623332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:50.623607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] PATH_INFO: `/v3/projects/068d36239cf649a7a1173eccb78102b4/users/a1d0c3330c394270ab476216830b5c87/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:50.645306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068d36239cf649a7a1173eccb78102b4, user_id=a1d0c3330c394270ab476216830b5c87, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:50.647953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:50.921197 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2116/4173] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:50 2021] PUT /identity/v3/projects/068d36239cf649a7a1173eccb78102b4/users/a1d0c3330c394270ab476216830b5c87/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:50.925378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:50.935736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771c830-7851-4659-b2b2-bfbef631cccf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:50.999434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22c40f-2894-4af4-91fd-4a93a9f958de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.000172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c40f-2894-4af4-91fd-4a93a9f958de admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.000454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c40f-2894-4af4-91fd-4a93a9f958de admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.000725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22c40f-2894-4af4-91fd-4a93a9f958de admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.001475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c40f-2894-4af4-91fd-4a93a9f958de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.003064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22c40f-2894-4af4-91fd-4a93a9f958de admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.013201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2058/4174] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:50 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:51.022217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:51.033029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe38be-baf6-41d7-86ee-529b704e8bf5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:51.037790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.039571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.039859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.040134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] PATH_INFO: `/v3/projects/068d36239cf649a7a1173eccb78102b4/users/a1d0c3330c394270ab476216830b5c87/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.050067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068d36239cf649a7a1173eccb78102b4, user_id=a1d0c3330c394270ab476216830b5c87, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.050067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.058426 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2117/4175] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:51 2021] PUT /identity/v3/projects/068d36239cf649a7a1173eccb78102b4/users/a1d0c3330c394270ab476216830b5c87/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:51.072305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30407ac4-ea8d-4175-9873-26015efa96d3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.073418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30407ac4-ea8d-4175-9873-26015efa96d3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.078525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30407ac4-ea8d-4175-9873-26015efa96d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.108841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-30407ac4-ea8d-4175-9873-26015efa96d3 None None] MFA Rules not processed for user `a1d0c3330c394270ab476216830b5c87`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:51.110108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-30407ac4-ea8d-4175-9873-26015efa96d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:51.190379 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2059/4176] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:51 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:51.195293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:51.206423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d67d5-e1e5-4bba-a725-392eb6961d74 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:51.212775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.214658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.215153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.215439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.216648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.217837 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:51.217837 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:51.217837 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:51.218714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.305806 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2118/4177] 10.222.0.32 () {60 vars in 1184 bytes} [Sat Dec 25 21:23:51 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:51.308957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30407ac4-ea8d-4175-9873-26015efa96d3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:51.317954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30407ac4-ea8d-4175-9873-26015efa96d3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:51.322729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.323543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.323817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.324077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/dc1f0413f2c147a09966c216e8873735` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.324732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=dc1f0413f2c147a09966c216e8873735)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.325819 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:51.325819 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:51.325819 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:51.326679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.334170 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2060/4178] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:23:51 2021] GET /identity/v3/OS-OAUTH1/consumers/dc1f0413f2c147a09966c216e8873735 => generated 221 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:51.338837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:51.349918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c28f-995b-4851-8a95-e20752060565 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:51.355937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.356994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.359740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.359740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/dc1f0413f2c147a09966c216e8873735` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.359740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=dc1f0413f2c147a09966c216e8873735)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.359740 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:51.359740 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:51.359740 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:51.360283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.360283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invalidating token cache because consumer dc1f0413f2c147a09966c216e8873735 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:51.360599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:51.361277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:51.458066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'dc1f0413f2c147a09966c216e8873735', 'request_id': 'req-6d167eba-1689-4848-9003-93447b63aaaa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:51.555957 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2119/4179] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:23:51 2021] DELETE /identity/v3/OS-OAUTH1/consumers/dc1f0413f2c147a09966c216e8873735 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:51.562399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:51.564139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:51.578699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2840b-84ba-44cb-9e46-be12af0a2612 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:51.584340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.585033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.585316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.585784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.586526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.587558 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:51.587558 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:51.587558 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:51.588523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.671230 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2061/4180] 10.222.0.32 () {60 vars in 1184 bytes} [Sat Dec 25 21:23:51 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:51.675292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:51.691196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167eba-1689-4848-9003-93447b63aaaa tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:51.703779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.704509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.704805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.705193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.705747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=8b6f8ad65b8a469885392937b1ab3a00)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.706864 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:51.706864 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:23:51.706864 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:23:51.707768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.732413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2120/4181] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:23:51 2021] GET /identity/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00 => generated 221 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:51.733221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:51.745857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c38c-d4ad-4207-bd14-9707a2f05b4a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:51.751219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:51.752260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:51.752560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:51.752939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:51.753687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8b6f8ad65b8a469885392937b1ab3a00)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:51.754947 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:51.754947 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:51.754947 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:51.756237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:51.756237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invalidating token cache because consumer 8b6f8ad65b8a469885392937b1ab3a00 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:51.756457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:51.757303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:51.920969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8b6f8ad65b8a469885392937b1ab3a00', 'request_id': 'req-59534f7b-fa99-4d90-b101-da25252a203a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.069356 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2062/4182] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:23:51 2021] DELETE /identity/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:52.076945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:52.076945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:52.093234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe5bc-c05a-42b0-a185-c41dde1fe82f tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:52.099976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:52.105695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:52.105695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:52.105695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:52.105695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=8b6f8ad65b8a469885392937b1ab3a00)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:52.106295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:52.117897 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Dec 25 21:23:52.122380 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2121/4183] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:23:52 2021] GET /identity/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00 => generated 74 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 21:23:52.123230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:52.137715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534f7b-fa99-4d90-b101-da25252a203a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:52.142868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:52.143704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:52.143994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:52.144417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:52.145167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8b6f8ad65b8a469885392937b1ab3a00)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:52.146743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:52.147014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invalidating token cache because consumer 8b6f8ad65b8a469885392937b1ab3a00 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:52.147291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.147965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.186899 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Dec 25 21:23:52.199347 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2063/4184] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:23:52 2021] DELETE /identity/v3/OS-OAUTH1/consumers/8b6f8ad65b8a469885392937b1ab3a00 => generated 74 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 21:23:52.204036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:52.205919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:52.219653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c22509-7e8a-4713-bac6-471745a1ade3 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:52.224439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:52.225113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:52.225426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:52.225676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:52.226411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:52.228025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:52.353313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:52.360579 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2122/4185] 10.222.0.32 () {60 vars in 1184 bytes} [Sat Dec 25 21:23:52 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:52.364792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb4a47-a5b6-4afb-9603-5aa5030eb7d5 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:52.383258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:52.384572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:52.385207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:52.385587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:52.386408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:52.387988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:52.414429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:52.420022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:52.491240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596109-ccf4-460a-ad27-1f2b93ae204e tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:52.503846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:52.505173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:52.505458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:52.505774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] PATH_INFO: `/v3/users/bba170d1e3f24eff80014662508faf01` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:52.507723 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2064/4186] 10.222.0.32 () {60 vars in 1184 bytes} [Sat Dec 25 21:23:52 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:52.508540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba170d1e3f24eff80014662508faf01)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:52.509194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:52.512532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:52.521702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7387988-569a-47ab-b51f-372da91607a0 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:52.527845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:52.528787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:52.529170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:52.529519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:52.530465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:52.531697 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:52.531697 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:52.531697 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:52.532970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:52.541319 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2065/4187] 10.222.0.32 () {58 vars in 1163 bytes} [Sat Dec 25 21:23:52 2021] GET /identity/v3/OS-OAUTH1/consumers => generated 534 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:52.561379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:52.575660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb42b36-e06e-4501-978b-f3c7b84b241a tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:52.583224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:52.584687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:52.585930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:52.586831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1ae17daaca364bcb875f93a4957bf635` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:52.587764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1ae17daaca364bcb875f93a4957bf635)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:52.591268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:52.591907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invalidating token cache because consumer 1ae17daaca364bcb875f93a4957bf635 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:52.592376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.593342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.805345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1ae17daaca364bcb875f93a4957bf635', 'request_id': 'req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.964690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba170d1e3f24eff80014662508faf01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.971861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba170d1e3f24eff80014662508faf01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.985854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba170d1e3f24eff80014662508faf01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:52.986602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba170d1e3f24eff80014662508faf01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.008223 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2066/4188] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:23:52 2021] DELETE /identity/v3/OS-OAUTH1/consumers/1ae17daaca364bcb875f93a4957bf635 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:53.012667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.014234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:53.029873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895813a-92ee-4cdd-8bfb-0bb6fcb56dc2 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:53.035305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:53.036144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.036427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.036717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7545ccc3510645f09fbc73903c5a6ec6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.037414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=7545ccc3510645f09fbc73903c5a6ec6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:53.039264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:53.039729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invalidating token cache because consumer 7545ccc3510645f09fbc73903c5a6ec6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:53.039967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.040631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.082246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dc4d85e-b682-4b96-ab84-736b34caf7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba170d1e3f24eff80014662508faf01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.095602 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2123/4189] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:52 2021] DELETE /identity/v3/users/bba170d1e3f24eff80014662508faf01 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:53.097549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.098746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.099254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.116478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '7545ccc3510645f09fbc73903c5a6ec6', 'request_id': 'req-27586939-359f-4955-83c1-f68a5fe178a4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.118286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:53.119572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:53.199782 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2124/4190] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:53.203570 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2067/4191] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:23:53 2021] DELETE /identity/v3/OS-OAUTH1/consumers/7545ccc3510645f09fbc73903c5a6ec6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:53.211976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.213915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:53.217717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.219259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:53.300225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27586939-359f-4955-83c1-f68a5fe178a4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:53.300377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c1a0-1ea7-4b54-9a47-53803cc76740 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:53.310817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:53.311484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.311770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.312045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.312800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:53.315017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:53.357803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:53.358660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.358946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.359364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.369160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:53.370625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:53.380369 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2068/4192] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:53.479946 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2125/4193] 10.222.0.32 () {60 vars in 1184 bytes} [Sat Dec 25 21:23:53 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:53.481049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.492700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c2a0-102c-49fe-becd-37d7e4b5e7c2 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:53.497633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:53.498454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.498830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.499115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/aa1b8e297a63469a9994b86f5fdd8e57` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.499860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=aa1b8e297a63469a9994b86f5fdd8e57)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:53.500980 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:53.500980 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:23:53.500980 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:23:53.501876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:53.581152 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2069/4194] 10.222.0.32 () {60 vars in 1284 bytes} [Sat Dec 25 21:23:53 2021] PATCH /identity/v3/OS-OAUTH1/consumers/aa1b8e297a63469a9994b86f5fdd8e57 => generated 220 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:23:53.585543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.602078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79cc56-0674-4e7f-b730-ed7a4f1ac4bb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:53.618249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:53.619356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.620366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.620854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/aa1b8e297a63469a9994b86f5fdd8e57` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.621787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=aa1b8e297a63469a9994b86f5fdd8e57)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:53.623982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:53.646019 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2126/4195] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:23:53 2021] GET /identity/v3/OS-OAUTH1/consumers/aa1b8e297a63469a9994b86f5fdd8e57 => generated 220 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:53.650231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.676737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474feeb1-3d0d-42d0-878d-f64df174d767 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:53.686366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1d0c3330c394270ab476216830b5c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '068d36239cf649a7a1173eccb78102b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:53.687898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.688399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.688759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/aa1b8e297a63469a9994b86f5fdd8e57` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.690017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=aa1b8e297a63469a9994b86f5fdd8e57)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:53.695823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:53.695823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invalidating token cache because consumer aa1b8e297a63469a9994b86f5fdd8e57 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:53.695823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.695823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.772253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'aa1b8e297a63469a9994b86f5fdd8e57', 'request_id': 'req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:53.919031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.925571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:53.970465 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2070/4196] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:23:53 2021] DELETE /identity/v3/OS-OAUTH1/consumers/aa1b8e297a63469a9994b86f5fdd8e57 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:53.975377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:53.978393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:53.985044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab78124-daba-45b5-8f88-749c5ce930fb tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:53.990899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:53.991966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:53.994793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:53.994793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] PATH_INFO: `/v3/projects/6b738c8b5d99478b89c36f60180b4aa8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:53.994793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b738c8b5d99478b89c36f60180b4aa8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:53.995822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:53.997432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8a688-6fd8-4d87-915b-dc31af3ab8d4 tempest-OAUTHConsumersV3Test-1434497449 tempest-OAUTHConsumersV3Test-1434497449-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:54.003012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:54.004107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:54.004557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:54.005653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] PATH_INFO: `/v3/users/cafa3945d98f459d9e8dbc3af5ffac5d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:54.007106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cafa3945d98f459d9e8dbc3af5ffac5d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:54.009950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:54.209291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b738c8b5d99478b89c36f60180b4aa8', 'request_id': 'req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.223548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cafa3945d98f459d9e8dbc3af5ffac5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.237063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cafa3945d98f459d9e8dbc3af5ffac5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.275196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cafa3945d98f459d9e8dbc3af5ffac5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.277560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cafa3945d98f459d9e8dbc3af5ffac5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.279234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f928d48a-600e-4dbc-afce-f1a3d19f92a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cafa3945d98f459d9e8dbc3af5ffac5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.284532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b738c8b5d99478b89c36f60180b4aa8', 'request_id': 'req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.293791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b738c8b5d99478b89c36f60180b4aa8', 'request_id': 'req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.308175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] The token cache is being invalidate because project 6b738c8b5d99478b89c36f60180b4aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:54.309196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.310617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.312520 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2127/4197] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:53 2021] DELETE /identity/v3/projects/6b738c8b5d99478b89c36f60180b4aa8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:54.317308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:54.319120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:54.371534 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2071/4198] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:53 2021] DELETE /identity/v3/users/cafa3945d98f459d9e8dbc3af5ffac5d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:54.375911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:54.376612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:54.377216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:54.407787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:54.412303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:54.418579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9682b-11b1-4b3d-b392-cba2b206e6a0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:54.496074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:54.497142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:54.497419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:54.497712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] PATH_INFO: `/v3/users/1dc0d98763d2453dbc32e75cd6a73503` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:54.498936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc0d98763d2453dbc32e75cd6a73503)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:54.501145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:54.514624 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2072/4199] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:54.527406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:54.531146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:54.608501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d71a09-fe00-474b-9396-51e5cc4ba2a1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:54.613417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:54.613715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:54.614008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:54.614272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:54.624715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:54.626187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:54.636394 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2073/4200] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:23:54.701835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc0d98763d2453dbc32e75cd6a73503'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.709763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc0d98763d2453dbc32e75cd6a73503'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.722597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc0d98763d2453dbc32e75cd6a73503'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.723385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc0d98763d2453dbc32e75cd6a73503'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.816714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc0d98763d2453dbc32e75cd6a73503'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:54.824344 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2128/4201] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:54 2021] DELETE /identity/v3/users/1dc0d98763d2453dbc32e75cd6a73503 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:55.216635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:55.218560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:55.238257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3f9a6-0a30-4bf5-a175-8668a9648fc6 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:55.339049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:55.339927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:55.340583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:55.341166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] PATH_INFO: `/v3/projects/113c2fc01bdf40bd902b658d044e8892` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:55.342592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113c2fc01bdf40bd902b658d044e8892)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:55.344839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:55.446630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:55.448848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:55.501077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc7e74-9b1e-4791-a436-8d3bb4640fff admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:55.505483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113c2fc01bdf40bd902b658d044e8892', 'request_id': 'req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.518188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113c2fc01bdf40bd902b658d044e8892', 'request_id': 'req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.575217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:55.576087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:55.576362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:55.576926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] PATH_INFO: `/v3/projects/7738237db9ce43b9adc0c1c1e45679ca` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:55.578169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7738237db9ce43b9adc0c1c1e45679ca)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:55.580062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:55.606966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113c2fc01bdf40bd902b658d044e8892', 'request_id': 'req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.619414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] The token cache is being invalidate because project 113c2fc01bdf40bd902b658d044e8892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:55.619718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.620342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.624963 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2074/4202] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:55 2021] DELETE /identity/v3/projects/113c2fc01bdf40bd902b658d044e8892 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:55.626330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:55.628187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:55.646511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf1c43-2a20-47bf-affc-a6fc00a06a41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:55.651895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:55.652930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:55.653075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:55.653323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] PATH_INFO: `/v3/users/a1d0c3330c394270ab476216830b5c87` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:55.654547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d0c3330c394270ab476216830b5c87)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:55.656624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:55.712020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7738237db9ce43b9adc0c1c1e45679ca', 'request_id': 'req-04c7a260-63c1-4a06-9856-c3f979b25a44'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.838958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7738237db9ce43b9adc0c1c1e45679ca', 'request_id': 'req-04c7a260-63c1-4a06-9856-c3f979b25a44'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.847401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7738237db9ce43b9adc0c1c1e45679ca', 'request_id': 'req-04c7a260-63c1-4a06-9856-c3f979b25a44'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.860205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] The token cache is being invalidate because project 7738237db9ce43b9adc0c1c1e45679ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:55.861309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.861776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-04c7a260-63c1-4a06-9856-c3f979b25a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.863568 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2129/4203] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:55 2021] DELETE /identity/v3/projects/7738237db9ce43b9adc0c1c1e45679ca => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:55.868863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953946-5c96-48aa-8d9b-a7313bf9fe6f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:55.869309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953946-5c96-48aa-8d9b-a7313bf9fe6f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:55.870674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953946-5c96-48aa-8d9b-a7313bf9fe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:55.902671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-71953946-5c96-48aa-8d9b-a7313bf9fe6f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:55.904122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-71953946-5c96-48aa-8d9b-a7313bf9fe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:55.989656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d0c3330c394270ab476216830b5c87'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:55.999342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d0c3330c394270ab476216830b5c87'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.015653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d0c3330c394270ab476216830b5c87'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.017934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d0c3330c394270ab476216830b5c87'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.020443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d0c3330c394270ab476216830b5c87'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.030113 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2130/4204] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:23:56.039015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48684a6-c655-4cbe-b95c-3223840aeaaa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.044298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48684a6-c655-4cbe-b95c-3223840aeaaa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.044298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48684a6-c655-4cbe-b95c-3223840aeaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.077770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d48684a6-c655-4cbe-b95c-3223840aeaaa None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:56.079307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d48684a6-c655-4cbe-b95c-3223840aeaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:56.090985 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2131/4205] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:56.095925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48684a6-c655-4cbe-b95c-3223840aeaaa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.105952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48684a6-c655-4cbe-b95c-3223840aeaaa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.110823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.111811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.111811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.112323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.113586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:56.114033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.117673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.128630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2132/4206] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:56.133430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.147522 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2075/4207] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:55 2021] DELETE /identity/v3/users/a1d0c3330c394270ab476216830b5c87 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:56.156671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfafbc-8bb7-45bb-80a1-7dbbf23485d2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.220474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.221363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.221716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.222001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.222694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.224603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.311084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.312786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:56.330429 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2133/4208] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:56 2021] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:56.334610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.335963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6589ff-236a-41e8-8a46-5c1cace08a23 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.402875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.403882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.404201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.404481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] PATH_INFO: `/v3/users/d7df5c79b8ea4c6ea7cf84b381b29765` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.404700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f674b12-c63a-4cd3-96ba-53731b17fb67 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.405766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7df5c79b8ea4c6ea7cf84b381b29765)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.407676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.410528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.411868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.412696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.413990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.414108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.417083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.482484 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2134/4209] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:56 2021] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:56.486792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.496542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a86f44-8dd0-4bf9-9534-1233ad901dfd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.501785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.511109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.511109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.511109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.511109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.511109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.515501 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2135/4210] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:56.519449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.530679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71e25c-0581-4b30-843b-aa3d2545ef24 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.535810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.536601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.538144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.538144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.538144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.540280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.551399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2136/4211] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:56 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:56.561058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.575945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0fe33-0f2c-4a59-bebe-96b0f011fcbd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.587534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.592515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.593817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.594076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] PATH_INFO: `/v3/projects/b1f37e0e28644c6eb7382c1c9a760cd0/users/0214e9ebb24b44c8bc99f5efad1112a3/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.607111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7df5c79b8ea4c6ea7cf84b381b29765'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.619202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7df5c79b8ea4c6ea7cf84b381b29765'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.627645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f37e0e28644c6eb7382c1c9a760cd0, user_id=0214e9ebb24b44c8bc99f5efad1112a3, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.631646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.645307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7df5c79b8ea4c6ea7cf84b381b29765'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.646267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7df5c79b8ea4c6ea7cf84b381b29765'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.647152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32b293ff-a1af-47d4-abe5-3293bd77921f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7df5c79b8ea4c6ea7cf84b381b29765'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:56.739128 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2137/4212] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:56 2021] PUT /identity/v3/projects/b1f37e0e28644c6eb7382c1c9a760cd0/users/0214e9ebb24b44c8bc99f5efad1112a3/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:56.740328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.741995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:56.785771 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2076/4213] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:23:56 2021] DELETE /identity/v3/users/d7df5c79b8ea4c6ea7cf84b381b29765 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:23:56.789294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.789294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.789294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.817366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] MFA Rules not processed for user `0214e9ebb24b44c8bc99f5efad1112a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:56.818468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:56.820009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443df4f-e7e2-4db4-9606-0b6745cbde87 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.903092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.906532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.906987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.908529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] PATH_INFO: `/v3/projects/068d36239cf649a7a1173eccb78102b4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.910004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] RBAC: Authorizing `identity:delete_project(project_id=068d36239cf649a7a1173eccb78102b4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.918732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:56.918882 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2077/4214] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:56 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:56.919814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:56.921835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:56.945669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e5454-885a-46a2-a1ca-8a902eac1331 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:56.951295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:56.951967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:56.952252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:56.952529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:56.953276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:56.956956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.049512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068d36239cf649a7a1173eccb78102b4', 'request_id': 'req-2747ce60-7b45-47a3-9d32-bf1dde3a725c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.096046 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2078/4215] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:56 2021] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:57.100495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.169123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954029f-9246-4c72-8f22-5b8a98a2e428 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.172830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068d36239cf649a7a1173eccb78102b4', 'request_id': 'req-2747ce60-7b45-47a3-9d32-bf1dde3a725c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.185603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d30d7-cc90-41c1-a82f-ad86a5184ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.186509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d30d7-cc90-41c1-a82f-ad86a5184ced admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.186667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d30d7-cc90-41c1-a82f-ad86a5184ced admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.186951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d30d7-cc90-41c1-a82f-ad86a5184ced admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.187789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d30d7-cc90-41c1-a82f-ad86a5184ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:57.189948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d30d7-cc90-41c1-a82f-ad86a5184ced admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.203515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068d36239cf649a7a1173eccb78102b4', 'request_id': 'req-2747ce60-7b45-47a3-9d32-bf1dde3a725c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.216590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] The token cache is being invalidate because project 068d36239cf649a7a1173eccb78102b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:57.216905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.217590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.219428 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2138/4216] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:56 2021] DELETE /identity/v3/projects/068d36239cf649a7a1173eccb78102b4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:57.220474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.221894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.290829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747ce60-7b45-47a3-9d32-bf1dde3a725c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.299098 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2079/4217] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:23:57.305343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.305343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.305343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.307242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.307242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.307551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.307773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] PATH_INFO: `/v3/projects/8dcf2517f61849cb9650682caf0c5712` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.308981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcf2517f61849cb9650682caf0c5712)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:57.310894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.328790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:57.330315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.343526 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2080/4218] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:57.344591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.346096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.360704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e33b-9931-42d5-a116-fcbb68d188b3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.365582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fcc56-3b08-4522-a0e9-508e19f7e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.366340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fcc56-3b08-4522-a0e9-508e19f7e8ff admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.366719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fcc56-3b08-4522-a0e9-508e19f7e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.367033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fcc56-3b08-4522-a0e9-508e19f7e8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.367974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fcc56-3b08-4522-a0e9-508e19f7e8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:57.369734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fcc56-3b08-4522-a0e9-508e19f7e8ff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.379719 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2081/4219] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:57 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:57.384134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd7ad0-7195-4d7a-92bf-c22079a99ee0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.384426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd7ad0-7195-4d7a-92bf-c22079a99ee0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.384708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd7ad0-7195-4d7a-92bf-c22079a99ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.403311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b8fd7ad0-7195-4d7a-92bf-c22079a99ee0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:57.404520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b8fd7ad0-7195-4d7a-92bf-c22079a99ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.412652 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2082/4220] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:57.414019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd7ad0-7195-4d7a-92bf-c22079a99ee0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.424059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd7ad0-7195-4d7a-92bf-c22079a99ee0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.433733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.433733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.433733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.433733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.434195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:57.434195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.442188 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2083/4221] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:57.446082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.457086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b9677-cebd-44f9-822c-e6c4ec77e0f8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.461883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.462535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.462816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.463654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.464389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:57.464695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:57.466318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.477908 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2084/4222] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:57.478687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.489896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763f8b-e7b5-415c-9bda-915b373b3e8f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.525105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcf2517f61849cb9650682caf0c5712', 'request_id': 'req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.549626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f257f-8970-42ca-a35f-ddfd40d2cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.550447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f257f-8970-42ca-a35f-ddfd40d2cf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.550733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f257f-8970-42ca-a35f-ddfd40d2cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.551069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f257f-8970-42ca-a35f-ddfd40d2cf5b admin admin] PATH_INFO: `/v3/projects/ddb89ad797b743899fc576ec3228c0e0/users/72264edb570041f29d8f4dc5fc67fbde/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.566089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f257f-8970-42ca-a35f-ddfd40d2cf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb89ad797b743899fc576ec3228c0e0, user_id=72264edb570041f29d8f4dc5fc67fbde, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:57.568677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f257f-8970-42ca-a35f-ddfd40d2cf5b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.673556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcf2517f61849cb9650682caf0c5712', 'request_id': 'req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.680341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcf2517f61849cb9650682caf0c5712', 'request_id': 'req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.691528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] The token cache is being invalidate because project 8dcf2517f61849cb9650682caf0c5712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:23:57.691829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.692495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:23:57.694304 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2139/4223] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:23:57 2021] DELETE /identity/v3/projects/8dcf2517f61849cb9650682caf0c5712 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:57.695607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.696941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.708116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2085/4224] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:57 2021] PUT /identity/v3/projects/ddb89ad797b743899fc576ec3228c0e0/users/72264edb570041f29d8f4dc5fc67fbde/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:57.710398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d06246-f769-42bc-9ef0-6c04ccf9f8a2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.710693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d06246-f769-42bc-9ef0-6c04ccf9f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.710966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d06246-f769-42bc-9ef0-6c04ccf9f8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.712718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cf8dd-46a1-4dce-9d9f-f70edee50200 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.736853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-61d06246-f769-42bc-9ef0-6c04ccf9f8a2 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:57.738121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-61d06246-f769-42bc-9ef0-6c04ccf9f8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.780195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.781049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.781401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.781743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.782559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:57.784535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:57.804099 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2086/4225] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:57.810535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c80d8-7347-4cc7-9d0e-7e23c613e484 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.810880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c80d8-7347-4cc7-9d0e-7e23c613e484 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.811163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c80d8-7347-4cc7-9d0e-7e23c613e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.832300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2c2c80d8-7347-4cc7-9d0e-7e23c613e484 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:57.833534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2c2c80d8-7347-4cc7-9d0e-7e23c613e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.842157 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2087/4226] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:57.843376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a0c1-3bd6-447c-bbff-efd43b88a08f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.843661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a0c1-3bd6-447c-bbff-efd43b88a08f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.843938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a0c1-3bd6-447c-bbff-efd43b88a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.869924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1793a0c1-3bd6-447c-bbff-efd43b88a08f None None] MFA Rules not processed for user `72264edb570041f29d8f4dc5fc67fbde`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:57.871513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1793a0c1-3bd6-447c-bbff-efd43b88a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.903692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2140/4227] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:57.903692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:57.903692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.941374 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2088/4228] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:57.942736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d578-b2e9-4bcb-86f8-d2acfff7e605 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.943026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d578-b2e9-4bcb-86f8-d2acfff7e605 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.943297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085d578-b2e9-4bcb-86f8-d2acfff7e605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:57.970120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b085d578-b2e9-4bcb-86f8-d2acfff7e605 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:57.971303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b085d578-b2e9-4bcb-86f8-d2acfff7e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:57.986273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa32fd0-dcc1-4900-8399-3d9742c86eef admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:57.991733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:57.992369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:57.992651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:57.992958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.033054 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2089/4229] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:58.034035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d578-b2e9-4bcb-86f8-d2acfff7e605 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.043686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085d578-b2e9-4bcb-86f8-d2acfff7e605 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.048376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.049057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.049337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.049720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.050510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.052520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.052974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.054701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.063678 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2141/4230] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:23:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:58.064026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.065503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:58.121159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c15b-0187-4290-88d4-f940f1ce1c20 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.124840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.125509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.125791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.126066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.127850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:58.186754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.187813 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2090/4231] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:58 2021] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:58.188189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.191760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.198093 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2142/4232] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:58 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:58.200532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.202176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d58f07-2328-4f19-b5d5-e728dbd28725 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.208942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.208942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.208942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.209567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.210463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:23:58.210778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.211831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f29b9-fb39-4f53-8943-f63713aaecad service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.212389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.218641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.219291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.219573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.219849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.221643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.227278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.239652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2143/4233] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:58 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:58.243730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.258631 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2091/4234] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:23:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:23:58.260661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.263078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd8ad0-0a63-4ce5-ba97-47ca1351c036 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.268862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.269404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.269717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.270064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.270902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.272611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.286481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68073580-9442-42f1-842c-3c8eca88fa15 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.290860 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2144/4235] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:58 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:58.292600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.298985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.299658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.299993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.300266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.301174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.303427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aee9-b3c8-4c86-af20-3be98c9ca2e3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.305392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.315308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4517c-37a9-4f0c-ba0b-b6afcf011495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.319508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4517c-37a9-4f0c-ba0b-b6afcf011495 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.319508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4517c-37a9-4f0c-ba0b-b6afcf011495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.319508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4517c-37a9-4f0c-ba0b-b6afcf011495 admin admin] PATH_INFO: `/v3/projects/d0ff6007d73444dda12f017c3f7be6c9/users/e0b650d066c74ef38c294a65f25a7bde/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.334607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4517c-37a9-4f0c-ba0b-b6afcf011495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ff6007d73444dda12f017c3f7be6c9, user_id=e0b650d066c74ef38c294a65f25a7bde, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.338503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4517c-37a9-4f0c-ba0b-b6afcf011495 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.398130 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2092/4236] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:58 2021] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:58.406028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.423837 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2145/4237] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:58 2021] PUT /identity/v3/projects/d0ff6007d73444dda12f017c3f7be6c9/users/e0b650d066c74ef38c294a65f25a7bde/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:58.452498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300713f-b7a4-449f-803a-3bcc2c3e3351 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.452742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300713f-b7a4-449f-803a-3bcc2c3e3351 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.453217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300713f-b7a4-449f-803a-3bcc2c3e3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.532036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6300713f-b7a4-449f-803a-3bcc2c3e3351 None None] MFA Rules not processed for user `e0b650d066c74ef38c294a65f25a7bde`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:58.534046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6300713f-b7a4-449f-803a-3bcc2c3e3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:58.548404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fff65-6404-43a3-a246-e64fea0cbdd6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.622102 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2146/4238] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:58 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:58.629892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300713f-b7a4-449f-803a-3bcc2c3e3351 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.689982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.690668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.690946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.691787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.692645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.694810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.704827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300713f-b7a4-449f-803a-3bcc2c3e3351 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.709324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.710332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.710923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.711348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.794659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.796561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.809394 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2147/4239] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:58 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:23:58.810457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.821210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed489e0f-6960-4a9c-89b1-2923a73062c9 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.825704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.826595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.827033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.827365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.828095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e0b650d066c74ef38c294a65f25a7bde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.829713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.868249 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2093/4240] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:58 2021] POST /identity/v3/users => generated 293 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:58.869528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.879848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2164ce-2d89-4f5e-adba-a8f829d0c59c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.888561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.889266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.889548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.889827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.890565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.892796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.903940 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2094/4241] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:58 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:23:58.908001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.934841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc3e27-14be-42fe-a8f1-d69d77a538dc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:58.947636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:58.949172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:58.949478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:58.949622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:58.950555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:58.953827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:58.981830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2095/4242] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:23:58 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:23:58.986661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:58.992065 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2148/4243] 10.222.0.32 () {60 vars in 1298 bytes} [Sat Dec 25 21:23:58 2021] POST /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2 => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:59.003517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.011537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623714fe-699f-4296-8917-254b19db1d44 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.019584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea72959-64ff-43f5-b1be-052340c6be2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.019584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72959-64ff-43f5-b1be-052340c6be2c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.019584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72959-64ff-43f5-b1be-052340c6be2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.019584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea72959-64ff-43f5-b1be-052340c6be2c admin admin] PATH_INFO: `/v3/projects/a702b12f68b44b949a2ab7f5eeaf411b/users/0da15b405cc34c26b253658157cd7442/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.019997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58364e-a6a5-48aa-beb8-f90d2d2a2bee tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.027410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.028603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.029081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.029560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/a0a1e3b7868842af8f77e816b89d7a9f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.032060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e0b650d066c74ef38c294a65f25a7bde, credential_id=a0a1e3b7868842af8f77e816b89d7a9f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:59.034263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:59.044452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea72959-64ff-43f5-b1be-052340c6be2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a702b12f68b44b949a2ab7f5eeaf411b, user_id=0da15b405cc34c26b253658157cd7442, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:59.047609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea72959-64ff-43f5-b1be-052340c6be2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:59.191473 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2149/4244] 10.222.0.32 () {58 vars in 1379 bytes} [Sat Dec 25 21:23:59 2021] DELETE /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/a0a1e3b7868842af8f77e816b89d7a9f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:59.198031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.210017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f478eb3-963a-402e-beea-240928b4c858 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.214791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.219150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.219150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.219150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.219150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e0b650d066c74ef38c294a65f25a7bde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:59.219150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:59.247462 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2096/4245] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:23:58 2021] PUT /identity/v3/projects/a702b12f68b44b949a2ab7f5eeaf411b/users/0da15b405cc34c26b253658157cd7442/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:59.257635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108676e2-89d1-46be-a45e-d9b4390d81eb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.261958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108676e2-89d1-46be-a45e-d9b4390d81eb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.261958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108676e2-89d1-46be-a45e-d9b4390d81eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.303142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-108676e2-89d1-46be-a45e-d9b4390d81eb None None] MFA Rules not processed for user `0da15b405cc34c26b253658157cd7442`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:23:59.304404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-108676e2-89d1-46be-a45e-d9b4390d81eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:59.351610 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2150/4246] 10.222.0.32 () {60 vars in 1298 bytes} [Sat Dec 25 21:23:59 2021] POST /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2 => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:59.355925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.357818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:59.398163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2097/4247] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:23:59 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:23:59.398163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108676e2-89d1-46be-a45e-d9b4390d81eb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.457800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e630-44d3-4816-95d4-aa49bc0a1e11 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.490587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108676e2-89d1-46be-a45e-d9b4390d81eb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.495930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.496809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.497136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.497417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/9f8b711dc2314908bc24ef87d0cc1da2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.499677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e0b650d066c74ef38c294a65f25a7bde, credential_id=9f8b711dc2314908bc24ef87d0cc1da2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:59.501138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:59.549117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.553646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.553646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.553646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.553646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:23:59.628864 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2098/4248] 10.222.0.32 () {58 vars in 1379 bytes} [Sat Dec 25 21:23:59 2021] DELETE /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/9f8b711dc2314908bc24ef87d0cc1da2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:23:59.628864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.637223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:59.639112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:59.652172 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2151/4249] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:23:59 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:23:59.653517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.674561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580ab95-9f2a-49d0-81a4-6e399f949c7a service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.679643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f272d-186a-45a6-9822-b78053fd3a55 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.680792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f272d-186a-45a6-9822-b78053fd3a55 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.681207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f272d-186a-45a6-9822-b78053fd3a55 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.681776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f272d-186a-45a6-9822-b78053fd3a55 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/9f8b711dc2314908bc24ef87d0cc1da2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.706159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d397c2-4992-48cd-81de-d53cb5f034a1 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.710665 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-5f9f272d-186a-45a6-9822-b78053fd3a55 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Could not find credential: 4b63508284ec87e598dbb5ca861cda8fcc9248293139b6094ee691b2d49edb6a.: keystone.exception.CredentialNotFound: Could not find credential: 4b63508284ec87e598dbb5ca861cda8fcc9248293139b6094ee691b2d49edb6a. Dec 25 21:23:59.710665 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2152/4250] 10.222.0.32 () {58 vars in 1376 bytes} [Sat Dec 25 21:23:59 2021] GET /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/9f8b711dc2314908bc24ef87d0cc1da2 => generated 148 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:23:59.714831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f272d-186a-45a6-9822-b78053fd3a55 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.716788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.717747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.718226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.718844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.720748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:59.723247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:59.726634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f272d-186a-45a6-9822-b78053fd3a55 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:23:59.745596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:23:59.745596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:23:59.745596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:23:59.745952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:23:59.745952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e0b650d066c74ef38c294a65f25a7bde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:23:59.751344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:23:59.892534 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2153/4251] 10.222.0.32 () {60 vars in 1298 bytes} [Sat Dec 25 21:23:59 2021] POST /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2 => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:59.894972 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2099/4252] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:23:59 2021] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:23:59.895828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.895987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:23:59.914653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67baf82-c374-4b34-bb45-137298533324 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.009262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.010801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01845b4-4be5-4ff7-a276-c79d9efb5d76 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.013743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.013743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.013743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.013743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e0b650d066c74ef38c294a65f25a7bde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.013743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.022650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.029279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.029279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.029279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.029279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.029279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.107428 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2154/4253] 10.222.0.32 () {60 vars in 1298 bytes} [Sat Dec 25 21:23:59 2021] POST /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2 => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:00.115644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.127320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448e5fa-9ad5-4e4f-9e4e-f5e2eeb830e3 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.136414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.137312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.137607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.144048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.144048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=e0b650d066c74ef38c294a65f25a7bde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.144261 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2100/4254] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:23:59 2021] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:00.144359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.146675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.156776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2155/4255] 10.222.0.32 () {58 vars in 1277 bytes} [Sat Dec 25 21:24:00 2021] GET /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2 => generated 865 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:00.161100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.163833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffb17-7de6-4155-ae63-cbc66102be70 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.172296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.173636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.174378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.174653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.175521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.177642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.182368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c34e7-2d33-4aa6-9e65-30870973bd33 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.187458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.188468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.189082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.189473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/117cd0d67fea477eaf3f4944d63a567f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.191730 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2101/4256] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:00 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:00.195855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.196516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e0b650d066c74ef38c294a65f25a7bde, credential_id=117cd0d67fea477eaf3f4944d63a567f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.198827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.219022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165d915-c42a-45da-829b-e6828e22ae88 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.225344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.226238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.226520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.226794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] PATH_INFO: `/v3/projects/22a773b87e52482483b87d5f4fad39b0/users/9438fcdc9aab464f83218f383931528c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.243704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a773b87e52482483b87d5f4fad39b0, user_id=9438fcdc9aab464f83218f383931528c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.246952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.259036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2156/4257] 10.222.0.32 () {58 vars in 1379 bytes} [Sat Dec 25 21:24:00 2021] DELETE /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/117cd0d67fea477eaf3f4944d63a567f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:00.263302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.279869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3d0a2-fe4c-4d61-ba6e-8b0649f31ad0 tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.283464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.289359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.289359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.289359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/8a242117d8a349a8b3f4a7f703d82666` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.289359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e0b650d066c74ef38c294a65f25a7bde, credential_id=8a242117d8a349a8b3f4a7f703d82666)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.289832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.330920 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2102/4258] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:00 2021] PUT /identity/v3/projects/22a773b87e52482483b87d5f4fad39b0/users/9438fcdc9aab464f83218f383931528c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:00.334918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.386514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2157/4259] 10.222.0.32 () {58 vars in 1379 bytes} [Sat Dec 25 21:24:00 2021] DELETE /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/8a242117d8a349a8b3f4a7f703d82666 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:00.393341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.408043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b9a06-d941-42e7-9ab7-6202cf942bec tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.443672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9369e-4f7e-4ddc-882c-0ec449e12414 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.449458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.450136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.450428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.450711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.451566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.453290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.471488 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2103/4260] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:00 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:00.480922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.493645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63722873-edd7-4f85-8034-6c37f05bd534 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.497485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.498447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.498861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.499416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.500605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e0b650d066c74ef38c294a65f25a7bde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.503227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.504246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3bb79-e8bd-4b09-bff7-aac99e5a14ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.505585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3bb79-e8bd-4b09-bff7-aac99e5a14ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.506055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3bb79-e8bd-4b09-bff7-aac99e5a14ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.506584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3bb79-e8bd-4b09-bff7-aac99e5a14ec admin admin] PATH_INFO: `/v3/projects/22a773b87e52482483b87d5f4fad39b0/users/9438fcdc9aab464f83218f383931528c/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.509569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3bb79-e8bd-4b09-bff7-aac99e5a14ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a773b87e52482483b87d5f4fad39b0, user_id=9438fcdc9aab464f83218f383931528c, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.517467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3bb79-e8bd-4b09-bff7-aac99e5a14ec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.530562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2104/4261] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:00 2021] PUT /identity/v3/projects/22a773b87e52482483b87d5f4fad39b0/users/9438fcdc9aab464f83218f383931528c/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:00.546624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa790e-ab6e-4bfc-b25e-6dad2b25b315 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.547218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa790e-ab6e-4bfc-b25e-6dad2b25b315 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.547575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa790e-ab6e-4bfc-b25e-6dad2b25b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.582312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-deaa790e-ab6e-4bfc-b25e-6dad2b25b315 None None] MFA Rules not processed for user `9438fcdc9aab464f83218f383931528c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:00.583664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-deaa790e-ab6e-4bfc-b25e-6dad2b25b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:00.588450 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2158/4262] 10.222.0.32 () {60 vars in 1298 bytes} [Sat Dec 25 21:24:00 2021] POST /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2 => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:00.592179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.603586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6acd16-5010-4363-9e83-604b6c07076b tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.683943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.685547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.686007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.686919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/28ee33192fbd4f94935bff5d1a5594d8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.689972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=e0b650d066c74ef38c294a65f25a7bde, credential_id=28ee33192fbd4f94935bff5d1a5594d8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.691884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.697204 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2159/4263] 10.222.0.32 () {58 vars in 1376 bytes} [Sat Dec 25 21:24:00 2021] GET /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/28ee33192fbd4f94935bff5d1a5594d8 => generated 367 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:00.701510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.721222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb63ec3-c370-4124-9794-382f0dc1b50e tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.726188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b650d066c74ef38c294a65f25a7bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0ff6007d73444dda12f017c3f7be6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.727494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.727814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.728124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/28ee33192fbd4f94935bff5d1a5594d8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.729060 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2105/4264] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:00 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:00.733077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa790e-ab6e-4bfc-b25e-6dad2b25b315 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.735695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e0b650d066c74ef38c294a65f25a7bde, credential_id=28ee33192fbd4f94935bff5d1a5594d8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.737496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.743954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa790e-ab6e-4bfc-b25e-6dad2b25b315 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.750462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.751269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.751646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.752007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.752817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.754550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.852295 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2160/4265] 10.222.0.32 () {58 vars in 1379 bytes} [Sat Dec 25 21:24:00 2021] DELETE /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde/credentials/OS-EC2/28ee33192fbd4f94935bff5d1a5594d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:00.859540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.895011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2106/4266] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:00 2021] POST /identity/v3/services => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:00.900180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:00.942492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf67ffa-dc86-4efd-a174-40d89d71d8fa tempest-EC2CredentialsTest-110655721 tempest-EC2CredentialsTest-110655721-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.942752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120963e-54cb-41f2-a1e6-e9b45ab6aef5 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:00.959003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.959619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.959903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.961992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.962713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.969737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.982839 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 25 21:24:00.982839 ncdv-master-1 devstack@keystone.service[96732]: Failed validating 'type' in schema['properties']['enabled']: Dec 25 21:24:00.982839 ncdv-master-1 devstack@keystone.service[96732]: {'enum': [True, False, None], 'type': 'boolean'} Dec 25 21:24:00.982839 ncdv-master-1 devstack@keystone.service[96732]: On instance['enabled']: Dec 25 21:24:00.982839 ncdv-master-1 devstack@keystone.service[96732]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 25 21:24:00.984645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2107/4267] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:00 2021] POST /identity/v3/endpoints => generated 283 bytes in 85 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:24:00.988385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:00.988385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:00.988385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:00.988385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] PATH_INFO: `/v3/users/e0b650d066c74ef38c294a65f25a7bde` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:00.990386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b650d066c74ef38c294a65f25a7bde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:00.992341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:00.995620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:01.020926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2d723-d188-4d40-ade8-09975e11768b tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:01.035643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:01.036561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.036983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.037376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.038470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:01.040118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:01.048242 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 25 21:24:01.048242 ncdv-master-1 devstack@keystone.service[96732]: Failed validating 'type' in schema['properties']['enabled']: Dec 25 21:24:01.048242 ncdv-master-1 devstack@keystone.service[96732]: {'enum': [True, False, None], 'type': 'boolean'} Dec 25 21:24:01.048242 ncdv-master-1 devstack@keystone.service[96732]: On instance['enabled']: Dec 25 21:24:01.048242 ncdv-master-1 devstack@keystone.service[96732]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 25 21:24:01.051197 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2108/4268] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:00 2021] POST /identity/v3/endpoints => generated 281 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:24:01.058204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:01.078244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d7971-82ab-4a5b-8dce-7356dbed6b15 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:01.083240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:01.083982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.084337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.084778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.085637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:01.087306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:01.273530 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-891861514. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:24:01.273530 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:24:01.273530 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:01.324809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b650d066c74ef38c294a65f25a7bde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:01.336716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b650d066c74ef38c294a65f25a7bde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:01.358849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b650d066c74ef38c294a65f25a7bde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:01.359902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b650d066c74ef38c294a65f25a7bde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:01.390155 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2109/4269] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:01 2021] POST /identity/v3/endpoints => generated 359 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:01.392137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:01.427894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b5465-a9fe-4e0d-8be9-71c705999c7a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:01.437113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:01.437978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.438259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.439948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/regions/tempest-region-891861514` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.439948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-891861514)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:01.440449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:01.444915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2110/4270] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:24:01 2021] GET /identity/v3/regions/tempest-region-891861514 => generated 178 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:01.446572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:01.458474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be680ef8-3a36-4612-9334-46608e7620a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b650d066c74ef38c294a65f25a7bde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:01.458678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6238ef-094c-4a8c-94f6-ac025bb8f3fb tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:01.465628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:01.475698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.475698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.475698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints/3bf27a778da2483d922a61bacae2c1a5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.476024 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2161/4271] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:00 2021] DELETE /identity/v3/users/e0b650d066c74ef38c294a65f25a7bde => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:01.479348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.479348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.479348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.482325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=3bf27a778da2483d922a61bacae2c1a5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:01.483358 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:01.483358 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:01.483358 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:01.484264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:01.504020 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 25 21:24:01.504020 ncdv-master-1 devstack@keystone.service[96732]: Failed validating 'type' in schema['properties']['enabled']: Dec 25 21:24:01.504020 ncdv-master-1 devstack@keystone.service[96732]: {'enum': [True, False, None], 'type': 'boolean'} Dec 25 21:24:01.504020 ncdv-master-1 devstack@keystone.service[96732]: On instance['enabled']: Dec 25 21:24:01.504020 ncdv-master-1 devstack@keystone.service[96732]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Dec 25 21:24:01.504020 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2111/4272] 10.222.0.32 () {60 vars in 1254 bytes} [Sat Dec 25 21:24:01 2021] PATCH /identity/v3/endpoints/3bf27a778da2483d922a61bacae2c1a5 => generated 283 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Dec 25 21:24:01.510728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:01.512953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:01.531344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899baef-98da-4b28-b772-8910ca011620 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:01.532589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:01.534028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:01.616315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:01.617798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.618389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.619026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints/3bf27a778da2483d922a61bacae2c1a5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.621335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=3bf27a778da2483d922a61bacae2c1a5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:01.622521 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:01.622521 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:01.622521 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:01.623793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:01.630808 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2162/4273] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:01 2021] POST /identity/v3/auth/tokens => generated 3543 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:01.644668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:01.646458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:01.747797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6937bd-bcc9-4dba-8086-ceb9cc6f3e62 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:01.753023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:01.753023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.753023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.753023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.763481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:01.765207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:01.785210 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2163/4274] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:01 2021] GET /identity/v3/auth/tokens => generated 3543 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:01.785443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '3bf27a778da2483d922a61bacae2c1a5', 'request_id': 'req-59238b48-1f28-46e5-8e61-ca35d579a009'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:01.804497 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2112/4275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:01 2021] DELETE /identity/v3/endpoints/3bf27a778da2483d922a61bacae2c1a5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:01.809800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:01.837745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ce9a4-2339-4cf1-8d6a-38f9a72d73e7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:01.890683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:01.891826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:01.892109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:01.895859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/regions/tempest-region-891861514` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:01.897172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-891861514)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:01.898885 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:01.898885 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:01.898885 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:01.899792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:02.395411 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-891861514. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:24:02.395411 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:24:02.395411 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:02.408043 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2164/4276] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:24:01 2021] DELETE /identity/v3/regions/tempest-region-891861514 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:02.412821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:02.436359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59238b48-1f28-46e5-8e61-ca35d579a009 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:02.458209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:02.459215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:02.459356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:02.459629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:02.460391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:02.462370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:02.600473 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-769851858. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:24:02.600473 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:24:02.600473 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:02.725302 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2113/4277] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:02 2021] POST /identity/v3/endpoints => generated 359 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:02.726226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:02.735532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2667-02a6-4bd3-afd9-2c7040589df2 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:02.761825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:02.762061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:02.763962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:02.764830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:02.766386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:02.767079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/regions/tempest-region-769851858` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:02.769603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-769851858)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:02.774041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:02.780533 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2165/4278] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:24:02 2021] GET /identity/v3/regions/tempest-region-769851858 => generated 178 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:02.785476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:02.826976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83777e2d-f12b-4906-b932-01d4ad6c6853 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:02.828331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:02.829267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:02.829549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:02.829973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints/5bbc4033757d4f9db53c9237ec6547c7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:02.839639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=5bbc4033757d4f9db53c9237ec6547c7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:02.841249 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:02.841249 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:02.841249 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:02.842367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:02.846443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fd4e9-e859-4af2-ad04-51a73d8ac6ca tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:02.857424 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 25 21:24:02.857424 ncdv-master-1 devstack@keystone.service[96733]: Failed validating 'type' in schema['properties']['enabled']: Dec 25 21:24:02.857424 ncdv-master-1 devstack@keystone.service[96733]: {'enum': [True, False, None], 'type': 'boolean'} Dec 25 21:24:02.857424 ncdv-master-1 devstack@keystone.service[96733]: On instance['enabled']: Dec 25 21:24:02.857424 ncdv-master-1 devstack@keystone.service[96733]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Dec 25 21:24:02.858730 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2166/4279] 10.222.0.32 () {60 vars in 1254 bytes} [Sat Dec 25 21:24:02 2021] PATCH /identity/v3/endpoints/5bbc4033757d4f9db53c9237ec6547c7 => generated 281 bytes in 74 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:24:02.860159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:02.861445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:02.862078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:02.863624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] PATH_INFO: `/v3/projects/d0ff6007d73444dda12f017c3f7be6c9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:02.865302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ff6007d73444dda12f017c3f7be6c9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:02.867480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:02.870911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:02.886680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aa77a-3fb1-4480-a017-51f24c55f28a tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:02.894091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:02.904357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:02.904665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:02.904980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/endpoints/5bbc4033757d4f9db53c9237ec6547c7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:02.906408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5bbc4033757d4f9db53c9237ec6547c7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:02.909248 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:02.909248 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:02.909248 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:02.909248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:03.048179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5bbc4033757d4f9db53c9237ec6547c7', 'request_id': 'req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.067949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ff6007d73444dda12f017c3f7be6c9', 'request_id': 'req-7c7f43f6-165b-4bcc-af95-4fde719558a7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.086182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ff6007d73444dda12f017c3f7be6c9', 'request_id': 'req-7c7f43f6-165b-4bcc-af95-4fde719558a7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.094393 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2167/4280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:02 2021] DELETE /identity/v3/endpoints/5bbc4033757d4f9db53c9237ec6547c7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:03.095281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:03.101866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:03.150145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d0bb7-1c00-4adb-ba75-1c80250ec4ee tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:03.207841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ff6007d73444dda12f017c3f7be6c9', 'request_id': 'req-7c7f43f6-165b-4bcc-af95-4fde719558a7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.239987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] The token cache is being invalidate because project d0ff6007d73444dda12f017c3f7be6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:03.240326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.244985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.252571 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2114/4281] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:02 2021] DELETE /identity/v3/projects/d0ff6007d73444dda12f017c3f7be6c9 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:03.254157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:03.256352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:03.271280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:03.272801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.273834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.274124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] PATH_INFO: `/v3/users/0214e9ebb24b44c8bc99f5efad1112a3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.276452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0214e9ebb24b44c8bc99f5efad1112a3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:03.278547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:03.418524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f43f6-165b-4bcc-af95-4fde719558a7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:03.442499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b13f3-9d59-49c0-bcc0-eb19a81afbf0 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:03.442499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b13f3-9d59-49c0-bcc0-eb19a81afbf0 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.442499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b13f3-9d59-49c0-bcc0-eb19a81afbf0 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.442956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b13f3-9d59-49c0-bcc0-eb19a81afbf0 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/regions/tempest-region-769851858` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.442956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b13f3-9d59-49c0-bcc0-eb19a81afbf0 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-769851858)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:03.443924 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-348b13f3-9d59-49c0-bcc0-eb19a81afbf0 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:03.443924 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:03.443924 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:03.445210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b13f3-9d59-49c0-bcc0-eb19a81afbf0 tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:03.506150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0214e9ebb24b44c8bc99f5efad1112a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.514223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0214e9ebb24b44c8bc99f5efad1112a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.530716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0214e9ebb24b44c8bc99f5efad1112a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.531439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0214e9ebb24b44c8bc99f5efad1112a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.557885 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2115/4282] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:24:03 2021] DELETE /identity/v3/regions/tempest-region-769851858 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:03.564150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08c2f-2d74-4d6d-82ee-6f60e0a012bf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.566321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08c2f-2d74-4d6d-82ee-6f60e0a012bf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.571691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a08c2f-2d74-4d6d-82ee-6f60e0a012bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.600831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-21a08c2f-2d74-4d6d-82ee-6f60e0a012bf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:03.604129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-21a08c2f-2d74-4d6d-82ee-6f60e0a012bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:03.629327 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2116/4283] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:03.635407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08c2f-2d74-4d6d-82ee-6f60e0a012bf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:03.635559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11e1b823-16f0-402e-9d0b-256b3a9f9876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0214e9ebb24b44c8bc99f5efad1112a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:03.647652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2168/4284] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:03 2021] DELETE /identity/v3/users/0214e9ebb24b44c8bc99f5efad1112a3 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:03.647652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37405a-feee-4a42-bb42-009583480e47 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.647652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37405a-feee-4a42-bb42-009583480e47 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.647652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37405a-feee-4a42-bb42-009583480e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.680618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a08c2f-2d74-4d6d-82ee-6f60e0a012bf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:03.694042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2b37405a-feee-4a42-bb42-009583480e47 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:03.696754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b37405a-feee-4a42-bb42-009583480e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:03.798452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9438fcdc9aab464f83218f383931528c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a773b87e52482483b87d5f4fad39b0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:03.801515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.801515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.801763 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2169/4285] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:03.802209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] PATH_INFO: `/v3/services/5f6557722094472193462df9949a9c5c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.802209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5f6557722094472193462df9949a9c5c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:03.802209 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:03.802209 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:03.802209 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:03.803359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:03.803587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d354b8-125c-4c2d-88ca-e4d2804689e6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.804091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d354b8-125c-4c2d-88ca-e4d2804689e6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.804526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d354b8-125c-4c2d-88ca-e4d2804689e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.828113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-46d354b8-125c-4c2d-88ca-e4d2804689e6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:03.829485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-46d354b8-125c-4c2d-88ca-e4d2804689e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:03.842235 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2170/4286] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:03.843096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d354b8-125c-4c2d-88ca-e4d2804689e6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:03.855040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d354b8-125c-4c2d-88ca-e4d2804689e6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:03.863875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:03.864559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.864842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.865180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.865965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:03.866283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:03.868381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:03.886073 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2171/4287] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:03.886073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:03.888300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:03.930026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2117/4288] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:03 2021] DELETE /identity/v3/services/5f6557722094472193462df9949a9c5c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:03.934468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:03.986151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe97ce-da4a-4ad2-ab69-35c1d6555fed tempest-EndpointsNegativeTestJSON-353148156 tempest-EndpointsNegativeTestJSON-353148156-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:03.991429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345abf-c733-4d8f-b387-4fbbe2fee5e1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:03.997389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:03.999785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:03.999785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:03.999785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:03.999785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.003644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.011911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.012651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.013104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.013378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.024253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.026506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.044114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2172/4289] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:04.058871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.062898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:04.092012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794ffd8-eafd-4e7b-be85-0e1cedc432db service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:04.100365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.101588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.102082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.102831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] PATH_INFO: `/v3/users/0da15b405cc34c26b253658157cd7442` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.106226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da15b405cc34c26b253658157cd7442)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.116146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.150916 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2118/4290] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:03 2021] POST /identity/v3/projects => generated 395 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:04.157926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.242717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157f0e-a4ae-49ba-a9ef-d9971d207921 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:04.254246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.254246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.254246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.254246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.254600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.256828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.368623 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2119/4291] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:04 2021] POST /identity/v3/users => generated 304 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:04.378070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.406875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6e04-31e0-4a05-a0d4-6e915d93c06d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:04.408469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da15b405cc34c26b253658157cd7442'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:04.417031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da15b405cc34c26b253658157cd7442'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:04.423650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.424355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.424641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.425082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.425889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.429797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.440392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da15b405cc34c26b253658157cd7442'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:04.443207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da15b405cc34c26b253658157cd7442'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:04.450797 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2120/4292] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:04 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:04.453405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.466315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac09e4d-9b42-401f-be4e-bfba0c989106 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:04.472488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.473507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.473864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.474612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] PATH_INFO: `/v3/projects/d7fd3a986d5b4c38898b9ae8f0b6eee4/users/747bd79ceac348ddbb1ee54f605da025/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.494075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fd3a986d5b4c38898b9ae8f0b6eee4, user_id=747bd79ceac348ddbb1ee54f605da025, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.497313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.532600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c76979ed-5d40-40d2-b71c-a6e0cf8a2897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da15b405cc34c26b253658157cd7442'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:04.539971 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2173/4293] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:04 2021] DELETE /identity/v3/users/0da15b405cc34c26b253658157cd7442 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:04.545153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.545439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.545715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.572952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:04.574466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:04.594628 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2121/4294] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:04 2021] PUT /identity/v3/projects/d7fd3a986d5b4c38898b9ae8f0b6eee4/users/747bd79ceac348ddbb1ee54f605da025/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:04.598973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.600710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:04.658034 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2174/4295] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:04.658915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.660288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:04.683075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be6d8e-15ae-4fff-9a41-6d088c225ed0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:04.727670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bfb1e-8cbd-403c-b74d-b8840fd15e5a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:04.734779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.735539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.735822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.736106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.736908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.738628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.751182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.751182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.751182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.751182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] PATH_INFO: `/v3/projects/b1f37e0e28644c6eb7382c1c9a760cd0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.751609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f37e0e28644c6eb7382c1c9a760cd0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.751609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.760932 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2122/4296] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:04 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:04.760932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.769517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:04.852601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a5ac5-d698-456e-af87-06c602d4b215 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:04.863447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:04.863447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:04.863447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:04.873433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:04.887262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:04.888948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:04.911944 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2123/4297] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:04.913563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:04.922013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f37e0e28644c6eb7382c1c9a760cd0', 'request_id': 'req-029b6903-2721-459d-ac96-022725c47f51'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:04.934160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6af44-2ec7-489c-ae8c-75489890c1ee service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:05.012760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f37e0e28644c6eb7382c1c9a760cd0', 'request_id': 'req-029b6903-2721-459d-ac96-022725c47f51'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.019503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd2168-1dda-48de-8b5e-2de2641c6194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:05.022300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2168-1dda-48de-8b5e-2de2641c6194 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:05.022300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2168-1dda-48de-8b5e-2de2641c6194 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:05.022300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd2168-1dda-48de-8b5e-2de2641c6194 admin admin] PATH_INFO: `/v3/projects/d7fd3a986d5b4c38898b9ae8f0b6eee4/users/747bd79ceac348ddbb1ee54f605da025/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:05.022876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f37e0e28644c6eb7382c1c9a760cd0', 'request_id': 'req-029b6903-2721-459d-ac96-022725c47f51'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.024163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd2168-1dda-48de-8b5e-2de2641c6194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fd3a986d5b4c38898b9ae8f0b6eee4, user_id=747bd79ceac348ddbb1ee54f605da025, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:05.028102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd2168-1dda-48de-8b5e-2de2641c6194 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:05.041647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] The token cache is being invalidate because project b1f37e0e28644c6eb7382c1c9a760cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:05.042122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.043445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.046655 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2175/4298] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:04 2021] DELETE /identity/v3/projects/b1f37e0e28644c6eb7382c1c9a760cd0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:05.048298 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2124/4299] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:04 2021] PUT /identity/v3/projects/d7fd3a986d5b4c38898b9ae8f0b6eee4/users/747bd79ceac348ddbb1ee54f605da025/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:05.050352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:05.061194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:05.061520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:05.061756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:05.064372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:05.093344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6903-2721-459d-ac96-022725c47f51 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:05.122229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] MFA Rules not processed for user `747bd79ceac348ddbb1ee54f605da025`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:05.128926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:05.195994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:05.198333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:05.198976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:05.199368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] PATH_INFO: `/v3/users/72264edb570041f29d8f4dc5fc67fbde` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:05.201945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72264edb570041f29d8f4dc5fc67fbde)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:05.217085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:05.285265 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2125/4300] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:05 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:05.286343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:05.287842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:05.307559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43b379-29d3-479c-83e5-ae28e61c32dd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:05.313274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:05.314021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:05.326494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:05.326494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:05.326494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:05.326494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:05.433039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2126/4301] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:05 2021] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:05.436446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:05.448159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72264edb570041f29d8f4dc5fc67fbde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.458724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72264edb570041f29d8f4dc5fc67fbde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.476190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72264edb570041f29d8f4dc5fc67fbde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.477322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72264edb570041f29d8f4dc5fc67fbde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.561528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72264edb570041f29d8f4dc5fc67fbde'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:05.570536 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2176/4302] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:05 2021] DELETE /identity/v3/users/72264edb570041f29d8f4dc5fc67fbde => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:05.582488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63ed1e-08b0-4adb-b6f2-4197a8892771 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:05.671563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:05.673756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:05.674359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:05.675655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:05.676838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:05.683251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:05.819317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:05.820837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:05.840865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0226-0e9f-4ade-98cb-ae2f07af0ec9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:05.856705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:05.857926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:05.858436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:05.858776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] PATH_INFO: `/v3/projects/a702b12f68b44b949a2ab7f5eeaf411b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:05.860150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a702b12f68b44b949a2ab7f5eeaf411b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:05.862615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:05.885283 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2127/4303] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:05 2021] POST /identity/v3/users => generated 300 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:05.886535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:05.889636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:05.920013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6f931-ff64-4105-bd4d-1e4e6263289c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:05.932368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:05.933199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:05.933347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:05.933988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:05.934746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:05.939283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:05.971749 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2128/4304] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:05 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:05.976662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:05.993524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df631f95-6f34-40c2-9b95-1ee4dd3da1a4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:06.002789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a702b12f68b44b949a2ab7f5eeaf411b', 'request_id': 'req-027b7f5c-a067-49da-859c-8e1fd95c41b1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.084147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a702b12f68b44b949a2ab7f5eeaf411b', 'request_id': 'req-027b7f5c-a067-49da-859c-8e1fd95c41b1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.096195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a702b12f68b44b949a2ab7f5eeaf411b', 'request_id': 'req-027b7f5c-a067-49da-859c-8e1fd95c41b1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.121898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:06.122842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:06.123438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:06.124626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:06.125838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:06.127677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:06.143557 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2129/4305] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:05 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:06.147902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:06.160287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] The token cache is being invalidate because project a702b12f68b44b949a2ab7f5eeaf411b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:06.161035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.161894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.166322 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2177/4306] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:05 2021] DELETE /identity/v3/projects/a702b12f68b44b949a2ab7f5eeaf411b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:06.169978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:06.171764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:06.179734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9058f3-0d5a-413f-9c29-c9a3bd440b00 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:06.190630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b7f5c-a067-49da-859c-8e1fd95c41b1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:06.196597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:06.198451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:06.198956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:06.199619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] PATH_INFO: `/v3/users/9438fcdc9aab464f83218f383931528c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:06.202016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:06.202016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:06.202016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:06.202371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] PATH_INFO: `/v3/projects/8051c2a9844a42cb928ba6b5e05a7f26/users/53b933138e3544619e8f6ed3b26208e5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:06.204461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9438fcdc9aab464f83218f383931528c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:06.207104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:06.239328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8051c2a9844a42cb928ba6b5e05a7f26, user_id=53b933138e3544619e8f6ed3b26208e5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:06.258782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:06.409305 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2130/4307] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:06 2021] PUT /identity/v3/projects/8051c2a9844a42cb928ba6b5e05a7f26/users/53b933138e3544619e8f6ed3b26208e5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:06.410303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:06.412138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:06.542435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9438fcdc9aab464f83218f383931528c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.553934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5f07f-67e3-4abb-b49d-664937a94cf0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:06.555766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9438fcdc9aab464f83218f383931528c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.567738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:06.568634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:06.570498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:06.570691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] PATH_INFO: `/v3/projects/ddb89ad797b743899fc576ec3228c0e0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:06.573542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb89ad797b743899fc576ec3228c0e0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:06.578143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:06.591727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9438fcdc9aab464f83218f383931528c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:06.592513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9438fcdc9aab464f83218f383931528c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.011941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52135dad-56a8-4517-bbdd-269225f0ea5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9438fcdc9aab464f83218f383931528c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.018386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2178/4308] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:06 2021] DELETE /identity/v3/users/9438fcdc9aab464f83218f383931528c => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:07.019656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:07.019942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:07.020220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:07.047972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] MFA Rules not processed for user `53b933138e3544619e8f6ed3b26208e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:07.049330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:07.117851 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2179/4309] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:07 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:07.130315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:07.131708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:07.139963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb89ad797b743899fc576ec3228c0e0', 'request_id': 'req-472e8cab-621f-4d45-b32f-18a524b07ec8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.149081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb89ad797b743899fc576ec3228c0e0', 'request_id': 'req-472e8cab-621f-4d45-b32f-18a524b07ec8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.229832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f4fa-9067-4cd6-9d62-85a5a9f474b9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:07.261433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb89ad797b743899fc576ec3228c0e0', 'request_id': 'req-472e8cab-621f-4d45-b32f-18a524b07ec8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.277233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] The token cache is being invalidate because project ddb89ad797b743899fc576ec3228c0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:07.277616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.278593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-472e8cab-621f-4d45-b32f-18a524b07ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.286062 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2131/4310] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:06 2021] DELETE /identity/v3/projects/ddb89ad797b743899fc576ec3228c0e0 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:07.291698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadf0e-595d-40aa-a3f5-0ec45ca4f798 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:07.291698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadf0e-595d-40aa-a3f5-0ec45ca4f798 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:07.291698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadf0e-595d-40aa-a3f5-0ec45ca4f798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:07.336990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-83aadf0e-595d-40aa-a3f5-0ec45ca4f798 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:07.342152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-83aadf0e-595d-40aa-a3f5-0ec45ca4f798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:07.383155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:07.384342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:07.386170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:07.388099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:07.392987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:07.459702 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2132/4311] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:07.471980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:07.472459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:07.472810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:07.515577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:07.517492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:07.538371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:07.541495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:07.547089 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2180/4312] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:07 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:07.566900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2133/4313] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:07.571060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:07.588920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ad1d-f003-4226-8c29-ded0228a78d5 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:07.608084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:07.608777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:07.609078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:07.609355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:07.610101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:07.610409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:07.612051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:07.624379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:07.627323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:07.656107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cebbf-0f23-43b6-9d53-6785106ca696 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:07.669205 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2181/4314] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:07.673605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:07.689285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:07.690175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:07.691192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:07.691192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] PATH_INFO: `/v3/projects/22a773b87e52482483b87d5f4fad39b0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:07.693324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a773b87e52482483b87d5f4fad39b0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:07.698221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:07.702041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e9e24-aeaf-4bc8-8e1b-299b8e5d30cb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:07.725682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:07.726368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:07.726657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:07.727082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:07.727635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:07.732236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:07.941171 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2182/4315] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:07 2021] POST /identity/v3/projects => generated 365 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:07.952406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a773b87e52482483b87d5f4fad39b0', 'request_id': 'req-5e316db6-a5f6-48d4-8211-4e945ca38660'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:07.956203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:07.963988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a773b87e52482483b87d5f4fad39b0', 'request_id': 'req-5e316db6-a5f6-48d4-8211-4e945ca38660'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:08.049816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a773b87e52482483b87d5f4fad39b0', 'request_id': 'req-5e316db6-a5f6-48d4-8211-4e945ca38660'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:08.054479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df240d7c-01c4-45cd-b368-8cf61014c92a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.060403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.061108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.061394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.061688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.062086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] The token cache is being invalidate because project 22a773b87e52482483b87d5f4fad39b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:08.063106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.063224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:08.063419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e316db6-a5f6-48d4-8211-4e945ca38660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:08.064292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.065553 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2134/4316] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:07 2021] DELETE /identity/v3/projects/22a773b87e52482483b87d5f4fad39b0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:08.070748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f247a-11d6-43d9-829c-eba94683250c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.071047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f247a-11d6-43d9-829c-eba94683250c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.071369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f247a-11d6-43d9-829c-eba94683250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.154661 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2183/4317] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:07 2021] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:08.155837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.157998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:08.173225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed860648-0425-4a4b-9e0e-3732370b452e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.179186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.180049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.180428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.180802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.182019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.183935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.202345 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2184/4318] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:08.203438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.217011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965acc3e-c7ef-4076-bde1-e5cbf87e601b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.222138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.225488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.225488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.225488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.225488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.229710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.232418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d96f247a-11d6-43d9-829c-eba94683250c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:08.233451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d96f247a-11d6-43d9-829c-eba94683250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:08.245624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2185/4319] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:08.247685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.250147 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2135/4320] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:08.251603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d589b-fc10-43c9-9c92-92e8d601e981 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.251891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d589b-fc10-43c9-9c92-92e8d601e981 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.252169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d589b-fc10-43c9-9c92-92e8d601e981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.270755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1a252-b95f-4c46-879c-b6e81d4d435a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.272309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dd0d589b-fc10-43c9-9c92-92e8d601e981 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:08.273642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dd0d589b-fc10-43c9-9c92-92e8d601e981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:08.277327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae3165-f731-4bbc-822c-e390d0791f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.278400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae3165-f731-4bbc-822c-e390d0791f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.278643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae3165-f731-4bbc-822c-e390d0791f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.279197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae3165-f731-4bbc-822c-e390d0791f23 admin admin] PATH_INFO: `/v3/projects/8958585cad0b40b3916d14bc98d64f1e/users/bc2f39d8cd6c4f11894be8934a3ac5a1/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.282844 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2136/4321] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:08.287224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d589b-fc10-43c9-9c92-92e8d601e981 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.298333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d589b-fc10-43c9-9c92-92e8d601e981 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.299122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae3165-f731-4bbc-822c-e390d0791f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8958585cad0b40b3916d14bc98d64f1e, user_id=bc2f39d8cd6c4f11894be8934a3ac5a1, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.301809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae3165-f731-4bbc-822c-e390d0791f23 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.303623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.304392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.304783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.305216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.306045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:08.307009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.308769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.325113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2137/4322] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:08.329010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.342677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a44ca-88ec-458e-9eed-22f7ae45eea6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.351927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.352734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.352840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.353219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.354495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.359221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.395327 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2186/4323] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:08 2021] PUT /identity/v3/projects/8958585cad0b40b3916d14bc98d64f1e/users/bc2f39d8cd6c4f11894be8934a3ac5a1/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:08.411215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcbf49-8860-4121-aaa8-5da8e4699c55 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.411421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcbf49-8860-4121-aaa8-5da8e4699c55 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.411703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcbf49-8860-4121-aaa8-5da8e4699c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.448112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-10fcbf49-8860-4121-aaa8-5da8e4699c55 None None] MFA Rules not processed for user `bc2f39d8cd6c4f11894be8934a3ac5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:08.449471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-10fcbf49-8860-4121-aaa8-5da8e4699c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:08.476909 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2138/4324] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:08 2021] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:08.487029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.551627 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2187/4325] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:08 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:08.552722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcbf49-8860-4121-aaa8-5da8e4699c55 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.604311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68309e27-cf4a-47fc-b599-b191959b982e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.609319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.610225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.610507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.610786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.611587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.613486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.646530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcbf49-8860-4121-aaa8-5da8e4699c55 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.652044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.652739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.653058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.657618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.657618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.657618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.701175 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2139/4326] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:08 2021] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:08.703341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.705058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:08.726032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf40cf-b75e-4eff-b3dd-3c0729d8de94 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.731803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.732816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.733323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.733742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] PATH_INFO: `/v3/users/747bd79ceac348ddbb1ee54f605da025` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.734990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747bd79ceac348ddbb1ee54f605da025)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.737235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.788590 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2188/4327] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:08 2021] POST /identity/v3/projects => generated 363 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:08.789539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.871805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b1284-f61f-4583-a8e0-b4d3f4e82770 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.876729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.877439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.877855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.878152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.878961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.893579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:08.916696 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2189/4328] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:08.917686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:08.946317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab98ac0-bfd7-4a71-b28e-2d6741df906e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:08.959642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:08.960260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:08.960565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:08.960863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:08.961618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:08.964186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.042515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747bd79ceac348ddbb1ee54f605da025'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:09.067587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747bd79ceac348ddbb1ee54f605da025'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:09.070202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2190/4329] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:08 2021] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:09.074469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.091494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560666c-f70b-4894-9a06-b34ac6b75fc1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.100652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747bd79ceac348ddbb1ee54f605da025'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:09.101430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747bd79ceac348ddbb1ee54f605da025'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:09.110119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747bd79ceac348ddbb1ee54f605da025'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:09.113974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.113974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.113974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.113974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.114330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.119596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.136783 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2191/4330] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:09 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:09.137943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.139880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:09.160603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9a0b-61c7-41cc-a29d-42375325536c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.166685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.167647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.167997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.168337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.169189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.173578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.188781 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2192/4331] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:09 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:09.188781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.190598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:09.206828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2140/4332] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:08 2021] DELETE /identity/v3/users/747bd79ceac348ddbb1ee54f605da025 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:09.207826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.219236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5816bd-10d5-46e5-970b-82ccf2237309 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.288794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d805-de77-43f3-8877-dfa77fe23553 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.296096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b268-69c7-49d8-8871-bb69fdb62951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.297371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b268-69c7-49d8-8871-bb69fdb62951 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.297494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463fb18-e100-48c5-bc3b-54352853f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.297999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b268-69c7-49d8-8871-bb69fdb62951 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.298310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fb18-e100-48c5-bc3b-54352853f2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.298591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fb18-e100-48c5-bc3b-54352853f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.298930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fb18-e100-48c5-bc3b-54352853f2cc admin admin] PATH_INFO: `/v3/projects/8b91ae1df7d44f9cb5d1ddcf71f36af7/users/32c564bdb9334446af39daca5d283a18/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.299240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b268-69c7-49d8-8871-bb69fdb62951 admin admin] PATH_INFO: `/v3/projects/5e9f01b394564869be68f956d9a125c9/users/037d4705f8d04eaea2db924599d54e4e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.319333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463fb18-e100-48c5-bc3b-54352853f2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b91ae1df7d44f9cb5d1ddcf71f36af7, user_id=32c564bdb9334446af39daca5d283a18, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.322872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463fb18-e100-48c5-bc3b-54352853f2cc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.339589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b268-69c7-49d8-8871-bb69fdb62951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9f01b394564869be68f956d9a125c9, user_id=037d4705f8d04eaea2db924599d54e4e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.345409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b268-69c7-49d8-8871-bb69fdb62951 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.410194 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2193/4333] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:09 2021] PUT /identity/v3/projects/8b91ae1df7d44f9cb5d1ddcf71f36af7/users/32c564bdb9334446af39daca5d283a18/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:09.410194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71220ed-2169-4b7e-8ba5-1050536a9a56 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.410194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71220ed-2169-4b7e-8ba5-1050536a9a56 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.410194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71220ed-2169-4b7e-8ba5-1050536a9a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.432814 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2141/4334] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:09 2021] PUT /identity/v3/projects/5e9f01b394564869be68f956d9a125c9/users/037d4705f8d04eaea2db924599d54e4e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:09.434630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2c00-f42b-4fec-9c85-8477f81561c2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.435144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2c00-f42b-4fec-9c85-8477f81561c2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.435800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2c00-f42b-4fec-9c85-8477f81561c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.444800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d71220ed-2169-4b7e-8ba5-1050536a9a56 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:09.446285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d71220ed-2169-4b7e-8ba5-1050536a9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:09.484185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5a9f2c00-f42b-4fec-9c85-8477f81561c2 None None] MFA Rules not processed for user `32c564bdb9334446af39daca5d283a18`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:09.485953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a9f2c00-f42b-4fec-9c85-8477f81561c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:09.537708 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2194/4335] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:09.538892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71220ed-2169-4b7e-8ba5-1050536a9a56 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.558295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71220ed-2169-4b7e-8ba5-1050536a9a56 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.563945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.565548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.565548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.565774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.566486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.568090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.585492 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2195/4336] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:09 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:09.586502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.588974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:09.605537 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2142/4337] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:09 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:09.607397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f2c00-f42b-4fec-9c85-8477f81561c2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.625092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f2c00-f42b-4fec-9c85-8477f81561c2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.640615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.642255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.643051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.643051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] PATH_INFO: `/v3/projects/5e9f01b394564869be68f956d9a125c9/users/037d4705f8d04eaea2db924599d54e4e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.646003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9f01b394564869be68f956d9a125c9, user_id=037d4705f8d04eaea2db924599d54e4e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.652642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.678915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2143/4338] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:09 2021] PUT /identity/v3/projects/5e9f01b394564869be68f956d9a125c9/users/037d4705f8d04eaea2db924599d54e4e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:09.679950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:09.687961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d5429-4f37-4442-bb70-130c23bc8298 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.763366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f60f4-2e76-485b-9008-67154cabe0c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.764294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f60f4-2e76-485b-9008-67154cabe0c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.764580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f60f4-2e76-485b-9008-67154cabe0c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.765072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f60f4-2e76-485b-9008-67154cabe0c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.781483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d99515-c87d-48c5-819d-41df7da4bada admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:09.786603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:09.787462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.788003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.788363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.789226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.792058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.837159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f60f4-2e76-485b-9008-67154cabe0c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:09.839514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f60f4-2e76-485b-9008-67154cabe0c8 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:09.854074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2196/4339] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:09.855457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:09.856011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:09.856326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:09.895095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] MFA Rules not processed for user `037d4705f8d04eaea2db924599d54e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:09.896686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:09.926007 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2144/4340] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:09 2021] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:09.930208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.059109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d34a3-47cb-4f07-a2e3-099e566b14e0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.062614 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2197/4341] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:09 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:10.064108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.065694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:10.075519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.076228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.077009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.077302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.078018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.079953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.081907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924813d-a839-4baa-b957-c7e5e10f7eca None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.093268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.093884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.094162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.094834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] PATH_INFO: `/v3/users/257eeccacdc24f00a418cbb27204cf4f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.100788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] RBAC: Authorizing `identity:delete_user(user_id=257eeccacdc24f00a418cbb27204cf4f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.104455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.219965 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2145/4342] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:09 2021] POST /identity/v3/users => generated 300 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:10.220861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.227614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:10.313250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a6deb-d4fb-448c-a5a0-17087ee9fc05 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.317545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.318201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.320826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.320826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.355877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257eeccacdc24f00a418cbb27204cf4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:10.373384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257eeccacdc24f00a418cbb27204cf4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:10.397605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257eeccacdc24f00a418cbb27204cf4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:10.398434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257eeccacdc24f00a418cbb27204cf4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:10.424368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.425905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.437826 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2146/4343] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:10 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:10.438464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.451066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f3b24-1bfc-413a-96c9-569fbde46a78 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.458889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.459115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.459307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.459529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.461032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.462928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.481074 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2147/4344] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:10 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:10.483374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.494173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4c398-abaf-4b7d-ba61-c76a40f1b604 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.499258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.500287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.500634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.501013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] PATH_INFO: `/v3/projects/e0550a56e2bf41908cdc7d4613d8d3da/users/bb70c239efad49869c061d51e07b04cd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.503387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257eeccacdc24f00a418cbb27204cf4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:10.511620 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2198/4345] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:10 2021] DELETE /identity/v3/users/257eeccacdc24f00a418cbb27204cf4f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:10.552021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0550a56e2bf41908cdc7d4613d8d3da, user_id=bb70c239efad49869c061d51e07b04cd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.552021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.554165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.555988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:10.664344 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2148/4346] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:10 2021] PUT /identity/v3/projects/e0550a56e2bf41908cdc7d4613d8d3da/users/bb70c239efad49869c061d51e07b04cd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:10.665336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.669501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:10.687201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada19c3-000e-4737-bde0-71ae246c048a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.809784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.810910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.810910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.811180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] PATH_INFO: `/v3/projects/d7fd3a986d5b4c38898b9ae8f0b6eee4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.813158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fd3a986d5b4c38898b9ae8f0b6eee4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.815182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac28cdc-def9-46f7-b45d-25d6c49b630f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.815753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.821650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.823249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.823724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.824216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.825174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.827170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.841588 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2149/4347] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:10 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:10.847308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:10.859870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82562281-cdf0-48ce-9c4f-279a68c6660e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:10.872810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7b764-6b10-4cb3-b30a-cc212452b00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:10.872810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b764-6b10-4cb3-b30a-cc212452b00f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.872810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b764-6b10-4cb3-b30a-cc212452b00f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.872810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b764-6b10-4cb3-b30a-cc212452b00f admin admin] PATH_INFO: `/v3/projects/e0550a56e2bf41908cdc7d4613d8d3da/users/bb70c239efad49869c061d51e07b04cd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.873284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7b764-6b10-4cb3-b30a-cc212452b00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0550a56e2bf41908cdc7d4613d8d3da, user_id=bb70c239efad49869c061d51e07b04cd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:10.875468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7b764-6b10-4cb3-b30a-cc212452b00f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:10.887405 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2150/4348] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:10 2021] PUT /identity/v3/projects/e0550a56e2bf41908cdc7d4613d8d3da/users/bb70c239efad49869c061d51e07b04cd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:10.899172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:10.900667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:10.900667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:10.930771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] MFA Rules not processed for user `bb70c239efad49869c061d51e07b04cd`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:10.932046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:11.047888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fd3a986d5b4c38898b9ae8f0b6eee4', 'request_id': 'req-775ae551-966d-4a60-a5c4-056c8c77aa53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.055499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2151/4349] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:10 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:11.060743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:11.062392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:11.141100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a8788-bfec-4260-9c00-2d593703e8fe None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:11.204909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:11.205787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:11.206070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:11.206347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] PATH_INFO: `/v3/projects/66319858228140b3841ef6c7c8cd5c14` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:11.207790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66319858228140b3841ef6c7c8cd5c14)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:11.209898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:11.611805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fd3a986d5b4c38898b9ae8f0b6eee4', 'request_id': 'req-775ae551-966d-4a60-a5c4-056c8c77aa53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.619822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fd3a986d5b4c38898b9ae8f0b6eee4', 'request_id': 'req-775ae551-966d-4a60-a5c4-056c8c77aa53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.636330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] The token cache is being invalidate because project d7fd3a986d5b4c38898b9ae8f0b6eee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:11.636596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.637266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.641856 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2199/4350] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:10 2021] DELETE /identity/v3/projects/d7fd3a986d5b4c38898b9ae8f0b6eee4 => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:11.641856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:11.644015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:11.650619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66319858228140b3841ef6c7c8cd5c14', 'request_id': 'req-3a311372-1a7a-4cbc-aa82-5b3edf00108d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.657075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66319858228140b3841ef6c7c8cd5c14', 'request_id': 'req-3a311372-1a7a-4cbc-aa82-5b3edf00108d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.745670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ae551-966d-4a60-a5c4-056c8c77aa53 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:11.773342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66319858228140b3841ef6c7c8cd5c14', 'request_id': 'req-3a311372-1a7a-4cbc-aa82-5b3edf00108d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.800621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] The token cache is being invalidate because project 66319858228140b3841ef6c7c8cd5c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:11.800621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.800621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:11.800621 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2152/4351] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:11 2021] DELETE /identity/v3/projects/66319858228140b3841ef6c7c8cd5c14 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:11.801046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:11.802200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:11.851789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c2ec1-f740-4c79-9d3c-bd816dc06e16 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:11.851789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2ec1-f740-4c79-9d3c-bd816dc06e16 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:11.851789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2ec1-f740-4c79-9d3c-bd816dc06e16 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:11.852143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2ec1-f740-4c79-9d3c-bd816dc06e16 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:11.852143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c2ec1-f740-4c79-9d3c-bd816dc06e16 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:11.859647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c2ec1-f740-4c79-9d3c-bd816dc06e16 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:11.909083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311372-1a7a-4cbc-aa82-5b3edf00108d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:11.914346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:11.915352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:11.915720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:11.916057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] PATH_INFO: `/v3/users/53b933138e3544619e8f6ed3b26208e5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:11.917375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b933138e3544619e8f6ed3b26208e5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:11.919695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.032431 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2200/4352] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:11 2021] POST /identity/v3/projects => generated 358 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:12.032431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.032431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.032431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.054047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:12.055710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:12.126792 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2201/4353] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:12.127718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.130621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:12.154311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b933138e3544619e8f6ed3b26208e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:12.161717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b933138e3544619e8f6ed3b26208e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:12.173999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b933138e3544619e8f6ed3b26208e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:12.174804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b933138e3544619e8f6ed3b26208e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:12.176045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3b32c6fb-905a-4b53-94ed-4ceb1e89562b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b933138e3544619e8f6ed3b26208e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:12.208477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5800c-bd89-40bd-ac7a-1c44e45eef1f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.214598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.215496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.215807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.216114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-71604293` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.219019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=e94c95a28a034e81b32c984dc5c34ac9, value=tempest-tag-71604293)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.220272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.363302 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2153/4354] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:11 2021] DELETE /identity/v3/users/53b933138e3544619e8f6ed3b26208e5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:12.365110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d50a-8e33-49a0-b0ba-885112f670b1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.365576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d50a-8e33-49a0-b0ba-885112f670b1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.366288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d50a-8e33-49a0-b0ba-885112f670b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.386249 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-71604293. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:24:12.386249 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:24:12.386249 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:12.391037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4f82d50a-8e33-49a0-b0ba-885112f670b1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:12.392632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4f82d50a-8e33-49a0-b0ba-885112f670b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:12.395448 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2202/4355] 10.222.0.32 () {60 vars in 1326 bytes} [Sat Dec 25 21:24:12 2021] PUT /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-71604293 => generated 0 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 289 bytes (1 switches on core 0) Dec 25 21:24:12.399282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.402268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:12.417164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0697c5-5053-44bb-91e5-8b194e3a6ed8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.491208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2154/4356] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:12.492235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82d50a-8e33-49a0-b0ba-885112f670b1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.494737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.497230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.497230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.497230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-71604293` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.517851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82d50a-8e33-49a0-b0ba-885112f670b1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.518374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=e94c95a28a034e81b32c984dc5c34ac9, value=tempest-tag-71604293)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.520521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.523732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.524588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.525636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.526006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.526841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:12.527255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.528966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.541841 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2203/4357] 10.222.0.32 () {58 vars in 1307 bytes} [Sat Dec 25 21:24:12 2021] GET /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-71604293 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:12.541841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.551773 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2155/4358] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:12.552476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecb08e-d2e8-4527-adf8-9f8d22386a35 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.553061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.562482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.563355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.563607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.563874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.565512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=e94c95a28a034e81b32c984dc5c34ac9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.570367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a049a3-6059-4f1a-9cf9-fa3e8f17a962 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.570515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.571459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.572317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.572598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.572860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.573582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.575459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.735945 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2204/4359] 10.222.0.32 () {60 vars in 1264 bytes} [Sat Dec 25 21:24:12 2021] PUT /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags => generated 141 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:12.739536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.748334 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2156/4360] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:12 2021] POST /identity/v3/projects => generated 405 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:12.749942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.759576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feea801-fe3f-42c6-bd60-02679d31a0b8 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.825461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6c4b6-3a04-453e-906c-64584ad5bbf8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.831194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165358fa-a210-424b-804b-184dac72612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.838287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165358fa-a210-424b-804b-184dac72612b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.838287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165358fa-a210-424b-804b-184dac72612b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.838287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165358fa-a210-424b-804b-184dac72612b admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.839012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.839125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165358fa-a210-424b-804b-184dac72612b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.839273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.839273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.839273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.839633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165358fa-a210-424b-804b-184dac72612b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.848043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=e94c95a28a034e81b32c984dc5c34ac9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.850175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.866375 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2205/4361] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:12 2021] GET /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags => generated 141 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:12.867543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.878051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745da55-289b-4d8f-b781-e6fff542e312 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.882896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.883699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.884923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.884923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-955273429` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.886102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=e94c95a28a034e81b32c984dc5c34ac9, value=tempest-tag-955273429)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.888188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:12.962422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2157/4362] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:12 2021] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:12.963848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165358fa-a210-424b-804b-184dac72612b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:12.966487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-165358fa-a210-424b-804b-184dac72612b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:12.979381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165358fa-a210-424b-804b-184dac72612b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:12.984136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:12.985017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:12.985296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:12.985618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] PATH_INFO: `/v3/projects/8051c2a9844a42cb928ba6b5e05a7f26` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:12.986876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8051c2a9844a42cb928ba6b5e05a7f26)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:12.988980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.006589 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-955273429. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:24:13.006589 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:24:13.006589 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:13.012843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2206/4363] 10.222.0.32 () {58 vars in 1313 bytes} [Sat Dec 25 21:24:12 2021] DELETE /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-955273429 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:13.013725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.025821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05381f-dfa8-4626-b99f-8c5f428f5f82 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.030751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.031630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.031912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.032185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.032954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.034632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.045843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2207/4364] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:13.046650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.057420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904762f3-9bb4-4c4e-b946-1cf74d866496 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.062172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.063006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.063295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.063578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-955273429` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.075913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=e94c95a28a034e81b32c984dc5c34ac9, value=tempest-tag-955273429)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.078179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.097627 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Could not find project tag: tempest-tag-955273429.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-955273429. Dec 25 21:24:13.098864 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2208/4365] 10.222.0.32 () {58 vars in 1310 bytes} [Sat Dec 25 21:24:13 2021] GET /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags/tempest-tag-955273429 => generated 106 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:24:13.099626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.110268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d81d2-1e00-4b07-b5d6-4e0e0b21ca24 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.121545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8051c2a9844a42cb928ba6b5e05a7f26', 'request_id': 'req-c22e325c-e858-4b42-b4bb-abea7c0afc76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:13.127995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8051c2a9844a42cb928ba6b5e05a7f26', 'request_id': 'req-c22e325c-e858-4b42-b4bb-abea7c0afc76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:13.176634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.177236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.177566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.177832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.178563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.180158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.190170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2209/4366] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:13 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:13.191093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.256083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76425f-b18d-4cde-b7fc-718a0d947ae7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.261733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dee9c-33f0-4daa-ace2-a8b1243e449d tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.262561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dee9c-33f0-4daa-ace2-a8b1243e449d tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.262852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dee9c-33f0-4daa-ace2-a8b1243e449d tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.263130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dee9c-33f0-4daa-ace2-a8b1243e449d tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.264376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dee9c-33f0-4daa-ace2-a8b1243e449d tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=e94c95a28a034e81b32c984dc5c34ac9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.266594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dee9c-33f0-4daa-ace2-a8b1243e449d tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.297014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8051c2a9844a42cb928ba6b5e05a7f26', 'request_id': 'req-c22e325c-e858-4b42-b4bb-abea7c0afc76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:13.312842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] The token cache is being invalidate because project 8051c2a9844a42cb928ba6b5e05a7f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:13.313314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:13.314080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:13.315970 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2158/4367] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:12 2021] DELETE /identity/v3/projects/8051c2a9844a42cb928ba6b5e05a7f26 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:13.316609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.318064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:13.332606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e325c-e858-4b42-b4bb-abea7c0afc76 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.341398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c55a1a-d606-4393-b43b-7a0e6c5b92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.341398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55a1a-d606-4393-b43b-7a0e6c5b92fc admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.341398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55a1a-d606-4393-b43b-7a0e6c5b92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.341398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c55a1a-d606-4393-b43b-7a0e6c5b92fc admin admin] PATH_INFO: `/v3/projects/e78183302ecf4f92a3eab85b3f567d9e/users/8a9aca0cfb134140a880e9ef5ecde9ea/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.355719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c55a1a-d606-4393-b43b-7a0e6c5b92fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78183302ecf4f92a3eab85b3f567d9e, user_id=8a9aca0cfb134140a880e9ef5ecde9ea, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.366621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c55a1a-d606-4393-b43b-7a0e6c5b92fc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.411449 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2210/4368] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:24:13 2021] DELETE /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:13.413396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.413687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.413962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.434224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:13.435353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:13.443561 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2211/4369] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:13.449906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.452146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:13.466297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d47b6-dfee-44d1-8715-11f1de8e1373 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.471149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51533b-9ffa-43dc-ba7a-100e20d5311a tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.472000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51533b-9ffa-43dc-ba7a-100e20d5311a tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.475032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51533b-9ffa-43dc-ba7a-100e20d5311a tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.475032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51533b-9ffa-43dc-ba7a-100e20d5311a tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.485164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51533b-9ffa-43dc-ba7a-100e20d5311a tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=e94c95a28a034e81b32c984dc5c34ac9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.487350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51533b-9ffa-43dc-ba7a-100e20d5311a tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.495642 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2159/4370] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:13 2021] PUT /identity/v3/projects/e78183302ecf4f92a3eab85b3f567d9e/users/8a9aca0cfb134140a880e9ef5ecde9ea/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:13.496988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d370-255d-45b2-b7ef-b797eb099857 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.497280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d370-255d-45b2-b7ef-b797eb099857 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.497562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d370-255d-45b2-b7ef-b797eb099857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.501064 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2212/4371] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:13 2021] GET /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9/tags => generated 66 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:24:13.502892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edeae1-00e2-443f-a851-97b5faee4cff None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.503462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edeae1-00e2-443f-a851-97b5faee4cff None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.504293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edeae1-00e2-443f-a851-97b5faee4cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.523547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b046d370-255d-45b2-b7ef-b797eb099857 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:13.524322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b046d370-255d-45b2-b7ef-b797eb099857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:13.548070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-60edeae1-00e2-443f-a851-97b5faee4cff None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:13.551642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-60edeae1-00e2-443f-a851-97b5faee4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:13.609778 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2160/4372] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:13.611435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046d370-255d-45b2-b7ef-b797eb099857 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.632178 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2213/4373] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:13.633496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edeae1-00e2-443f-a851-97b5faee4cff None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.651155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edeae1-00e2-443f-a851-97b5faee4cff None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.659450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.660470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.661872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.661872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.662356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:13.663036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.666066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.690000 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2214/4374] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:13.690000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.692556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046d370-255d-45b2-b7ef-b797eb099857 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.700156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb70c239efad49869c061d51e07b04cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e0550a56e2bf41908cdc7d4613d8d3da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.701418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaaa2a-cf7d-4ca2-966d-1eeeefa222bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.701584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.701584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.701824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] PATH_INFO: `/v3/projects/e94c95a28a034e81b32c984dc5c34ac9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.703114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e94c95a28a034e81b32c984dc5c34ac9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.705232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.707381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.708645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.709038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.713041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:13.713041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:13.713041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:13.848651 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2215/4375] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:13 2021] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:13.849663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:13.851331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:13.917321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94c95a28a034e81b32c984dc5c34ac9', 'request_id': 'req-ac493d9e-3933-4d01-aa45-146a5c4a5356'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:13.924047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adcd3f-2b04-4a2b-bf73-e5bab1c5b861 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:13.932144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94c95a28a034e81b32c984dc5c34ac9', 'request_id': 'req-ac493d9e-3933-4d01-aa45-146a5c4a5356'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:13.996123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:13.996788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:13.997104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:13.997567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.038219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94c95a28a034e81b32c984dc5c34ac9', 'request_id': 'req-ac493d9e-3933-4d01-aa45-146a5c4a5356'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.053499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] The token cache is being invalidate because project e94c95a28a034e81b32c984dc5c34ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:14.053878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.054485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.061774 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2161/4376] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:13 2021] DELETE /identity/v3/projects/e94c95a28a034e81b32c984dc5c34ac9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:14.061774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.062813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.116211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.118124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.131744 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2216/4377] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:14.132963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.135686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.155292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f6a5f-d0cd-4e8b-8de8-a1ce75dd3ddc service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.155419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493d9e-3933-4d01-aa45-146a5c4a5356 tempest-IdentityV3ProjectTagsTest-1654153623 tempest-IdentityV3ProjectTagsTest-1654153623-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.161852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.162858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.163673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.163859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.164617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.165895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.166989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.167215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.167789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.168511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] PATH_INFO: `/v3/users/32c564bdb9334446af39daca5d283a18` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.170081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c564bdb9334446af39daca5d283a18)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.173811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.284920 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2162/4378] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:14 2021] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:14.285827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.287362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.300768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f3fd-47a9-4b33-a8a8-ca216acc9e21 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.304580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.305281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.305565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.305842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.307837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.369584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.371025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.380496 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2163/4379] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:14 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:14.381404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.392347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba4cbe-28ae-4730-8a96-7bd73fea19ea service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.398260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.398260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.398539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.398812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.399559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.401230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.418279 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2164/4380] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:14.424037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.433626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de6d1-66f3-4f81-8eb2-21ef538b8da9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.444614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.444614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.444614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.444614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.445003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.446145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.456988 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2165/4381] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:14 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:14.461151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.479182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89d9df-fa1d-4058-ad26-6fa14eb8bb8e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.493177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634034bb-a75b-45fb-a7af-e131e4fcc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.494742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634034bb-a75b-45fb-a7af-e131e4fcc87f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.495437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634034bb-a75b-45fb-a7af-e131e4fcc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.495437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634034bb-a75b-45fb-a7af-e131e4fcc87f admin admin] PATH_INFO: `/v3/projects/401a922101e747bfbc07633acb8009b5/users/f255cf69ee9b485a83b885920cf213f1/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.497722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c564bdb9334446af39daca5d283a18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.510439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c564bdb9334446af39daca5d283a18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.520702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634034bb-a75b-45fb-a7af-e131e4fcc87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=401a922101e747bfbc07633acb8009b5, user_id=f255cf69ee9b485a83b885920cf213f1, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.526468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634034bb-a75b-45fb-a7af-e131e4fcc87f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.546164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c564bdb9334446af39daca5d283a18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.547097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c564bdb9334446af39daca5d283a18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.597536 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2166/4382] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:14 2021] PUT /identity/v3/projects/401a922101e747bfbc07633acb8009b5/users/f255cf69ee9b485a83b885920cf213f1/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:14.610467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-432bc80e-c071-430f-96dd-b8e917dc325c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c564bdb9334446af39daca5d283a18'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:14.615471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.615728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.616072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.626241 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2217/4383] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:14 2021] DELETE /identity/v3/users/32c564bdb9334446af39daca5d283a18 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:14.627856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.628240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.628762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.647673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:14.648140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] MFA Rules not processed for user `f255cf69ee9b485a83b885920cf213f1`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:14.649320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.649457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.719717 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2167/4384] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:14 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:14.722722 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2218/4385] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:14.724131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.726175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.742950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87f17-9f3f-4fc6-a931-90079bd70315 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.744502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:14.749207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.749419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:14.750227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.750729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.751302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.752178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.754657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.813273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e60dd9-6170-43ef-b51e-8c54b83e505f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:14.817154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:14.817802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:14.818110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:14.818362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:14.827713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:14.829206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:14.844484 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2219/4386] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:15.019529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2168/4387] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:14 2021] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:15.023263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:15.033701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11131a-5848-487b-8099-0cc0f2b9721a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:15.095029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:15.095714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.095991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.096266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.097290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:15.099146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:15.193894 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2220/4388] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:15 2021] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:15.197417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:15.213824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2ec6-3942-4030-80fe-b9e0aadd3cd8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:15.234983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:15.236956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.237431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.237905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.239546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:15.242665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:15.262547 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2169/4389] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:15 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:15.262820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:15.279677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d5bea-e7d3-41e1-9f53-642c9664f340 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:15.293772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:15.294467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.294750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.295027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.295778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:15.310929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:15.332160 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2221/4390] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:15 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:15.334960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:15.348362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226583b5-68f9-4279-8006-d0650fe9a24c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:15.353830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14feadb-12f3-4a10-bfa7-e660934380ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:15.363494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14feadb-12f3-4a10-bfa7-e660934380ad admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.363494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14feadb-12f3-4a10-bfa7-e660934380ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.363494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14feadb-12f3-4a10-bfa7-e660934380ad admin admin] PATH_INFO: `/v3/projects/60a6023373ca45fb850670e3986748b7/users/c0e7bce427b1432fa6b06059155f6f65/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.373304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14feadb-12f3-4a10-bfa7-e660934380ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a6023373ca45fb850670e3986748b7, user_id=c0e7bce427b1432fa6b06059155f6f65, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:15.376472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14feadb-12f3-4a10-bfa7-e660934380ad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:15.429013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:15.430830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:15.448220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41af83-e81f-4157-83bf-10e572d42ac4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:15.463736 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2170/4391] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:15 2021] PUT /identity/v3/projects/60a6023373ca45fb850670e3986748b7/users/c0e7bce427b1432fa6b06059155f6f65/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:15.474155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468574-6909-48f6-9904-227a9623480d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.474696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468574-6909-48f6-9904-227a9623480d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.476742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f468574-6909-48f6-9904-227a9623480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.529228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8f468574-6909-48f6-9904-227a9623480d None None] MFA Rules not processed for user `c0e7bce427b1432fa6b06059155f6f65`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:15.530811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8f468574-6909-48f6-9904-227a9623480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:15.543947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:15.546958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.546958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.546958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] PATH_INFO: `/v3/projects/8b91ae1df7d44f9cb5d1ddcf71f36af7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.547823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b91ae1df7d44f9cb5d1ddcf71f36af7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:15.550078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:15.608220 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2171/4392] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:15 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:15.633846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f468574-6909-48f6-9904-227a9623480d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:15.635294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8f468574-6909-48f6-9904-227a9623480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:15.684166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b91ae1df7d44f9cb5d1ddcf71f36af7', 'request_id': 'req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:15.698123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f468574-6909-48f6-9904-227a9623480d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:15.750187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720adfda-880b-4fc5-bb3c-566ae7f9d910 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:15.750871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720adfda-880b-4fc5-bb3c-566ae7f9d910 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.751250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720adfda-880b-4fc5-bb3c-566ae7f9d910 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.751525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720adfda-880b-4fc5-bb3c-566ae7f9d910 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.766473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b91ae1df7d44f9cb5d1ddcf71f36af7', 'request_id': 'req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:15.776375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b91ae1df7d44f9cb5d1ddcf71f36af7', 'request_id': 'req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:15.787339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] The token cache is being invalidate because project 8b91ae1df7d44f9cb5d1ddcf71f36af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:15.787949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:15.788812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:15.791098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2222/4393] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:15 2021] DELETE /identity/v3/projects/8b91ae1df7d44f9cb5d1ddcf71f36af7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:15.798346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:15.802009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:15.810500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720adfda-880b-4fc5-bb3c-566ae7f9d910 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:15.812257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720adfda-880b-4fc5-bb3c-566ae7f9d910 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:15.822426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2172/4394] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:15 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:15.871584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef2ba-81ce-43dc-9e9c-02e654c733ba admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:15.876586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:15.877734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:15.878016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:15.878464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] PATH_INFO: `/v3/users/bb70c239efad49869c061d51e07b04cd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:15.880069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb70c239efad49869c061d51e07b04cd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:15.882053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:16.085001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16121176-660e-44b3-93e9-a3a6e132eff3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:16.085472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16121176-660e-44b3-93e9-a3a6e132eff3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:16.085584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16121176-660e-44b3-93e9-a3a6e132eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:16.115472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-16121176-660e-44b3-93e9-a3a6e132eff3 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:16.117590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-16121176-660e-44b3-93e9-a3a6e132eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:16.124717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb70c239efad49869c061d51e07b04cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.133823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb70c239efad49869c061d51e07b04cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.147613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb70c239efad49869c061d51e07b04cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.148471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb70c239efad49869c061d51e07b04cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.223403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb70c239efad49869c061d51e07b04cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.235581 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2223/4395] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:15 2021] DELETE /identity/v3/users/bb70c239efad49869c061d51e07b04cd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:16.235581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:16.235910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:16.257676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2173/4396] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:24:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:16.272479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:16.273116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:16.273603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:16.342881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] MFA Rules not processed for user `8a9aca0cfb134140a880e9ef5ecde9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:16.344325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:16.372463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0171387-ce87-42f1-bcdb-bf6721f12bcc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:16.383727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:16.383727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:16.383727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:16.384806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] PATH_INFO: `/v3/users/bc2f39d8cd6c4f11894be8934a3ac5a1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:16.386695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2f39d8cd6c4f11894be8934a3ac5a1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:16.391875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:16.473174 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2174/4397] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:16 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:16.473887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:16.475723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:16.568452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904a88c-2175-4d3a-9e35-35c33fc90d83 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:16.574345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:16.574998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:16.575282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:16.579228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:16.579228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:16.658964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:16.661635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:16.674370 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2175/4398] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:24:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:16.677771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:16.680105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:16.696267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc2186-8d0f-4b45-9606-7ba4d144ace1 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:16.701740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:16.702538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:16.702925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:16.703259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:16.704115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:16.706168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:16.746161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2f39d8cd6c4f11894be8934a3ac5a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.754379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2f39d8cd6c4f11894be8934a3ac5a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.766981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2f39d8cd6c4f11894be8934a3ac5a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.767820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2f39d8cd6c4f11894be8934a3ac5a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.828470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2176/4399] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:16 2021] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:16.832361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:16.892937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f749094-86b3-454b-af54-7a992578e642 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:16.897644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:16.898301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:16.898586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:16.898861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:16.899585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:16.901370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-63dbf96b-e05c-4365-bcde-2eea74e0cb61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2f39d8cd6c4f11894be8934a3ac5a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:16.910593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:16.910735 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2224/4400] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:16 2021] DELETE /identity/v3/users/bc2f39d8cd6c4f11894be8934a3ac5a1 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:16.912442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:16.913101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:16.913387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:16.931906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:16.934395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:16.998102 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2225/4401] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:16.999359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.000851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.013308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc4bb-e238-4a17-837d-9b2432e1872d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.018216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.019075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.019360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.019638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] PATH_INFO: `/v3/projects/e0550a56e2bf41908cdc7d4613d8d3da` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.020865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0550a56e2bf41908cdc7d4613d8d3da)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.022946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.037417 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2177/4402] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:16 2021] POST /identity/v3/users => generated 303 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:17.039617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.043568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.110152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820379b-55bb-41ad-ac38-2d5e76fc794a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.159372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.159917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.160191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.160460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.169923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.170696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0550a56e2bf41908cdc7d4613d8d3da', 'request_id': 'req-eb58aa80-b4dd-4045-86ba-1a170e6699f8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:17.171331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.181517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2178/4403] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:17.182327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.183571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.196255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b85a-b7bf-4d83-b29c-6f4c93d78819 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.257927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0550a56e2bf41908cdc7d4613d8d3da', 'request_id': 'req-eb58aa80-b4dd-4045-86ba-1a170e6699f8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:17.266914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb385f8-79a7-42e9-acad-012b59f9bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.267243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0550a56e2bf41908cdc7d4613d8d3da', 'request_id': 'req-eb58aa80-b4dd-4045-86ba-1a170e6699f8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:17.267652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb385f8-79a7-42e9-acad-012b59f9bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.267927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb385f8-79a7-42e9-acad-012b59f9bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.268260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb385f8-79a7-42e9-acad-012b59f9bc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.269091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb385f8-79a7-42e9-acad-012b59f9bc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.270749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb385f8-79a7-42e9-acad-012b59f9bc87 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.279825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] The token cache is being invalidate because project e0550a56e2bf41908cdc7d4613d8d3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:17.280596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:17.281327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:17.282898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2226/4404] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:16 2021] DELETE /identity/v3/projects/e0550a56e2bf41908cdc7d4613d8d3da => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:17.285607 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2179/4405] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:17 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:17.290667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.290963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.291244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.292057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.293560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.313457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:17.314874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.323705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2180/4406] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:17.324508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.330554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.345054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8119-9a61-4820-936c-0eaff50fa93a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.350113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5b2e9-4d7c-4755-b0c2-8beb95c1d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.350837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b2e9-4d7c-4755-b0c2-8beb95c1d200 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.351123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b2e9-4d7c-4755-b0c2-8beb95c1d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.351403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b2e9-4d7c-4755-b0c2-8beb95c1d200 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.352212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5b2e9-4d7c-4755-b0c2-8beb95c1d200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.354579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5b2e9-4d7c-4755-b0c2-8beb95c1d200 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.368794 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2181/4407] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:17 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:17.369036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58aa80-b4dd-4045-86ba-1a170e6699f8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.369129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e083-a747-433a-92d5-ea37a7b7f419 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.369129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e083-a747-433a-92d5-ea37a7b7f419 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.369129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e083-a747-433a-92d5-ea37a7b7f419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.376615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.377308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.377575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.377847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.380220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.389827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5e16e083-a747-433a-92d5-ea37a7b7f419 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:17.389827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5e16e083-a747-433a-92d5-ea37a7b7f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.399149 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2182/4408] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:17.400535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16e083-a747-433a-92d5-ea37a7b7f419 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.410819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16e083-a747-433a-92d5-ea37a7b7f419 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.417098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10495817-11b1-47e0-8d54-3a77fc2c68e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.418930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10495817-11b1-47e0-8d54-3a77fc2c68e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.418930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10495817-11b1-47e0-8d54-3a77fc2c68e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.418930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10495817-11b1-47e0-8d54-3a77fc2c68e4 admin admin] PATH_INFO: `/v3/projects/08db6be69b3b4400a38c7491ded0ab82/users/1483e3fc61c74348a27ffbd3085678b9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.441467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10495817-11b1-47e0-8d54-3a77fc2c68e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08db6be69b3b4400a38c7491ded0ab82, user_id=1483e3fc61c74348a27ffbd3085678b9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.447312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10495817-11b1-47e0-8d54-3a77fc2c68e4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.485797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.487252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.506589 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2227/4409] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:17 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:17.506589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.530921 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2183/4410] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:17 2021] PUT /identity/v3/projects/08db6be69b3b4400a38c7491ded0ab82/users/1483e3fc61c74348a27ffbd3085678b9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:17.539742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c451550-6abb-4092-89be-0443afb82f3c service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.629118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.631806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.631806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.657323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:17.660233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.666289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.666892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.667181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.667669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.668185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:17.668492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.670135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.687407 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2228/4411] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:17.691588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.701785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d26d6-0bf5-4add-b926-8ab20a4016f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.706776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.707324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.707603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.707903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.708588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.710548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.733405 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2184/4412] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:24:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:17.747566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.749156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.838822 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2229/4413] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:17 2021] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:17.838822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:17.842652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:17.861373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f9a2-9132-4422-8231-7e7baa069cb9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.955742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d1175-0338-436a-a40c-74147d5fbab0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:17.967834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.968705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.969071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.969346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] PATH_INFO: `/v3/projects/8958585cad0b40b3916d14bc98d64f1e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:17.970575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8958585cad0b40b3916d14bc98d64f1e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:17.972563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:17.972819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:17.974286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:17.974286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:17.974286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.045921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.047842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:18.086111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2185/4414] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:24:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:18.086999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:18.111878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8ea24-56aa-4597-9cd1-d1fdecfecb98 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:18.130922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:18.130922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.130922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.130922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.133139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.135691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:18.183119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8958585cad0b40b3916d14bc98d64f1e', 'request_id': 'req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.252211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2186/4415] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:18 2021] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:18.258902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:18.266528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6efb1-a5b2-4e16-b2e1-7aeca34467be admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:18.316377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8958585cad0b40b3916d14bc98d64f1e', 'request_id': 'req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.325561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8958585cad0b40b3916d14bc98d64f1e', 'request_id': 'req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.339766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:18.340193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] The token cache is being invalidate because project 8958585cad0b40b3916d14bc98d64f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:18.340641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.340755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.340853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.341150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.341270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.342049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.343722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:18.345975 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2230/4416] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:17 2021] DELETE /identity/v3/projects/8958585cad0b40b3916d14bc98d64f1e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:18.347420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:18.351851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:18.356235 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2187/4417] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:18 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:18.360779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:18.363620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac8378-4b7e-49c2-a2df-875daf0fa6f0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:18.364242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:18.368963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:18.379126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1717f-26e9-4dec-9c36-733490af0aac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:18.382182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.382566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.383350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] PATH_INFO: `/v3/users/037d4705f8d04eaea2db924599d54e4e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.386812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] RBAC: Authorizing `identity:delete_user(user_id=037d4705f8d04eaea2db924599d54e4e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.389594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:18.390491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.390780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.391053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.391987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.393693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:18.397889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:18.418528 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2188/4418] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:18 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:18.420229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:18.436866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e5c8d-d865-485f-9603-779b7d0feb47 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:18.441042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b944eb-2166-4395-8a88-b72b6c263849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:18.442212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b944eb-2166-4395-8a88-b72b6c263849 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.442724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b944eb-2166-4395-8a88-b72b6c263849 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.443067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b944eb-2166-4395-8a88-b72b6c263849 admin admin] PATH_INFO: `/v3/projects/a8218fb49e504c92b7f0accee662333d/users/4c0581110ee642de82a781461100ccaf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.463852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b944eb-2166-4395-8a88-b72b6c263849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8218fb49e504c92b7f0accee662333d, user_id=4c0581110ee642de82a781461100ccaf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.467177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b944eb-2166-4395-8a88-b72b6c263849 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:18.587516 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2189/4419] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:18 2021] PUT /identity/v3/projects/a8218fb49e504c92b7f0accee662333d/users/4c0581110ee642de82a781461100ccaf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:18.598214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.598483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.598752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.624745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037d4705f8d04eaea2db924599d54e4e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.632019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037d4705f8d04eaea2db924599d54e4e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.638491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] MFA Rules not processed for user `4c0581110ee642de82a781461100ccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:18.640234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:18.648431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037d4705f8d04eaea2db924599d54e4e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.649236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037d4705f8d04eaea2db924599d54e4e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.731431 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2190/4420] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:18 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:18.732473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:18.734747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:18.792472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037d4705f8d04eaea2db924599d54e4e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:18.803169 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2231/4421] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:18 2021] DELETE /identity/v3/users/037d4705f8d04eaea2db924599d54e4e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:18.806233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:18.819545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:18.826211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5359de9-4848-40d0-844b-a4c33f88ed36 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:18.959301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e74fc-f3f5-47dd-8513-b2fcc1cc849f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:18.966999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:18.967957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.968247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.969292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] PATH_INFO: `/v3/users/f255cf69ee9b485a83b885920cf213f1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.972923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f255cf69ee9b485a83b885920cf213f1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.975046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:18.975418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:18.979110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:18.979110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:18.979110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:18.979541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:18.983669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.179250 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2232/4422] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:18 2021] POST /identity/v3/projects => generated 367 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:19.183854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:19.254967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79dffa-0f6d-4e87-846c-6a6a43f58804 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:19.261524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:19.262206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.262485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.263252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.263560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:19.265559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.285725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f255cf69ee9b485a83b885920cf213f1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.296587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f255cf69ee9b485a83b885920cf213f1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.313618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f255cf69ee9b485a83b885920cf213f1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.314357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f255cf69ee9b485a83b885920cf213f1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.316480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f255cf69ee9b485a83b885920cf213f1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.349233 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2233/4423] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:19 2021] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:19.353075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:19.354912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:19.367182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da53fb8-80cb-4f82-b5d4-59d66c84726e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:19.373488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:19.379884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.379884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.379884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.379884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:19.379884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.394794 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2234/4424] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:19 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:19.396105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:19.406661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09ad5c-ae5b-439b-a399-79f0e0cfa58d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:19.411493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31ff8-801b-4cb7-bc2b-ad5df2620001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:19.412713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31ff8-801b-4cb7-bc2b-ad5df2620001 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.413029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31ff8-801b-4cb7-bc2b-ad5df2620001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.413304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31ff8-801b-4cb7-bc2b-ad5df2620001 admin admin] PATH_INFO: `/v3/projects/eadb6072ef6f45bc80a5167c91f6342c/users/bc518944756f4956b67a0813793cfc74/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.431518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31ff8-801b-4cb7-bc2b-ad5df2620001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb6072ef6f45bc80a5167c91f6342c, user_id=bc518944756f4956b67a0813793cfc74, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:19.433532 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2191/4425] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:18 2021] DELETE /identity/v3/users/f255cf69ee9b485a83b885920cf213f1 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:19.434293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:19.435691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31ff8-801b-4cb7-bc2b-ad5df2620001 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.435890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:19.495183 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2235/4426] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:19 2021] PUT /identity/v3/projects/eadb6072ef6f45bc80a5167c91f6342c/users/bc518944756f4956b67a0813793cfc74/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:19.496636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c28ad-38df-46dd-8cd4-9acbc0806cf7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.496978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c28ad-38df-46dd-8cd4-9acbc0806cf7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.497227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c28ad-38df-46dd-8cd4-9acbc0806cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.520722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ea4c28ad-38df-46dd-8cd4-9acbc0806cf7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:19.520722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ea4c28ad-38df-46dd-8cd4-9acbc0806cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:19.536183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5f6e4-7521-4b27-8381-ab29f7242c33 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:19.600638 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2236/4427] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:19.600638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc858-867f-46fe-b7d1-16062f51f2db None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.600638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc858-867f-46fe-b7d1-16062f51f2db None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.600638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc858-867f-46fe-b7d1-16062f51f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.610354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:19.610354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.610354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.610354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] PATH_INFO: `/v3/projects/5e9f01b394564869be68f956d9a125c9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.614643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9f01b394564869be68f956d9a125c9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:19.619963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.638844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c9dcc858-867f-46fe-b7d1-16062f51f2db None None] MFA Rules not processed for user `1483e3fc61c74348a27ffbd3085678b9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:19.640061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c9dcc858-867f-46fe-b7d1-16062f51f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:19.704892 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2237/4428] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:19 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:19.705773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcc858-867f-46fe-b7d1-16062f51f2db None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:19.716544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcc858-867f-46fe-b7d1-16062f51f2db None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:19.721174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:19.721816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.722099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.722376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.723128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:19.724715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.734677 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2238/4429] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:19.735783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:19.737769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:19.750387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9f01b394564869be68f956d9a125c9', 'request_id': 'req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.756974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9f01b394564869be68f956d9a125c9', 'request_id': 'req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.797615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88f0f-29a4-402b-bf6d-7acb0468216f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:19.849608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:19.850348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.855517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.855517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.860722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9f01b394564869be68f956d9a125c9', 'request_id': 'req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.872432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] The token cache is being invalidate because project 5e9f01b394564869be68f956d9a125c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:19.872834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.873597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49ae5c5c-63e4-4fa3-be5c-2b74677981ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:19.875245 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2192/4430] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:19 2021] DELETE /identity/v3/projects/5e9f01b394564869be68f956d9a125c9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:19.876896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e94b97-9219-4659-aa44-f75840d71b59 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.877403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e94b97-9219-4659-aa44-f75840d71b59 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.881551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e94b97-9219-4659-aa44-f75840d71b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.894830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b3e94b97-9219-4659-aa44-f75840d71b59 None None] MFA Rules not processed for user `8a9aca0cfb134140a880e9ef5ecde9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:19.896026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b3e94b97-9219-4659-aa44-f75840d71b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:19.911830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:19.913305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.923639 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2239/4431] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:19.925874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:19.938024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781819e-358d-4132-8719-da3b302e3c12 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:19.953641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:19.955120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.957149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.957503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] PATH_INFO: `/v3/projects/eadb6072ef6f45bc80a5167c91f6342c/users/bc518944756f4956b67a0813793cfc74/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.960764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb6072ef6f45bc80a5167c91f6342c, user_id=bc518944756f4956b67a0813793cfc74, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:19.965552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:19.969038 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2193/4432] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:19 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:19.970578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac7f3-ed5b-435a-95d6-e1e76643ba69 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:19.970869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac7f3-ed5b-435a-95d6-e1e76643ba69 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:19.971143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac7f3-ed5b-435a-95d6-e1e76643ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:19.990270 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2240/4433] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:19 2021] PUT /identity/v3/projects/eadb6072ef6f45bc80a5167c91f6342c/users/bc518944756f4956b67a0813793cfc74/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:20.021802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.021802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.022239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a19ac7f3-ed5b-435a-95d6-e1e76643ba69 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:20.022239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a19ac7f3-ed5b-435a-95d6-e1e76643ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.069361 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2194/4434] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:20.076750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658553-8d42-4f99-a099-7d73064a4484 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.077467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658553-8d42-4f99-a099-7d73064a4484 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.077912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a658553-8d42-4f99-a099-7d73064a4484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.099175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7a658553-8d42-4f99-a099-7d73064a4484 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:20.100582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7a658553-8d42-4f99-a099-7d73064a4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.109801 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2195/4435] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:20.113219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509e6d-4c11-4bc3-b18c-0bf4ac1f31d3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.113219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509e6d-4c11-4bc3-b18c-0bf4ac1f31d3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.113219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2509e6d-4c11-4bc3-b18c-0bf4ac1f31d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.114458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8017912-45ab-4763-8a98-4544f76afffa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.125166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.125836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.126129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.126706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.128676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.139692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a2509e6d-4c11-4bc3-b18c-0bf4ac1f31d3 None None] MFA Rules not processed for user `bc518944756f4956b67a0813793cfc74`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:20.140908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2509e6d-4c11-4bc3-b18c-0bf4ac1f31d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.221152 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2196/4436] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:20.223181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509e6d-4c11-4bc3-b18c-0bf4ac1f31d3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.237308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2509e6d-4c11-4bc3-b18c-0bf4ac1f31d3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.239022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.241441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.247879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.247879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.247879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.247879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.248288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:20.248288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.249993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.253784 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2241/4437] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:19 2021] GET /identity/v3/auth/tokens => generated 3272 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:20.254491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.266321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db6021-e26c-46bd-a90d-db1a3f99157f service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.271319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.272008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.272644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.272644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.273343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.275428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.275581 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2197/4438] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:20.280047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.291329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a957a-e68c-48ab-8823-02d104f18440 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.299145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.300479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.300479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.300479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.305490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.305490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.363387 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2242/4439] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/roles => generated 234 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:20.364440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.374136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb2308-7e34-4087-a581-d3bd08bdf9e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.378792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.379436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.379720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.379995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.380731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.382352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.416400 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2198/4440] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:20.417433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.486241 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2243/4441] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/roles => generated 235 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:20.486241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.486241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.486938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27487-5e07-4e48-a06b-3cbe171a0fd7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.492463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.493447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.493659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.493913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.494616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.496985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.512991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc5673-5f2b-4a09-a587-c5b199751b1d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.517937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.518797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.519082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.519441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] PATH_INFO: `/v3/projects/401a922101e747bfbc07633acb8009b5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.520580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=401a922101e747bfbc07633acb8009b5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.522559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.598291 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2199/4442] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:20.598291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.645081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401a922101e747bfbc07633acb8009b5', 'request_id': 'req-295ad663-af09-492b-9b78-e49dfa1f2d5a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:20.660217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb66df-bbd1-48b4-8838-756677913eac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.722820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.723556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.723842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.724117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.724860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.726510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.736722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401a922101e747bfbc07633acb8009b5', 'request_id': 'req-295ad663-af09-492b-9b78-e49dfa1f2d5a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:20.744809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401a922101e747bfbc07633acb8009b5', 'request_id': 'req-295ad663-af09-492b-9b78-e49dfa1f2d5a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:20.755619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] The token cache is being invalidate because project 401a922101e747bfbc07633acb8009b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:20.755901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:20.756557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:20.759934 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2244/4443] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:20 2021] DELETE /identity/v3/projects/401a922101e747bfbc07633acb8009b5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:20.759934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.760382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.819404 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2200/4444] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/roles => generated 235 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:20.820590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.822287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.824300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ad663-af09-492b-9b78-e49dfa1f2d5a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.828290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.829021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.829310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.829583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.831489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.845356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.846804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.856963 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2245/4445] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:20.857930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.859630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.900097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff105de6-ba97-415f-8eb0-4398c02de356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.906398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.908161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.908973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.909470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.910713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.913266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.930503 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2201/4446] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:20 2021] GET /identity/v3/roles => generated 2097 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:20.931486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:20.933222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:20.949733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d71b3a-5cdf-4060-9972-b315b24c1f8e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.955281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.956032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.957048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.957048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.957502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.959318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:20.979315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408144-9d83-4c30-9558-aa8d4152ecd5 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:20.984313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:20.985334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:20.985710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:20.986049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] PATH_INFO: `/v3/users/c0e7bce427b1432fa6b06059155f6f65` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:20.987372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e7bce427b1432fa6b06059155f6f65)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:20.989510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.036561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2202/4447] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:24:20 2021] POST /identity/v3/domains => generated 275 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:21.037772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.113101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3d86-4ace-4632-a9c2-726a8ad91c7c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.117960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.119194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.119503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.119853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.123231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.123231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.133422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2203/4448] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:21 2021] GET /identity/v3/roles => generated 2097 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:21.134963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.197686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2386ce-6beb-4970-b57b-1bc27b7a7f99 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.202376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.203052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.203343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.203657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.204369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.206299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.253201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e7bce427b1432fa6b06059155f6f65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:21.260987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e7bce427b1432fa6b06059155f6f65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:21.272136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e7bce427b1432fa6b06059155f6f65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:21.272810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e7bce427b1432fa6b06059155f6f65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:21.342711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2204/4449] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:21 2021] POST /identity/v3/projects => generated 401 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:21.344169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.383385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e7bce427b1432fa6b06059155f6f65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:21.401623 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2246/4450] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:20 2021] DELETE /identity/v3/users/c0e7bce427b1432fa6b06059155f6f65 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:21.403071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.403968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:21.422483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a846be-dddf-47ca-ab6e-ff7da851911f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.485537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8f8f-8946-4217-a93f-e4ab36c59959 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.490901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.491572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.491861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.492141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7600-521e-4595-8cee-682b6eefe2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.492804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.492958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.494209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7600-521e-4595-8cee-682b6eefe2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.494596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7600-521e-4595-8cee-682b6eefe2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.495015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7600-521e-4595-8cee-682b6eefe2ce admin admin] PATH_INFO: `/v3/projects/4916e3d4210e4240a4525180663a098e/users/01c8a433c6ca4d38a40ca7661b033270/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.495373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.512386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7600-521e-4595-8cee-682b6eefe2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4916e3d4210e4240a4525180663a098e, user_id=01c8a433c6ca4d38a40ca7661b033270, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.515150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7600-521e-4595-8cee-682b6eefe2ce admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.570089 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2247/4451] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:24:21 2021] POST /identity/v3/groups => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:21.574799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.584408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6578b-119e-4099-ba63-aa9a2987b84b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.589449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.590081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.590393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.590676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.591411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.593008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.605560 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2205/4452] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:21 2021] PUT /identity/v3/projects/4916e3d4210e4240a4525180663a098e/users/01c8a433c6ca4d38a40ca7661b033270/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:21.616352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.616768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.617163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.647810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] MFA Rules not processed for user `01c8a433c6ca4d38a40ca7661b033270`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:21.649762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:21.661119 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2248/4453] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:21 2021] POST /identity/v3/roles => generated 235 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:21.665353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.677364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f39f23-5fb0-43fd-9115-beb5639f4c36 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.726634 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2206/4454] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:21 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:21.737864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.740143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:21.753631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.754289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.754569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.754843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.755816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.757584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.815576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e6e01-6ffd-4093-9dc2-b87771234747 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.819382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.820065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.820342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.820614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.831549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.831549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.841713 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2207/4455] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:21 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:21.867553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.869021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:21.893860 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2249/4456] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:21 2021] POST /identity/v3/users => generated 439 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:21.898577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:21.922037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a770b7-d226-469e-8695-578e34e8d90c tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.933035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.933957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.934292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.934600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.935316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.937359 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:21.937359 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:21.937359 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:21.939124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:21.951893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504f410-66bc-4fd3-bbbe-206128d1976d service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:21.962654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:21.962654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:21.962654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:21.962654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] PATH_INFO: `/v3/users/01c8a433c6ca4d38a40ca7661b033270` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:21.963257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c8a433c6ca4d38a40ca7661b033270)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:21.963993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.048606 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2250/4457] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:21 2021] POST /identity/v3/roles => generated 270 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:22.048606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.048606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.062264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0cb7a-1349-427e-a1a1-8959bb478641 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:22.067467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:22.068337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.068621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.068922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] PATH_INFO: `/v3/projects/60a6023373ca45fb850670e3986748b7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.070159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a6023373ca45fb850670e3986748b7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:22.072141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.156783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c8a433c6ca4d38a40ca7661b033270'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.164042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c8a433c6ca4d38a40ca7661b033270'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.176074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c8a433c6ca4d38a40ca7661b033270'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.176782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c8a433c6ca4d38a40ca7661b033270'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.177519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c8a433c6ca4d38a40ca7661b033270'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.206391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a6023373ca45fb850670e3986748b7', 'request_id': 'req-a58598c2-adac-452a-91dc-e94ee0c66b8f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.313254 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2208/4458] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:21 2021] DELETE /identity/v3/users/01c8a433c6ca4d38a40ca7661b033270 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:22.314199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.315521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.378395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836348c-21c3-4c88-9cce-ae1110564d79 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:22.383343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe2e9a-09e6-4ddf-9112-ab2faad10309 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:22.385012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2e9a-09e6-4ddf-9112-ab2faad10309 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.385326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2e9a-09e6-4ddf-9112-ab2faad10309 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.385604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2e9a-09e6-4ddf-9112-ab2faad10309 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/496a7d8e1ab243a8a79b137a5ee6727d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.398177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a6023373ca45fb850670e3986748b7', 'request_id': 'req-a58598c2-adac-452a-91dc-e94ee0c66b8f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.402294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe2e9a-09e6-4ddf-9112-ab2faad10309 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=496a7d8e1ab243a8a79b137a5ee6727d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:22.402974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe2e9a-09e6-4ddf-9112-ab2faad10309 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.406139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a6023373ca45fb850670e3986748b7', 'request_id': 'req-a58598c2-adac-452a-91dc-e94ee0c66b8f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.417426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] The token cache is being invalidate because project 60a6023373ca45fb850670e3986748b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:22.417711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.418380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a58598c2-adac-452a-91dc-e94ee0c66b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.419981 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2251/4459] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:22 2021] DELETE /identity/v3/projects/60a6023373ca45fb850670e3986748b7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:22.421254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b842e-5a4c-4b31-aa10-3945e4c68993 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.421633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b842e-5a4c-4b31-aa10-3945e4c68993 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.425397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b842e-5a4c-4b31-aa10-3945e4c68993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.444230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b10b842e-5a4c-4b31-aa10-3945e4c68993 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:22.448332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b10b842e-5a4c-4b31-aa10-3945e4c68993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.504238 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2252/4460] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:22.505835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.506295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.506770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.526002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:22.527186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.535045 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2253/4461] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:22.535797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.537092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.554695 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2209/4462] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:22 2021] PUT /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/496a7d8e1ab243a8a79b137a5ee6727d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:22.556836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.557299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.557694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.577649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:22.578766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.596847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4363b4b-f3d3-4da6-b9ef-911cd93cbf75 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:22.640540 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2210/4463] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:22.641473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.642831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.644850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:22.645548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.645866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.646218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.656175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:22.657640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.668577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2254/4464] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:22.669541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.678906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01a7d-7836-4cc4-a44e-335df183cac7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:22.684708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:22.685394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.685791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.686095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.686687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:22.686993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:22.688629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.701944 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2255/4465] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:22.706391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.715721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ada17-0fed-4d18-b99e-f543ccb1afdd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:22.717247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc542e-2ded-427f-89a7-1d49eef9acc0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:22.720635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:22.721326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.721617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.721895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.722703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Adding query filter params (scope.project.id=b9dafcb43eed4c70ac26ecfa77e255ca, user.id=21c7d289eb5247ca9798d0a54b1c0d94) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:22.722991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:22.723146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:22.723954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.724086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.724331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.724830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.725075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:22.727271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.772411 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2211/4466] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:24:22 2021] GET /identity/v3/role_assignments?scope.project.id=b9dafcb43eed4c70ac26ecfa77e255ca&user.id=21c7d289eb5247ca9798d0a54b1c0d94&effective => generated 228 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:22.777333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.788667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7cfee-6df5-4a21-bf8a-388dec80e854 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:22.794282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:22.795236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:22.795505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:22.795782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/496a7d8e1ab243a8a79b137a5ee6727d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:22.798096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=496a7d8e1ab243a8a79b137a5ee6727d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:22.800698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:22.806361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 496a7d8e1ab243a8a79b137a5ee6727d was removed from user 21c7d289eb5247ca9798d0a54b1c0d94 on project b9dafcb43eed4c70ac26ecfa77e255ca. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:22.806668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.807324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:22.870697 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2256/4467] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:22 2021] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:22.874688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.876305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.969039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2212/4468] 10.222.0.32 () {58 vars in 1466 bytes} [Sat Dec 25 21:24:22 2021] DELETE /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/496a7d8e1ab243a8a79b137a5ee6727d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:22.973238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:22.974978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:22.976846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6ba15-9c4f-45d2-8d19-f6ab20a466ff admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.070740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c88321-e2dc-4179-b48a-2b55e928ee27 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.075022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.075997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.076521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.077074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.078216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.080438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.086473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.088345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.088638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.088952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/496a7d8e1ab243a8a79b137a5ee6727d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.090536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=496a7d8e1ab243a8a79b137a5ee6727d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.092158 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:23.092158 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:23.092158 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:23.093619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.178785 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2257/4469] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:22 2021] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:23.183612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.196839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6311c-bbaf-4753-9582-a6f05e02b0f9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.202644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.203640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.204346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.204629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.205399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.207001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.220921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2258/4470] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:23 2021] GET /identity/v3/roles => generated 2323 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:23.223955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.235263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e35a8f-f539-4078-91a9-8538b685eeb5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.240020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.240767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.241088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.241363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.242097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.244614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.255761 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2259/4471] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:23 2021] GET /identity/v3/roles => generated 2323 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:23.260541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.271502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d719174-6274-4ee0-8123-d5104814ec30 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.276614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.277665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.277948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.278238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] PATH_INFO: `/v3/projects/396d6485ec1e422d9d0b4fc1a10a2c79/users/c3e7d750529245e89770ccd581163584/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.296335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 496a7d8e1ab243a8a79b137a5ee6727d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:23.296675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:23.301916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396d6485ec1e422d9d0b4fc1a10a2c79, user_id=c3e7d750529245e89770ccd581163584, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.305424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.306956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:23.313649 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2213/4472] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:22 2021] DELETE /identity/v3/roles/496a7d8e1ab243a8a79b137a5ee6727d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:23.313649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.313649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:23.380623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a742-d8ad-443a-959d-1f6b7d549e5b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.385918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.386775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.387060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.387339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] PATH_INFO: `/v3/projects/4916e3d4210e4240a4525180663a098e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.388542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4916e3d4210e4240a4525180663a098e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.390516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.398715 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2260/4473] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:23 2021] PUT /identity/v3/projects/396d6485ec1e422d9d0b4fc1a10a2c79/users/c3e7d750529245e89770ccd581163584/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:23.399550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.401317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:23.473062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71f2b2-71a2-47d1-b91f-67b6851861b3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.478708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04afd9f-eb18-48b6-804d-3f4ccbf3bba2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.481735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04afd9f-eb18-48b6-804d-3f4ccbf3bba2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.481735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04afd9f-eb18-48b6-804d-3f4ccbf3bba2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.481735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04afd9f-eb18-48b6-804d-3f4ccbf3bba2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/573f249f1a7c463fbbeb36646de2eeeb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.482601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04afd9f-eb18-48b6-804d-3f4ccbf3bba2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=573f249f1a7c463fbbeb36646de2eeeb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.485268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04afd9f-eb18-48b6-804d-3f4ccbf3bba2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.641225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2261/4474] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:23 2021] PUT /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/573f249f1a7c463fbbeb36646de2eeeb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:23.642512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10e55-bf83-4e98-b1ee-baac3b3cfd7c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.642877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10e55-bf83-4e98-b1ee-baac3b3cfd7c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.643220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10e55-bf83-4e98-b1ee-baac3b3cfd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.650041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4916e3d4210e4240a4525180663a098e', 'request_id': 'req-19a6e2f6-cf27-4a06-842d-41b79a660cf4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:23.656598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4916e3d4210e4240a4525180663a098e', 'request_id': 'req-19a6e2f6-cf27-4a06-842d-41b79a660cf4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:23.670274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-67e10e55-bf83-4e98-b1ee-baac3b3cfd7c None None] MFA Rules not processed for user `c3e7d750529245e89770ccd581163584`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:23.671480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-67e10e55-bf83-4e98-b1ee-baac3b3cfd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:23.735328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2262/4475] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:23 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:23.736411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e10e55-bf83-4e98-b1ee-baac3b3cfd7c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.754363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4916e3d4210e4240a4525180663a098e', 'request_id': 'req-19a6e2f6-cf27-4a06-842d-41b79a660cf4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:23.766012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] The token cache is being invalidate because project 4916e3d4210e4240a4525180663a098e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:23.766416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:23.767049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:23.768657 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2214/4476] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:23 2021] DELETE /identity/v3/projects/4916e3d4210e4240a4525180663a098e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:23.769473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.770730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:23.800240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e10e55-bf83-4e98-b1ee-baac3b3cfd7c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.806544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b941247-c626-4f77-b613-14495845f339 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.807458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b941247-c626-4f77-b613-14495845f339 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.810185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b941247-c626-4f77-b613-14495845f339 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.810185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b941247-c626-4f77-b613-14495845f339 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.810185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b941247-c626-4f77-b613-14495845f339 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.810834 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-1b941247-c626-4f77-b613-14495845f339 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:23.810834 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:23.810834 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:23.811705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b941247-c626-4f77-b613-14495845f339 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.839860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e2f6-cf27-4a06-842d-41b79a660cf4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:23.845466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:23.846278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.846629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.846978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.847758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:23.850236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:23.887427 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2263/4477] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:23 2021] PUT /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 520 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:23.887427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca129-a8b3-44f1-8a58-55810d17e79e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:23.887427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca129-a8b3-44f1-8a58-55810d17e79e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:23.887427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ca129-a8b3-44f1-8a58-55810d17e79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:23.907704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a52ca129-a8b3-44f1-8a58-55810d17e79e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:23.908819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a52ca129-a8b3-44f1-8a58-55810d17e79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:23.962477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2215/4478] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:23 2021] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:23.963561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.966777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:23.973390 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2264/4479] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:23.974056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ca129-a8b3-44f1-8a58-55810d17e79e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:23.984163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ca129-a8b3-44f1-8a58-55810d17e79e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.033176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7498b-e06e-4b4f-90da-8a3bbcb1e058 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.039751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b35e8-2afd-450f-8cf3-81c28c736914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.040912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b35e8-2afd-450f-8cf3-81c28c736914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.041235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b35e8-2afd-450f-8cf3-81c28c736914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.041495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b35e8-2afd-450f-8cf3-81c28c736914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.042539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.042730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b35e8-2afd-450f-8cf3-81c28c736914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Adding query filter params (scope.project.id=b9dafcb43eed4c70ac26ecfa77e255ca, user.id=21c7d289eb5247ca9798d0a54b1c0d94) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:24.042840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b35e8-2afd-450f-8cf3-81c28c736914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.043219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.043506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.044073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.046025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.046170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b35e8-2afd-450f-8cf3-81c28c736914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.046999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.099054 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2216/4480] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:24:23 2021] GET /identity/v3/role_assignments?scope.project.id=b9dafcb43eed4c70ac26ecfa77e255ca&user.id=21c7d289eb5247ca9798d0a54b1c0d94&effective => generated 1061 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:24.100761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95869c7-1b47-4679-a1a1-2b725f2d416b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.101135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95869c7-1b47-4679-a1a1-2b725f2d416b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.101478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95869c7-1b47-4679-a1a1-2b725f2d416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.120155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b95869c7-1b47-4679-a1a1-2b725f2d416b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:24.121535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b95869c7-1b47-4679-a1a1-2b725f2d416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:24.129786 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2217/4481] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:24.130559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95869c7-1b47-4679-a1a1-2b725f2d416b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.144194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95869c7-1b47-4679-a1a1-2b725f2d416b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.162134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.163097 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2265/4482] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:23 2021] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:24.164122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.165604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.166118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.166648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.170616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.172163 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:24.172163 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:24.172163 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:24.174252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.188207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a6ccd-dc9c-4f23-be12-3e5be7b2cbdd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.205321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.206007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.206294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.208417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.208417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:24.208417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.210920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.230224 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2266/4483] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:24.231462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.248731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7b4b-4d32-4a2b-9752-4aa741c098dc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.253896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.254551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.254830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.255137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.256014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.258288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.259237 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2218/4484] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:24 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:24.263724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.270498 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2267/4485] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:24 2021] GET /identity/v3/roles => generated 2323 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:24.271586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.303964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189de131-a37f-4a00-b959-a51e4fdc97a7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.348386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b8cc6-78a5-4846-a80d-9b41441a4250 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.355909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.356464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.356766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.357303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.358370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.360550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.403609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.404418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.407226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.407226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.407226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Adding query filter params (scope.project.id=b9dafcb43eed4c70ac26ecfa77e255ca, user.id=21c7d289eb5247ca9798d0a54b1c0d94) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:24.407226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.408495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.461214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2268/4486] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:24:24 2021] GET /identity/v3/role_assignments?scope.project.id=b9dafcb43eed4c70ac26ecfa77e255ca&user.id=21c7d289eb5247ca9798d0a54b1c0d94&effective => generated 577 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:24.461724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.467828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2219/4487] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:24 2021] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:24.469366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.477582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d87c9-76c5-4d97-9805-7325e9f730ba tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.538912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.539787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.540137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.540586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.541499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.543274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.549710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a18aae-4c4d-4c4a-976f-39bae3f5ed2d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.564900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.565114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2269/4488] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:24 2021] GET /identity/v3/roles => generated 2323 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:24.565223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.565223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.565223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.565519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.565612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.565612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.567215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73ed5e-5b7c-47f8-b2c9-e744e9203ba4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.573164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.573912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.574165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.574442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.575179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.577146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.588610 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] 573f249f1a7c463fbbeb36646de2eeeb does not imply d6684387d7ed4f0f822078efbaf8ac7d.: keystone.exception.ImpliedRoleNotFound: 573f249f1a7c463fbbeb36646de2eeeb does not imply d6684387d7ed4f0f822078efbaf8ac7d. Dec 25 21:24:24.589959 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2220/4489] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:24 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 137 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:24:24.591566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.602881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698cd5d-edf9-437d-8f77-e79187ddc05f tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.608203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.609232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.609513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.609786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] PATH_INFO: `/v3/projects/d83155e42c9244f590ef41de1f346737/users/cf412d9574584b7b83c436f7144b7f32/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.630082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83155e42c9244f590ef41de1f346737, user_id=cf412d9574584b7b83c436f7144b7f32, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.632981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.685705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2270/4490] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:24 2021] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:24.686200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.697991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6fc1-34f6-4153-9ecd-7a2b173f36b7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.702867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.708470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.708470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.708470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/573f249f1a7c463fbbeb36646de2eeeb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.708470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=573f249f1a7c463fbbeb36646de2eeeb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.709587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.715341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 573f249f1a7c463fbbeb36646de2eeeb was removed from user 21c7d289eb5247ca9798d0a54b1c0d94 on project b9dafcb43eed4c70ac26ecfa77e255ca. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:24.715642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:24.716390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:24.741161 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2221/4491] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:24 2021] PUT /identity/v3/projects/d83155e42c9244f590ef41de1f346737/users/cf412d9574584b7b83c436f7144b7f32/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:24.750646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.750646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:24.808239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f5d16-aa41-48a8-bcc2-c14a7b323048 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.813005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2d4ea-6d16-48f3-ac12-5a59c72858f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.813673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d4ea-6d16-48f3-ac12-5a59c72858f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.813952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d4ea-6d16-48f3-ac12-5a59c72858f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.814227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2d4ea-6d16-48f3-ac12-5a59c72858f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.814959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2d4ea-6d16-48f3-ac12-5a59c72858f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.816535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2d4ea-6d16-48f3-ac12-5a59c72858f7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.827587 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2222/4492] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:24 2021] GET /identity/v3/roles => generated 2323 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:24.828862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.829143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.829419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.856596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] MFA Rules not processed for user `cf412d9574584b7b83c436f7144b7f32`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:24.864579 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2271/4493] 10.222.0.32 () {58 vars in 1466 bytes} [Sat Dec 25 21:24:24 2021] DELETE /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/573f249f1a7c463fbbeb36646de2eeeb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:24.864717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:24.864818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.927221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d13bf-63ef-43ff-854b-b1b8a7411deb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:24.930307 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2223/4494] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:24.931121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.932376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:24.934800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:24.936238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:24.936238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:24.936238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:24.937253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:24.938907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:24.951392 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2272/4495] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:24 2021] GET /identity/v3/roles => generated 2323 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:24.952219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:24.955542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.006536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b44dd-2f7c-458d-9113-bbaa85cfed80 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.012194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.012854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.013168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.013442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.014195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.015206 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:25.015206 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:25.015206 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:25.016131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.025372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1381e-0185-4766-bf9f-7d65a40b34fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.029347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.033610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.033610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.033610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.033610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.089967 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2224/4496] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:24 2021] POST /identity/v3/roles => generated 272 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:25.089967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.102875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.103724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b38c2e-1e6a-4174-b26f-8c2dffd0d584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.104336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.108691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e43237-de45-4907-9bd5-72542bf0e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.109753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43237-de45-4907-9bd5-72542bf0e955 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.110144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43237-de45-4907-9bd5-72542bf0e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.110508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43237-de45-4907-9bd5-72542bf0e955 admin admin] PATH_INFO: `/v3/projects/3075932236c24ad8974bea0414dd1507/users/7fafe1898f1b4b40adf4ff7a1de2a06f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.114702 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2273/4497] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:25.114854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.126585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074f506-2ce9-4295-8d2d-87d38e80c4ce service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.128015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e43237-de45-4907-9bd5-72542bf0e955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3075932236c24ad8974bea0414dd1507, user_id=7fafe1898f1b4b40adf4ff7a1de2a06f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.130982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e43237-de45-4907-9bd5-72542bf0e955 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.131331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.131990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.132273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.132553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.133323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Adding query filter params (domain_id=a79d8adf202f429d819832a6af2ce70a) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:25.133664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.134677 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:25.134677 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:25.134677 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:25.135554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.143850 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2274/4498] 10.222.0.32 () {58 vars in 1206 bytes} [Sat Dec 25 21:24:25 2021] GET /identity/v3/roles?domain_id=a79d8adf202f429d819832a6af2ce70a => generated 409 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:25.147781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.157274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8304ba-cd92-49c0-aaaa-9a055d23d3cc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.161876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.162952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.163237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.163512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/8b9c1cfcd5434c7f85fd28d692e4094f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.164694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8b9c1cfcd5434c7f85fd28d692e4094f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.166279 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:25.166279 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:25.166279 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:25.167147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.227883 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2225/4499] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:25 2021] PUT /identity/v3/projects/3075932236c24ad8974bea0414dd1507/users/7fafe1898f1b4b40adf4ff7a1de2a06f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:25.238455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.238742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.243906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.274787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] MFA Rules not processed for user `7fafe1898f1b4b40adf4ff7a1de2a06f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:25.276150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.349022 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2226/4500] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:25 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:25.360016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 8b9c1cfcd5434c7f85fd28d692e4094f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:25.360305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:25.361020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:25.362902 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2275/4501] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:25 2021] DELETE /identity/v3/roles/8b9c1cfcd5434c7f85fd28d692e4094f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:25.363100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.364663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.367674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.369762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.439709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0f5b8-b025-4b00-ab19-9a7be8b22987 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.455041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e93dc-04a6-4300-8d1a-e779e363ed45 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.461184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.461458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.461781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.462062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.462802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Adding query filter params (domain_id=a79d8adf202f429d819832a6af2ce70a) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:25.463116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.464718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.471123 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2276/4502] 10.222.0.32 () {58 vars in 1206 bytes} [Sat Dec 25 21:24:25 2021] GET /identity/v3/roles?domain_id=a79d8adf202f429d819832a6af2ce70a => generated 148 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:25.473663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.475507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.506523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.507684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.507971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.508257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.511442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.556346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d735d-54ba-48f4-a8a4-7abfa3e741c0 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.561144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.561806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.562088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.562364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.564378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:25.588371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.592085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.608471 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2227/4503] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:25 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:25.622732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.649013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36591-b7e9-4218-840a-b9d6b92e2739 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.656461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.660927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.660927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.660927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/8b9c1cfcd5434c7f85fd28d692e4094f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.670200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.670648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:24:25.672157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.679823 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Could not find role: 8b9c1cfcd5434c7f85fd28d692e4094f.: keystone.exception.RoleNotFound: Could not find role: 8b9c1cfcd5434c7f85fd28d692e4094f. Dec 25 21:24:25.681790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2228/4504] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:25 2021] DELETE /identity/v3/roles/8b9c1cfcd5434c7f85fd28d692e4094f => generated 110 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:24:25.683583 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2277/4505] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:25 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:25.687058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.698129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6afba7-15e8-417e-af21-cb59a77407d1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.706992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.708035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.708433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.708812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.716392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a79d8adf202f429d819832a6af2ce70a, group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.719464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.838818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2229/4506] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:25 2021] PUT /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:25.840465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.855998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d55ad-ac8c-43f7-a7e2-ddfb2930fbec service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:25.954482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:25.955484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:25.955876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:25.956256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:25.958910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a79d8adf202f429d819832a6af2ce70a, group_id=a0d4c467e5cb4c5ead94a8dd75455245)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:25.960156 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:25.960156 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:25.960156 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:25.962306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:25.979940 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2278/4507] 10.222.0.32 () {58 vars in 1364 bytes} [Sat Dec 25 21:24:25 2021] GET /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles => generated 410 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:25.981255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:25.995230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65d4f5-01b8-435b-a8ad-fa778e9f2ced tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:26.003545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:26.004601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:26.005014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:26.005418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:26.007869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a79d8adf202f429d819832a6af2ce70a, group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:26.009070 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:26.009070 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:26.009070 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:26.011098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:26.028787 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2230/4508] 10.222.0.32 () {58 vars in 1464 bytes} [Sat Dec 25 21:24:25 2021] HEAD /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:26.030740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:26.043023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e8ba1-8c49-4dcd-b7c8-1906064ac743 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:26.053063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:26.053902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:26.054200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:26.054656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:26.057306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a79d8adf202f429d819832a6af2ce70a, group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:26.061515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:26.073810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role dfc15b1a473246a3bc61db1f9f8d8ea8 was removed from group a0d4c467e5cb4c5ead94a8dd75455245 on domain a79d8adf202f429d819832a6af2ce70a. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:26.073810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:26.074237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:26.194345 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2279/4509] 10.222.0.32 () {58 vars in 1466 bytes} [Sat Dec 25 21:24:26 2021] DELETE /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:26.198722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:26.200518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:26.225964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0f505-c2f5-492a-9161-3ac9150c0f67 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:26.315571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:26.316820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:26.316820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:26.321823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:26.321823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:26.322999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:26.400511 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2231/4510] 10.222.0.32 () {60 vars in 1485 bytes} [Sat Dec 25 21:24:26 2021] PUT /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:26.404576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:26.430283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1588c-f861-469e-b0ea-56c9d3f0cc63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:26.532322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:26.532322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:26.532322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:26.533343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:26.533343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_grants(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, group_id=a0d4c467e5cb4c5ead94a8dd75455245)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:26.533343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:26.547828 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2280/4511] 10.222.0.32 () {58 vars in 1367 bytes} [Sat Dec 25 21:24:26 2021] GET /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles => generated 411 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:26.552501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:26.564191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba26282-5a85-48c4-b5c6-d6122ccbdb60 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:26.570044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cf79a-0b6a-4184-a4fc-757748eb03fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:26.571214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cf79a-0b6a-4184-a4fc-757748eb03fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:26.571540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cf79a-0b6a-4184-a4fc-757748eb03fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:26.571782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cf79a-0b6a-4184-a4fc-757748eb03fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/groups/a0d4c467e5cb4c5ead94a8dd75455245/users/21c7d289eb5247ca9798d0a54b1c0d94` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:26.573703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cf79a-0b6a-4184-a4fc-757748eb03fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a0d4c467e5cb4c5ead94a8dd75455245, user_id=21c7d289eb5247ca9798d0a54b1c0d94)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:26.575720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cf79a-0b6a-4184-a4fc-757748eb03fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:26.756026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:26.757760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2232/4512] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:24:26 2021] PUT /identity/v3/groups/a0d4c467e5cb4c5ead94a8dd75455245/users/21c7d289eb5247ca9798d0a54b1c0d94 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:26.759178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:26.763555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a727cd0-518d-4346-8d7c-6978547ad96d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:26.763555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a727cd0-518d-4346-8d7c-6978547ad96d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:26.763555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a727cd0-518d-4346-8d7c-6978547ad96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:26.810591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3a727cd0-518d-4346-8d7c-6978547ad96d None None] MFA Rules not processed for user `21c7d289eb5247ca9798d0a54b1c0d94`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:26.811756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a727cd0-518d-4346-8d7c-6978547ad96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:26.847406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d758db-4eee-4178-9ab1-03ffede1c94a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:26.920751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:26.922111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:26.922556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:26.923804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] PATH_INFO: `/v3/users/c3e7d750529245e89770ccd581163584` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:26.924352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e7d750529245e89770ccd581163584)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:26.926523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:26.953218 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2233/4513] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:26 2021] POST /identity/v3/auth/tokens => generated 3255 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:26.955376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a727cd0-518d-4346-8d7c-6978547ad96d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:27.054170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a727cd0-518d-4346-8d7c-6978547ad96d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:27.059295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:27.060231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:27.060792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:27.061102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:27.063582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:27.066347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:27.076951 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2234/4514] 10.222.0.32 () {58 vars in 1467 bytes} [Sat Dec 25 21:24:26 2021] HEAD /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:27.078985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:27.089745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1c48-9f48-402a-9e93-2e06a2eae3f4 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:27.095802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:27.096694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:27.097064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:27.097346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:27.104980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:27.109398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:27.115603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role dfc15b1a473246a3bc61db1f9f8d8ea8 was removed from group a0d4c467e5cb4c5ead94a8dd75455245 on project b9dafcb43eed4c70ac26ecfa77e255ca. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:27.115975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.116759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.156977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e7d750529245e89770ccd581163584'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.170488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e7d750529245e89770ccd581163584'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.178806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e7d750529245e89770ccd581163584'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.179525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e7d750529245e89770ccd581163584'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.241236 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2235/4515] 10.222.0.32 () {58 vars in 1469 bytes} [Sat Dec 25 21:24:27 2021] DELETE /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:27.245397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:27.246774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:27.331063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ece6-309a-4e27-85b5-27983cdbedb3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:27.336754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0814d9f2-8712-4639-b79c-6763daf10266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e7d750529245e89770ccd581163584'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.346873 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2281/4516] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:26 2021] DELETE /identity/v3/users/c3e7d750529245e89770ccd581163584 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:27.347078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:27.347078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:27.347078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:27.347363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/groups/a0d4c467e5cb4c5ead94a8dd75455245/users/21c7d289eb5247ca9798d0a54b1c0d94` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:27.348459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:27.348752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:27.349086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:27.353485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a0d4c467e5cb4c5ead94a8dd75455245, user_id=21c7d289eb5247ca9798d0a54b1c0d94)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:27.358785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:27.380865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:27.382244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:27.457532 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2282/4517] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:27.467993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '21c7d289eb5247ca9798d0a54b1c0d94'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:27.470061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:27.471811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:27.554229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f042e33-0e04-4a4b-90b2-a1614fc628c3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:27.561955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:27.564487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:27.564487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:27.564723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:27.577764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:27.579941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:27.582020 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2236/4518] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:24:27 2021] DELETE /identity/v3/groups/a0d4c467e5cb4c5ead94a8dd75455245/users/21c7d289eb5247ca9798d0a54b1c0d94 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:27.587956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:27.590175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:27.594833 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2283/4519] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:27.722928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec9f1-e8df-4916-a8ba-c97083e50e9a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:27.728287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:27.729299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:27.729591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:27.729890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:27.731967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:27.733064 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:27.733064 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:27.733064 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:27.733950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:27.914544 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2237/4520] 10.222.0.32 () {60 vars in 1380 bytes} [Sat Dec 25 21:24:27 2021] PUT /identity/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:27.921855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.032547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceebdd8-4eb7-408b-90d4-eab45b3da5a9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.041931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.043366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.043366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.043366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.045311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=a0d4c467e5cb4c5ead94a8dd75455245)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.046413 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:28.046413 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:28.046413 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:28.047535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.062922 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2284/4521] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:24:27 2021] GET /identity/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles => generated 376 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:28.066320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.077913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53ba3-4848-4518-b502-ffaa5f6d8d4b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.083326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.086161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.086161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.086161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.087404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.088284 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:28.088284 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:28.088284 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:28.089182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.096709 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2238/4522] 10.222.0.32 () {58 vars in 1362 bytes} [Sat Dec 25 21:24:28 2021] HEAD /identity/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:28.100600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.113709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8192d07-2649-4f77-99dd-379da3ae8568 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.118967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.120165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.120165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.120379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.122117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=a0d4c467e5cb4c5ead94a8dd75455245, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.123133 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:28.123133 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:28.123133 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:28.124281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.218946 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2285/4523] 10.222.0.32 () {58 vars in 1364 bytes} [Sat Dec 25 21:24:28 2021] DELETE /identity/v3/system/groups/a0d4c467e5cb4c5ead94a8dd75455245/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:28.223869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.236443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbac87-6f25-4125-ad7b-6c3cd9659e2e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.246469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.247746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.248065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.248372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.250890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a79d8adf202f429d819832a6af2ce70a, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.253536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.377944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.380609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:28.381456 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2239/4524] 10.222.0.32 () {60 vars in 1479 bytes} [Sat Dec 25 21:24:28 2021] PUT /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:28.386615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.487345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31590-a75d-4730-bbe2-4914af7742be tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.495965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729531f-9ddf-4506-ba43-40582d879a49 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.510495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.511462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.511760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.512045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.515383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a79d8adf202f429d819832a6af2ce70a, user_id=21c7d289eb5247ca9798d0a54b1c0d94)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.516506 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:28.516506 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:28.516506 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:28.518825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.535853 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2240/4525] 10.222.0.32 () {58 vars in 1361 bytes} [Sat Dec 25 21:24:28 2021] GET /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles => generated 409 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:28.540195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.554962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6304-71b0-4af6-b65a-c21e82e73bd5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.568639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.569907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.571466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.571466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.574204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a79d8adf202f429d819832a6af2ce70a, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.579357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.588086 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2241/4526] 10.222.0.32 () {58 vars in 1461 bytes} [Sat Dec 25 21:24:28 2021] HEAD /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:28.592182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.608998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb4c50-064a-4b08-b7ae-ddf9168f6cbc tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.617139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.619614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.620094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.623887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] PATH_INFO: `/v3/projects/396d6485ec1e422d9d0b4fc1a10a2c79` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.624057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.624730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] RBAC: Authorizing `identity:delete_project(project_id=396d6485ec1e422d9d0b4fc1a10a2c79)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.626878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.631922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.632210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.635076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.651487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a79d8adf202f429d819832a6af2ce70a, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.660347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.674280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role dfc15b1a473246a3bc61db1f9f8d8ea8 was removed from user 21c7d289eb5247ca9798d0a54b1c0d94 on domain a79d8adf202f429d819832a6af2ce70a. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:28.674575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:28.675331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:28.754364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396d6485ec1e422d9d0b4fc1a10a2c79', 'request_id': 'req-115c7723-3364-4b64-b521-3e2b9198809f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:28.817059 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2242/4527] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 21:24:28 2021] DELETE /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:28.823232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.824658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:28.828016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396d6485ec1e422d9d0b4fc1a10a2c79', 'request_id': 'req-115c7723-3364-4b64-b521-3e2b9198809f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:28.837456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396d6485ec1e422d9d0b4fc1a10a2c79', 'request_id': 'req-115c7723-3364-4b64-b521-3e2b9198809f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:28.850809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] The token cache is being invalidate because project 396d6485ec1e422d9d0b4fc1a10a2c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:28.851264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:28.851947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:28.854039 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2286/4528] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:28 2021] DELETE /identity/v3/projects/396d6485ec1e422d9d0b4fc1a10a2c79 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:28.857993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:28.859541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:28.901504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180d423-7a25-48e9-9a0d-204cb8e263c8 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:28.906528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:28.907410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:28.907692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:28.907965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:28.910461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:28.913710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:28.942605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c7723-3364-4b64-b521-3e2b9198809f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:29.015620 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2243/4529] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:28 2021] PUT /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:29.030415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:29.038153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:29.045743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:29.048574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:29.048574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:29.048574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] PATH_INFO: `/v3/users/cf412d9574584b7b83c436f7144b7f32` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:29.049491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf412d9574584b7b83c436f7144b7f32)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:29.052161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:29.146421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b2bf-5b39-475c-b8d9-cc0fd22d25c9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:29.151785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:29.152694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:29.158381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:29.158381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:29.158381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_grants(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:29.158381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:29.174740 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2244/4530] 10.222.0.32 () {58 vars in 1364 bytes} [Sat Dec 25 21:24:29 2021] GET /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles => generated 410 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:29.176310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:29.214010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e716ff-c3c8-435e-80d4-a8a08e996450 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:29.220799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:29.222078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:29.222362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:29.222640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:29.225308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:29.228793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:29.237771 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2245/4531] 10.222.0.32 () {58 vars in 1464 bytes} [Sat Dec 25 21:24:29 2021] HEAD /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:29.242215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:29.256171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c4615-d739-4efb-9046-0832e730b37a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:29.262351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:29.263283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:29.264116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:29.264116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:29.267352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b9dafcb43eed4c70ac26ecfa77e255ca, user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:29.286685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:29.286685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role dfc15b1a473246a3bc61db1f9f8d8ea8 was removed from user 21c7d289eb5247ca9798d0a54b1c0d94 on project b9dafcb43eed4c70ac26ecfa77e255ca. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:29.286685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:29.286685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:29.287471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf412d9574584b7b83c436f7144b7f32'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:29.288010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf412d9574584b7b83c436f7144b7f32'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:29.302096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf412d9574584b7b83c436f7144b7f32'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:29.302836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf412d9574584b7b83c436f7144b7f32'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:29.376677 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2246/4532] 10.222.0.32 () {58 vars in 1466 bytes} [Sat Dec 25 21:24:29 2021] DELETE /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:29.382126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:29.385459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:29.399583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf412d9574584b7b83c436f7144b7f32'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:29.411550 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2287/4533] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:28 2021] DELETE /identity/v3/users/cf412d9574584b7b83c436f7144b7f32 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:29.515214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657941c2-9ec8-464a-839f-35f3d8d60b90 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:29.613526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:29.614409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:29.614688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:29.614964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:29.618905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:29.618905 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:29.618905 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:29.618905 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:29.620012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:29.769286 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2247/4534] 10.222.0.32 () {60 vars in 1377 bytes} [Sat Dec 25 21:24:29 2021] PUT /identity/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:29.771420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:29.773528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:29.809468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e542cc-27ac-4c64-a3d7-8af2644b59dd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:29.816690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:29.817691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:29.819410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:29.819410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:29.820579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=21c7d289eb5247ca9798d0a54b1c0d94)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:29.822684 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:29.822684 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:29.822684 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:29.823770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:29.881239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2288/4535] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:24:29 2021] GET /identity/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles => generated 375 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:29.882209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:29.912575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d2532-0365-4b56-953d-9380b0571489 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:29.918412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:29.919294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:29.919577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:29.919857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:29.923593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:29.926877 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:29.926877 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:29.926877 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:29.931452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:29.971864 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2248/4536] 10.222.0.32 () {58 vars in 1359 bytes} [Sat Dec 25 21:24:29 2021] HEAD /identity/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:29.975931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:29.991564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757e88-33b0-4f0d-826f-20662df5059e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.001992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.002961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.003311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.003793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.009290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.011597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:30.015116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=21c7d289eb5247ca9798d0a54b1c0d94, role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.019465 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:30.019465 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:30.019465 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:30.021115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.115419 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2289/4537] 10.222.0.32 () {58 vars in 1361 bytes} [Sat Dec 25 21:24:29 2021] DELETE /identity/v3/system/users/21c7d289eb5247ca9798d0a54b1c0d94/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:30.120363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.136301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5bae5-a4f4-4475-be2e-c7feecbb0530 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.154353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.155047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.155320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.155604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.159022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.160942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.176425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7240f-2aed-4d9e-97e8-7e3e78392909 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.184919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.186221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.186751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.187041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] PATH_INFO: `/v3/projects/d83155e42c9244f590ef41de1f346737` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.188420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83155e42c9244f590ef41de1f346737)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.190747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.237128 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2290/4538] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/roles => generated 270 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:30.241473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.260272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6632-a948-4824-8582-838eca58143a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.276758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.278119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.279410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.279920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.281018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.283950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.353233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83155e42c9244f590ef41de1f346737', 'request_id': 'req-56150e30-5e5c-4f52-a63b-f34de8659a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:30.362153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83155e42c9244f590ef41de1f346737', 'request_id': 'req-56150e30-5e5c-4f52-a63b-f34de8659a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:30.387547 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2291/4539] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/roles => generated 270 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:30.388236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.398962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360738f5-1b50-45ed-afbd-1e847d1ddbf5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.444406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83155e42c9244f590ef41de1f346737', 'request_id': 'req-56150e30-5e5c-4f52-a63b-f34de8659a17'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:30.462638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] The token cache is being invalidate because project d83155e42c9244f590ef41de1f346737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:30.463010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:30.463634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56150e30-5e5c-4f52-a63b-f34de8659a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:30.475724 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2249/4540] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:30 2021] DELETE /identity/v3/projects/d83155e42c9244f590ef41de1f346737 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:30.475724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954595dd-07e1-498c-88b7-554e97dae2cc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.475724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954595dd-07e1-498c-88b7-554e97dae2cc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.475724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954595dd-07e1-498c-88b7-554e97dae2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.479300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.481216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.481831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.482450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/0920984f878049d0a9698af9bb4373f3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.484794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55fc8236e95c40829ce345e8a36fc1f2, implied_role_id=0920984f878049d0a9698af9bb4373f3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.486938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.497306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-954595dd-07e1-498c-88b7-554e97dae2cc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:30.498682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-954595dd-07e1-498c-88b7-554e97dae2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:30.583469 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2292/4541] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:30 2021] PUT /identity/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/0920984f878049d0a9698af9bb4373f3 => generated 531 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:30.587502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.589487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:30.603005 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2250/4542] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:30.604795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0d2a-afa6-4aac-abca-de85e40d75cf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.605272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0d2a-afa6-4aac-abca-de85e40d75cf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.605606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0d2a-afa6-4aac-abca-de85e40d75cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.632085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f95e0d2a-afa6-4aac-abca-de85e40d75cf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:30.636693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f95e0d2a-afa6-4aac-abca-de85e40d75cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:30.743661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66d95-90f1-42aa-8a4d-3b40aface092 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.755815 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2251/4543] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:30.757695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0d2a-afa6-4aac-abca-de85e40d75cf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.761855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.762680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.763116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.763640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.764968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.768026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.780425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0d2a-afa6-4aac-abca-de85e40d75cf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.788183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.789030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.789421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.793176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.793176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:30.793176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.794306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.812761 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2252/4544] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:30.814211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.827436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e02c3-9ac6-44cf-bd96-c83d453c1ca2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:30.833918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:30.834734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:30.835143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:30.835668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:30.837069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:30.839574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:30.881596 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2293/4545] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/domains => generated 276 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:30.886234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:30.976860 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2253/4546] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:30.979500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:31.059005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d6b5f-47d1-4639-9547-dd490217aa96 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.146546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b922-1891-4da7-95ce-4f202053828a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.159571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.160626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.161120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.161571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.162701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:31.166435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:31.196832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.197699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.197988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.198318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.199087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:31.200928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:31.261336 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2254/4547] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/users => generated 283 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:31.265372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:31.289352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499ab0-ec19-441d-9534-12e516903462 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.292404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.294335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.294921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.295469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.296186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:31.297997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:31.315050 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2255/4548] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:31 2021] GET /identity/v3/roles => generated 2323 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:31.328227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:31.344277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65dc42-bfba-4897-9f5a-4f2c44d63f1c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.349903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.350772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.351393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.351744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.353437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:31.355411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:31.367851 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2294/4549] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:30 2021] POST /identity/v3/roles => generated 269 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:31.368780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:31.386631 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2256/4550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:31 2021] GET /identity/v3/roles => generated 2323 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:31.390937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:31.406927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd7e4d-70a1-4d08-822a-dcfb136c1914 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.428034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62afcf-8102-41be-ac57-279550d72ccd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.439659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.443669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.444672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.445596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/98a87dc0aa214512944bfbc800d5c29f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.449670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5eb00-f68c-411e-8b3e-7e5dfc9a52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.451950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55fc8236e95c40829ce345e8a36fc1f2, implied_role_id=98a87dc0aa214512944bfbc800d5c29f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:31.452558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5eb00-f68c-411e-8b3e-7e5dfc9a52f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.459583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:31.459732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5eb00-f68c-411e-8b3e-7e5dfc9a52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.459732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5eb00-f68c-411e-8b3e-7e5dfc9a52f5 admin admin] PATH_INFO: `/v3/projects/3b9f8aa1c60a47598c04c07492161154/users/8135b83498a14d96be0fd8829283cdbd/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.496676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5eb00-f68c-411e-8b3e-7e5dfc9a52f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9f8aa1c60a47598c04c07492161154, user_id=8135b83498a14d96be0fd8829283cdbd, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:31.501024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5eb00-f68c-411e-8b3e-7e5dfc9a52f5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:31.572905 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2295/4551] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:31 2021] PUT /identity/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/98a87dc0aa214512944bfbc800d5c29f => generated 530 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:31.576138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:31.599310 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2257/4552] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:31 2021] PUT /identity/v3/projects/3b9f8aa1c60a47598c04c07492161154/users/8135b83498a14d96be0fd8829283cdbd/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:31.612297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.612649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.612902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.660542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] MFA Rules not processed for user `8135b83498a14d96be0fd8829283cdbd`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:31.663211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:31.713438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad736c76-f952-4748-8e1e-954738818576 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.813395 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2258/4553] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:31 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:31.827495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:31.832562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:31.855589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.857022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.857411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.857786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:31.859762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55fc8236e95c40829ce345e8a36fc1f2, implied_role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:31.864423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:31.974161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12cc1d-7467-4685-81a1-43c07695556b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:31.984856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:31.985584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:31.986431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:31.986772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:32.007216 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2296/4554] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:31 2021] PUT /identity/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 526 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:32.011353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:32.017537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:32.021000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:32.039429 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2259/4555] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:31 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:32.112588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1faaa2-d048-436a-9a5a-9dfe093c65b9 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:32.118816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:32.119768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:32.120054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:32.120328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/dfc15b1a473246a3bc61db1f9f8d8ea8/implies/55fc8236e95c40829ce345e8a36fc1f2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:32.132560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dfc15b1a473246a3bc61db1f9f8d8ea8, implied_role_id=55fc8236e95c40829ce345e8a36fc1f2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:32.132560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:32.184210 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] 55fc8236e95c40829ce345e8a36fc1f2 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 55fc8236e95c40829ce345e8a36fc1f2 cannot be an implied roles. Dec 25 21:24:32.186418 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2297/4556] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:32 2021] PUT /identity/v3/roles/dfc15b1a473246a3bc61db1f9f8d8ea8/implies/55fc8236e95c40829ce345e8a36fc1f2 => generated 116 bytes in 175 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:24:32.193020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:32.216765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1a894-6d9e-4727-a85e-1819efceaf91 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:32.224084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:32.225271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:32.225750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:32.226190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:32.231886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55fc8236e95c40829ce345e8a36fc1f2, implied_role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:32.234969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:32.346254 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2260/4557] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:32 2021] DELETE /identity/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:32.347652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:32.364915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7b42e-0ad0-40b2-85e6-e4998e84abb2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:32.500708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:32.501787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:32.502151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:32.502537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/98a87dc0aa214512944bfbc800d5c29f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:32.504889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55fc8236e95c40829ce345e8a36fc1f2, implied_role_id=98a87dc0aa214512944bfbc800d5c29f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:32.506271 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:32.506271 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:32.506271 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:32.507342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:32.634404 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2298/4558] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:32 2021] DELETE /identity/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/98a87dc0aa214512944bfbc800d5c29f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:32.635381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:32.651117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe0a80-b8a1-479b-8988-1b737ba0a315 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:32.787208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:32.788831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:32.789337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:32.790334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/98a87dc0aa214512944bfbc800d5c29f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:32.802604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=98a87dc0aa214512944bfbc800d5c29f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:32.803272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:33.028639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 98a87dc0aa214512944bfbc800d5c29f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:33.028639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.028639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.034485 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2261/4559] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:32 2021] DELETE /identity/v3/roles/98a87dc0aa214512944bfbc800d5c29f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:33.039378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:33.041451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:33.059926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0da6-c02e-439f-98c9-63ba6987a4a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:33.188228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:33.190407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:33.190697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:33.191022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/57cf08c5a7a24c149663afc80b6f67e9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:33.215930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=57cf08c5a7a24c149663afc80b6f67e9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:33.218851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:33.263407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.264684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.299549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:33.301031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:33.416629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.419040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.423496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2299/4560] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:24:33 2021] PATCH /identity/v3/domains/57cf08c5a7a24c149663afc80b6f67e9 => generated 277 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:33.429145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:33.433969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:33.465904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a7161-4536-408a-83d9-fbff04283f7a tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:33.585732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:33.586846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:33.587131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:33.587405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] PATH_INFO: `/v3/users/8135b83498a14d96be0fd8829283cdbd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:33.591315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8135b83498a14d96be0fd8829283cdbd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:33.596388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:33.606311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5de0-e707-413a-870e-d40f22466ecd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:33.624201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:33.625296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:33.625584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:33.625863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/57cf08c5a7a24c149663afc80b6f67e9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:33.653702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=57cf08c5a7a24c149663afc80b6f67e9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:33.655515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:33.717816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.746241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.929672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9', 'request_id': 'req-c9813332-200c-4712-89b9-4a365c5842e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.931571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8135b83498a14d96be0fd8829283cdbd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.947582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8135b83498a14d96be0fd8829283cdbd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.975344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8135b83498a14d96be0fd8829283cdbd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.976315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8135b83498a14d96be0fd8829283cdbd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:33.977749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-38a6b57a-0177-4734-90f3-8cce8da16970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8135b83498a14d96be0fd8829283cdbd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.027685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9', 'request_id': 'req-c9813332-200c-4712-89b9-4a365c5842e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.040908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9', 'request_id': 'req-c9813332-200c-4712-89b9-4a365c5842e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.061764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] The token cache is being invalidate because project 57cf08c5a7a24c149663afc80b6f67e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:34.063148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.064518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.098290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9', 'request_id': 'req-c9813332-200c-4712-89b9-4a365c5842e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.099647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9', 'request_id': 'req-c9813332-200c-4712-89b9-4a365c5842e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.100357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '57cf08c5a7a24c149663afc80b6f67e9', 'request_id': 'req-c9813332-200c-4712-89b9-4a365c5842e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.114995 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2262/4561] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:33 2021] DELETE /identity/v3/users/8135b83498a14d96be0fd8829283cdbd => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:34.120177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:34.120594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:34.121017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:34.121518 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2300/4562] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:24:33 2021] DELETE /identity/v3/domains/57cf08c5a7a24c149663afc80b6f67e9 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:34.125410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:34.127166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:34.162950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:34.162950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:34.300314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813332-200c-4712-89b9-4a365c5842e5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:34.305898 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2263/4563] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:34.400922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:34.401874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:34.402270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:34.402902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/0920984f878049d0a9698af9bb4373f3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:34.404861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55fc8236e95c40829ce345e8a36fc1f2, implied_role_id=0920984f878049d0a9698af9bb4373f3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:34.406684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:34.420373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:34.426270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:34.540132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe9306-9629-47f6-869b-4e4fced81a46 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:34.556440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:34.558116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:34.558574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:34.559072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:34.577671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:34.579233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:34.590266 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2301/4564] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:34 2021] DELETE /identity/v3/roles/55fc8236e95c40829ce345e8a36fc1f2/implies/0920984f878049d0a9698af9bb4373f3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:34.594169 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2264/4565] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:34.595178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:34.689018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670da26-bc00-4edb-908c-1544c9144371 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:34.697862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:34.699542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:34.699826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:34.700102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/0920984f878049d0a9698af9bb4373f3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:34.702889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0920984f878049d0a9698af9bb4373f3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:34.704560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:34.823243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 0920984f878049d0a9698af9bb4373f3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:34.824552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.825775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:34.828768 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2302/4566] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:34 2021] DELETE /identity/v3/roles/0920984f878049d0a9698af9bb4373f3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:34.832859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:34.845813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92983b-f77c-42f7-a8c5-e4a638670cd8 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:34.905523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:34.906441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:34.906721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:34.907002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/55fc8236e95c40829ce345e8a36fc1f2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:34.908307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=55fc8236e95c40829ce345e8a36fc1f2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:34.909969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.044223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 55fc8236e95c40829ce345e8a36fc1f2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:35.044223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:35.044223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:35.045222 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2265/4567] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:34 2021] DELETE /identity/v3/roles/55fc8236e95c40829ce345e8a36fc1f2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:35.050883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:35.052523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:35.075752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70485a1-f351-4ad5-a2cb-5db7ed89abac tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:35.173547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:35.174394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:35.175049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:35.175182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:35.183450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:35.185281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.276999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:35.278965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:35.282830 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2303/4568] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:35 2021] PUT /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 520 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:35.294899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336886f-d0de-4f62-8510-eb746af50a63 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:35.386130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:35.387236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:35.387526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:35.387806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:35.392940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:35.394403 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:35.394403 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:35.394403 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:35.395512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.396615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:35.400724 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:35.400724 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:35.400724 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:35.400724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.409789 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2266/4569] 10.222.0.32 () {58 vars in 1344 bytes} [Sat Dec 25 21:24:35 2021] HEAD /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:35.417352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:35.440665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd77b9-5628-4333-afae-36746b89dadf tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:35.452663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:35.453801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:35.454183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:35.454561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:35.458642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:35.460083 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:35.460083 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:35.460083 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:35.462861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.482044 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2304/4570] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:24:35 2021] GET /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 520 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:35.486504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:35.505492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ad59-7749-4d8c-90fc-796d893179f7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:35.511937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:35.513031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:35.513415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:35.513797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:35.518315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:35.526538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.556538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:35.558415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:35.641128 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2267/4571] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:35 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:35.642510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:35.646294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:35.675630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3134-1fdf-4284-b1bc-a2520949841d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:35.752809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:35.754303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:35.755295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:35.755573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] PATH_INFO: `/v3/projects/3b9f8aa1c60a47598c04c07492161154` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:35.758139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9f8aa1c60a47598c04c07492161154)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:35.760109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.773494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9e491-6530-44bb-8917-5c40caf86356 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:35.781859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:35.783071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:35.783419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:35.783756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] PATH_INFO: `/v3/users/97abfab761214f10bb25fbf8ba958822` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:35.785109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97abfab761214f10bb25fbf8ba958822)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:35.787794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:35.940533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9f8aa1c60a47598c04c07492161154', 'request_id': 'req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.003849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97abfab761214f10bb25fbf8ba958822'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.011640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97abfab761214f10bb25fbf8ba958822'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.025633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97abfab761214f10bb25fbf8ba958822'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.026039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97abfab761214f10bb25fbf8ba958822'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.026717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3adfc6f9-bdcb-42e5-a1eb-c0cdeb9e4018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97abfab761214f10bb25fbf8ba958822'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.046065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9f8aa1c60a47598c04c07492161154', 'request_id': 'req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.053020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9f8aa1c60a47598c04c07492161154', 'request_id': 'req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.065184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] The token cache is being invalidate because project 3b9f8aa1c60a47598c04c07492161154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:36.065477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.066155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.067876 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2305/4572] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:35 2021] DELETE /identity/v3/projects/3b9f8aa1c60a47598c04c07492161154 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:36.073861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.075337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:36.140547 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2268/4573] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:35 2021] DELETE /identity/v3/users/97abfab761214f10bb25fbf8ba958822 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:36.146831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7f26d-0ee0-447e-bbf9-4a2cee945d2d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.157167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f28db-fa21-4326-94e0-0ea97a6a8d92 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.157788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f28db-fa21-4326-94e0-0ea97a6a8d92 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.158265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f28db-fa21-4326-94e0-0ea97a6a8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.190977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b07f28db-fa21-4326-94e0-0ea97a6a8d92 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:36.193093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b07f28db-fa21-4326-94e0-0ea97a6a8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:36.224961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.226093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.227478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.227783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.230826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.232126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.266620 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] 573f249f1a7c463fbbeb36646de2eeeb does not imply d6684387d7ed4f0f822078efbaf8ac7d.: keystone.exception.ImpliedRoleNotFound: 573f249f1a7c463fbbeb36646de2eeeb does not imply d6684387d7ed4f0f822078efbaf8ac7d. Dec 25 21:24:36.271657 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2306/4574] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:24:36 2021] GET /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 137 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:24:36.272893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.280446 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2269/4575] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:36.288678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc52-7360-403a-a700-7c1568461a84 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.293344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc52-7360-403a-a700-7c1568461a84 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.293344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58bc52-7360-403a-a700-7c1568461a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.296464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fe0fd-db14-4430-b4f1-d0367173e349 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.305073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.306607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.306607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.309501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.309501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.311362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.323166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8c58bc52-7360-403a-a700-7c1568461a84 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:36.325943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8c58bc52-7360-403a-a700-7c1568461a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:36.326757 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] 573f249f1a7c463fbbeb36646de2eeeb does not imply d6684387d7ed4f0f822078efbaf8ac7d.: keystone.exception.ImpliedRoleNotFound: 573f249f1a7c463fbbeb36646de2eeeb does not imply d6684387d7ed4f0f822078efbaf8ac7d. Dec 25 21:24:36.328678 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2307/4576] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:36 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 137 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:24:36.333406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.349233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ecd9a-729d-4590-bd31-0b1cef4d8e8b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.352462 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2270/4577] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:36.356646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bc52-7360-403a-a700-7c1568461a84 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.366273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.367606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.367863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.369073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.371579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.373565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.374334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58bc52-7360-403a-a700-7c1568461a84 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.384375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.384494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.384773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.385075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.385865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:36.386179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.387807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.400565 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2271/4578] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:36.411223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.421809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed806de-4732-410e-9beb-87a04cef3f94 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.426478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.427126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.427408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.427687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.428382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.430338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.541798 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2308/4579] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:36 2021] PUT /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 520 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:36.544250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.546298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:36.559599 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2272/4580] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:36 2021] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:36.559599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.629253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92217126-7084-4074-92da-de22db4d78a2 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.669635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bcf75-09f1-4fed-8cf6-aca4fd56a7ca admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.676588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.678573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.678726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.682723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.682723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=cceccb9a484f4301840529a24efc10ed)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.683525 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:36.683525 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:36.683525 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:36.684734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.702782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.703817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.704139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.704416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] PATH_INFO: `/v3/projects/af127d2683f84f0682595fe8297db6b1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.705696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af127d2683f84f0682595fe8297db6b1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.710707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.794929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2273/4581] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:36 2021] PUT /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed => generated 520 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:36.795828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:36.863975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af127d2683f84f0682595fe8297db6b1', 'request_id': 'req-0a745bdb-6680-4bc9-8aa1-54e3a1737811'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.884518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4a5f7-4cd6-4ebc-a582-76fd9f24ae82 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:36.959374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af127d2683f84f0682595fe8297db6b1', 'request_id': 'req-0a745bdb-6680-4bc9-8aa1-54e3a1737811'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.965029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc7c70-db7b-4263-ad79-9cde00ddba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:36.965842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7c70-db7b-4263-ad79-9cde00ddba97 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:36.966402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7c70-db7b-4263-ad79-9cde00ddba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:36.966753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7c70-db7b-4263-ad79-9cde00ddba97 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:36.967566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc7c70-db7b-4263-ad79-9cde00ddba97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:36.967973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af127d2683f84f0682595fe8297db6b1', 'request_id': 'req-0a745bdb-6680-4bc9-8aa1-54e3a1737811'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.969842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc7c70-db7b-4263-ad79-9cde00ddba97 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:36.997235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] The token cache is being invalidate because project af127d2683f84f0682595fe8297db6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:36.997629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:36.998558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:37.001213 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2309/4582] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:36 2021] DELETE /identity/v3/projects/af127d2683f84f0682595fe8297db6b1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:37.002151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.003570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:37.110589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745bdb-6680-4bc9-8aa1-54e3a1737811 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.116262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.117369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.118644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.119127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.121586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=cceccb9a484f4301840529a24efc10ed, implied_role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.123508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.160112 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2274/4583] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:36 2021] POST /identity/v3/users => generated 292 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:37.162157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.162475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.162757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.188716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:37.189889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:37.198767 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2275/4584] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:37.199620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.200931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:37.212552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03560e-138f-49f9-9d5d-5c0835baf9c7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.218821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54284880-f8a7-42d9-9b42-d3004c388ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.220405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54284880-f8a7-42d9-9b42-d3004c388ffb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.220405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54284880-f8a7-42d9-9b42-d3004c388ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.220593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54284880-f8a7-42d9-9b42-d3004c388ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.221501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54284880-f8a7-42d9-9b42-d3004c388ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.223566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54284880-f8a7-42d9-9b42-d3004c388ffb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.241519 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2276/4585] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:37 2021] GET /identity/v3/roles => generated 2323 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:37.241519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290021-af91-477c-b3fa-33bd8e4b0101 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.241519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290021-af91-477c-b3fa-33bd8e4b0101 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.241519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290021-af91-477c-b3fa-33bd8e4b0101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.263291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-52290021-af91-477c-b3fa-33bd8e4b0101 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:37.264577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-52290021-af91-477c-b3fa-33bd8e4b0101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:37.275926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2310/4586] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:37 2021] PUT /identity/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 521 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:37.277240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.279830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2277/4587] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:37.280643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52290021-af91-477c-b3fa-33bd8e4b0101 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.292047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52290021-af91-477c-b3fa-33bd8e4b0101 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.357533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e50fb-6560-4358-8219-31f548151de7 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.363455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.363663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.364274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.364487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.364689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.364798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.364996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.365371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.365929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.366454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.368445 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:37.368445 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:37.368445 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:37.369035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.370240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.384396 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2311/4588] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:37 2021] GET /identity/v3/roles => generated 2323 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:37.385110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.392039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2278/4589] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:24:37 2021] GET /identity/v3/role_inferences => generated 1607 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:37.392545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.398684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cfb71-e142-459e-9199-b59b33d62f7e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.403479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.403653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd07b5-6c26-44c3-b7b5-c43a333c6fbd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.404208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.404552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.404839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.405633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:37.405947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.407567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.409028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.410051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.410440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.411109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] PATH_INFO: `/v3/projects/8a091e06d57243b49dee854809c30dd5/users/22804fe0bc4948e08d0ceafc6b99d0f0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.422277 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2312/4590] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:37.426940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.428200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a091e06d57243b49dee854809c30dd5, user_id=22804fe0bc4948e08d0ceafc6b99d0f0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.431544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.439120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5beae3-74be-426f-bf81-22f46b35f7b7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.444050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948ec54-6696-4ac0-bb50-4f8bfbf47d93 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.445112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948ec54-6696-4ac0-bb50-4f8bfbf47d93 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.446045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948ec54-6696-4ac0-bb50-4f8bfbf47d93 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.446404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948ec54-6696-4ac0-bb50-4f8bfbf47d93 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.448276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948ec54-6696-4ac0-bb50-4f8bfbf47d93 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=cceccb9a484f4301840529a24efc10ed, implied_role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.449998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948ec54-6696-4ac0-bb50-4f8bfbf47d93 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.491581 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2279/4591] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:37 2021] PUT /identity/v3/projects/8a091e06d57243b49dee854809c30dd5/users/22804fe0bc4948e08d0ceafc6b99d0f0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:37.492792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.514862 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2313/4592] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:37 2021] DELETE /identity/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:37.517293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c156c1-69cb-4758-8854-29d3f6e4e382 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.517949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c156c1-69cb-4758-8854-29d3f6e4e382 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.524534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c156c1-69cb-4758-8854-29d3f6e4e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.566735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da84bb6-c250-484a-8332-34c89046175e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.570567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d8c156c1-69cb-4758-8854-29d3f6e4e382 None None] MFA Rules not processed for user `22804fe0bc4948e08d0ceafc6b99d0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:37.574864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d8c156c1-69cb-4758-8854-29d3f6e4e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:37.634214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.635430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.635953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.636385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.637146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.639974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.659609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2314/4593] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:37 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:37.664023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c156c1-69cb-4758-8854-29d3f6e4e382 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.730742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c156c1-69cb-4758-8854-29d3f6e4e382 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.735647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.736563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.736850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.737156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.738900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=cceccb9a484f4301840529a24efc10ed)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.740530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.787464 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2280/4594] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:37 2021] POST /identity/v3/projects => generated 371 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:37.787464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.846505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64e632-276b-43cb-9afc-0bba71ddb108 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.853373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.854027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.854332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.854727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.855289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.857577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.861820 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2315/4595] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:37 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:37.862665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:37.945061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e675a-d571-4687-91fc-f008258f4889 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:37.949942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:37.950616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:37.950895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:37.951167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:37.951868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:37.953842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:37.984923 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2281/4596] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:37 2021] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:37.985963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.071311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b558b4-5819-4c5e-875d-e9855b4db716 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.084826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.086920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.089154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.089154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.090781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.093479 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2316/4597] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:37 2021] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:38.093881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.095394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.128403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56f7e-901f-4428-9986-47d96918280b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.172219 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2282/4598] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:37 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:38.173054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.295684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.296795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.297359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.298068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.299917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.303887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426ae1b-fe9a-4074-85da-6fe86f1d6fc3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.305362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.326042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.326762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.327005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.327282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.328030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.329764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.359168 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2283/4599] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:38 2021] GET /identity/v3/roles => generated 2323 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:38.360261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.406222 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2317/4600] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:38 2021] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:38.409850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.422952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e83f2-faf5-4729-8e7a-0eabb8554728 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.428040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.428752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.429091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.429509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.430272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.432439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.449203 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2318/4601] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:38 2021] GET /identity/v3/roles => generated 2323 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:38.449203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.456542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffd82e-7dd7-47fd-b548-497387da5a44 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.458005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd8138-7cb2-47be-b2d7-894c3d15d983 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.467277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.468104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.468391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.468685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.469450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.470496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.471141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.471399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.471759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.473262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.474087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.476555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.490162 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2319/4602] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:38 2021] GET /identity/v3/roles => generated 2323 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:38.491326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.507400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623d258-f7fc-4a22-923d-5f39882048a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.508500 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2284/4603] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:38 2021] GET /identity/v3/roles => generated 2323 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:38.508500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.521311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.522782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40229e3-0673-4205-921f-bf155177c584 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.522899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.523464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.524421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] PATH_INFO: `/v3/projects/352ec3feac38422a973bdc8134d9678b/users/66cffeb0cda44ffbb26d9cbf29e325d0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.528243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.530033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.530403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.530752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.531577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.534707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.547347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=352ec3feac38422a973bdc8134d9678b, user_id=66cffeb0cda44ffbb26d9cbf29e325d0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.550983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.555550 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2285/4604] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:38 2021] GET /identity/v3/roles => generated 2323 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:38.555550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.568123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89785bcd-ac32-45e6-b37f-49a86fa4cd56 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.578676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806d63-c6a6-43ea-b689-c8d15a894bf1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.580085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806d63-c6a6-43ea-b689-c8d15a894bf1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.580466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806d63-c6a6-43ea-b689-c8d15a894bf1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.580829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806d63-c6a6-43ea-b689-c8d15a894bf1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.581692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806d63-c6a6-43ea-b689-c8d15a894bf1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.583367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806d63-c6a6-43ea-b689-c8d15a894bf1 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.650264 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2320/4605] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:38 2021] PUT /identity/v3/projects/352ec3feac38422a973bdc8134d9678b/users/66cffeb0cda44ffbb26d9cbf29e325d0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:38.652407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.676288 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2286/4606] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:24:38 2021] POST /identity/v3/roles => generated 234 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:38.676288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e279a9-998a-489b-a9f3-54abad6e89b4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.676288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e279a9-998a-489b-a9f3-54abad6e89b4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.676288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e279a9-998a-489b-a9f3-54abad6e89b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.734403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c9e279a9-998a-489b-a9f3-54abad6e89b4 None None] MFA Rules not processed for user `66cffeb0cda44ffbb26d9cbf29e325d0`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:38.738182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c9e279a9-998a-489b-a9f3-54abad6e89b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:38.796233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3b731-5c52-4ad5-89a8-6b6e420be11e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.801656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.802808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.803186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.803684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] PATH_INFO: `/v3/projects/c16db4ecd33749a9aa596352d01cea65/users/465ac76ed2034ecab62a8c35976aacf0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.825506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16db4ecd33749a9aa596352d01cea65, user_id=465ac76ed2034ecab62a8c35976aacf0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.829187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.840968 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2287/4607] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:38 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:38.842136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e279a9-998a-489b-a9f3-54abad6e89b4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.918263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e279a9-998a-489b-a9f3-54abad6e89b4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:38.926989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d3d3f-b7ec-4458-9306-172908a18ed6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:38.927873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3d3f-b7ec-4458-9306-172908a18ed6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:38.928795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3d3f-b7ec-4458-9306-172908a18ed6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:38.929135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3d3f-b7ec-4458-9306-172908a18ed6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/98bdb6713ddb43e3ba0c291d4f25a8fd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:38.931455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d3d3f-b7ec-4458-9306-172908a18ed6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:update_role(role_id=98bdb6713ddb43e3ba0c291d4f25a8fd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:38.932594 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-c03d3d3f-b7ec-4458-9306-172908a18ed6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:38.932594 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:38.932594 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:38.933531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d3d3f-b7ec-4458-9306-172908a18ed6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:38.974069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2321/4608] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:38 2021] PUT /identity/v3/projects/c16db4ecd33749a9aa596352d01cea65/users/465ac76ed2034ecab62a8c35976aacf0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:38.981926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:38.983768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:39.070280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3be627-1366-4fe1-bf69-9471245e9bf5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.092727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.095327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.096697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.097336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.098715 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2288/4609] 10.222.0.32 () {60 vars in 1242 bytes} [Sat Dec 25 21:24:38 2021] PATCH /identity/v3/roles/98bdb6713ddb43e3ba0c291d4f25a8fd => generated 238 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:39.100436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80086c0-c5e6-4325-9e63-706f1c305b4f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.100823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80086c0-c5e6-4325-9e63-706f1c305b4f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.101309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80086c0-c5e6-4325-9e63-706f1c305b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.136452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c80086c0-c5e6-4325-9e63-706f1c305b4f None None] MFA Rules not processed for user `465ac76ed2034ecab62a8c35976aacf0`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:39.138466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c80086c0-c5e6-4325-9e63-706f1c305b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:39.182025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.183651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.198959 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2322/4610] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:38 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:39.199810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.203572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:39.223134 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2289/4611] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:39 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:39.225368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80086c0-c5e6-4325-9e63-706f1c305b4f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.230644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84aae-7724-48a8-8b98-a9f066eae94a service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.246599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.247266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.247546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.247831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.252410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:39.311643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80086c0-c5e6-4325-9e63-706f1c305b4f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.318041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.319114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.319409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.319821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/98bdb6713ddb43e3ba0c291d4f25a8fd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.321419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.323272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.331862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:get_role(role_id=98bdb6713ddb43e3ba0c291d4f25a8fd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.333516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.334942 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2290/4612] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:24:39 2021] GET /identity/v3/roles/98bdb6713ddb43e3ba0c291d4f25a8fd => generated 238 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:39.335808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.337548 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2323/4613] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:39 2021] GET /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:39.340196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.356820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3babcb-2bce-460b-9364-c4392a8d959b service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.362922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.363968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.364333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.364627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.365510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.367398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.384408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2324/4614] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:39 2021] GET /identity/v3/roles => generated 2552 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:39.388704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.415058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573296bf-485b-48b4-b59b-6903299ec324 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.429765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.430786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.431180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.431861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/98bdb6713ddb43e3ba0c291d4f25a8fd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.433866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_role(role_id=98bdb6713ddb43e3ba0c291d4f25a8fd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.435690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a770a37-2b0e-4198-9943-4e46d1237ba3 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.436852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.440780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.441770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.442054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.442336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.443069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.445108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.554550 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2291/4615] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:39 2021] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:39.561549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.622981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 98bdb6713ddb43e3ba0c291d4f25a8fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:39.630621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:39.630621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:39.630859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a984ef-0b97-4ce8-b29e-dbdc600dc35b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.630950 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2325/4616] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:39 2021] DELETE /identity/v3/roles/98bdb6713ddb43e3ba0c291d4f25a8fd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:39.631042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.631206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.631504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.631844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.632558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.634151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.635208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.636420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:39.739235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070494e0-efe2-4e1b-91e7-b2a3ebcfd21e tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.744534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.745499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.745791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.746211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.748185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.749867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.752325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2292/4617] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:39 2021] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:39.756003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.762633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:39.778772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9e433-7dfb-41df-abff-819199372915 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.861118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.862085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.862400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.862929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.863672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.865313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.883930 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2293/4618] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:39 2021] GET /identity/v3/roles => generated 2323 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:39.888185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:39.901009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133161b-30ef-4c0a-96db-d191da7cce85 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:39.909254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:39.910087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:39.910374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:39.910651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] PATH_INFO: `/v3/projects/53b80d53bc6e4121b08f23b979a11f31/users/e082c308db82468cbe79e07337e27acb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:39.930890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b80d53bc6e4121b08f23b979a11f31, user_id=e082c308db82468cbe79e07337e27acb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:39.933692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:39.964423 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2326/4619] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:39 2021] PUT /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 520 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:39.966268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.078935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d6a6c-648e-4a3b-a3a8-8f9d2d2e538b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.084339 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2294/4620] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:39 2021] PUT /identity/v3/projects/53b80d53bc6e4121b08f23b979a11f31/users/e082c308db82468cbe79e07337e27acb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:40.085595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.175452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019eb0-061a-48d1-8330-17ab24508d7b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.181758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.181995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.183193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.183660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.183660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.183859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.184348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.184833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.185113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.190257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.192322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=cceccb9a484f4301840529a24efc10ed)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.198093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.209264 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2295/4621] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:40 2021] GET /identity/v3/roles => generated 2323 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:40.210189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.226099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e50e1-1a11-42cd-b30d-b0c16580b259 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.232712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542b1a-59e9-47d9-9230-a0660d2aed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.234220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542b1a-59e9-47d9-9230-a0660d2aed2a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.234502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542b1a-59e9-47d9-9230-a0660d2aed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.235137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542b1a-59e9-47d9-9230-a0660d2aed2a admin admin] PATH_INFO: `/v3/projects/53b80d53bc6e4121b08f23b979a11f31/users/e082c308db82468cbe79e07337e27acb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.237052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542b1a-59e9-47d9-9230-a0660d2aed2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b80d53bc6e4121b08f23b979a11f31, user_id=e082c308db82468cbe79e07337e27acb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.239789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542b1a-59e9-47d9-9230-a0660d2aed2a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.260177 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2296/4622] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:40 2021] PUT /identity/v3/projects/53b80d53bc6e4121b08f23b979a11f31/users/e082c308db82468cbe79e07337e27acb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:40.271144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.271596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.271887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.307375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] MFA Rules not processed for user `e082c308db82468cbe79e07337e27acb`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:40.309845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:40.345405 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2327/4623] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:39 2021] PUT /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed => generated 520 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:40.349207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.410735 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2297/4624] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:40 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:40.427550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.429533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:40.431508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24acb1-8f6d-40b5-b6d1-581af557d5f5 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.437383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.438570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.438908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.439244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.441264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=cceccb9a484f4301840529a24efc10ed, implied_role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.443053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.496775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb882fc-4f03-4e2c-b4e4-be382a4a0a79 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.547192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2328/4625] 10.222.0.32 () {60 vars in 1362 bytes} [Sat Dec 25 21:24:40 2021] PUT /identity/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 521 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:40.549430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.572084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.573286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.573686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.574035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.576198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:40.649611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.651408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.670516 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2298/4626] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:40 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:40.693899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f97c8-715c-4b68-b516-5bf1d9807dd6 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.699959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.701017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.701440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.701719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/cceccb9a484f4301840529a24efc10ed/implies` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.702913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=cceccb9a484f4301840529a24efc10ed)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.704000 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:40.704000 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:40.704000 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:40.704965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.716440 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2329/4627] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:40 2021] GET /identity/v3/roles/cceccb9a484f4301840529a24efc10ed/implies => generated 490 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:40.720402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.733773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b771f3-5377-49cc-9fc0-18e85082af85 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.739092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.740166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.740525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.740864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.742729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.744026 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:40.744026 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:40.744026 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:40.745111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.753940 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2299/4628] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:40 2021] GET /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies => generated 660 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:40.758363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.769161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a3b44-09b7-4aeb-81a5-a4f0f7dc2d48 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.774045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.775105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.775442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.775721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.777588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=cceccb9a484f4301840529a24efc10ed, implied_role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.780560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:40.893003 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2330/4629] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:40 2021] DELETE /identity/v3/roles/cceccb9a484f4301840529a24efc10ed/implies/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:40.897340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:40.907907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e6bc4-a954-417f-b033-4c3f504786fd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:40.969554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:40.970553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:40.970763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:40.975139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:40.975139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=cceccb9a484f4301840529a24efc10ed)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:40.975139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:41.068350 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2300/4630] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:40 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/cceccb9a484f4301840529a24efc10ed => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:41.072810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:41.083262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6fed6-8fe9-47a0-b3db-dc578b4ff352 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:41.142555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:41.143574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:41.143865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:41.144145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:41.145894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=573f249f1a7c463fbbeb36646de2eeeb, implied_role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:41.147490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:41.240921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2331/4631] 10.222.0.32 () {58 vars in 1346 bytes} [Sat Dec 25 21:24:41 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb/implies/d6684387d7ed4f0f822078efbaf8ac7d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:41.246734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:41.257518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11376b79-cb9f-46f9-8ace-a64598ca8165 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:41.316421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:41.317703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:41.317994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:41.318434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/57cf08c5a7a24c149663afc80b6f67e9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:41.326694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:24:41.338262 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Could not find domain: 57cf08c5a7a24c149663afc80b6f67e9.: keystone.exception.DomainNotFound: Could not find domain: 57cf08c5a7a24c149663afc80b6f67e9. Dec 25 21:24:41.339266 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2301/4632] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:24:41 2021] PATCH /identity/v3/domains/57cf08c5a7a24c149663afc80b6f67e9 => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:24:41.345882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:41.362052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d0719-1f8f-4a3a-85a7-4f133b647c6b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:41.369228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:41.370230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:41.370592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:41.371368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/users/21c7d289eb5247ca9798d0a54b1c0d94` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:41.372978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_user(user_id=21c7d289eb5247ca9798d0a54b1c0d94)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:41.374725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:41.542533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c7d289eb5247ca9798d0a54b1c0d94'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:41.551772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c7d289eb5247ca9798d0a54b1c0d94'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:41.563715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c7d289eb5247ca9798d0a54b1c0d94'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:41.564534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c7d289eb5247ca9798d0a54b1c0d94'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:41.618259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e6472592-487a-4b9b-8708-ebecd91d102b tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c7d289eb5247ca9798d0a54b1c0d94'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:41.625399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2332/4633] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:41 2021] DELETE /identity/v3/users/21c7d289eb5247ca9798d0a54b1c0d94 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:41.629824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:41.631192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:41.646422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269b3f-1058-4987-a809-4adf4c93bebd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:41.707444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:41.708307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:41.708646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:41.708979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/dfc15b1a473246a3bc61db1f9f8d8ea8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:41.710746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dfc15b1a473246a3bc61db1f9f8d8ea8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:41.712495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:41.849906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:41.850194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:41.850550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:41.869595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role dfc15b1a473246a3bc61db1f9f8d8ea8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:41.870294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:41.871302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:41.872214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:41.873557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:41.874271 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2302/4634] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:41 2021] DELETE /identity/v3/roles/dfc15b1a473246a3bc61db1f9f8d8ea8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:41.877833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:41.881045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:41.951482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334d5eb-0bf4-4ead-9927-de032de3b3bd tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:41.955281 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2333/4635] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:24:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:41.957306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:41.966238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:41.966536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:41.966817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/groups/a0d4c467e5cb4c5ead94a8dd75455245` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:41.968291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a0d4c467e5cb4c5ead94a8dd75455245)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:41.970574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:41.972725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:41.974187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:42.116159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c39f3-0900-4fd9-9db5-36c578b343e9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:42.116159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:42.116159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:42.116159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:42.118701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:42.118701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:42.118701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:42.118701 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2334/4636] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:24:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:42.172808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2303/4637] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:24:41 2021] DELETE /identity/v3/groups/a0d4c467e5cb4c5ead94a8dd75455245 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:42.177049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:42.189576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4aef5-8dd6-443d-9aee-a5a5666b72db service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:42.283261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:42.283261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:42.283261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:42.284388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:42.284388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9dafcb43eed4c70ac26ecfa77e255ca)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:42.284388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:42.420716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dafcb43eed4c70ac26ecfa77e255ca', 'request_id': 'req-135f5959-f3f0-4d1b-ab83-b19daa16c3db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.544666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dafcb43eed4c70ac26ecfa77e255ca', 'request_id': 'req-135f5959-f3f0-4d1b-ab83-b19daa16c3db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.552148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dafcb43eed4c70ac26ecfa77e255ca', 'request_id': 'req-135f5959-f3f0-4d1b-ab83-b19daa16c3db'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.564300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] The token cache is being invalidate because project b9dafcb43eed4c70ac26ecfa77e255ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:42.564715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.565544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.567271 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2335/4638] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:42 2021] DELETE /identity/v3/projects/b9dafcb43eed4c70ac26ecfa77e255ca => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:42.571977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:42.573837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:42.586958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b7c7-e47b-42f7-b26d-6e48825bfc11 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:42.645766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:42.646523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:42.646936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:42.647408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:42.648811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a79d8adf202f429d819832a6af2ce70a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:42.653185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:42.672494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.678612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.805950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.807624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.815297 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2304/4639] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:24:42 2021] PATCH /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a => generated 276 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:42.825034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:42.837472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f5959-f3f0-4d1b-ab83-b19daa16c3db tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:42.905439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:42.905439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:42.905439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:42.905877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/domains/a79d8adf202f429d819832a6af2ce70a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:42.912600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a79d8adf202f429d819832a6af2ce70a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:42.914303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:42.937904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:42.967015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.068667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a', 'request_id': 'req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.279261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a', 'request_id': 'req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.288240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a', 'request_id': 'req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.306336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] The token cache is being invalidate because project a79d8adf202f429d819832a6af2ce70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:43.306336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.306336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.314978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a', 'request_id': 'req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.316255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a', 'request_id': 'req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.317218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a79d8adf202f429d819832a6af2ce70a', 'request_id': 'req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.334661 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2336/4640] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:24:42 2021] DELETE /identity/v3/domains/a79d8adf202f429d819832a6af2ce70a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:43.338624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:43.340242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:43.364292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d69f-9a7e-4556-adbb-5b3007fb8063 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:43.424998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:43.425994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:43.426407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:43.426821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/cceccb9a484f4301840529a24efc10ed` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:43.428868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cceccb9a484f4301840529a24efc10ed)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:43.430698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:43.560120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role cceccb9a484f4301840529a24efc10ed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:43.560618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.561542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.563785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2305/4641] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:43 2021] DELETE /identity/v3/roles/cceccb9a484f4301840529a24efc10ed => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:43.568576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:43.571013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:43.591886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03cb9-4213-4af9-879c-4b77ec15cfeb tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:43.665297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:43.666144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:43.666435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:43.666713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/d6684387d7ed4f0f822078efbaf8ac7d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:43.668225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d6684387d7ed4f0f822078efbaf8ac7d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:43.670253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:43.826270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role d6684387d7ed4f0f822078efbaf8ac7d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:43.826635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.827587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:43.832787 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2337/4642] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:43 2021] DELETE /identity/v3/roles/d6684387d7ed4f0f822078efbaf8ac7d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:43.834205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:43.835647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:43.852217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6614ae-53ea-4bbc-ba5f-224e19b7600d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:43.971222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc518944756f4956b67a0813793cfc74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eadb6072ef6f45bc80a5167c91f6342c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:43.971222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:43.971222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:43.971673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] PATH_INFO: `/v3/roles/573f249f1a7c463fbbeb36646de2eeeb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:43.972082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorizing `identity:delete_role(role_id=573f249f1a7c463fbbeb36646de2eeeb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:43.973740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:44.131521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invalidating the token cache because role 573f249f1a7c463fbbeb36646de2eeeb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:44.132024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:44.133004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a2222bcc-7fd3-440a-8753-a0f13c35e75d tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:44.135157 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2306/4643] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:43 2021] DELETE /identity/v3/roles/573f249f1a7c463fbbeb36646de2eeeb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:44.139506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:44.146854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:44.238724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc158-e2b4-4259-b7da-b030bb861712 tempest-RolesV3TestJSON-2133444538 tempest-RolesV3TestJSON-2133444538-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:44.308415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:44.309343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:44.309628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:44.309907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] PATH_INFO: `/v3/users/4c0581110ee642de82a781461100ccaf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:44.311134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0581110ee642de82a781461100ccaf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:44.313155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:44.536177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0581110ee642de82a781461100ccaf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:44.552757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0581110ee642de82a781461100ccaf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:44.581889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0581110ee642de82a781461100ccaf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:44.587527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0581110ee642de82a781461100ccaf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:44.691231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0581110ee642de82a781461100ccaf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:44.700539 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2338/4644] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:44 2021] DELETE /identity/v3/users/4c0581110ee642de82a781461100ccaf => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:44.706212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:44.707017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:44.707573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:44.753833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:44.755420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:44.769380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:44.771410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:44.895705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2307/4645] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:44.907058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:44.909148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:44.942165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ddb15-7259-4b2f-9ee4-890f63edb5be admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:44.970716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:44.971444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:44.971723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:44.971996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:44.974001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:44.983758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930d1e-9a12-49cf-9a58-9f0eebd044b0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:44.988149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:44.995226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:44.995365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:44.995365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:44.995365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:44.995365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:45.002745 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2339/4646] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:45.012492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:45.014991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:45.058338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2308/4647] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:45.807388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:45.809567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:45.829647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2f8f0-0bd2-49d7-a776-253977105592 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:45.834454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:45.835194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:45.835476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:45.836285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] PATH_INFO: `/v3/projects/a8218fb49e504c92b7f0accee662333d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:45.837720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8218fb49e504c92b7f0accee662333d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:45.839653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:46.002272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8218fb49e504c92b7f0accee662333d', 'request_id': 'req-1528b6eb-cb6e-4bae-868f-4514e1025f28'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.075560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8218fb49e504c92b7f0accee662333d', 'request_id': 'req-1528b6eb-cb6e-4bae-868f-4514e1025f28'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.081272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8218fb49e504c92b7f0accee662333d', 'request_id': 'req-1528b6eb-cb6e-4bae-868f-4514e1025f28'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.109073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] The token cache is being invalidate because project a8218fb49e504c92b7f0accee662333d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:46.109539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.110326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.112202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2340/4648] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:45 2021] DELETE /identity/v3/projects/a8218fb49e504c92b7f0accee662333d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:46.116451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:46.130188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35523f0d-7a63-49d1-8ea5-736328d9abac service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:46.214984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:46.215899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:46.216604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:46.216604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] PATH_INFO: `/v3/users/bc518944756f4956b67a0813793cfc74` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:46.217949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc518944756f4956b67a0813793cfc74)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:46.220162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:46.478803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc518944756f4956b67a0813793cfc74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.486875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc518944756f4956b67a0813793cfc74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.521904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc518944756f4956b67a0813793cfc74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.523545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc518944756f4956b67a0813793cfc74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.525690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc518944756f4956b67a0813793cfc74'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:46.606539 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2309/4649] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:46 2021] DELETE /identity/v3/users/bc518944756f4956b67a0813793cfc74 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:48.135976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:48.137589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:48.160943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b6eb-cb6e-4bae-868f-4514e1025f28 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:48.242226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:48.243509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:48.243898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:48.244298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] PATH_INFO: `/v3/projects/eadb6072ef6f45bc80a5167c91f6342c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:48.246005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadb6072ef6f45bc80a5167c91f6342c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:48.248175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:48.290426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:48.291264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:48.306885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec789-021a-40e8-8fa8-57bcf81ad8d1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:48.316779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:48.317721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:48.318002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:48.318278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] PATH_INFO: `/v3/users/8a9aca0cfb134140a880e9ef5ecde9ea` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:48.319501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9aca0cfb134140a880e9ef5ecde9ea)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:48.321689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:48.442201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadb6072ef6f45bc80a5167c91f6342c', 'request_id': 'req-8df04f9a-8a69-4628-9b78-b136bed1c788'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.608742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9aca0cfb134140a880e9ef5ecde9ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.620189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9aca0cfb134140a880e9ef5ecde9ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.637352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadb6072ef6f45bc80a5167c91f6342c', 'request_id': 'req-8df04f9a-8a69-4628-9b78-b136bed1c788'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.644777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadb6072ef6f45bc80a5167c91f6342c', 'request_id': 'req-8df04f9a-8a69-4628-9b78-b136bed1c788'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.649836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9aca0cfb134140a880e9ef5ecde9ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.650843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9aca0cfb134140a880e9ef5ecde9ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.651642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-34e95e6d-d7b1-485c-a945-f2e11f1026ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9aca0cfb134140a880e9ef5ecde9ea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.666997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] The token cache is being invalidate because project eadb6072ef6f45bc80a5167c91f6342c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:48.666997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.666997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8df04f9a-8a69-4628-9b78-b136bed1c788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:48.666997 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2341/4650] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:48 2021] DELETE /identity/v3/projects/eadb6072ef6f45bc80a5167c91f6342c => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:48.670827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5a4b8-2a90-42ea-a71a-77789b77a685 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:48.671221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5a4b8-2a90-42ea-a71a-77789b77a685 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:48.671853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5a4b8-2a90-42ea-a71a-77789b77a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:48.693595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-54f5a4b8-2a90-42ea-a71a-77789b77a685 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:48.696996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-54f5a4b8-2a90-42ea-a71a-77789b77a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:48.784369 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2310/4651] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:48 2021] DELETE /identity/v3/users/8a9aca0cfb134140a880e9ef5ecde9ea => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:48.848153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2342/4652] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:48.857607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f2c5-28e3-41fc-b638-5e129032e0df None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:48.857898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f2c5-28e3-41fc-b638-5e129032e0df None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:48.858176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f2c5-28e3-41fc-b638-5e129032e0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:48.909584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b220f2c5-28e3-41fc-b638-5e129032e0df None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:48.926004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b220f2c5-28e3-41fc-b638-5e129032e0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:49.076852 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2311/4653] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:49.081577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5a4b8-2a90-42ea-a71a-77789b77a685 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.100103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5a4b8-2a90-42ea-a71a-77789b77a685 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.112273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.115152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.116496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.117231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.118212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:49.122322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.127093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.149119 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2343/4654] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:49.153508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f2c5-28e3-41fc-b638-5e129032e0df None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.173545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f2c5-28e3-41fc-b638-5e129032e0df None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.183884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.184685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.185080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.186679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.187484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.189560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.279626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.281816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:49.313411 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2312/4655] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:49 2021] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:49.314171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4e30-c748-4494-a9c0-bcbba0cf2002 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.317158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.430895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693dce-ae4d-47f6-b530-ebde1415ae9c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.438289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.439415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.439877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.440506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.441747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.445431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.452336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.453315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.453597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.453873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] PATH_INFO: `/v3/projects/e78183302ecf4f92a3eab85b3f567d9e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.455893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78183302ecf4f92a3eab85b3f567d9e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.458105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.624684 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2313/4656] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:49 2021] POST /identity/v3/users => generated 288 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:49.625628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.632239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:49.638565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78183302ecf4f92a3eab85b3f567d9e', 'request_id': 'req-cfa9169a-c607-48bb-bc46-0b2efd897e5c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:49.744447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b5b6e-1640-4437-a05a-a6a5c9279d6f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.765843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78183302ecf4f92a3eab85b3f567d9e', 'request_id': 'req-cfa9169a-c607-48bb-bc46-0b2efd897e5c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:49.776240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78183302ecf4f92a3eab85b3f567d9e', 'request_id': 'req-cfa9169a-c607-48bb-bc46-0b2efd897e5c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:49.797739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] The token cache is being invalidate because project e78183302ecf4f92a3eab85b3f567d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:49.798133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:49.798769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:49.801111 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2344/4657] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:49 2021] DELETE /identity/v3/projects/e78183302ecf4f92a3eab85b3f567d9e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:49.801561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.803209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:49.832470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.834082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.834506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.834895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.838260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:49.858518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.860670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.872631 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2314/4658] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:49.873519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.875031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:49.882199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9169a-c607-48bb-bc46-0b2efd897e5c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.889425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.890699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.891252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.891686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50e68-9f41-4adf-9e5b-5c81d36e51dc service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.892108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.893220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.895978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.901899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.903121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.904092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.904573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] PATH_INFO: `/v3/users/1483e3fc61c74348a27ffbd3085678b9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.906930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1483e3fc61c74348a27ffbd3085678b9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.909734 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2345/4659] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:49 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:49.912896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.913798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:49.937855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21c53-c715-46aa-b203-09b757e76fd4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:49.949568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:49.950249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:49.950524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:49.950799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:49.951531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:49.953938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:49.974212 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2346/4660] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:49 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:49.974212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:50.004051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73bfdc-2757-4bcf-9006-e7c94c38805b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:50.025219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce483d60-cca7-4211-b45e-e75884659327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:50.028496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483d60-cca7-4211-b45e-e75884659327 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:50.028496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483d60-cca7-4211-b45e-e75884659327 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:50.028687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce483d60-cca7-4211-b45e-e75884659327 admin admin] PATH_INFO: `/v3/projects/7234bacaa9f742f6b74ce28dff8546ec/users/796405a5e0f54f9ab6d9fdce9064c68b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:50.066951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce483d60-cca7-4211-b45e-e75884659327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7234bacaa9f742f6b74ce28dff8546ec, user_id=796405a5e0f54f9ab6d9fdce9064c68b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:50.070530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce483d60-cca7-4211-b45e-e75884659327 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:50.136436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1483e3fc61c74348a27ffbd3085678b9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.144482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1483e3fc61c74348a27ffbd3085678b9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.158338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1483e3fc61c74348a27ffbd3085678b9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.164320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1483e3fc61c74348a27ffbd3085678b9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.168621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1483e3fc61c74348a27ffbd3085678b9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.180994 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2347/4661] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:49 2021] PUT /identity/v3/projects/7234bacaa9f742f6b74ce28dff8546ec/users/796405a5e0f54f9ab6d9fdce9064c68b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:50.183511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552aa3-417f-4122-9156-fba8796ad915 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:50.183798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552aa3-417f-4122-9156-fba8796ad915 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:50.184071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552aa3-417f-4122-9156-fba8796ad915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:50.216259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3a552aa3-417f-4122-9156-fba8796ad915 None None] MFA Rules not processed for user `796405a5e0f54f9ab6d9fdce9064c68b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:50.217877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3a552aa3-417f-4122-9156-fba8796ad915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:50.299330 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2348/4662] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:24:50.303660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552aa3-417f-4122-9156-fba8796ad915 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:50.323769 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2315/4663] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:49 2021] DELETE /identity/v3/users/1483e3fc61c74348a27ffbd3085678b9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:50.331175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552aa3-417f-4122-9156-fba8796ad915 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:50.413365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '796405a5e0f54f9ab6d9fdce9064c68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7234bacaa9f742f6b74ce28dff8546ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:50.414612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:50.414903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:50.415364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] PATH_INFO: `/v3/auth/catalog` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:50.416209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:50.417639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:50.420130 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2349/4664] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:24:50 2021] GET /identity/v3/auth/catalog => generated 2648 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:50.424843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:50.428120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:50.557651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f550-03fb-4938-a723-94b6c90701c3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:50.566913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:50.568048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:50.568395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:50.569162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] PATH_INFO: `/v3/users/796405a5e0f54f9ab6d9fdce9064c68b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:50.570308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=796405a5e0f54f9ab6d9fdce9064c68b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:50.573272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:50.858727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:50.858727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:50.864657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796405a5e0f54f9ab6d9fdce9064c68b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.875075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796405a5e0f54f9ab6d9fdce9064c68b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.881883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d3a62-d758-4b94-ba0c-b6d5b26fb6a5 tempest-IdentityCatalogTest-1285978202 tempest-IdentityCatalogTest-1285978202-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:50.895005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:50.896377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:50.896655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:50.898027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] PATH_INFO: `/v3/projects/08db6be69b3b4400a38c7491ded0ab82` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:50.899462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08db6be69b3b4400a38c7491ded0ab82)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:50.905905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:50.918043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796405a5e0f54f9ab6d9fdce9064c68b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.919903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796405a5e0f54f9ab6d9fdce9064c68b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:50.920752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6c41b459-0581-45b3-b538-0147889e1c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796405a5e0f54f9ab6d9fdce9064c68b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:51.061562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2316/4665] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:50 2021] DELETE /identity/v3/users/796405a5e0f54f9ab6d9fdce9064c68b => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:51.066738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718d21-a0ac-4cf1-8353-d699394fee74 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.067028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718d21-a0ac-4cf1-8353-d699394fee74 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.067302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7718d21-a0ac-4cf1-8353-d699394fee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.098364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c7718d21-a0ac-4cf1-8353-d699394fee74 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:51.110169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c7718d21-a0ac-4cf1-8353-d699394fee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:51.141670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08db6be69b3b4400a38c7491ded0ab82', 'request_id': 'req-f821c8b3-81ad-4a9e-955f-435d93d16bcc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:51.255679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08db6be69b3b4400a38c7491ded0ab82', 'request_id': 'req-f821c8b3-81ad-4a9e-955f-435d93d16bcc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:51.263794 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2317/4666] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:51.264102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08db6be69b3b4400a38c7491ded0ab82', 'request_id': 'req-f821c8b3-81ad-4a9e-955f-435d93d16bcc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:51.287444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] The token cache is being invalidate because project 08db6be69b3b4400a38c7491ded0ab82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:51.287651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:51.291278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:51.292993 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2350/4667] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:50 2021] DELETE /identity/v3/projects/08db6be69b3b4400a38c7491ded0ab82 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:51.300790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759dd38-4f8b-451e-9111-8244bf19bf40 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.301096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759dd38-4f8b-451e-9111-8244bf19bf40 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.305379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759dd38-4f8b-451e-9111-8244bf19bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.314582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:51.316029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:51.338568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1759dd38-4f8b-451e-9111-8244bf19bf40 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:51.339919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1759dd38-4f8b-451e-9111-8244bf19bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:51.352476 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2318/4668] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:51.364094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403abdd-5637-4c0a-932d-c89003e9b75d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.364487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403abdd-5637-4c0a-932d-c89003e9b75d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.365639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403abdd-5637-4c0a-932d-c89003e9b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.394137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4403abdd-5637-4c0a-932d-c89003e9b75d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:51.396329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4403abdd-5637-4c0a-932d-c89003e9b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:51.429178 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2319/4669] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:51.435205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403abdd-5637-4c0a-932d-c89003e9b75d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:51.441709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821c8b3-81ad-4a9e-955f-435d93d16bcc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:51.447193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:51.447364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403abdd-5637-4c0a-932d-c89003e9b75d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:51.448349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.453236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.453236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.454197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:51.454960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.455317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.455918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.456753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:51.457168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:51.458645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:51.458899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:51.481327 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2320/4670] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:51.488682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:51.490328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:51.496364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:51.511694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae50cb-4898-4137-ae30-32aeb88e2069 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:51.520456 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2351/4671] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:51.525253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:51.526020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.526364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.526701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.527476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:51.529506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:51.644927 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2321/4672] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:51 2021] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:51.649355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:51.659420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef7cb-79f4-493b-b6b8-1ad160e00f92 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:51.765355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:51.766111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.766399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.769756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.779768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:51.784630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:51.919519 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2352/4673] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:51 2021] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:51.920771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:51.935971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffc19c-63f8-4d30-98ed-7a9567efb29d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:51.947150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:51.947839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:51.948117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:51.948543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:51.949324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:51.951378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:51.986629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2322/4674] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:51 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:51.990104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:52.005415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220496b5-037f-4dd1-8625-828311b19f6d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:52.017729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96388a-06a8-4a57-b2ca-1b236904765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:52.018597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96388a-06a8-4a57-b2ca-1b236904765b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.018884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96388a-06a8-4a57-b2ca-1b236904765b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.019155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96388a-06a8-4a57-b2ca-1b236904765b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.019897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96388a-06a8-4a57-b2ca-1b236904765b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:52.027621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96388a-06a8-4a57-b2ca-1b236904765b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:52.068538 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2353/4675] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:51 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:52.070658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:52.088325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecff97c-5367-469f-9ace-1333957f274d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:52.100377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:52.101617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.102057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.102506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] PATH_INFO: `/v3/projects/a5994474339c4e2d8dd50eeab0ee993f/users/40de098493ad447794d22ab4fec92300/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.122501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5994474339c4e2d8dd50eeab0ee993f, user_id=40de098493ad447794d22ab4fec92300, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:52.125831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:52.242818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc476b-8ed9-42a8-ba72-e6b19025f060 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.243301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc476b-8ed9-42a8-ba72-e6b19025f060 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.243675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc476b-8ed9-42a8-ba72-e6b19025f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.245201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2323/4676] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:52 2021] PUT /identity/v3/projects/a5994474339c4e2d8dd50eeab0ee993f/users/40de098493ad447794d22ab4fec92300/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:52.284651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-32bc476b-8ed9-42a8-ba72-e6b19025f060 None None] MFA Rules not processed for user `40de098493ad447794d22ab4fec92300`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:52.289559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-32bc476b-8ed9-42a8-ba72-e6b19025f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:52.394791 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2354/4677] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:52 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:52.409923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:52.412679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:52.516732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7760b20-2ee3-4704-a60f-2be751bd9e5a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:52.532892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:52.533567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.533855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.534136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.545966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:52.549866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:52.584344 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2324/4678] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:52 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:52.598615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667a1a5-a798-411d-b1a2-76bb15d512b9 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.598912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667a1a5-a798-411d-b1a2-76bb15d512b9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.603362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667a1a5-a798-411d-b1a2-76bb15d512b9 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.603362 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2355/4679] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:24:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:24:52.607465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:24:52.627122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:52.643841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4ac48-8477-46c3-9e24-d9c609baf583 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:52.649059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40de098493ad447794d22ab4fec92300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5994474339c4e2d8dd50eeab0ee993f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:52.649954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.650219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.650499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] PATH_INFO: `/v3/projects/a5994474339c4e2d8dd50eeab0ee993f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.651765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorizing `identity:get_project(project_id=a5994474339c4e2d8dd50eeab0ee993f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:52.654308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:52.656454 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2325/4680] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:24:52 2021] GET /identity/v3/projects/a5994474339c4e2d8dd50eeab0ee993f => generated 365 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:52.689165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:52.689631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd544-0898-4c3f-9f44-102bfc96001f None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.689870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd544-0898-4c3f-9f44-102bfc96001f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.690364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd544-0898-4c3f-9f44-102bfc96001f None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.690958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:52.692144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2356/4681] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:24:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:24:52.699326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd544-0898-4c3f-9f44-102bfc96001f None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:24:52.701390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-909dd544-0898-4c3f-9f44-102bfc96001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:52.748585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd544-0898-4c3f-9f44-102bfc96001f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:52.763970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd544-0898-4c3f-9f44-102bfc96001f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:52.772661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892ec24-de6d-4234-98fe-15a451d44388 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40de098493ad447794d22ab4fec92300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5994474339c4e2d8dd50eeab0ee993f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:52.776441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ec24-de6d-4234-98fe-15a451d44388 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.776744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ec24-de6d-4234-98fe-15a451d44388 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.777447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ec24-de6d-4234-98fe-15a451d44388 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] PATH_INFO: `/v3/projects/a5994474339c4e2d8dd50eeab0ee993f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.780342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892ec24-de6d-4234-98fe-15a451d44388 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorizing `identity:get_project(project_id=a5994474339c4e2d8dd50eeab0ee993f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:52.787218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892ec24-de6d-4234-98fe-15a451d44388 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:52.796027 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2357/4682] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:24:52 2021] GET /identity/v3/projects/a5994474339c4e2d8dd50eeab0ee993f => generated 365 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:52.802490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9d577-c08f-41c9-b3c3-64726546b275 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:52.809624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:52.810805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.813841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.814371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] PATH_INFO: `/v3/projects/7234bacaa9f742f6b74ce28dff8546ec` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.816529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7234bacaa9f742f6b74ce28dff8546ec)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:52.818695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:52.842028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d97af4-8d3b-49bb-804e-939562c8c15b None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.842568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d97af4-8d3b-49bb-804e-939562c8c15b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.843033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d97af4-8d3b-49bb-804e-939562c8c15b None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.845325 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2358/4683] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:24:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:24:52.851870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d97af4-8d3b-49bb-804e-939562c8c15b None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:24:52.875035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d97af4-8d3b-49bb-804e-939562c8c15b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:52.905983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d97af4-8d3b-49bb-804e-939562c8c15b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:52.924441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c502f-380c-44f2-98df-7d227915dae2 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40de098493ad447794d22ab4fec92300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5994474339c4e2d8dd50eeab0ee993f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:52.925396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c502f-380c-44f2-98df-7d227915dae2 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.925686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c502f-380c-44f2-98df-7d227915dae2 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.925968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c502f-380c-44f2-98df-7d227915dae2 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] PATH_INFO: `/v3/projects/a5994474339c4e2d8dd50eeab0ee993f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.927248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c502f-380c-44f2-98df-7d227915dae2 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorizing `identity:get_project(project_id=a5994474339c4e2d8dd50eeab0ee993f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:52.929699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c502f-380c-44f2-98df-7d227915dae2 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:52.932333 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2359/4684] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:24:52 2021] GET /identity/v3/projects/a5994474339c4e2d8dd50eeab0ee993f => generated 365 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:52.987026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047bab-40a7-4479-9e14-2b0b2968646c None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:52.987238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047bab-40a7-4479-9e14-2b0b2968646c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:52.987522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b047bab-40a7-4479-9e14-2b0b2968646c None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:52.989391 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2360/4685] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:24:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:24:53.000720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047bab-40a7-4479-9e14-2b0b2968646c None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:24:53.003213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7234bacaa9f742f6b74ce28dff8546ec', 'request_id': 'req-7efcbe9f-997f-41de-a29d-a691729bc674'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.021352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7234bacaa9f742f6b74ce28dff8546ec', 'request_id': 'req-7efcbe9f-997f-41de-a29d-a691729bc674'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.106116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7234bacaa9f742f6b74ce28dff8546ec', 'request_id': 'req-7efcbe9f-997f-41de-a29d-a691729bc674'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.121734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] The token cache is being invalidate because project 7234bacaa9f742f6b74ce28dff8546ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:53.122292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.122985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7efcbe9f-997f-41de-a29d-a691729bc674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.129117 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2326/4686] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:52 2021] DELETE /identity/v3/projects/7234bacaa9f742f6b74ce28dff8546ec => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:53.155190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf958eca-ef96-4a00-9e03-2ce3903eb2bf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.155595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf958eca-ef96-4a00-9e03-2ce3903eb2bf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.165225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf958eca-ef96-4a00-9e03-2ce3903eb2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.167406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047bab-40a7-4479-9e14-2b0b2968646c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:53.224748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bf958eca-ef96-4a00-9e03-2ce3903eb2bf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:53.226600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bf958eca-ef96-4a00-9e03-2ce3903eb2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:53.262847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b047bab-40a7-4479-9e14-2b0b2968646c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:53.267759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e54c0-2768-45af-ad00-b914024fec10 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40de098493ad447794d22ab4fec92300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5994474339c4e2d8dd50eeab0ee993f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:53.269112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e54c0-2768-45af-ad00-b914024fec10 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.269817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e54c0-2768-45af-ad00-b914024fec10 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.270333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e54c0-2768-45af-ad00-b914024fec10 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] PATH_INFO: `/v3/projects/a5994474339c4e2d8dd50eeab0ee993f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.272432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e54c0-2768-45af-ad00-b914024fec10 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorizing `identity:get_project(project_id=a5994474339c4e2d8dd50eeab0ee993f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:53.277398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e54c0-2768-45af-ad00-b914024fec10 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:53.292776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2361/4687] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:24:52 2021] GET /identity/v3/projects/a5994474339c4e2d8dd50eeab0ee993f => generated 365 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:53.348620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.349436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.350209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.354346 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2362/4688] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:24:53 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 25 21:24:53.363984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:24:53.367621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:53.391822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:53.393964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:53.419253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dc79b-72ef-461f-88f4-abbff1866e11 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:53.430568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40de098493ad447794d22ab4fec92300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5994474339c4e2d8dd50eeab0ee993f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:53.431638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.432038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.432329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] PATH_INFO: `/v3/projects/a5994474339c4e2d8dd50eeab0ee993f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.434076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorizing `identity:get_project(project_id=a5994474339c4e2d8dd50eeab0ee993f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:53.436528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:53.439558 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2327/4689] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:53.447237 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2363/4690] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:24:53 2021] GET /identity/v3/projects/a5994474339c4e2d8dd50eeab0ee993f => generated 365 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:53.462842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db9b8-c065-473f-b118-47518dc65b42 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.463339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db9b8-c065-473f-b118-47518dc65b42 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.463504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db9b8-c065-473f-b118-47518dc65b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.508109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:53.510997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:53.533779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6f1db9b8-c065-473f-b118-47518dc65b42 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:53.541534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6f1db9b8-c065-473f-b118-47518dc65b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:53.546861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc1b70-458a-486d-8b90-516d386df885 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:53.574335 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2328/4691] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:53.578497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1db9b8-c065-473f-b118-47518dc65b42 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:53.594582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:53.594871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1db9b8-c065-473f-b118-47518dc65b42 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:53.594982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.594982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.594982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] PATH_INFO: `/v3/users/40de098493ad447794d22ab4fec92300` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.601527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=40de098493ad447794d22ab4fec92300)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:53.605742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:53.606724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:53.620652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.621354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.622286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.623948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:53.625043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:53.627069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:53.644598 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2329/4692] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:53.646097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:53.648700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:53.664834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f35ac-17fa-4674-be37-e2b2c3bbc640 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:53.671662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:53.673000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:53.673534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:53.674553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] PATH_INFO: `/v3/users/66cffeb0cda44ffbb26d9cbf29e325d0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:53.678071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66cffeb0cda44ffbb26d9cbf29e325d0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:53.681047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:53.861457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40de098493ad447794d22ab4fec92300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.870965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40de098493ad447794d22ab4fec92300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.885871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40de098493ad447794d22ab4fec92300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.886744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40de098493ad447794d22ab4fec92300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.924261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66cffeb0cda44ffbb26d9cbf29e325d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.932252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66cffeb0cda44ffbb26d9cbf29e325d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.954114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40de098493ad447794d22ab4fec92300'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.966404 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2364/4693] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:53 2021] DELETE /identity/v3/users/40de098493ad447794d22ab4fec92300 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:53.968308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:53.970458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:53.972764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66cffeb0cda44ffbb26d9cbf29e325d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.975117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66cffeb0cda44ffbb26d9cbf29e325d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:53.975745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c4960e82-ea74-4ce9-af5e-83587dbcd787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66cffeb0cda44ffbb26d9cbf29e325d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:54.077644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7919b1b-1a73-4d69-bfc3-eed71dc798fa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.077744 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2330/4694] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:53 2021] DELETE /identity/v3/users/66cffeb0cda44ffbb26d9cbf29e325d0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:54.077744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12caeb-24ea-473d-ae7c-f6d770c8c0a0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.077744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12caeb-24ea-473d-ae7c-f6d770c8c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.077744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12caeb-24ea-473d-ae7c-f6d770c8c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.096143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4d12caeb-24ea-473d-ae7c-f6d770c8c0a0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:54.097373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d12caeb-24ea-473d-ae7c-f6d770c8c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:54.185772 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2331/4695] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:54.187481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.188126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.188607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.196429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.197135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.197418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.197689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.198398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:54.200337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:54.212291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:54.214720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:54.231556 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2332/4696] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:54.252051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:54.254232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:54.337193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959489c3-40da-4525-b930-b93b4b867fbd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.341644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.342605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.342737 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2365/4697] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:53 2021] POST /identity/v3/projects => generated 387 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:54.343491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.343687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:54.344245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.357261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:54.358905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:54.379602 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2333/4698] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:54.380784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:54.386843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:54.399954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75de14-9a24-439c-af78-1f045ce9a9fd service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.474894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83f8f8-b4b9-4321-9a17-345b5dd06b51 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.478592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.480180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.480655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.481396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.483443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:54.494018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:54.502241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.505930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.507887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.508932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.535000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:54.537394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:54.553227 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2366/4699] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:54.615922 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2334/4700] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:54 2021] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:54.617644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:54.633287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a6f9e-49eb-4a77-b7cb-549422a293b7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.649954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.651785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.652379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.653646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.655435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:54.660571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:54.697943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2367/4701] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:54 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:54.700485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:54.712960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d48a9-2476-40d8-9076-010d75396304 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.717492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.718509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.719027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.719460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] PATH_INFO: `/v3/projects/0f13668bdd534ba291de6741157506e7/users/bd0b30f61a6f49c1b6eb7797892a81cb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.742392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f13668bdd534ba291de6741157506e7, user_id=bd0b30f61a6f49c1b6eb7797892a81cb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:54.745140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:54.834142 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2335/4702] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:54 2021] PUT /identity/v3/projects/0f13668bdd534ba291de6741157506e7/users/bd0b30f61a6f49c1b6eb7797892a81cb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:54.838257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:54.851206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa77ff7-1797-4ae0-b0b7-43e3aa99586e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.932571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878acdb1-b82c-4459-a64e-ac1a6494fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.936095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acdb1-b82c-4459-a64e-ac1a6494fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.936095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acdb1-b82c-4459-a64e-ac1a6494fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.936095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acdb1-b82c-4459-a64e-ac1a6494fd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.936095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878acdb1-b82c-4459-a64e-ac1a6494fd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:54.937928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878acdb1-b82c-4459-a64e-ac1a6494fd0d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:54.964795 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2368/4703] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:54 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:24:54.968465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:54.981495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae04ad5-caa4-4404-b6e7-91790240943c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:54.987785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:54.989397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:54.989918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:54.990456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] PATH_INFO: `/v3/projects/0f13668bdd534ba291de6741157506e7/users/bd0b30f61a6f49c1b6eb7797892a81cb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:54.995686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f13668bdd534ba291de6741157506e7, user_id=bd0b30f61a6f49c1b6eb7797892a81cb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:55.005651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:55.041122 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2336/4704] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:54 2021] PUT /identity/v3/projects/0f13668bdd534ba291de6741157506e7/users/bd0b30f61a6f49c1b6eb7797892a81cb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:55.057278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bede833-ba44-4328-8121-a84a138d8ed5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:55.057605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bede833-ba44-4328-8121-a84a138d8ed5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:55.057877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bede833-ba44-4328-8121-a84a138d8ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:55.091402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0bede833-ba44-4328-8121-a84a138d8ed5 None None] MFA Rules not processed for user `bd0b30f61a6f49c1b6eb7797892a81cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:55.092927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0bede833-ba44-4328-8121-a84a138d8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:55.202215 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2369/4705] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:55 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:55.205783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:55.309632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed69f5-a30d-4bba-9fff-0b345dbe9b56 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:55.314742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:55.316062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:55.316062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:55.316062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:55.317297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:55.320405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:55.504909 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2337/4706] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:55 2021] POST /identity/v3/projects => generated 387 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:55.513301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bede833-ba44-4328-8121-a84a138d8ed5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:55.519885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bede833-ba44-4328-8121-a84a138d8ed5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:55.540478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:55.542379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:55.596352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:55.597122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:55.597530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:55.597899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:55.605715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:55.609590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:55.659434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5dd5-b3a9-4876-a751-fd04a546299e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:55.673267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:55.674134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:55.674413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:55.674693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] PATH_INFO: `/v3/projects/a5994474339c4e2d8dd50eeab0ee993f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:55.678250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5994474339c4e2d8dd50eeab0ee993f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:55.682283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:55.690490 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2370/4707] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:55 2021] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:55.694189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:55.704642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:55.723754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743a39-7ece-4c21-a44e-0ebe50e945ab admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:55.733828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:55.735097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:55.735353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:55.735724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] PATH_INFO: `/v3/projects/352ec3feac38422a973bdc8134d9678b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:55.740424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352ec3feac38422a973bdc8134d9678b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:55.743031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:55.833110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5994474339c4e2d8dd50eeab0ee993f', 'request_id': 'req-78f8271a-faae-4de4-a988-10c35a37cefd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:55.839565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5994474339c4e2d8dd50eeab0ee993f', 'request_id': 'req-78f8271a-faae-4de4-a988-10c35a37cefd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:55.890116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352ec3feac38422a973bdc8134d9678b', 'request_id': 'req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:55.992881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5994474339c4e2d8dd50eeab0ee993f', 'request_id': 'req-78f8271a-faae-4de4-a988-10c35a37cefd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:56.004813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] The token cache is being invalidate because project a5994474339c4e2d8dd50eeab0ee993f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:56.005129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:56.005792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:56.015142 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2338/4708] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:55 2021] DELETE /identity/v3/projects/a5994474339c4e2d8dd50eeab0ee993f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:24:56.015142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.016998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.049066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352ec3feac38422a973bdc8134d9678b', 'request_id': 'req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:56.059984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352ec3feac38422a973bdc8134d9678b', 'request_id': 'req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:56.075840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] The token cache is being invalidate because project 352ec3feac38422a973bdc8134d9678b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:24:56.076328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:56.079250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-777ae516-b7bd-4b9a-a9c2-4a7eb071a516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:56.083140 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2371/4709] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:55 2021] DELETE /identity/v3/projects/352ec3feac38422a973bdc8134d9678b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:56.086100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.087959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.088098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.104901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8271a-faae-4de4-a988-10c35a37cefd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.107350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:56.108564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.172032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb00cf5-30aa-4d07-8f19-126d8b67af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.174260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb00cf5-30aa-4d07-8f19-126d8b67af37 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.174548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb00cf5-30aa-4d07-8f19-126d8b67af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.174823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb00cf5-30aa-4d07-8f19-126d8b67af37 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.175561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb00cf5-30aa-4d07-8f19-126d8b67af37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.177189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb00cf5-30aa-4d07-8f19-126d8b67af37 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.196542 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2339/4710] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:56 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:56.196542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e836-c93a-4d68-917f-412833d07d85 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.196937 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2372/4711] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:56.197088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e836-c93a-4d68-917f-412833d07d85 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.197088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9e836-c93a-4d68-917f-412833d07d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.197890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.199318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.216191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d095e1-0ef8-4a17-a42f-f14e7f882e01 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.221910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0db9e836-c93a-4d68-917f-412833d07d85 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:56.222101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0012-ef37-444e-82f6-02c0777e18ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.223811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0012-ef37-444e-82f6-02c0777e18ca admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.224106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0012-ef37-444e-82f6-02c0777e18ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.224374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0012-ef37-444e-82f6-02c0777e18ca admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.224623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0db9e836-c93a-4d68-917f-412833d07d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.227253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0012-ef37-444e-82f6-02c0777e18ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.230279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0012-ef37-444e-82f6-02c0777e18ca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.235944 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2340/4712] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:56.238608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941479b-cb04-44b1-8f0c-ee5778111a41 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.239180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941479b-cb04-44b1-8f0c-ee5778111a41 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.239673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941479b-cb04-44b1-8f0c-ee5778111a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.253630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2373/4713] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:56 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:56.255061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d1c6-74ae-46ea-bc06-51e33b57cc79 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.255353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d1c6-74ae-46ea-bc06-51e33b57cc79 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.255629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d1c6-74ae-46ea-bc06-51e33b57cc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.266141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c941479b-cb04-44b1-8f0c-ee5778111a41 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:56.271607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c941479b-cb04-44b1-8f0c-ee5778111a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.284278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2341/4714] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:56.289495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8d04d1c6-74ae-46ea-bc06-51e33b57cc79 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:56.290125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941479b-cb04-44b1-8f0c-ee5778111a41 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.290864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8d04d1c6-74ae-46ea-bc06-51e33b57cc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.305291 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2374/4715] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:56.305779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941479b-cb04-44b1-8f0c-ee5778111a41 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.305879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d1c6-74ae-46ea-bc06-51e33b57cc79 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.310196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.311202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.311491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.311619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d1c6-74ae-46ea-bc06-51e33b57cc79 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.311791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] PATH_INFO: `/v3/projects/a6acc2637d5441c4a844db60083d1715/users/abed67d6cf7c4b6ca617d6c16d386dd5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.317736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.318630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.318782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.319081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.319858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:56.320168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.322560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.330120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6acc2637d5441c4a844db60083d1715, user_id=abed67d6cf7c4b6ca617d6c16d386dd5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.332380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.339926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2375/4716] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:56.340843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.353088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f5ab2-bd67-4be9-8dd1-b86158f41dbd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.364147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.364932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.365198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.365479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.366274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:24:56.366621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.371335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.392170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2376/4717] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:24:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:56.392170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.402364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00d03-b6cb-440b-94af-b743c6862105 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.407620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13381b6b-6556-4bdc-8cbb-caff93e6cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.408376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13381b6b-6556-4bdc-8cbb-caff93e6cf33 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.408744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13381b6b-6556-4bdc-8cbb-caff93e6cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.409147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13381b6b-6556-4bdc-8cbb-caff93e6cf33 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.409952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13381b6b-6556-4bdc-8cbb-caff93e6cf33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.412297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13381b6b-6556-4bdc-8cbb-caff93e6cf33 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.474001 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2342/4718] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:56 2021] PUT /identity/v3/projects/a6acc2637d5441c4a844db60083d1715/users/abed67d6cf7c4b6ca617d6c16d386dd5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:56.474937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.544749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071ff71-ac05-4ca6-9348-730a86976519 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.549693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.550400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.550666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.550936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.551914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.554061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.589678 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2377/4719] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:56.591312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac105a-096f-4851-8a75-38a0a1c542c7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.591498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac105a-096f-4851-8a75-38a0a1c542c7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.591882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac105a-096f-4851-8a75-38a0a1c542c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.620616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-15ac105a-096f-4851-8a75-38a0a1c542c7 None None] MFA Rules not processed for user `abed67d6cf7c4b6ca617d6c16d386dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:56.621979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-15ac105a-096f-4851-8a75-38a0a1c542c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.691412 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2378/4720] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:56.692272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac105a-096f-4851-8a75-38a0a1c542c7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.705643 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2343/4721] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:56.710700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.712523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.775073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac105a-096f-4851-8a75-38a0a1c542c7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.780706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4fcca-b8b6-4f6d-99d9-3151ae7bf6d4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.793501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.797185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.797350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.797736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.802516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:56.888486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.889370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:56.894961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:56.894961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:56.894961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.894961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.957345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:56.962305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:56.979014 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2344/4722] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:56 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:56.980140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:56.992196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162950f-0cea-4980-af4b-4f0de4bdd071 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:56.999014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:56.999749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.000028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.002650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.002650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.003409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.031244 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2379/4723] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/users => generated 287 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:57.036350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.052186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd069-d714-4bd4-9060-c94091e094ad admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.058220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.059462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.060156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.060653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.061895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.063801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.092428 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2380/4724] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:57 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:57.093843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.096088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:57.166563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2345/4725] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:56 2021] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:57.166563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.180246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9814e-1467-4d97-8c97-1de5f6693c04 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.188772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.189658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.190531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.191113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.191968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.193807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db40c93-86a1-4402-9638-08c33992ce6d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.203137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.213630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.214764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.215121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.216006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.222974 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2346/4726] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:57 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:57.224167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:57.224368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.237416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa956-d5a3-46e1-bb53-f093aa66d2b8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.245474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.246158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.246443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.246717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.247546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.251007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.269975 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2347/4727] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:57 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:57.269975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.282457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58f0d-15b9-439e-91b5-a38967aea452 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.290395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d02c7a-358e-4ad4-aa4f-18ecd893fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.294128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02c7a-358e-4ad4-aa4f-18ecd893fa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.295210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02c7a-358e-4ad4-aa4f-18ecd893fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.295210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d02c7a-358e-4ad4-aa4f-18ecd893fa20 admin admin] PATH_INFO: `/v3/projects/a2feec922713464da7fde364e2a97ed4/users/1017770a74894b1f895be50c367f16ae/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.309373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.312212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.317130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d02c7a-358e-4ad4-aa4f-18ecd893fa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2feec922713464da7fde364e2a97ed4, user_id=1017770a74894b1f895be50c367f16ae, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.326726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d02c7a-358e-4ad4-aa4f-18ecd893fa20 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.328752 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2381/4728] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:57 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:57.329795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.341081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c637bd0-8ebb-469a-a8cb-9b82bae53e86 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.346917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.352559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.352559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.352559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.352559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.352559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.367071 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2382/4729] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:57 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:57.368126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.379761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d2be7-3172-450f-b920-3db6aa696aed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.387577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3a084-10fc-45cc-b1f9-2739e8273719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.388574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3a084-10fc-45cc-b1f9-2739e8273719 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.388865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3a084-10fc-45cc-b1f9-2739e8273719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.389203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3a084-10fc-45cc-b1f9-2739e8273719 admin admin] PATH_INFO: `/v3/projects/6e144b52c078444d8d70c611027c4cc0/users/d9d5bbbce03e407fa0fcdb1de799a8e5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.405234 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2348/4730] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:57 2021] PUT /identity/v3/projects/a2feec922713464da7fde364e2a97ed4/users/1017770a74894b1f895be50c367f16ae/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:57.418105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.418455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.418745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.429393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3a084-10fc-45cc-b1f9-2739e8273719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e144b52c078444d8d70c611027c4cc0, user_id=d9d5bbbce03e407fa0fcdb1de799a8e5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.434838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3a084-10fc-45cc-b1f9-2739e8273719 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.451881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] MFA Rules not processed for user `1017770a74894b1f895be50c367f16ae`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:57.453483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:57.559080 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2383/4731] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:57 2021] PUT /identity/v3/projects/6e144b52c078444d8d70c611027c4cc0/users/d9d5bbbce03e407fa0fcdb1de799a8e5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:57.565189 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2349/4732] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:57.572381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7263a5-80e8-4767-81c2-4f8d11223455 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.572739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7263a5-80e8-4767-81c2-4f8d11223455 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.573135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7263a5-80e8-4767-81c2-4f8d11223455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.581317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.586853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:57.622801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-aa7263a5-80e8-4767-81c2-4f8d11223455 None None] MFA Rules not processed for user `d9d5bbbce03e407fa0fcdb1de799a8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:57.624981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aa7263a5-80e8-4767-81c2-4f8d11223455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:57.687471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bffa9-ea33-4157-85c3-4fdef3f3bdf6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.704623 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2384/4733] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:57 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:57.709786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7263a5-80e8-4767-81c2-4f8d11223455 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.760672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.761791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.762301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.763012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.781620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7263a5-80e8-4767-81c2-4f8d11223455 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.787043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.787641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.787923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.788818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.789545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.791784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.830189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.831919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.841153 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2350/4734] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:57 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:24:57.841892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:57.852327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a593361-f532-4daf-87ff-7cc1821b6acf service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:57.861905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:57.862884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:57.863221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:57.863572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] PATH_INFO: `/v3/users/bd0b30f61a6f49c1b6eb7797892a81cb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:57.864911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0b30f61a6f49c1b6eb7797892a81cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:57.867645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:57.942413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2385/4735] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:24:57 2021] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:57.946649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.026048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82235c7-f5e6-494f-9f2b-a8e5144a56b2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.031260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.031561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.032117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.032117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.033111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.035162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.121287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0b30f61a6f49c1b6eb7797892a81cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.130342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0b30f61a6f49c1b6eb7797892a81cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.145022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0b30f61a6f49c1b6eb7797892a81cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.145841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0b30f61a6f49c1b6eb7797892a81cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.146516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0b30f61a6f49c1b6eb7797892a81cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.165093 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2386/4736] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:24:57 2021] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:58.165934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.170256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.180913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae69e1-53d4-4f52-a45c-29cf0544c65c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.186547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.187500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.187855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.188214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] PATH_INFO: `/v3/users/1017770a74894b1f895be50c367f16ae` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.189574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1017770a74894b1f895be50c367f16ae)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.191601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.221462 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2351/4737] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:57 2021] DELETE /identity/v3/users/bd0b30f61a6f49c1b6eb7797892a81cb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:58.222734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.224226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.293586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbc511-4086-48f5-8935-76257e7ad44a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.299645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6773bca-3d6e-4876-8eb5-b0f83703c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.301189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6773bca-3d6e-4876-8eb5-b0f83703c1cd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.301478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6773bca-3d6e-4876-8eb5-b0f83703c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.301756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6773bca-3d6e-4876-8eb5-b0f83703c1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.302654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6773bca-3d6e-4876-8eb5-b0f83703c1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.304386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6773bca-3d6e-4876-8eb5-b0f83703c1cd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.317699 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2352/4738] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:58 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:58.319278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b5d1-b22f-4905-8b3b-3b6923c8814b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.319594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b5d1-b22f-4905-8b3b-3b6923c8814b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.319871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7b5d1-b22f-4905-8b3b-3b6923c8814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.340726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-42e7b5d1-b22f-4905-8b3b-3b6923c8814b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:58.342083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42e7b5d1-b22f-4905-8b3b-3b6923c8814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.351839 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2353/4739] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:58.351839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7b5d1-b22f-4905-8b3b-3b6923c8814b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.361419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7b5d1-b22f-4905-8b3b-3b6923c8814b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.366987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.368666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.368666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.368666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] PATH_INFO: `/v3/projects/5178c24ca3d34196ad52420f49f9c4b6/users/9711464fe0814257b7857c7a9b90547a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.391364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1017770a74894b1f895be50c367f16ae'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.396469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5178c24ca3d34196ad52420f49f9c4b6, user_id=9711464fe0814257b7857c7a9b90547a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.400531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.405845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1017770a74894b1f895be50c367f16ae'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.421798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1017770a74894b1f895be50c367f16ae'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.422351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1017770a74894b1f895be50c367f16ae'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.463150 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2354/4740] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:58 2021] PUT /identity/v3/projects/5178c24ca3d34196ad52420f49f9c4b6/users/9711464fe0814257b7857c7a9b90547a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:58.464386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.468129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.483831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1017770a74894b1f895be50c367f16ae'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:24:58.509391 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2387/4741] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:24:58 2021] DELETE /identity/v3/users/1017770a74894b1f895be50c367f16ae => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:58.510987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.512500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.573411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330cf1-1ade-4672-8ff7-062d0b505b3d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.599903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0a777-9fc8-4aee-9481-a8f6587e4ebc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.606072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebdc86-fe53-4a43-a635-c2fd403c3672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.606795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebdc86-fe53-4a43-a635-c2fd403c3672 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.607114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebdc86-fe53-4a43-a635-c2fd403c3672 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.607398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebdc86-fe53-4a43-a635-c2fd403c3672 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.608135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebdc86-fe53-4a43-a635-c2fd403c3672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.609881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebdc86-fe53-4a43-a635-c2fd403c3672 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.625547 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2388/4742] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:24:58 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:24:58.625547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d9cf-03c7-4ddb-9b63-15d0092857d8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.625547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d9cf-03c7-4ddb-9b63-15d0092857d8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.625547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644d9cf-03c7-4ddb-9b63-15d0092857d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.640030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.641067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.641591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.642127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.644939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.646653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5644d9cf-03c7-4ddb-9b63-15d0092857d8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:58.648492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5644d9cf-03c7-4ddb-9b63-15d0092857d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.657414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2389/4743] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:58.658319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644d9cf-03c7-4ddb-9b63-15d0092857d8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.665779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.667600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.678141 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2355/4744] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:58.679279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.680902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.684718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644d9cf-03c7-4ddb-9b63-15d0092857d8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.689969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc003c-e633-427f-b01b-92d9c5fe1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.690870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc003c-e633-427f-b01b-92d9c5fe1be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.691158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc003c-e633-427f-b01b-92d9c5fe1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.691522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc003c-e633-427f-b01b-92d9c5fe1be0 admin admin] PATH_INFO: `/v3/projects/5178c24ca3d34196ad52420f49f9c4b6/users/9711464fe0814257b7857c7a9b90547a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.693695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc003c-e633-427f-b01b-92d9c5fe1be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5178c24ca3d34196ad52420f49f9c4b6, user_id=9711464fe0814257b7857c7a9b90547a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.697037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f5713-69a4-468a-a29a-80359031545e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.697188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc003c-e633-427f-b01b-92d9c5fe1be0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.702775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.703724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.704398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.705210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.709651 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2390/4745] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:24:58 2021] PUT /identity/v3/projects/5178c24ca3d34196ad52420f49f9c4b6/users/9711464fe0814257b7857c7a9b90547a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:58.717215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.719121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:58.720285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e733c9-29f4-4df5-a06f-e802f2588f1e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.720581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e733c9-29f4-4df5-a06f-e802f2588f1e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.720860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e733c9-29f4-4df5-a06f-e802f2588f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.731924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2356/4746] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:58.758047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-01e733c9-29f4-4df5-a06f-e802f2588f1e None None] MFA Rules not processed for user `9711464fe0814257b7857c7a9b90547a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:24:58.760430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01e733c9-29f4-4df5-a06f-e802f2588f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:58.862602 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2391/4747] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:24:58 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:24:58.867823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:58.938501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2244-8867-4e0f-92b2-9a5580fdd1c3 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:58.943217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:58.944475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:58.944758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:58.945136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:58.946165 ncdv-master-1 devstack@keystone.service[96732]: WARNING oslo_log.versionutils [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 25 21:24:58.946698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:58.947966 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:58.947966 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:58.947966 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:58.948840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.048856 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2357/4748] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:24:58 2021] POST /identity/v3/policies => generated 228 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:59.053451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e733c9-29f4-4df5-a06f-e802f2588f1e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.086660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e733c9-29f4-4df5-a06f-e802f2588f1e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.086660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.086660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.086985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.086985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies/63833bd1dd5d4250aa10fab8af0cde39` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.086985 ncdv-master-1 devstack@keystone.service[96733]: WARNING oslo_log.versionutils [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 25 21:24:59.086985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=63833bd1dd5d4250aa10fab8af0cde39)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.093261 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:59.093261 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:59.093261 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:59.094238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.225166 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2392/4749] 10.222.0.32 () {60 vars in 1251 bytes} [Sat Dec 25 21:24:59 2021] PATCH /identity/v3/policies/63833bd1dd5d4250aa10fab8af0cde39 => generated 235 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:24:59.230125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.265364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48296-7943-433a-b9a8-acec4f3f233b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.280850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.281846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.282202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.282420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies/63833bd1dd5d4250aa10fab8af0cde39` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.283233 ncdv-master-1 devstack@keystone.service[96732]: WARNING oslo_log.versionutils [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 25 21:24:59.286334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=63833bd1dd5d4250aa10fab8af0cde39)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.288853 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:59.288853 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:24:59.288853 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:24:59.289766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.311538 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2358/4750] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:24:59 2021] GET /identity/v3/policies/63833bd1dd5d4250aa10fab8af0cde39 => generated 235 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:24:59.313099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.325358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd15726-8a8a-4ddc-9153-4eb5126e3604 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.331469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.332520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.332984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.333390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies/63833bd1dd5d4250aa10fab8af0cde39` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.334850 ncdv-master-1 devstack@keystone.service[96733]: WARNING oslo_log.versionutils [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 25 21:24:59.336297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=63833bd1dd5d4250aa10fab8af0cde39)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.337706 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:59.337706 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:59.337706 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:59.338999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.438288 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2393/4751] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:24:59 2021] DELETE /identity/v3/policies/63833bd1dd5d4250aa10fab8af0cde39 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:24:59.442685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.470234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532219c-e2b2-4276-9e29-07316d8688bc tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.475905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.478132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.478702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.479406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.481053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.490015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.623585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.624529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2359/4752] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:24:59 2021] POST /identity/v3/policies => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:59.641884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc81ad6-0017-4267-b4f4-e6f86d3072c4 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.648666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.649720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.650263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.650774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.652636 ncdv-master-1 devstack@keystone.service[96733]: WARNING oslo_log.versionutils [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 25 21:24:59.657372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.659766 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:59.659766 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:59.659766 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:59.661068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.768496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2394/4753] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:24:59 2021] POST /identity/v3/policies => generated 230 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:24:59.770568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.774315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.777498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:59.792294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718faf8-6b16-4d0b-817a-646e4159e47d tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.801370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.802882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.803332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.803934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.809251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.809251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.865866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd1446-4e61-4aa2-aab7-8e8184f80e79 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.871409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.872062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.872366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.872635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.874684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:24:59.888192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.889950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.901813 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2395/4754] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:24:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:24:59.940172 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2360/4755] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:24:59 2021] POST /identity/v3/policies => generated 230 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:24:59.944329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:24:59.974605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee1979-06a6-4604-8da2-494847b3fc18 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:24:59.982505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:24:59.983369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:24:59.983520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:24:59.983775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:24:59.984840 ncdv-master-1 devstack@keystone.service[96733]: WARNING oslo_log.versionutils [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 25 21:24:59.985520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:24:59.986833 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:59.986833 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:24:59.986833 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:24:59.988313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:24:59.999590 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2396/4756] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:24:59 2021] GET /identity/v3/policies => generated 765 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:00.003922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:00.018131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97af47-d3d3-4194-8070-61ab3f8d33e2 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:00.025307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:00.026206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:00.026501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:00.026943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies/62ee75feb2514e74bfec11788f386173` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:00.028003 ncdv-master-1 devstack@keystone.service[96732]: WARNING oslo_log.versionutils [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Dec 25 21:25:00.028648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=62ee75feb2514e74bfec11788f386173)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:00.031725 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:00.031725 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:25:00.031725 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:00.032846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:00.137531 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2361/4757] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:00 2021] DELETE /identity/v3/policies/62ee75feb2514e74bfec11788f386173 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:00.138559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:00.148322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8557b-a471-4db1-9c24-924c9db6b249 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:00.154021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:00.154599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:00.155155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:00.155422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies/de65a2c5d84f43a396ec8a11069d2a6d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:00.156577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=de65a2c5d84f43a396ec8a11069d2a6d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:00.158448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:00.194060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:00.201059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:00.289292 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2397/4758] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:00 2021] DELETE /identity/v3/policies/de65a2c5d84f43a396ec8a11069d2a6d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:00.291130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:00.295875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:00.312608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47957104-7870-449c-b03d-3bd119c29c0b tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:00.318066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:00.319116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:00.319952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:00.320215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] PATH_INFO: `/v3/projects/0f13668bdd534ba291de6741157506e7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:00.320734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62bb7f-c830-4334-b411-b9e508703e85 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:00.321774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f13668bdd534ba291de6741157506e7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:00.323821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:00.332020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:00.333314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:00.334226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:00.334710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] PATH_INFO: `/v3/projects/a2feec922713464da7fde364e2a97ed4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:00.337772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2feec922713464da7fde364e2a97ed4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:00.340187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:00.443760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f13668bdd534ba291de6741157506e7', 'request_id': 'req-66aeb1af-9545-475f-92ba-9f44e90808b1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.452346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f13668bdd534ba291de6741157506e7', 'request_id': 'req-66aeb1af-9545-475f-92ba-9f44e90808b1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.496331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2feec922713464da7fde364e2a97ed4', 'request_id': 'req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.607413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f13668bdd534ba291de6741157506e7', 'request_id': 'req-66aeb1af-9545-475f-92ba-9f44e90808b1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.629342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] The token cache is being invalidate because project 0f13668bdd534ba291de6741157506e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:00.630428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.631496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.634304 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2362/4759] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:00 2021] DELETE /identity/v3/projects/0f13668bdd534ba291de6741157506e7 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:00.639475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:00.640899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:00.725180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb1af-9545-475f-92ba-9f44e90808b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:00.804962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7393e2c-5fcb-4006-8373-e1aee9389378 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9711464fe0814257b7857c7a9b90547a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5178c24ca3d34196ad52420f49f9c4b6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:00.806032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7393e2c-5fcb-4006-8373-e1aee9389378 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:00.806511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7393e2c-5fcb-4006-8373-e1aee9389378 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:00.806863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7393e2c-5fcb-4006-8373-e1aee9389378 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] PATH_INFO: `/v3/policies/8023c2ad168e4b8fafc55343d970b379` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:00.810459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7393e2c-5fcb-4006-8373-e1aee9389378 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8023c2ad168e4b8fafc55343d970b379)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:00.810837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7393e2c-5fcb-4006-8373-e1aee9389378 tempest-PoliciesTestJSON-714776385 tempest-PoliciesTestJSON-714776385-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:00.832615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2feec922713464da7fde364e2a97ed4', 'request_id': 'req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.840107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2feec922713464da7fde364e2a97ed4', 'request_id': 'req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.851281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] The token cache is being invalidate because project a2feec922713464da7fde364e2a97ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:00.851571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.852326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:00.853971 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2398/4760] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:00 2021] DELETE /identity/v3/projects/a2feec922713464da7fde364e2a97ed4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:00.854954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:00.856279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:00.933971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccec8e-9f4f-4b4c-b6b4-2c3666fc30e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:00.939296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:00.940258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:00.940544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:00.940827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] PATH_INFO: `/v3/users/abed67d6cf7c4b6ca617d6c16d386dd5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:00.942092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abed67d6cf7c4b6ca617d6c16d386dd5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:00.944055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:00.959168 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2363/4761] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:00 2021] DELETE /identity/v3/policies/8023c2ad168e4b8fafc55343d970b379 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:00.963374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:00.963511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:00.964278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:00.982926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:00.984509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:00.993508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2364/4762] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:00.994246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:00.997842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:01.009817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90276ca-6c8f-4a2b-9ef7-33d12700b0a5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:01.014490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:01.015348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:01.015626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:01.015897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] PATH_INFO: `/v3/users/d9d5bbbce03e407fa0fcdb1de799a8e5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:01.017127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d5bbbce03e407fa0fcdb1de799a8e5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:01.019006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:01.230447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abed67d6cf7c4b6ca617d6c16d386dd5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.235311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d5bbbce03e407fa0fcdb1de799a8e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.254781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abed67d6cf7c4b6ca617d6c16d386dd5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.255045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d5bbbce03e407fa0fcdb1de799a8e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.274976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d5bbbce03e407fa0fcdb1de799a8e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.277124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abed67d6cf7c4b6ca617d6c16d386dd5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.277858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abed67d6cf7c4b6ca617d6c16d386dd5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.278905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d5bbbce03e407fa0fcdb1de799a8e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.281184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f93cb9a9-12c5-4fe3-a75f-216900cfbd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d5bbbce03e407fa0fcdb1de799a8e5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.397513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a9fda6ca-be41-4482-91de-dddc5b16c0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abed67d6cf7c4b6ca617d6c16d386dd5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:01.404633 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2399/4763] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:00 2021] DELETE /identity/v3/users/abed67d6cf7c4b6ca617d6c16d386dd5 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:01.405914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6810e-bf10-43ca-974d-78b15927d9a8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:01.406204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6810e-bf10-43ca-974d-78b15927d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:01.406617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6810e-bf10-43ca-974d-78b15927d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:01.456949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e9d6810e-bf10-43ca-974d-78b15927d9a8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:01.458894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e9d6810e-bf10-43ca-974d-78b15927d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:01.472424 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2365/4764] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:00 2021] DELETE /identity/v3/users/d9d5bbbce03e407fa0fcdb1de799a8e5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:01.473933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:01.478175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:01.478175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:01.529413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:01.530692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:01.569299 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2400/4765] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:01.570260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6810e-bf10-43ca-974d-78b15927d9a8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:01.580599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6810e-bf10-43ca-974d-78b15927d9a8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:01.664497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:01.665565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:01.666022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:01.676977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:01.676977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:01.676977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:01.676977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:01.688933 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2401/4766] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:01.691367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:01.694732 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2366/4767] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:01.706511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aea89-3610-442a-8def-1bcd7f164af3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:01.708014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:01.709797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:01.712578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:01.713273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:01.713553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:01.713824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:01.714511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:01.716924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:01.785023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42a095-ca95-4e99-81ed-ceb89c26c42d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:01.785023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:01.785023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:01.785023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:01.785495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:01.795623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:01.797280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:01.810795 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2367/4768] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:25:01.842922 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2402/4769] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:01 2021] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:01.847622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:01.863522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4041d7-61a0-4d01-b6a8-f926b16418ba service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:02.053141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:02.058282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.058574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.058861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.059694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:02.061719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:02.236695 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2368/4770] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:01 2021] POST /identity/v3/users => generated 296 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:02.240553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:02.266266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d14112-4371-4bfe-92bc-6b65ac842216 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:02.273023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:02.273811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.274168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.274517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.275449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:02.277148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:02.288396 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2403/4771] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:02 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:02.295798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:02.306757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bca28-cb03-4553-8359-2c9078f27dcf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:02.315806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:02.316492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.319934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.319934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.319934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:02.319934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:02.335385 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2369/4772] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:02 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:02.336197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:02.349496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f46b-fc8f-46cb-8dde-767036f5df45 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:02.367190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37f3e7-252a-4fb3-8493-867817ead565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:02.367190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37f3e7-252a-4fb3-8493-867817ead565 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.367190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37f3e7-252a-4fb3-8493-867817ead565 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.367190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37f3e7-252a-4fb3-8493-867817ead565 admin admin] PATH_INFO: `/v3/projects/a195554218a94cc891fb5ee2097a42ed/users/22111afe17e84c769aa352b0e95f7436/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.420401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37f3e7-252a-4fb3-8493-867817ead565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a195554218a94cc891fb5ee2097a42ed, user_id=22111afe17e84c769aa352b0e95f7436, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:02.423519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37f3e7-252a-4fb3-8493-867817ead565 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:02.464931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:02.466621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:02.491764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724421b3-9770-4062-9d71-bda53e13504b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:02.505413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:02.506299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.506586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.507409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] PATH_INFO: `/v3/projects/a6acc2637d5441c4a844db60083d1715` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.513773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6acc2637d5441c4a844db60083d1715)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:02.515242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:02.521684 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2404/4773] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:02 2021] PUT /identity/v3/projects/a195554218a94cc891fb5ee2097a42ed/users/22111afe17e84c769aa352b0e95f7436/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:02.532509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e9e24-cac0-477f-9ad8-143f2352b678 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.532807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e9e24-cac0-477f-9ad8-143f2352b678 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.534962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e9e24-cac0-477f-9ad8-143f2352b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.604000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-586e9e24-cac0-477f-9ad8-143f2352b678 None None] MFA Rules not processed for user `22111afe17e84c769aa352b0e95f7436`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:02.605410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-586e9e24-cac0-477f-9ad8-143f2352b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:02.701318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2405/4774] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:02 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:25:02.705807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e9e24-cac0-477f-9ad8-143f2352b678 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:02.750917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6acc2637d5441c4a844db60083d1715', 'request_id': 'req-f9d74190-0da2-4e4a-8905-1b76626aff0f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:02.794785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6acc2637d5441c4a844db60083d1715', 'request_id': 'req-f9d74190-0da2-4e4a-8905-1b76626aff0f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:02.807557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e9e24-cac0-477f-9ad8-143f2352b678 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:02.919621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332485a2-bf8b-4a3f-ab78-c6fc252e9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:02.921185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332485a2-bf8b-4a3f-ab78-c6fc252e9d87 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.921478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332485a2-bf8b-4a3f-ab78-c6fc252e9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.921799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332485a2-bf8b-4a3f-ab78-c6fc252e9d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.924945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332485a2-bf8b-4a3f-ab78-c6fc252e9d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:02.929894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332485a2-bf8b-4a3f-ab78-c6fc252e9d87 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:02.947271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6acc2637d5441c4a844db60083d1715', 'request_id': 'req-f9d74190-0da2-4e4a-8905-1b76626aff0f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:02.968408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] The token cache is being invalidate because project a6acc2637d5441c4a844db60083d1715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:02.968719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:02.969507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:02.971328 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2370/4775] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:02 2021] DELETE /identity/v3/projects/a6acc2637d5441c4a844db60083d1715 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:02.972280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:02.973944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:02.989515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d74190-0da2-4e4a-8905-1b76626aff0f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:02.994409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:02.995549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:02.995844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:02.996116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] PATH_INFO: `/v3/projects/6e144b52c078444d8d70c611027c4cc0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:02.997779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e144b52c078444d8d70c611027c4cc0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:03.002064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:03.054923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2406/4776] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:02 2021] POST /identity/v3/projects => generated 391 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:03.054923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:03.054923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:03.054923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:03.105861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:03.107666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:03.199891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e144b52c078444d8d70c611027c4cc0', 'request_id': 'req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:03.210837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e144b52c078444d8d70c611027c4cc0', 'request_id': 'req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:03.216976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2407/4777] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:03.220148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:03.222328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:03.250133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39acc6-a3e1-47e8-8195-50077d516f64 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:03.307498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e144b52c078444d8d70c611027c4cc0', 'request_id': 'req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:03.323008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] The token cache is being invalidate because project 6e144b52c078444d8d70c611027c4cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:03.323333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:03.325801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-02fb99ea-b2d1-43b1-bef6-2f23a382ab49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:03.332165 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2371/4778] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:02 2021] DELETE /identity/v3/projects/6e144b52c078444d8d70c611027c4cc0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:03.334835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:03.335396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:03.335677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:03.383564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:03.388099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:03.415969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:03.416676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:03.417020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:03.417307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:03.418024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:03.419971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:03.552454 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2372/4779] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:03.554149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:03.558988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:03.559507 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2408/4780] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:03 2021] POST /identity/v3/users => generated 302 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:03.560594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:03.575461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a18a72-70c5-48cd-97b9-a1f3e1620b79 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:03.594241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:03.595361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:03.595717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7e62d-2c8f-4dcc-92f6-30fda4d1f645 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:03.597231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:03.598379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:03.601487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:03.603426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:03.608373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:03.611046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:03.613229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:03.614031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:03.615470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] PATH_INFO: `/v3/users/9711464fe0814257b7857c7a9b90547a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:03.620346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9711464fe0814257b7857c7a9b90547a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:03.625509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:03.643606 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2409/4781] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:03.644846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:03.650914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:03.683096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6ead7-5160-49d9-87c4-0760af12b4e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:03.700386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:03.702152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:03.702444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:03.704616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:03.706555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:03.709067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:03.729907 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2410/4782] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:03 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:03.733372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:03.752061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb722-6586-44d4-9bed-56dc29924237 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:03.759892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:03.760993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:03.761504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:03.762042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:03.762922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:03.765516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:03.922315 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2411/4783] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:03 2021] POST /identity/v3/projects => generated 399 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:03.926662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.003281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9711464fe0814257b7857c7a9b90547a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:04.021812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9711464fe0814257b7857c7a9b90547a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:04.056389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9711464fe0814257b7857c7a9b90547a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:04.058095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9711464fe0814257b7857c7a9b90547a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:04.058095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9711464fe0814257b7857c7a9b90547a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:04.074852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f257f-207e-4870-abbe-82f26ddbeb94 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.087707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.089674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.091097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.091439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] PATH_INFO: `/v3/projects/d68ffb1099fa4d8aa0c9b178d7578620/users/99ef58fea9704267a52fc68a98ae7f1a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.128201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68ffb1099fa4d8aa0c9b178d7578620, user_id=99ef58fea9704267a52fc68a98ae7f1a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.130922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.145386 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2373/4784] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:03 2021] DELETE /identity/v3/users/9711464fe0814257b7857c7a9b90547a => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:04.145386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.145386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:04.219896 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2412/4785] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:03 2021] PUT /identity/v3/projects/d68ffb1099fa4d8aa0c9b178d7578620/users/99ef58fea9704267a52fc68a98ae7f1a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:04.224614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.227033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:04.302733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586062-09f3-4dad-80e6-d76431747719 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.358146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa0f49-b752-4ee1-9068-15297f5ae564 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.372127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.372907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.373257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.373542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.374295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.376114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.415816 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2413/4786] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:04 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:25:04.415816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.425655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac380-02c8-4f04-8277-7c37e160fc25 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.435516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.437363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.438260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.440328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.441787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae087e-6fe9-46a5-922e-00f7b292f2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.446688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.446847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae087e-6fe9-46a5-922e-00f7b292f2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.446980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.448322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae087e-6fe9-46a5-922e-00f7b292f2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.448322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae087e-6fe9-46a5-922e-00f7b292f2ff admin admin] PATH_INFO: `/v3/projects/d68ffb1099fa4d8aa0c9b178d7578620/users/99ef58fea9704267a52fc68a98ae7f1a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.451727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae087e-6fe9-46a5-922e-00f7b292f2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68ffb1099fa4d8aa0c9b178d7578620, user_id=99ef58fea9704267a52fc68a98ae7f1a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.461116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae087e-6fe9-46a5-922e-00f7b292f2ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.490203 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2414/4787] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:04 2021] PUT /identity/v3/projects/d68ffb1099fa4d8aa0c9b178d7578620/users/99ef58fea9704267a52fc68a98ae7f1a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:04.493463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72211988-550c-455e-83de-01ec144d13cf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.493463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72211988-550c-455e-83de-01ec144d13cf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.493804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72211988-550c-455e-83de-01ec144d13cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.548574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-72211988-550c-455e-83de-01ec144d13cf None None] MFA Rules not processed for user `99ef58fea9704267a52fc68a98ae7f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:04.549617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-72211988-550c-455e-83de-01ec144d13cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:04.572620 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2374/4788] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:04 2021] POST /identity/v3/users => generated 300 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:04.576586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.596978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ddf00-c246-435a-b915-d6ba8ccc9be0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.662318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2415/4789] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:04 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:04.667655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72211988-550c-455e-83de-01ec144d13cf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.682613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72211988-550c-455e-83de-01ec144d13cf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.689801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.690248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.690543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.690824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.691618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.693660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.722590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.725764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.725764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.725922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.728014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.729718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.744796 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2375/4790] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:04 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:25:04.745944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.758915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c0b83-c944-4af9-8f49-b403f330eb84 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.765621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.765621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.765621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.765621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.766543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.768774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.785039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2376/4791] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:04 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:04.788193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.803383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cac1b-6547-4509-9358-0d7f9fa53ff3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.805554 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2416/4792] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:25:04 2021] POST /identity/v3/domains => generated 277 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:04.809799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:04.901054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec4468-65a2-49d4-9f06-85e4f373531f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:04.907713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.909013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.909722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.911529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.913387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=066343adaa4c4b3fad84acc16c88ef99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.914736 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:04.914736 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:25:04.914736 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:04.916072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:04.918793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:04.919818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:04.920109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:04.920524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] PATH_INFO: `/v3/projects/39002f2653254b3ead7231dc2a1b9797/users/4c074f0c379e4a4e96948036f5368eea/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:04.943087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39002f2653254b3ead7231dc2a1b9797, user_id=4c074f0c379e4a4e96948036f5368eea, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:04.952580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:05.054403 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2417/4793] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:25:04 2021] PUT /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config => generated 138 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:05.054403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:05.055042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:05.061366 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2377/4794] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:04 2021] PUT /identity/v3/projects/39002f2653254b3ead7231dc2a1b9797/users/4c074f0c379e4a4e96948036f5368eea/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:05.064466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:05.143228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679e1f-15f5-49bc-b51a-5b43c45fc11c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:05.149879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffd001-de2f-459f-817b-787a30887ef6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:05.151071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd001-de2f-459f-817b-787a30887ef6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:05.151216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd001-de2f-459f-817b-787a30887ef6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:05.151496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd001-de2f-459f-817b-787a30887ef6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:05.152981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffd001-de2f-459f-817b-787a30887ef6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=066343adaa4c4b3fad84acc16c88ef99, group=identity)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:05.154159 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-69ffd001-de2f-459f-817b-787a30887ef6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:05.154159 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:25:05.154159 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:05.155100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffd001-de2f-459f-817b-787a30887ef6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:05.165008 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2378/4795] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:25:05 2021] GET /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/identity => generated 45 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:05.166246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:05.166678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:05.167108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:05.175286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d661-ff9f-4af1-812b-25b12f872d28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:05.249292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] MFA Rules not processed for user `4c074f0c379e4a4e96948036f5368eea`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:05.254567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:05.280349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:05.281193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:05.281590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:05.281956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:05.283857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:05.369111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2379/4796] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:05 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:05.372842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:05.372842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:05.383676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:05.386507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:05.410843 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2418/4797] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:05 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:05.411788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:05.436283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ceb34-c354-4791-8b24-f74bb7eeceed service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:05.445463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:05.446776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:05.446776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:05.446987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/identity/driver` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:05.448285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=066343adaa4c4b3fad84acc16c88ef99, group=identity, option=driver)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:05.449352 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:05.449352 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:25:05.449352 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:05.450240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:05.458873 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2419/4798] 10.222.0.32 () {58 vars in 1295 bytes} [Sat Dec 25 21:25:05 2021] GET /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/identity/driver => generated 31 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:05.459403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:05.492767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b63c7-6cd0-44a0-9a2b-1e0e9dcc3dd9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:05.498745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:05.499731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:05.500020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:05.500301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] PATH_INFO: `/v3/projects/5178c24ca3d34196ad52420f49f9c4b6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:05.501676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5178c24ca3d34196ad52420f49f9c4b6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:05.503582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:05.601820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfd49d-d447-426f-a12c-db0015ca5491 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:05.610604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433bcf7-68b4-4a57-902b-6b072bc17c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:05.611585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bcf7-68b4-4a57-902b-6b072bc17c75 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:05.612720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bcf7-68b4-4a57-902b-6b072bc17c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:05.612720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433bcf7-68b4-4a57-902b-6b072bc17c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:05.613615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433bcf7-68b4-4a57-902b-6b072bc17c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:05.625996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433bcf7-68b4-4a57-902b-6b072bc17c75 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:05.651780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5178c24ca3d34196ad52420f49f9c4b6', 'request_id': 'req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:05.665782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5178c24ca3d34196ad52420f49f9c4b6', 'request_id': 'req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:05.798822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5178c24ca3d34196ad52420f49f9c4b6', 'request_id': 'req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:05.818394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] The token cache is being invalidate because project 5178c24ca3d34196ad52420f49f9c4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:05.819736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:05.821672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:05.827197 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2380/4799] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:05 2021] DELETE /identity/v3/projects/5178c24ca3d34196ad52420f49f9c4b6 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:05.829837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:05.833602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:05.844055 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2420/4800] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:05 2021] POST /identity/v3/projects => generated 399 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:05.845727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:05.846426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:05.846888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:05.878556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:05.880445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:05.988357 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2421/4801] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:05.990524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:05.992331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:05.999701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ea8fe-2687-4e13-9f70-dcf52fe2820d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.013792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67464b4-125f-4da5-bff1-30af2f543c56 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.022010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.023904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.024426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.025272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.026734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.029802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.114923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa715-aa38-4fa8-b565-44934c7ff8c5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.116691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa715-aa38-4fa8-b565-44934c7ff8c5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.117077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa715-aa38-4fa8-b565-44934c7ff8c5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.117638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa715-aa38-4fa8-b565-44934c7ff8c5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/ldap` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.119337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa715-aa38-4fa8-b565-44934c7ff8c5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=066343adaa4c4b3fad84acc16c88ef99, group=ldap)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.121475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa715-aa38-4fa8-b565-44934c7ff8c5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.132702 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2381/4802] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:25:05 2021] GET /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/ldap => generated 106 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:06.135364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b36d-c983-40be-a0ef-c7a07cad3a97 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.135737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b36d-c983-40be-a0ef-c7a07cad3a97 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.136451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b36d-c983-40be-a0ef-c7a07cad3a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.157202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2422/4803] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:05 2021] POST /identity/v3/users => generated 306 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:06.158695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.161018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e475b36d-c983-40be-a0ef-c7a07cad3a97 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:06.163938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e475b36d-c983-40be-a0ef-c7a07cad3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:06.182762 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2382/4804] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:06.185743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b36d-c983-40be-a0ef-c7a07cad3a97 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.196849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b217a-b3e4-4e53-8557-9755ef3ffe88 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.198858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b36d-c983-40be-a0ef-c7a07cad3a97 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.206356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.207584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.208063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.208434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.208573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/ldap/url` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.209213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.209441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.209751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.210278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=066343adaa4c4b3fad84acc16c88ef99, group=ldap, option=url)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.210616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.212218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.214597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.220626 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2423/4805] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:25:06 2021] GET /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/ldap/url => generated 46 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:06.222457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.248309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a915bbf-8ad7-44a5-ad34-d351ab7cdb11 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.251460 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2383/4806] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:06 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:06.252822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.268676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.269519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.269861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.270205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.276250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:06.276717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.278663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.301824 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2424/4807] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:06.303176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee6f3-de69-45a2-adc5-f7bce6431a91 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.304027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.319063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.322820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.323379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.325051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/ldap/user_tree_dn` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.326771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6bba-7e28-45d9-a637-833f26f777fc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.328417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=066343adaa4c4b3fad84acc16c88ef99, group=ldap, option=user_tree_dn)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.335198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.342436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.349409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.349409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.349409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] PATH_INFO: `/v3/projects/0ea361343c314273b0d0a62a792d2d8d/users/fc152352383e41aa9b76162617f66f0b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.351214 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2384/4808] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:25:06 2021] GET /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config/ldap/user_tree_dn => generated 63 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:06.352913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.378029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b640b7-a7cd-4094-ba1a-c2b187da4b26 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.388573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.389094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea361343c314273b0d0a62a792d2d8d, user_id=fc152352383e41aa9b76162617f66f0b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.389331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.389621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.389901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.390951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.394464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.401636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.481537 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2425/4809] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:06 2021] PUT /identity/v3/projects/0ea361343c314273b0d0a62a792d2d8d/users/fc152352383e41aa9b76162617f66f0b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:06.481537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.546557 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2385/4810] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:06 2021] POST /identity/v3/projects => generated 369 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:06.547667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.633181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992983be-95ff-4069-9951-c08ffe86f7e6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.707579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20664c-854e-47ab-8c8c-67a930a348a9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.723836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.724531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.724814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.725122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.725912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.727532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.748831 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2386/4811] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:06 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:06.749713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.766399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.769024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.769024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.769024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.769024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=066343adaa4c4b3fad84acc16c88ef99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.779949 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:06.779949 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:25:06.779949 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:06.779949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.780251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef07dc-e7d8-443b-b141-73df318998c9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.783232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228875b-5aea-4f2c-b9ae-a04bc814166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.783920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228875b-5aea-4f2c-b9ae-a04bc814166d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.784470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228875b-5aea-4f2c-b9ae-a04bc814166d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.784806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228875b-5aea-4f2c-b9ae-a04bc814166d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.785882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228875b-5aea-4f2c-b9ae-a04bc814166d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.788305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228875b-5aea-4f2c-b9ae-a04bc814166d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.894163 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2426/4812] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:06 2021] DELETE /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99/config => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:06.895132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.917814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831303e6-a225-4345-a65e-4bc84a088e74 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:06.921587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d3591-8874-463c-846a-549038997039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:06.922600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d3591-8874-463c-846a-549038997039 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.922886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d3591-8874-463c-846a-549038997039 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.923162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d3591-8874-463c-846a-549038997039 admin admin] PATH_INFO: `/v3/projects/0ea361343c314273b0d0a62a792d2d8d/users/fc152352383e41aa9b76162617f66f0b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:06.925305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d3591-8874-463c-846a-549038997039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea361343c314273b0d0a62a792d2d8d, user_id=fc152352383e41aa9b76162617f66f0b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:06.928017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d3591-8874-463c-846a-549038997039 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:06.941577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2427/4813] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:06 2021] PUT /identity/v3/projects/0ea361343c314273b0d0a62a792d2d8d/users/fc152352383e41aa9b76162617f66f0b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:06.942440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d3591-8874-463c-846a-549038997039 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:06.958686 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2387/4814] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:06 2021] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:06.960788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da15a-6d68-42fd-a961-b92644a14130 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:06.961632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da15a-6d68-42fd-a961-b92644a14130 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:06.962383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da15a-6d68-42fd-a961-b92644a14130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.018052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4d9da15a-6d68-42fd-a961-b92644a14130 None None] MFA Rules not processed for user `fc152352383e41aa9b76162617f66f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:07.018052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d9da15a-6d68-42fd-a961-b92644a14130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:07.073257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d3591-8874-463c-846a-549038997039 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:07.085445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:07.086336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:07.086621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:07.086898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.089757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=066343adaa4c4b3fad84acc16c88ef99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:07.093546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:07.126483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:07.127466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:07.140970 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2388/4815] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:06 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:07.141870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9da15a-6d68-42fd-a961-b92644a14130 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:07.256688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:07.258633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:07.269320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9da15a-6d68-42fd-a961-b92644a14130 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:07.269514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2428/4816] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:06 2021] PATCH /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99 => generated 278 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:07.273559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:07.276512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:07.392765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb4871-018a-464c-aefe-57efcd353b13 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:07.402846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:07.403538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:07.403849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:07.404356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.406698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:07.408403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:07.409712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:07.410242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:07.411024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.412226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:07.414705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:07.426790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2389/4817] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:07 2021] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:07.428944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:07.431641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:07.579558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb647b0-1ff1-42af-b8ed-8ae653ceffae admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:07.581543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:07.583639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:07.594169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:07.595397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:07.595853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:07.596301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.609120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2429/4818] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:07 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:07.610239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:07.614710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:07.622130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=066343adaa4c4b3fad84acc16c88ef99)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:07.624598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:07.646015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aebd67-6591-4f49-8bc0-03327cda0a48 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:07.660947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:07.661635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:07.661922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:07.662200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.665346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:07.667011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:07.677252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:07.705731 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2430/4819] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:07 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:07.709414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:07.710473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:07.730352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777eb3f-b064-4966-9f36-18bc60318dd0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:07.735369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75df0-a95a-4ec5-a103-60761400e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:07.736463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75df0-a95a-4ec5-a103-60761400e5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:07.736956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75df0-a95a-4ec5-a103-60761400e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:07.737248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75df0-a95a-4ec5-a103-60761400e5e0 admin admin] PATH_INFO: `/v3/projects/1df382b4626941ada0362a82c4a5ffe1/users/afa8c7b5af49428a859caf14d6075bde/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.757358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75df0-a95a-4ec5-a103-60761400e5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df382b4626941ada0362a82c4a5ffe1, user_id=afa8c7b5af49428a859caf14d6075bde, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:07.759670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75df0-a95a-4ec5-a103-60761400e5e0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:07.931024 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2431/4820] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:07 2021] PUT /identity/v3/projects/1df382b4626941ada0362a82c4a5ffe1/users/afa8c7b5af49428a859caf14d6075bde/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:07.942484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540d18-8229-4a35-85df-d4782f2cda2c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:07.942838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540d18-8229-4a35-85df-d4782f2cda2c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:07.943162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540d18-8229-4a35-85df-d4782f2cda2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:07.975106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99', 'request_id': 'req-d997aa2c-f161-47c2-a067-b75de08cb9f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:07.986155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99', 'request_id': 'req-d997aa2c-f161-47c2-a067-b75de08cb9f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:08.004639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e8540d18-8229-4a35-85df-d4782f2cda2c None None] MFA Rules not processed for user `afa8c7b5af49428a859caf14d6075bde`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:08.005874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e8540d18-8229-4a35-85df-d4782f2cda2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:08.093876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99', 'request_id': 'req-d997aa2c-f161-47c2-a067-b75de08cb9f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:08.105153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2432/4821] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:07 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:25:08.107080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540d18-8229-4a35-85df-d4782f2cda2c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.110798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] The token cache is being invalidate because project 066343adaa4c4b3fad84acc16c88ef99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:08.111089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:08.111783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:08.120228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99', 'request_id': 'req-d997aa2c-f161-47c2-a067-b75de08cb9f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:08.121001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99', 'request_id': 'req-d997aa2c-f161-47c2-a067-b75de08cb9f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:08.121774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '066343adaa4c4b3fad84acc16c88ef99', 'request_id': 'req-d997aa2c-f161-47c2-a067-b75de08cb9f3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:08.130993 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2390/4822] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:07 2021] DELETE /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:08.136088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.137785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:08.192202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540d18-8229-4a35-85df-d4782f2cda2c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.199849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.200046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.200351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.200587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.204539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.204539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.221730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997aa2c-f161-47c2-a067-b75de08cb9f3 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.229076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.229854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.230213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.230821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.231693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.233730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.354862 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2391/4823] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:25:08 2021] POST /identity/v3/domains => generated 277 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:08.359715 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2433/4824] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:08 2021] POST /identity/v3/projects => generated 369 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:08.361363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.363880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.366385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:08.485062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cec584-4206-46db-98ab-6eab5c57f7e6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.492609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac21a-a150-41bd-85f9-6f65ddba463e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.504968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.509446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.510095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.510614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.515261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.536830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.590906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.592065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.592522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.593218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.594149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.595763 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:08.595763 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:25:08.595763 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:08.596827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.667099 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2434/4825] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:08 2021] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:08.668258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.670539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:08.751311 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2392/4826] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:25:08 2021] PUT /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config => generated 138 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:08.752451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.778210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb519c00-ed6e-43bc-874f-c3cc7b2cd7dd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.781200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f4a0e-7a7c-465d-81bb-9c8fbde8c831 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.784866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.786206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.786817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.787394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.788410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.788531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.789310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.789660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.790016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.791180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.791988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:08.805964 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2393/4827] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:08 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:08.807903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.825503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461fa7e-f7ce-4557-93ce-ac1d15a192b2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.835965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.837036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.843692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.843692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.843692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.843692 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:08.843692 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:25:08.843692 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:08.844313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.873238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.874880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.893259 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2435/4828] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:08 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:08.894437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.907624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb745c9-8502-4c37-8886-59a067e0976e service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.913771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.914734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.915020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.915297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] PATH_INFO: `/v3/projects/04eefc967ba44a15b0c2cdec757f33f2/users/620b573460b841b19ba44e8274e348dc/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.934265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=04eefc967ba44a15b0c2cdec757f33f2, user_id=620b573460b841b19ba44e8274e348dc, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.937274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:08.943440 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2394/4829] 10.222.0.32 () {60 vars in 1270 bytes} [Sat Dec 25 21:25:08 2021] PATCH /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config => generated 141 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:08.955932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:08.973444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78045-1532-426a-bb8f-ae36c36b0c97 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:08.979137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:08.980011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:08.980297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:08.980582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:08.983404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:08.990293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.000901 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2395/4830] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:08 2021] GET /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config => generated 141 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:25:09.002052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.005041 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2436/4831] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:08 2021] PUT /identity/v3/projects/04eefc967ba44a15b0c2cdec757f33f2/users/620b573460b841b19ba44e8274e348dc/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:09.009667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.016611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1713b4-1c32-41f9-bebd-09eb6e22e6ae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.125040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5390a-76d6-47e0-87db-bab086fb5eeb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.130944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.132263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.132549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.132833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.133758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.135387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.148233 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2437/4832] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:09 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:09.153039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.153920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.156552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.157123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.157606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.158646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.160168 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:09.160168 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:25:09.160168 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:09.162064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.171805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1b76-43f6-4e9f-82f2-dd73dbee7fe1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.177749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a18378-c1f1-4cb7-b0d9-9c88fe357386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.179447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18378-c1f1-4cb7-b0d9-9c88fe357386 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.179741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18378-c1f1-4cb7-b0d9-9c88fe357386 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.180022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18378-c1f1-4cb7-b0d9-9c88fe357386 admin admin] PATH_INFO: `/v3/projects/04eefc967ba44a15b0c2cdec757f33f2/users/620b573460b841b19ba44e8274e348dc/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.182319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a18378-c1f1-4cb7-b0d9-9c88fe357386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04eefc967ba44a15b0c2cdec757f33f2, user_id=620b573460b841b19ba44e8274e348dc, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.185587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a18378-c1f1-4cb7-b0d9-9c88fe357386 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.220200 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2438/4833] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:09 2021] PUT /identity/v3/projects/04eefc967ba44a15b0c2cdec757f33f2/users/620b573460b841b19ba44e8274e348dc/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:09.222021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632619-7574-40b2-a308-b76f6754f17e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.222309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632619-7574-40b2-a308-b76f6754f17e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.222586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632619-7574-40b2-a308-b76f6754f17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.257009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-db632619-7574-40b2-a308-b76f6754f17e None None] MFA Rules not processed for user `620b573460b841b19ba44e8274e348dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:09.258358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-db632619-7574-40b2-a308-b76f6754f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:09.273742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2396/4834] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:09 2021] DELETE /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:09.275844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.295258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b760a-1c2b-4d9e-b8c4-f1ceed0abf70 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.359107 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2439/4835] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:09 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:09.360153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632619-7574-40b2-a308-b76f6754f17e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.391929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632619-7574-40b2-a308-b76f6754f17e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.405574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.406387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.406685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.406968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.407904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.409949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.424518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.426921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.427392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.427999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.430547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.432321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.452858 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Could not find any options in domain configuration for domain 0e5b4cc943e047758e75d7be96ef12cb.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 0e5b4cc943e047758e75d7be96ef12cb. Dec 25 21:25:09.459585 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2397/4836] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:09 2021] GET /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config => generated 151 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:09.461259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.471892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4e8a0-70d5-49c5-9372-a4d38cfc2d0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.477396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.487328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.487328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.487328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.487328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.487720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.490742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2398/4837] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:09 2021] DELETE /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb/config => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:09.492135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.501778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd8e1b-81cb-42ee-9fe6-80fa4ab95f0c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.506831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.508003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.508003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.508204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.509978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.511135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.534143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:09.535019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:09.628022 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2440/4838] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:25:09 2021] POST /identity/v3/projects => generated 329 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:09.637491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.655353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:09.701754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:09.702407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:09.705301 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2399/4839] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:09 2021] PATCH /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb => generated 278 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:09.711480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.712827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:09.791918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e9d2d-8c02-4d9f-8d35-5e8e0b944d43 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.797354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.798165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.798515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.798860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.799651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.802520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.839949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d13fe-12a7-4b9d-b957-9e8c5dad85de tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:09.909507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:09.910593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:09.910878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:09.911152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:09.923428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e5b4cc943e047758e75d7be96ef12cb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:09.925071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:09.969481 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2441/4840] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:09 2021] POST /identity/v3/users => generated 413 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:09.970809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:09.974021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:09.975778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:09.988714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.000788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbae3-bb4f-4ff1-9f94-4a62227e0e90 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:10.008806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:10.010435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:10.010894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:10.011335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:10.012860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:10.016011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:10.135400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb', 'request_id': 'req-9edad8a1-0ce5-4b89-85a2-650fe9625665'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.142001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb', 'request_id': 'req-9edad8a1-0ce5-4b89-85a2-650fe9625665'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.191330 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2442/4841] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:09 2021] POST /identity/v3/roles => generated 243 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:10.192764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:10.195023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:10.233957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb', 'request_id': 'req-9edad8a1-0ce5-4b89-85a2-650fe9625665'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.249253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] The token cache is being invalidate because project 0e5b4cc943e047758e75d7be96ef12cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:10.249939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.250860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.261611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb', 'request_id': 'req-9edad8a1-0ce5-4b89-85a2-650fe9625665'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.262860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb', 'request_id': 'req-9edad8a1-0ce5-4b89-85a2-650fe9625665'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.262998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e5b4cc943e047758e75d7be96ef12cb', 'request_id': 'req-9edad8a1-0ce5-4b89-85a2-650fe9625665'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:10.279284 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2400/4842] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:09 2021] DELETE /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:10.280302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:10.281937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:10.289017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaa802-1e0d-463c-a0e9-9736b0388a37 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:10.360175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:10.361745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:10.362455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:10.362904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:10.366035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:10.385430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edad8a1-0ce5-4b89-85a2-650fe9625665 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:10.395378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:10.396484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:10.397686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:10.397838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:10.398794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:10.401276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:10.455189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:10.457552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:10.476457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2443/4843] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:10.477479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:10.478749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:10.495193 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2401/4844] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:10 2021] POST /identity/v3/roles => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:10.499317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:10.513090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171570-65ff-4637-a50c-a7fec988cf8c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:10.519715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:10.520834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:10.521608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:10.521608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/023823e70e1648beaa506c34fe5ee463/users/c1009ce7c8fd4157a70db4fdea56ab68/roles/8ab9771d804a4d62a4b1626357b1a975` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:10.538548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=023823e70e1648beaa506c34fe5ee463, user_id=c1009ce7c8fd4157a70db4fdea56ab68, role_id=8ab9771d804a4d62a4b1626357b1a975)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:10.542958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:10.591029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca456e2-6cce-4a56-a46e-b5dddc085283 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:10.596344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:10.597265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:10.597654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:10.598025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:10.599021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:10.600794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:10.656948 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2402/4845] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:10 2021] PUT /identity/v3/projects/023823e70e1648beaa506c34fe5ee463/users/c1009ce7c8fd4157a70db4fdea56ab68/roles/8ab9771d804a4d62a4b1626357b1a975 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:10.658004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:10.712546 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2444/4846] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:25:10 2021] POST /identity/v3/domains => generated 276 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:10.725579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:10.775070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6aa8e-e394-43ce-b999-614ac105f12b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:10.845668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad0e7c-707b-4ec2-9d18-80f97022c899 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:10.861562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:10.865329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:10.865329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:10.865329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:10.865329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:10.867886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:10.898479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:10.899556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:10.899856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:10.900143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/023823e70e1648beaa506c34fe5ee463/users/c1009ce7c8fd4157a70db4fdea56ab68/roles/da7628e9e40b4963b066ddb53c8a01d1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:10.904010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=023823e70e1648beaa506c34fe5ee463, user_id=c1009ce7c8fd4157a70db4fdea56ab68, role_id=da7628e9e40b4963b066ddb53c8a01d1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:10.910956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.046832 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2445/4847] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:25:10 2021] PUT /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config => generated 138 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:11.049473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.061601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd68a1-6648-49c8-b3d2-6b27eb52da05 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.068755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.071798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.072272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.072765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.074356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058, group=identity)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.075608 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:11.075608 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:25:11.075608 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:11.076639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.096286 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2403/4848] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:10 2021] PUT /identity/v3/projects/023823e70e1648beaa506c34fe5ee463/users/c1009ce7c8fd4157a70db4fdea56ab68/roles/da7628e9e40b4963b066ddb53c8a01d1 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:11.100407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.184214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef005e1-5bfd-4e07-8562-657e9fa5abea tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.191265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e73e87-ecb4-4053-a44e-a4bd484b532c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.191964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e73e87-ecb4-4053-a44e-a4bd484b532c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.192249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e73e87-ecb4-4053-a44e-a4bd484b532c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.192526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e73e87-ecb4-4053-a44e-a4bd484b532c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.194978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e73e87-ecb4-4053-a44e-a4bd484b532c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.197705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e73e87-ecb4-4053-a44e-a4bd484b532c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.231827 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2446/4849] 10.222.0.32 () {60 vars in 1296 bytes} [Sat Dec 25 21:25:11 2021] PATCH /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity => generated 177 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:11.236046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.251314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f5ab1-d48f-4a14-b644-a6a8750aec64 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.267626 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2404/4850] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:11 2021] GET /identity/v3/users => generated 9519 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:11.269560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7182ef5-4968-4c2b-954f-0a2eeb08f699 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.270174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7182ef5-4968-4c2b-954f-0a2eeb08f699 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.270679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7182ef5-4968-4c2b-954f-0a2eeb08f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.350882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e7182ef5-4968-4c2b-954f-0a2eeb08f699 None None] MFA Rules not processed for user `c1009ce7c8fd4157a70db4fdea56ab68`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:11.355452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e7182ef5-4968-4c2b-954f-0a2eeb08f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:11.407033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.407950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.408236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.408516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity/driver` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.409315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058, group=identity, option=driver)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.411219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.498785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2405/4851] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:11 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:11.514466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea3b7-46dd-4823-a422-96674c6b47cf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.514760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea3b7-46dd-4823-a422-96674c6b47cf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.514996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea3b7-46dd-4823-a422-96674c6b47cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.539706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-792ea3b7-46dd-4823-a422-96674c6b47cf None None] MFA Rules not processed for user `c1009ce7c8fd4157a70db4fdea56ab68`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:11.540425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-792ea3b7-46dd-4823-a422-96674c6b47cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:11.546730 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2447/4852] 10.222.0.32 () {60 vars in 1317 bytes} [Sat Dec 25 21:25:11 2021] PATCH /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity/driver => generated 176 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:11.550257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.556753 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2406/4853] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:11 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:11.561757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ea3b7-46dd-4823-a422-96674c6b47cf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.573198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ea3b7-46dd-4823-a422-96674c6b47cf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.575069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b163d6-bb87-4e40-a4bf-792f592eb19c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.578838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1009ce7c8fd4157a70db4fdea56ab68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023823e70e1648beaa506c34fe5ee463', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1384904541', 'tempest-DelegatedRole-731352668'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.579617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.579967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.580320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.581631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] RBAC: Authorizing `identity:create_trust()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.583156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.587175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.588082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.594112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.594112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity/driver` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.594112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058, group=identity, option=driver)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.595067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.739314 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2448/4854] 10.222.0.32 () {58 vars in 1298 bytes} [Sat Dec 25 21:25:11 2021] DELETE /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity/driver => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:11.740219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.753836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6f88b-9877-4fbf-8cfa-6f31bf570e69 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.760248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.762038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.767243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.767243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity/driver` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.767243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058, group=identity, option=driver)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.767243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.782656 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Could not find option driver in group identity in domain configuration for domain 6c91a8577d2a49b59f60494e833e7058.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 6c91a8577d2a49b59f60494e833e7058. Dec 25 21:25:11.784180 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2449/4855] 10.222.0.32 () {58 vars in 1295 bytes} [Sat Dec 25 21:25:11 2021] GET /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity/driver => generated 171 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:25:11.789880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.801218 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2407/4856] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:25:11 2021] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:11.806446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f830b-28e2-4e18-a09c-e215b24a96e5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.806953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.813306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.814729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.817496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.817496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.819438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058, group=identity)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.821351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.832590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2157c-b5f4-4b77-bde5-88a71d2f6474 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.837634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.838567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.839080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.839553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.841035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.842264 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:11.842264 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:25:11.842264 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:11.843546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.853665 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2408/4857] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:25:11 2021] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:11.859048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.877415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba93c6-7fba-4f52-9346-0e7ec60f1d13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.884448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1009ce7c8fd4157a70db4fdea56ab68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023823e70e1648beaa506c34fe5ee463', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1384904541', 'tempest-DelegatedRole-731352668'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.888451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.889017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.889498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] PATH_INFO: `/v3/OS-TRUST/trusts/137e24d153c74adda54eacf7047acfab` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.905662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] RBAC: Authorizing `identity:delete_trust(trust_id=137e24d153c74adda54eacf7047acfab)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.907115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.923672 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2450/4858] 10.222.0.32 () {58 vars in 1277 bytes} [Sat Dec 25 21:25:11 2021] DELETE /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:11.925023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:11.945613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886882-fe82-42cd-9b5b-50106285e7ad tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:11.957215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:11.961191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:11.961739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:11.962253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:11.965838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058, group=identity)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:11.974269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:11.995343 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Could not find group identity in domain configuration for domain 6c91a8577d2a49b59f60494e833e7058.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 6c91a8577d2a49b59f60494e833e7058. Dec 25 21:25:12.000385 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2451/4859] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:25:11 2021] GET /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config/identity => generated 154 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:12.005177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:12.017853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe61d7-1781-4935-a5b6-f5198864803a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:12.020539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '137e24d153c74adda54eacf7047acfab', 'request_id': 'req-e4bd804d-37d9-49ad-9cfb-890e2787590d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.021510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '137e24d153c74adda54eacf7047acfab', 'request_id': 'req-e4bd804d-37d9-49ad-9cfb-890e2787590d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.022890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '137e24d153c74adda54eacf7047acfab', 'request_id': 'req-e4bd804d-37d9-49ad-9cfb-890e2787590d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.023374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:12.024332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:12.024807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:12.024961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058/config` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:12.026068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=6c91a8577d2a49b59f60494e833e7058)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:12.027344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:12.135705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2452/4860] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:12 2021] DELETE /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058/config => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:12.138829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:12.139705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:12.142891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2409/4861] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:25:11 2021] DELETE /identity/v3/OS-TRUST/trusts/137e24d153c74adda54eacf7047acfab => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:12.148297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:12.151317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:12.159332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ba9f1-d2a4-4113-9cd6-5024cf840493 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:12.165357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:12.171433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:12.173050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:12.173757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:12.179032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6c91a8577d2a49b59f60494e833e7058)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:12.179196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd804d-37d9-49ad-9cfb-890e2787590d tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:12.181201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:12.187511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1009ce7c8fd4157a70db4fdea56ab68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '023823e70e1648beaa506c34fe5ee463', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1384904541', 'tempest-DelegatedRole-731352668'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:12.188610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:12.190319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:12.193262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] PATH_INFO: `/v3/OS-TRUST/trusts/137e24d153c74adda54eacf7047acfab` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:12.207900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6c91a8577d2a49b59f60494e833e7058'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.209014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6c91a8577d2a49b59f60494e833e7058'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.218973 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Could not find trust: 137e24d153c74adda54eacf7047acfab.: keystone.exception.TrustNotFound: Could not find trust: 137e24d153c74adda54eacf7047acfab. Dec 25 21:25:12.224772 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2410/4862] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:12 2021] GET /identity/v3/OS-TRUST/trusts/137e24d153c74adda54eacf7047acfab => generated 111 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:12.229505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:12.231425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:12.247605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322263d-a306-4cd9-bfd2-dc608a1afb22 tempest-TrustsV3TestJSON-1542138806 tempest-user-512943707] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:12.317025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:12.317893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:12.318176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:12.318451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/da7628e9e40b4963b066ddb53c8a01d1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:12.320511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=da7628e9e40b4963b066ddb53c8a01d1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:12.322155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:12.372749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6c91a8577d2a49b59f60494e833e7058'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.373398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6c91a8577d2a49b59f60494e833e7058'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.376964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2453/4863] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:12 2021] PATCH /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058 => generated 277 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:12.380200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:12.381701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:12.476355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dff10-a23b-4b19-9e80-883b8691edb2 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:12.484652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:12.486967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:12.487261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:12.487610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:12.505639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6c91a8577d2a49b59f60494e833e7058)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:12.508056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:12.535468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6c91a8577d2a49b59f60494e833e7058'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.557092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role da7628e9e40b4963b066ddb53c8a01d1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:12.558164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.560226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.564290 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2411/4864] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:12 2021] DELETE /identity/v3/roles/da7628e9e40b4963b066ddb53c8a01d1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:12.568696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:12.570180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:12.574588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6c91a8577d2a49b59f60494e833e7058'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.669192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615128cb-9719-452f-a3cc-f823c10ccf66 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:12.701840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c91a8577d2a49b59f60494e833e7058', 'request_id': 'req-92f3f800-d8a2-4c86-9840-7968c2c1bde5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.748502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:12.749457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:12.749737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:12.750009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/8ab9771d804a4d62a4b1626357b1a975` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:12.751568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ab9771d804a4d62a4b1626357b1a975)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:12.753217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:12.800684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c91a8577d2a49b59f60494e833e7058', 'request_id': 'req-92f3f800-d8a2-4c86-9840-7968c2c1bde5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.809813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c91a8577d2a49b59f60494e833e7058', 'request_id': 'req-92f3f800-d8a2-4c86-9840-7968c2c1bde5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.822144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] The token cache is being invalidate because project 6c91a8577d2a49b59f60494e833e7058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:12.822439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.823112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.830448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6c91a8577d2a49b59f60494e833e7058', 'request_id': 'req-92f3f800-d8a2-4c86-9840-7968c2c1bde5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.831217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6c91a8577d2a49b59f60494e833e7058', 'request_id': 'req-92f3f800-d8a2-4c86-9840-7968c2c1bde5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.831854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6c91a8577d2a49b59f60494e833e7058', 'request_id': 'req-92f3f800-d8a2-4c86-9840-7968c2c1bde5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:12.860347 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2454/4865] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:12 2021] DELETE /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:12.861352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:12.862864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:12.956433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3f800-d8a2-4c86-9840-7968c2c1bde5 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:12.968823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:12.969597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:12.969956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:12.970320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:12.971050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:12.972157 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:12.972157 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:25:12.972157 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:12.973310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:12.983292 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2455/4866] 10.222.0.32 () {58 vars in 1172 bytes} [Sat Dec 25 21:25:12 2021] GET /identity/v3/domains/config/default => generated 1527 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:12.984192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.009225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91648b9e-3c62-4ca4-a2a4-a11f12a57806 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.010310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 8ab9771d804a4d62a4b1626357b1a975 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:13.010629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:13.011373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:13.018067 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2412/4867] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:12 2021] DELETE /identity/v3/roles/8ab9771d804a4d62a4b1626357b1a975 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:13.029300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.032781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.033708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.034108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.034348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.035123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.037114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.038410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:13.043976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2456/4868] 10.222.0.32 () {58 vars in 1199 bytes} [Sat Dec 25 21:25:12 2021] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.047605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.052116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:13.083670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69c6c4-d208-4314-8f14-edc492a402b4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.201832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.202605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.202892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.203543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.204362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.206138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.210783 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2457/4869] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:13.212756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ecae-f15c-4b53-9c20-2138d909ace4 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.214053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.226295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.227149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.229289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.229289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users/c1009ce7c8fd4157a70db4fdea56ab68` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.233020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c1009ce7c8fd4157a70db4fdea56ab68)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.235156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.236709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cc1fd-4ff0-459c-b22c-da83815383eb tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.243627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.245045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.245633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.246388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.247305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.249250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.254921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2458/4870] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.256550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.268540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465c69-2a6e-4d3c-bd65-27c9baff5c33 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.277300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.278783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.279334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.279856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.281877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.283905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.290996 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2459/4871] 10.222.0.32 () {58 vars in 1187 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:13.296574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.309672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6509f6-7ce1-4f42-b11e-6dfb6ddd8778 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.315018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.320522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.320522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.320522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.320522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.320926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.320926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2460/4872] 10.222.0.32 () {58 vars in 1199 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.323806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.335787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129be51-bb03-4ed5-b2c6-ca74046037bf tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.341002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.341891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.342251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.342541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.344027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.345192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.347761 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2461/4873] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:13.353614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.366191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c44ae5-937d-4579-9ccc-c536a170d503 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.373315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.374647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.374647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.374879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.375610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.377467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.378597 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2462/4874] 10.222.0.32 () {58 vars in 1208 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:13.382882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.397708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be86fa7-729d-448e-8e7b-6a10495b9719 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.408933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1009ce7c8fd4157a70db4fdea56ab68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:13.419982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1009ce7c8fd4157a70db4fdea56ab68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:13.420464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.422959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.423608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.424086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.425633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.428680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.434387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1009ce7c8fd4157a70db4fdea56ab68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:13.437955 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2463/4875] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.438115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1009ce7c8fd4157a70db4fdea56ab68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:13.438115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1009ce7c8fd4157a70db4fdea56ab68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:13.441863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.449450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:13.473061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc33c-440a-4e36-a004-7677a2d4bad7 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.481622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.481622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.481622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.482637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.484148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.486187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.491900 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2464/4876] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.493111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.505362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bce42-67bf-45e4-99c2-afb60f3d045e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.512729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.513845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.514339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.514817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.516227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.518197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.521416 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2465/4877] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.524026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.535619 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2413/4878] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:13 2021] DELETE /identity/v3/users/c1009ce7c8fd4157a70db4fdea56ab68 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:13.539297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777877-5b0f-4b66-97a3-fa2e7ae3ce76 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.542063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.544069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:13.658221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.660064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.660849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.661392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.662313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.665005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.671637 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2466/4879] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:13.674462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.675188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409868f0-8fc2-4fe0-98f2-a72bcd20c41c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.688315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a37b49-09df-4eff-afdb-9c4d9541006a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.693974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.699558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.699735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.699829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.699920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.700011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.700110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/023823e70e1648beaa506c34fe5ee463` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.700201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.700201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.700374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_project(project_id=023823e70e1648beaa506c34fe5ee463)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.700473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.700562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.705311 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2467/4880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.706770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.719056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f35ec-c800-476c-b920-efe053fde278 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.727399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.728734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.729555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.730063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.730947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.733383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.738810 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2468/4881] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.740381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.755589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90429-f9bd-4563-abf7-0432a185845f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.766592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.769954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.773505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.773505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.773505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.775304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.777095 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2469/4882] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.781755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.802570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad52ff-53ae-472f-b7cc-e761a37f57ed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.810915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.813716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.813716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.813716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.813716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.816031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.818901 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2470/4883] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:13.822653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.841430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9240-d664-441b-b768-e04c62ad9d10 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.851005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:13.851815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:13.852325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:13.852325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:13.853028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:13.858155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:13.862929 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2471/4884] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:13.864024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:13.877123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0c44-89f1-4dc0-bdb0-05b2248f2f2b tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:13.998272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.000076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.000636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.001707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.004489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.008541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.018092 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2472/4885] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:13 2021] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.021792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.022778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023823e70e1648beaa506c34fe5ee463', 'request_id': 'req-29f99287-5c72-4758-87b8-0400a46d0b4a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:14.035988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023823e70e1648beaa506c34fe5ee463', 'request_id': 'req-29f99287-5c72-4758-87b8-0400a46d0b4a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:14.040803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ffde-ffd4-4edb-ba57-f264d0318efa tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.052850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.055174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.056749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.057289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.065388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.066735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.068330 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2473/4886] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:14.072790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.123768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494578a0-56f3-4820-8e1c-d68c7a907bcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.135891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.137154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.137841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.139097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.140572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.143059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.145824 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2474/4887] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:14.150529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.157577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023823e70e1648beaa506c34fe5ee463', 'request_id': 'req-29f99287-5c72-4758-87b8-0400a46d0b4a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:14.177694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] The token cache is being invalidate because project 023823e70e1648beaa506c34fe5ee463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:14.179578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:14.181163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:14.181590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54999-241f-439a-819b-6ff5bc4e8b23 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.187718 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2414/4888] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:13 2021] DELETE /identity/v3/projects/023823e70e1648beaa506c34fe5ee463 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:14.190339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.190339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.190339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.190921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.192660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.194364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.195190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.196348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:14.199779 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2475/4889] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:14.201200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.203160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:14.222264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623bda3-d290-4d32-bb69-57cb55928aac tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.226892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.227882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.228286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.229055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.229481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.231380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.232691 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2476/4890] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.246114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.281354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f9d0-9765-401a-b0c2-f53daa4fd433 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.303400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.305358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.305358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.305358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.306081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.307790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.315343 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2477/4891] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.319613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.337163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23235-1c21-4b46-88aa-5f6f8fa3b75d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.342511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.343422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.343790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.344129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.344913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.346651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.348081 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2478/4892] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.352356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.363500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a6cec-c567-4572-8bb1-93d7dc5a3ac6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.368999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.369873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.370228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.370598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.371340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.373048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.378566 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2479/4893] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:14.379715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.390350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99287-5c72-4758-87b8-0400a46d0b4a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.399179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514380fc-9874-4569-89f5-d27f8cc5f75a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.403982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.405404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.406370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.406726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.407137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.407244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.407345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.407845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.409350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.409548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.411528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.414641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.421380 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2480/4894] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.422723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.440466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c089b09-94c9-4207-852e-d2f7a3d0eeb0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.449504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.450659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.453019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.453557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.454470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.462445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.463719 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2481/4895] 10.222.0.32 () {58 vars in 1289 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.464921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.476333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fcfae-1e08-4cc8-b38a-2e70291b1eed tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.482502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.484268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.485881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.489048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.489048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.491468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.497411 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2482/4896] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.498433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.515153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c9e32-7682-4770-8499-8f161e3d4763 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.520505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.521346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.521654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.522467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.523141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.524885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.529565 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2483/4897] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.532825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.546479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fd003-a82f-42e3-867f-81df797dfee8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.553770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.554597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.556443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.556443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.556443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.558174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.561363 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2484/4898] 10.222.0.32 () {58 vars in 1307 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.564018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.581536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3ce4-db72-48fa-897e-c9772c81f6c1 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.584024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2415/4899] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:25:14 2021] POST /identity/v3/projects => generated 329 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:14.588156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.670315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.671535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.672535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.673131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.674049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.676720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.685819 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2485/4900] 10.222.0.32 () {58 vars in 1289 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.687205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.706573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f109ba-b502-4b29-a87a-9ac56d4c7de0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.719294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.719646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7653d-156f-4f90-8ebf-cfef8d57aee6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.720232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.720527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.720988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.721719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.723320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.724461 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2486/4901] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.729003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.729874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.730623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.730940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.731268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.732072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.735142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.752820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bedb4-a5ab-4e27-a8c8-0e13034720a8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.758320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.759273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.759560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.760027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.760695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.762902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.767728 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2487/4902] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:14.769151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.781946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8797ea-82ca-4ad1-a900-8aff07e1caae tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.792143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.793408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.793823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.794113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.794776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.796769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.801580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2488/4903] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.802526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.818038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a8305-77eb-4bf6-8140-444a76e2193c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.823264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.824138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.824426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.824694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.825426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.827803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.833705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2489/4904] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.836089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.852185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b5cfc-8a4b-4be2-b1d9-512d8993e888 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.858965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.859763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.860042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.860811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.861517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.864797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.870991 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2490/4905] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.877284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.877447 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2416/4906] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:14 2021] POST /identity/v3/users => generated 413 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:14.878380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.888832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f00d0-67db-49c5-a113-67b66b7a4f2a tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.896497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d263519-4a48-45fd-b9f3-28a14f7452af tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.900215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.911818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.911818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.911818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.911818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.912365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.914391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.915102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.915383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.915652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.915995 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2491/4907] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.916935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.917854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.923326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.936850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceff342-ecd0-4b6c-a648-92cdf44071c6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.941970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.943202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.943499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.944360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.945238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.946829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.948646 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2492/4908] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.951915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:14.968174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f5543-8221-4e5c-826f-a34e4611b8e4 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:14.977372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:14.978366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:14.978717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:14.979001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:14.979730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:14.981359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:14.984949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2493/4909] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:14.986469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.005587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9532a1-ce14-4fbe-b15b-b68ee0dcdcb8 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.015387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.017644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.017644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.017644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.018403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.020902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.021743 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2417/4910] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:14 2021] POST /identity/v3/roles => generated 243 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:15.023427 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2494/4911] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:25:14 2021] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.025621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.030335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.048524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5ee7a-ab05-4720-8b8c-57cbf9ff1f28 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.054138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.054992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.055674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.055828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe27941-e6e9-457a-8e63-c3df1f6b2041 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.055955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.056200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.057845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.061887 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2495/4912] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.062741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.063200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.063623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.064005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.064442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.065729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.069480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.079408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5415b8-0255-43e9-ad4d-b2d3a2f83749 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.081432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.082272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.083167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.083457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.084652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.091404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.092997 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2496/4913] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:15.098582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.109434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c4ca0-6b3f-4c05-a312-72eed486990e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.114392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.115164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.116099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.116099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.117560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.119083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.123253 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2497/4914] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.123973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.135581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c61b3-a2a0-47e4-8e19-bfbae4d28d2c tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.141271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.142120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.142393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.142845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.143493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.145324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.146576 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2498/4915] 10.222.0.32 () {58 vars in 1211 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.150902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.153726 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2418/4916] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:15 2021] POST /identity/v3/roles => generated 246 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:15.162106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.165730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b230-8c42-41b8-96f3-2775e113db8f tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.170971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.171897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.172186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.175921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.175921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.176160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad5003-16ad-4a96-9b36-4294dd830e3d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.176295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.176295 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2499/4917] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:15.179728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.179907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.180862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.181480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.182010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/19ca21b7ce8c44e581eddbe4f16a18a4/users/e05a4806f75749f0857f495d0f46e0e1/roles/f45fe03e8db3443794f63fa284f73006` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.197852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84526f-ceaf-40c5-a55a-891d1b939c17 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.200574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=19ca21b7ce8c44e581eddbe4f16a18a4, user_id=e05a4806f75749f0857f495d0f46e0e1, role_id=f45fe03e8db3443794f63fa284f73006)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.203753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.203913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.205086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.205389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.206136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.207887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.212431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.216080 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2500/4918] 10.222.0.32 () {58 vars in 1214 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:15.219806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.236186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236c939-2210-4625-ad40-b1a3354d667d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.243271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.244051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.244336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.244614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.245430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.247233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.250718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2501/4919] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:15.254001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.255163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2419/4920] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:15 2021] PUT /identity/v3/projects/19ca21b7ce8c44e581eddbe4f16a18a4/users/e05a4806f75749f0857f495d0f46e0e1/roles/f45fe03e8db3443794f63fa284f73006 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:15.259434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.271148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20992f8-d643-4f55-9048-2c672986c9b6 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.342037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9888b31-0879-477e-ae66-e00a3c43e996 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.347777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.351118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.351118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.351118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/19ca21b7ce8c44e581eddbe4f16a18a4/users/e05a4806f75749f0857f495d0f46e0e1/roles/436522554e814cd4b2cfb6ff71450908` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.353600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=19ca21b7ce8c44e581eddbe4f16a18a4, user_id=e05a4806f75749f0857f495d0f46e0e1, role_id=436522554e814cd4b2cfb6ff71450908)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.356581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.375709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.375709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.375709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.375995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.375995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.378135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.381588 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2502/4921] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Dec 25 21:25:15.384088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.416720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ef981-209d-4a3d-b2b8-d848edc22e5e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.422169 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2420/4922] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:15 2021] PUT /identity/v3/projects/19ca21b7ce8c44e581eddbe4f16a18a4/users/e05a4806f75749f0857f495d0f46e0e1/roles/436522554e814cd4b2cfb6ff71450908 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:15.426348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.553761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.555219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.555974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.556264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.557912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.559266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.560613 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2503/4923] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.564273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.567429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efd6e8-5433-49ff-9c4e-d39f850927c9 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.572607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d9d29-6c29-466d-a8e2-0241b043c29c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.573569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9d29-6c29-466d-a8e2-0241b043c29c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.574362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9d29-6c29-466d-a8e2-0241b043c29c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.574362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9d29-6c29-466d-a8e2-0241b043c29c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.575356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d9d29-6c29-466d-a8e2-0241b043c29c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.577418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d9d29-6c29-466d-a8e2-0241b043c29c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.579311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9811ed-8cf0-4eef-93dd-3b64d5d5664d tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.585254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.586174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.586519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.586880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.587900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.590045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.592404 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2504/4924] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.596482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.613623 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2421/4925] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/users => generated 9519 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:15.619032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.619552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.620039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.624929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547530d-8e01-48d3-9a2f-fa8cca1c3fcd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.638214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.639046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.639326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.639601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.640305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.647689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.653774 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2505/4926] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.657025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.671858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6ed97-4654-420a-9a70-41f3cfe9ea22 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.672214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] MFA Rules not processed for user `e05a4806f75749f0857f495d0f46e0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:15.673728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:15.679122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.680143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.680598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.681093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.682168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.693514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.693514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2506/4927] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.693514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.702122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39fb8-e13a-44a3-ad43-8aeebba73c48 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.708531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.711303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.711775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.716530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.716530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.716530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.719986 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2507/4928] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.721026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.735742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76738c9-2e9c-4ed8-9028-fd3ed4c54ad0 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.744301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.745100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.746284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.747281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.748952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:15.750991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:15.752622 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2508/4929] 10.222.0.32 () {58 vars in 1277 bytes} [Sat Dec 25 21:25:15 2021] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Dec 25 21:25:15.758866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.773438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a497a-3be2-46e5-8902-a2b418f876bd tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.779827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.781310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.785362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.785362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/6c91a8577d2a49b59f60494e833e7058` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.796693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:15.801810 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Could not find domain: 6c91a8577d2a49b59f60494e833e7058.: keystone.exception.DomainNotFound: Could not find domain: 6c91a8577d2a49b59f60494e833e7058. Dec 25 21:25:15.803438 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2509/4930] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:15 2021] PATCH /identity/v3/domains/6c91a8577d2a49b59f60494e833e7058 => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:25:15.807655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.820188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c18915-af26-4843-8fad-d5a2cc59371e tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.825625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.826360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.826640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.826913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/0e5b4cc943e047758e75d7be96ef12cb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.835401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:15.844922 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Could not find domain: 0e5b4cc943e047758e75d7be96ef12cb.: keystone.exception.DomainNotFound: Could not find domain: 0e5b4cc943e047758e75d7be96ef12cb. Dec 25 21:25:15.854236 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2510/4931] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:15 2021] PATCH /identity/v3/domains/0e5b4cc943e047758e75d7be96ef12cb => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:25:15.862980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.876370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f5e54-a339-4f36-a142-52043aeef5ff tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:15.891630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217f9a1-40e1-446b-99cf-ab432248ba53 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ef58fea9704267a52fc68a98ae7f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd68ffb1099fa4d8aa0c9b178d7578620', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:15.892506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217f9a1-40e1-446b-99cf-ab432248ba53 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.897236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217f9a1-40e1-446b-99cf-ab432248ba53 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.897236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217f9a1-40e1-446b-99cf-ab432248ba53 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] PATH_INFO: `/v3/domains/066343adaa4c4b3fad84acc16c88ef99` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:15.898679 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2422/4932] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:15 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:15.900906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217f9a1-40e1-446b-99cf-ab432248ba53 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:15.910645 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-b217f9a1-40e1-446b-99cf-ab432248ba53 tempest-DomainConfigurationTestJSON-1651529065 tempest-DomainConfigurationTestJSON-1651529065-project-admin] Could not find domain: 066343adaa4c4b3fad84acc16c88ef99.: keystone.exception.DomainNotFound: Could not find domain: 066343adaa4c4b3fad84acc16c88ef99. Dec 25 21:25:15.912056 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2511/4933] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:15 2021] PATCH /identity/v3/domains/066343adaa4c4b3fad84acc16c88ef99 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:15.917856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:15.920742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:15.979417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579a894-3530-4439-9f2b-65bb921c78bf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:15.979705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579a894-3530-4439-9f2b-65bb921c78bf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:15.979984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579a894-3530-4439-9f2b-65bb921c78bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.011619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c579a894-3530-4439-9f2b-65bb921c78bf None None] MFA Rules not processed for user `e05a4806f75749f0857f495d0f46e0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:16.016207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c579a894-3530-4439-9f2b-65bb921c78bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:16.040278 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2512/4934] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:15 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:25:16.041376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579a894-3530-4439-9f2b-65bb921c78bf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:16.045772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e002dd-7a57-4d00-850e-ee31b10f6541 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:16.061800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:16.061984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579a894-3530-4439-9f2b-65bb921c78bf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:16.062107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.062107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.062107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] PATH_INFO: `/v3/users/22111afe17e84c769aa352b0e95f7436` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.062107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22111afe17e84c769aa352b0e95f7436)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:16.063908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05a4806f75749f0857f495d0f46e0e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ca21b7ce8c44e581eddbe4f16a18a4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-317838132', 'tempest-NotDelegatedRole-520997120'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:16.064207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:16.065125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.065125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.065369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.066462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: Authorizing `identity:create_trust()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:16.067086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:16.292069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2513/4935] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:25:16 2021] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:16.295886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:16.305969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b691f7b-f4f8-42b1-8c0b-54b0d4eb96b0 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:16.313633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05a4806f75749f0857f495d0f46e0e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ca21b7ce8c44e581eddbe4f16a18a4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-317838132', 'tempest-NotDelegatedRole-520997120'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:16.313633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.313633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.313956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.313956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:16.314142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:16.320313 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2514/4936] 10.222.0.32 () {58 vars in 1251 bytes} [Sat Dec 25 21:25:16 2021] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=e05a4806f75749f0857f495d0f46e0e1 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:25:16.324200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:16.334005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d42f-3ba2-4a69-b25f-d64008c275b8 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:16.341019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05a4806f75749f0857f495d0f46e0e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ca21b7ce8c44e581eddbe4f16a18a4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-317838132', 'tempest-NotDelegatedRole-520997120'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:16.343929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.343929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.343929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] PATH_INFO: `/v3/OS-TRUST/trusts/95936100a8ca4afb8f8e1f386c4662aa` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.360635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: Authorizing `identity:delete_trust(trust_id=95936100a8ca4afb8f8e1f386c4662aa)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:16.362902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:16.378619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22111afe17e84c769aa352b0e95f7436'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.388133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22111afe17e84c769aa352b0e95f7436'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.413242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22111afe17e84c769aa352b0e95f7436'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.414016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22111afe17e84c769aa352b0e95f7436'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.414636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6552815-cf60-4109-b796-24c645cd801f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22111afe17e84c769aa352b0e95f7436'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.478287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '95936100a8ca4afb8f8e1f386c4662aa', 'request_id': 'req-321bb5ce-e4e1-478c-a56b-0c04aea2b513'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.479753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '95936100a8ca4afb8f8e1f386c4662aa', 'request_id': 'req-321bb5ce-e4e1-478c-a56b-0c04aea2b513'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.480620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '95936100a8ca4afb8f8e1f386c4662aa', 'request_id': 'req-321bb5ce-e4e1-478c-a56b-0c04aea2b513'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:16.557259 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2423/4937] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:15 2021] DELETE /identity/v3/users/22111afe17e84c769aa352b0e95f7436 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:16.562231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.562615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.563320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.595997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:16.597558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:16.613378 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2515/4938] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:25:16 2021] DELETE /identity/v3/OS-TRUST/trusts/95936100a8ca4afb8f8e1f386c4662aa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:16.618579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:16.621635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:16.642291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bb5ce-e4e1-478c-a56b-0c04aea2b513 tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:16.695123 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2424/4939] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:16.719574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:16.735953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:16.736077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05a4806f75749f0857f495d0f46e0e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19ca21b7ce8c44e581eddbe4f16a18a4', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-317838132', 'tempest-NotDelegatedRole-520997120'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:16.736077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.736077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.736456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] PATH_INFO: `/v3/OS-TRUST/trusts/95936100a8ca4afb8f8e1f386c4662aa` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.754462 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Could not find trust: 95936100a8ca4afb8f8e1f386c4662aa.: keystone.exception.TrustNotFound: Could not find trust: 95936100a8ca4afb8f8e1f386c4662aa. Dec 25 21:25:16.756203 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2516/4940] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:16 2021] GET /identity/v3/OS-TRUST/trusts/95936100a8ca4afb8f8e1f386c4662aa => generated 111 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:25:16.759866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:16.762360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:16.822020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52f926-019e-429a-bf9f-08459ce91480 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:16.837727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:16.839491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.839938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.840374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.851479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba62622-dc6d-4d51-88a7-a3c74cb4fbdb tempest-TrustsV3TestJSON-1290315065 tempest-user-666402468] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:16.856370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:16.857271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:16.857555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:16.857833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/436522554e814cd4b2cfb6ff71450908` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:16.859409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=436522554e814cd4b2cfb6ff71450908)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:16.861174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:16.864413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:16.864413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:16.885301 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2425/4941] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:25:17.049875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 436522554e814cd4b2cfb6ff71450908 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:17.050235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.051012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.057173 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2517/4942] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:16 2021] DELETE /identity/v3/roles/436522554e814cd4b2cfb6ff71450908 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:17.060750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:17.076797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7dcb7-2f54-450b-be6a-d36cf76bb95f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:17.160913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:17.162320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:17.162947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:17.163917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/f45fe03e8db3443794f63fa284f73006` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:17.166752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f45fe03e8db3443794f63fa284f73006)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:17.169237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:17.419538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role f45fe03e8db3443794f63fa284f73006 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:17.419837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.420528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.424139 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2426/4943] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:17 2021] DELETE /identity/v3/roles/f45fe03e8db3443794f63fa284f73006 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:17.427902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:17.429917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:17.447108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769048c9-a46b-4332-9bb2-84416dde567a tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:17.514731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:17.516155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:17.516379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:17.516727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users/e05a4806f75749f0857f495d0f46e0e1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:17.518120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e05a4806f75749f0857f495d0f46e0e1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:17.520120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:17.702952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05a4806f75749f0857f495d0f46e0e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.714181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05a4806f75749f0857f495d0f46e0e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.761032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05a4806f75749f0857f495d0f46e0e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.762850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05a4806f75749f0857f495d0f46e0e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.878839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05a4806f75749f0857f495d0f46e0e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:17.885683 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2518/4944] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:17 2021] DELETE /identity/v3/users/e05a4806f75749f0857f495d0f46e0e1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:17.890282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:17.891933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:17.911808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2bf6e-e2c3-45f8-bed8-34bd150d69d7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:18.043770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:18.046102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:18.046678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:18.047333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/19ca21b7ce8c44e581eddbe4f16a18a4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:18.049019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19ca21b7ce8c44e581eddbe4f16a18a4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:18.051228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:18.197033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:18.198398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:18.285496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ca21b7ce8c44e581eddbe4f16a18a4', 'request_id': 'req-2fc345de-171c-4698-b64b-f00df154b405'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.306361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ca21b7ce8c44e581eddbe4f16a18a4', 'request_id': 'req-2fc345de-171c-4698-b64b-f00df154b405'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.327967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077409b6-df95-4e32-b415-3c60baf0759d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:18.387364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:18.388248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:18.388533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:18.388800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] PATH_INFO: `/v3/projects/a195554218a94cc891fb5ee2097a42ed` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:18.390964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a195554218a94cc891fb5ee2097a42ed)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:18.393162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:18.461205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ca21b7ce8c44e581eddbe4f16a18a4', 'request_id': 'req-2fc345de-171c-4698-b64b-f00df154b405'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.473896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] The token cache is being invalidate because project 19ca21b7ce8c44e581eddbe4f16a18a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:18.474590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.476250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.478535 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2427/4945] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:17 2021] DELETE /identity/v3/projects/19ca21b7ce8c44e581eddbe4f16a18a4 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:18.486648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:18.488499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:18.565648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a195554218a94cc891fb5ee2097a42ed', 'request_id': 'req-c7e99e42-6a60-426a-9261-011eac77cd4c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.591432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc345de-171c-4698-b64b-f00df154b405 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:18.655539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a195554218a94cc891fb5ee2097a42ed', 'request_id': 'req-c7e99e42-6a60-426a-9261-011eac77cd4c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.670829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:18.671820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:18.672378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:18.672906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:18.673840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:18.676220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a195554218a94cc891fb5ee2097a42ed', 'request_id': 'req-c7e99e42-6a60-426a-9261-011eac77cd4c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.677186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:18.692594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] The token cache is being invalidate because project a195554218a94cc891fb5ee2097a42ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:18.692916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.694050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:18.696214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2519/4946] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:18 2021] DELETE /identity/v3/projects/a195554218a94cc891fb5ee2097a42ed => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:18.699923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:18.702075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:18.796019 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2428/4947] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:25:18 2021] POST /identity/v3/projects => generated 328 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:18.797005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:18.801353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:18.801999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99e42-6a60-426a-9261-011eac77cd4c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:18.892002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:18.897964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:18.898638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:18.899128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] PATH_INFO: `/v3/users/99ef58fea9704267a52fc68a98ae7f1a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:18.900667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ef58fea9704267a52fc68a98ae7f1a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:18.903047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:18.912000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3274ab-c361-408b-9f04-84015edeac9d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:18.918128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:18.919759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:18.920039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:18.920434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:18.921429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:18.923469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:19.021101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2429/4948] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:18 2021] POST /identity/v3/users => generated 416 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:19.022550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:19.025216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:19.041025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf982daa-5540-432d-b62e-5e3bba1e20b8 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:19.046594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:19.047618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:19.047921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:19.048181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] PATH_INFO: `/v3/users/d2cc54d7a742403f896dd71d222895c2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:19.050288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cc54d7a742403f896dd71d222895c2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:19.052483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:19.127240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ef58fea9704267a52fc68a98ae7f1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.135408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ef58fea9704267a52fc68a98ae7f1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.153059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ef58fea9704267a52fc68a98ae7f1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.153059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ef58fea9704267a52fc68a98ae7f1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.242507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ef58fea9704267a52fc68a98ae7f1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.251645 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2520/4949] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:18 2021] DELETE /identity/v3/users/99ef58fea9704267a52fc68a98ae7f1a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:19.251645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:19.252998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:19.291860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cc54d7a742403f896dd71d222895c2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.305068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cc54d7a742403f896dd71d222895c2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.323355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cc54d7a742403f896dd71d222895c2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.324498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cc54d7a742403f896dd71d222895c2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.325360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cc54d7a742403f896dd71d222895c2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:19.354889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2363233-bbff-40eb-9ff0-28d44e92dccc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:19.362957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:19.363641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:19.363928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:19.364207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:19.365003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:19.368128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:19.426041 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2430/4950] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:19 2021] DELETE /identity/v3/users/d2cc54d7a742403f896dd71d222895c2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:19.513419 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2521/4951] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:19 2021] POST /identity/v3/roles => generated 243 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:19.517587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:19.519235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:19.611086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f0e3e-ccfb-4c2a-987f-3d6bf94c985e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:19.617798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:19.618977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:19.619322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:19.619671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:19.620526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:19.622488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:19.738376 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2431/4952] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:19 2021] POST /identity/v3/roles => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:19.744055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:19.762049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eaa5a-01a2-4abb-8000-e5b005e0ade6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:19.767537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:19.768752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:19.768936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:19.769258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/4619cd6167664ff8ba6376a5f3162c1b/users/f88569624b0d48c28d61138fb583af6e/roles/02a1c4033e044754bfd38f65ce42bfa5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:19.781749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:19.788335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4619cd6167664ff8ba6376a5f3162c1b, user_id=f88569624b0d48c28d61138fb583af6e, role_id=02a1c4033e044754bfd38f65ce42bfa5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:19.791327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:19.791731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:19.905074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df457e6-f7d7-45c7-849b-98bce35379d5 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:19.909776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:19.910902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:19.911186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:19.911460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] PATH_INFO: `/v3/users/22804fe0bc4948e08d0ceafc6b99d0f0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:19.913235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22804fe0bc4948e08d0ceafc6b99d0f0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:19.915152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:19.996598 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2522/4953] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:19 2021] PUT /identity/v3/projects/4619cd6167664ff8ba6376a5f3162c1b/users/f88569624b0d48c28d61138fb583af6e/roles/02a1c4033e044754bfd38f65ce42bfa5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:19.997085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:19.998511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.077110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45819d9-b36a-4fcd-8319-8eee1be5b8cc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:20.085376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:20.086704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.086704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.087395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] PATH_INFO: `/v3/projects/4c3545b07d0b4ccf9cd48a80c2d37521` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.088916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3545b07d0b4ccf9cd48a80c2d37521)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:20.092901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:20.218199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22804fe0bc4948e08d0ceafc6b99d0f0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.226210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22804fe0bc4948e08d0ceafc6b99d0f0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.239961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22804fe0bc4948e08d0ceafc6b99d0f0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.246929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22804fe0bc4948e08d0ceafc6b99d0f0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.246929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22804fe0bc4948e08d0ceafc6b99d0f0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.247156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3545b07d0b4ccf9cd48a80c2d37521', 'request_id': 'req-c202460d-c1d1-48b0-8721-f3836c582f08'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.342174 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2432/4954] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:19 2021] DELETE /identity/v3/users/22804fe0bc4948e08d0ceafc6b99d0f0 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:20.343909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:20.346468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.380134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3545b07d0b4ccf9cd48a80c2d37521', 'request_id': 'req-c202460d-c1d1-48b0-8721-f3836c582f08'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.388693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3545b07d0b4ccf9cd48a80c2d37521', 'request_id': 'req-c202460d-c1d1-48b0-8721-f3836c582f08'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.401376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] The token cache is being invalidate because project 4c3545b07d0b4ccf9cd48a80c2d37521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:20.401673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.402352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.404166 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2523/4955] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:19 2021] DELETE /identity/v3/projects/4c3545b07d0b4ccf9cd48a80c2d37521 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:20.404683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:20.406030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.433113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbacb-81c0-4102-9b4d-547be13130b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:20.438111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d089709-77d0-4eea-98c9-ec292a60e057 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:20.439054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d089709-77d0-4eea-98c9-ec292a60e057 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.439334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d089709-77d0-4eea-98c9-ec292a60e057 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.439631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d089709-77d0-4eea-98c9-ec292a60e057 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/4619cd6167664ff8ba6376a5f3162c1b/users/f88569624b0d48c28d61138fb583af6e/roles/ad3df65e206144d2903246c6addcf1bd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.441988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d089709-77d0-4eea-98c9-ec292a60e057 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4619cd6167664ff8ba6376a5f3162c1b, user_id=f88569624b0d48c28d61138fb583af6e, role_id=ad3df65e206144d2903246c6addcf1bd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:20.446184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d089709-77d0-4eea-98c9-ec292a60e057 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:20.480993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202460d-c1d1-48b0-8721-f3836c582f08 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:20.542478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:20.543346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.543633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.543903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] PATH_INFO: `/v3/projects/d68ffb1099fa4d8aa0c9b178d7578620` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.545242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68ffb1099fa4d8aa0c9b178d7578620)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:20.547243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:20.547637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2433/4956] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:20 2021] PUT /identity/v3/projects/4619cd6167664ff8ba6376a5f3162c1b/users/f88569624b0d48c28d61138fb583af6e/roles/ad3df65e206144d2903246c6addcf1bd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:20.549444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43ce18-eb74-4b62-ac68-c524d54d8112 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.549992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43ce18-eb74-4b62-ac68-c524d54d8112 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.550805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43ce18-eb74-4b62-ac68-c524d54d8112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.567586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1b43ce18-eb74-4b62-ac68-c524d54d8112 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:20.569382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1b43ce18-eb74-4b62-ac68-c524d54d8112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.636832 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2434/4957] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:20.638601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.639111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.639771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.662714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:20.664439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.693353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68ffb1099fa4d8aa0c9b178d7578620', 'request_id': 'req-cba3f8f2-974e-4e5a-b749-5e0531bac187'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.731779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2435/4958] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:20.732861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:20.744461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.769285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68ffb1099fa4d8aa0c9b178d7578620', 'request_id': 'req-cba3f8f2-974e-4e5a-b749-5e0531bac187'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.779719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68ffb1099fa4d8aa0c9b178d7578620', 'request_id': 'req-cba3f8f2-974e-4e5a-b749-5e0531bac187'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.799630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] The token cache is being invalidate because project d68ffb1099fa4d8aa0c9b178d7578620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:20.802177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.802177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:20.802408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2524/4959] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:20 2021] DELETE /identity/v3/projects/d68ffb1099fa4d8aa0c9b178d7578620 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:20.808100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:20.813146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.821631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec1de5-37ee-4d2d-bb7d-7933b2a0b8a4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:20.828555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fff5a6-5afb-4304-be21-f28a62fc8f0d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:20.829631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fff5a6-5afb-4304-be21-f28a62fc8f0d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.830293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fff5a6-5afb-4304-be21-f28a62fc8f0d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.830734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fff5a6-5afb-4304-be21-f28a62fc8f0d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.831820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fff5a6-5afb-4304-be21-f28a62fc8f0d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:20.835626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fff5a6-5afb-4304-be21-f28a62fc8f0d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:20.873366 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2436/4960] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:20 2021] GET /identity/v3/users => generated 8378 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:20.878259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bc15-4f2a-48dd-b164-b8ebb9dfbe0d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.878550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bc15-4f2a-48dd-b164-b8ebb9dfbe0d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.878826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bc15-4f2a-48dd-b164-b8ebb9dfbe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.906281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3f8f2-974e-4e5a-b749-5e0531bac187 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:20.907149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-69c2bc15-4f2a-48dd-b164-b8ebb9dfbe0d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:20.909100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-69c2bc15-4f2a-48dd-b164-b8ebb9dfbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.910801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3ea4-e213-431f-8f4c-0d99e128028f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:20.912089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3ea4-e213-431f-8f4c-0d99e128028f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.912089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3ea4-e213-431f-8f4c-0d99e128028f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.912089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3ea4-e213-431f-8f4c-0d99e128028f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.914613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d93e3ea4-e213-431f-8f4c-0d99e128028f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.922743 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2437/4961] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:20.924463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461538fe-a41a-491b-a700-878bae060da3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.924818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461538fe-a41a-491b-a700-878bae060da3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.925187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461538fe-a41a-491b-a700-878bae060da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.932367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3ea4-e213-431f-8f4c-0d99e128028f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:20.934003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3ea4-e213-431f-8f4c-0d99e128028f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:20.950245 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2525/4962] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:20.950245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96129-35b6-495d-a79e-421115657f6f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.950245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96129-35b6-495d-a79e-421115657f6f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.950245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96129-35b6-495d-a79e-421115657f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.952079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-461538fe-a41a-491b-a700-878bae060da3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:20.953580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-461538fe-a41a-491b-a700-878bae060da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:20.972934 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2438/4963] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:20.973716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461538fe-a41a-491b-a700-878bae060da3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:20.988341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461538fe-a41a-491b-a700-878bae060da3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:20.994896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750d5ba-db2a-462b-88f6-df035d62fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:20.996095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d5ba-db2a-462b-88f6-df035d62fa0a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:20.996095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d5ba-db2a-462b-88f6-df035d62fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:20.996329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d5ba-db2a-462b-88f6-df035d62fa0a admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:20.997036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750d5ba-db2a-462b-88f6-df035d62fa0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:20.997480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750d5ba-db2a-462b-88f6-df035d62fa0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:20.999119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750d5ba-db2a-462b-88f6-df035d62fa0a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.011421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-53a96129-35b6-495d-a79e-421115657f6f None None] MFA Rules not processed for user `f88569624b0d48c28d61138fb583af6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:21.014092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-53a96129-35b6-495d-a79e-421115657f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:21.021045 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2439/4964] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:21.023141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca4bd2-3e73-48cf-905d-df6b1eb08f99 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.025051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca4bd2-3e73-48cf-905d-df6b1eb08f99 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.025517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca4bd2-3e73-48cf-905d-df6b1eb08f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.064935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1aca4bd2-3e73-48cf-905d-df6b1eb08f99 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:21.066498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1aca4bd2-3e73-48cf-905d-df6b1eb08f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:21.075987 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2440/4965] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:21.083144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca4bd2-3e73-48cf-905d-df6b1eb08f99 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.088957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca4bd2-3e73-48cf-905d-df6b1eb08f99 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.095632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.096543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.097029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.097740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.098823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.101307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.125866 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2526/4966] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:20 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:21.129334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a96129-35b6-495d-a79e-421115657f6f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.141794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a96129-35b6-495d-a79e-421115657f6f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.147262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb948a-b720-473f-a37d-eb58ba75e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.148363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb948a-b720-473f-a37d-eb58ba75e82a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.148363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb948a-b720-473f-a37d-eb58ba75e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.149164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb948a-b720-473f-a37d-eb58ba75e82a admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.150037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb948a-b720-473f-a37d-eb58ba75e82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:21.150349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb948a-b720-473f-a37d-eb58ba75e82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.152011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb948a-b720-473f-a37d-eb58ba75e82a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.169964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2527/4967] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:21.171552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948eaa0-eee4-4c33-b2ec-0c53420609ff None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.172006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948eaa0-eee4-4c33-b2ec-0c53420609ff None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.172424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948eaa0-eee4-4c33-b2ec-0c53420609ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.192986 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2441/4968] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:21 2021] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:21.193973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.194725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5948eaa0-eee4-4c33-b2ec-0c53420609ff None None] MFA Rules not processed for user `f88569624b0d48c28d61138fb583af6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:21.196457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5948eaa0-eee4-4c33-b2ec-0c53420609ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:21.276658 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2528/4969] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:21 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:21.276658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948eaa0-eee4-4c33-b2ec-0c53420609ff None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.283055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf803-c984-49d5-a44a-5e9e3014550d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.288316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948eaa0-eee4-4c33-b2ec-0c53420609ff None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.289251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.290057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.290358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.291094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.291424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.293425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.294053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.300620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.300620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.300620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.300620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.300620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.416718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2529/4970] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:21 2021] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:21.418162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.420640 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2442/4971] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:21 2021] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:21.421789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.424674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:21.439430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca67b3-54f2-4ffd-88b5-1fb5c94af346 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.506480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d430fb-4283-46c9-8dd4-50d39dd8c630 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.511168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.511821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.512278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.512560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.513369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:create_trust()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.514687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.518655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.518655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.518655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.518655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] PATH_INFO: `/v3/projects/8a091e06d57243b49dee854809c30dd5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.519126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a091e06d57243b49dee854809c30dd5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.520402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.627545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a091e06d57243b49dee854809c30dd5', 'request_id': 'req-1f4a9629-18a6-4123-91d1-b68a6078e5d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:21.636822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a091e06d57243b49dee854809c30dd5', 'request_id': 'req-1f4a9629-18a6-4123-91d1-b68a6078e5d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:21.678076 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2530/4972] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:25:21 2021] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:21.685190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.691771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4d312-ff4c-4750-846d-5a2a22f1eb8f tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.755584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.757173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.757613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.758151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.759129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.760833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.768401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a091e06d57243b49dee854809c30dd5', 'request_id': 'req-1f4a9629-18a6-4123-91d1-b68a6078e5d0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:21.774080 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2531/4973] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:21 2021] GET /identity/v3/roles => generated 1892 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:21.775232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.785449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c801-5f26-4145-8250-b283e6ad21a9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.786328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] The token cache is being invalidate because project 8a091e06d57243b49dee854809c30dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:21.786617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:21.789441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:21.791283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.791867 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2443/4974] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:21 2021] DELETE /identity/v3/projects/8a091e06d57243b49dee854809c30dd5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:21.792393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.792506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.792848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.793239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.794009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.796120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:21.796547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.869222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a9629-18a6-4123-91d1-b68a6078e5d0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.878786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.879649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.880113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.880241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.889238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:get_trust(trust_id=850a14b58fca47928e9923ab72abf21e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.891581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.900962 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2444/4975] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:21 2021] GET /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e => generated 858 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:21.901920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.903863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:21.922386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa34b8-6cef-4bb1-8b75-554d7bcb32aa tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.928561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.929448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.929793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.930137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.930931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.932733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.950146 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2445/4976] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:21 2021] GET /identity/v3/roles => generated 1892 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:21.950146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.950146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:21.961080 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2532/4977] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:21 2021] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:21.961080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:21.977271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566be99-aef2-4d26-bc3e-21c54a8bd6e6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.979172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40c79b-7fc0-4b23-9f7f-f46d63b6d24b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:21.981019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.982375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.983282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.983597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.987340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:21.988408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:21.991456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:21.991456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] PATH_INFO: `/v3/users/465ac76ed2034ecab62a8c35976aacf0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:21.993629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] RBAC: Authorizing `identity:delete_user(user_id=465ac76ed2034ecab62a8c35976aacf0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.994757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=850a14b58fca47928e9923ab72abf21e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:21.998528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:21.998707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.010913 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2533/4978] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:25:21 2021] GET /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:22.011956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.040822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aa35e-3761-4e71-a232-7e8910d12e87 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.048150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.049761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.050265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.050794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] PATH_INFO: `/v3/projects/76f51d39e5e345dbafabc9f8d372fc34/users/925d8266445c4711bad30f8be395f458/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.073356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f51d39e5e345dbafabc9f8d372fc34, user_id=925d8266445c4711bad30f8be395f458, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.076445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.165086 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2534/4979] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:22 2021] PUT /identity/v3/projects/76f51d39e5e345dbafabc9f8d372fc34/users/925d8266445c4711bad30f8be395f458/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:22.166209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.168260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:22.210809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465ac76ed2034ecab62a8c35976aacf0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.219927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465ac76ed2034ecab62a8c35976aacf0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.235070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465ac76ed2034ecab62a8c35976aacf0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.235942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465ac76ed2034ecab62a8c35976aacf0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.236744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4296bec-c7c5-4d8a-9012-f2f0829d303c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465ac76ed2034ecab62a8c35976aacf0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.246754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50792-dc1c-49aa-885d-b398239a374a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.251570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.252300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.252582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.252858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.253616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.255205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.266335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2535/4980] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:22 2021] GET /identity/v3/roles => generated 1892 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:22.268350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.269145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:22.337989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae2c4b-0515-43a4-acfc-59524e7bf31b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.342626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.343445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.343843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.344073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/02a1c4033e044754bfd38f65ce42bfa5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.350686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:get_role_for_trust(trust_id=850a14b58fca47928e9923ab72abf21e, role_id=02a1c4033e044754bfd38f65ce42bfa5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.352230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.361840 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2536/4981] 10.222.0.32 () {58 vars in 1367 bytes} [Sat Dec 25 21:25:22 2021] GET /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/02a1c4033e044754bfd38f65ce42bfa5 => generated 243 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:22.361840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.365582 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2446/4982] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:21 2021] DELETE /identity/v3/users/465ac76ed2034ecab62a8c35976aacf0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:22.367526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.367526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.367738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:22.367840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.388037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:22.388675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e3c65-6b99-4749-b945-e25b993ebeee tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.395383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:22.468601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.470123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.470559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.471078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] PATH_INFO: `/v3/users/4c074f0c379e4a4e96948036f5368eea` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.473208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c074f0c379e4a4e96948036f5368eea)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.475655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.495177 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2447/4983] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:22.497859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.499171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:22.518848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e4f09-a4f1-4dab-a096-8cf227979947 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.524972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.525642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.525926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.526193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.527114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.528694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.542951 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2448/4984] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:22 2021] GET /identity/v3/roles => generated 1892 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:22.544019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.605542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb587a-a124-428c-93c0-e420d6736d53 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.610540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.611461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.612226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.612226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/02a1c4033e044754bfd38f65ce42bfa5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.618133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:get_role_for_trust(trust_id=850a14b58fca47928e9923ab72abf21e, role_id=02a1c4033e044754bfd38f65ce42bfa5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.619627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.628061 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2449/4985] 10.222.0.32 () {58 vars in 1368 bytes} [Sat Dec 25 21:25:22 2021] HEAD /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/02a1c4033e044754bfd38f65ce42bfa5 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Dec 25 21:25:22.628807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.632065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:22.708173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c074f0c379e4a4e96948036f5368eea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.716128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c074f0c379e4a4e96948036f5368eea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.731145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7083-8e38-4313-b0c7-a87074c468cb tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.736056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c074f0c379e4a4e96948036f5368eea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.736056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c074f0c379e4a4e96948036f5368eea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.736335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.736335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.736630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.737012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.749051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.750582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.763703 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2450/4986] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:22.764602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.776478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd588e-202f-4109-8c2e-8d8fee83dd7e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.781913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f357bf-eb12-4f89-8592-ff6f1fbf39fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:22.782876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f357bf-eb12-4f89-8592-ff6f1fbf39fb admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.783162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f357bf-eb12-4f89-8592-ff6f1fbf39fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.783716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f357bf-eb12-4f89-8592-ff6f1fbf39fb admin admin] PATH_INFO: `/v3/projects/83f09455970345ac919d8b99b665dadd/users/3e1bce380a094237a2eb87a5e1994339/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:22.801522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f357bf-eb12-4f89-8592-ff6f1fbf39fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f09455970345ac919d8b99b665dadd, user_id=3e1bce380a094237a2eb87a5e1994339, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:22.804243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f357bf-eb12-4f89-8592-ff6f1fbf39fb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:22.843478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c074f0c379e4a4e96948036f5368eea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:22.854557 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2537/4987] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:22 2021] DELETE /identity/v3/users/4c074f0c379e4a4e96948036f5368eea => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:22.858190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:22.879948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:22.996419 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2451/4988] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:22 2021] PUT /identity/v3/projects/83f09455970345ac919d8b99b665dadd/users/3e1bce380a094237a2eb87a5e1994339/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:22.998586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6480539-d5cf-4632-860c-292c9c365b60 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:22.998748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f4e8a-da31-497a-8b9e-7e0dfc001b8f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:22.998942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f4e8a-da31-497a-8b9e-7e0dfc001b8f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:22.999273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f4e8a-da31-497a-8b9e-7e0dfc001b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.027787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e65f4e8a-da31-497a-8b9e-7e0dfc001b8f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:23.030905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e65f4e8a-da31-497a-8b9e-7e0dfc001b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:23.135029 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2452/4989] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:23.135029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c2cc-0905-4299-bfb5-94de8d34398a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.135322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c2cc-0905-4299-bfb5-94de8d34398a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.135767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1c2cc-0905-4299-bfb5-94de8d34398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.137903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:23.138913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.139263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.139610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/ad3df65e206144d2903246c6addcf1bd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.158817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:get_role_for_trust(trust_id=850a14b58fca47928e9923ab72abf21e, role_id=ad3df65e206144d2903246c6addcf1bd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:23.161100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:23.190543 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Could not find role: ad3df65e206144d2903246c6addcf1bd.: keystone.exception.RoleNotFound: Could not find role: ad3df65e206144d2903246c6addcf1bd. Dec 25 21:25:23.192021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2538/4990] 10.222.0.32 () {58 vars in 1367 bytes} [Sat Dec 25 21:25:22 2021] GET /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/ad3df65e206144d2903246c6addcf1bd => generated 110 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:23.192714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e1a1c2cc-0905-4299-bfb5-94de8d34398a None None] MFA Rules not processed for user `3e1bce380a094237a2eb87a5e1994339`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:23.196822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:23.197638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1a1c2cc-0905-4299-bfb5-94de8d34398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:23.200747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:23.268847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c530a6a-d422-4ae9-9ffa-ec9c51210fe5 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:23.273279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:23.273859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.274629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.274629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.280496 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2453/4991] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:23 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:23.281669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c2cc-0905-4299-bfb5-94de8d34398a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:23.291322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:23.292782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:23.300732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1c2cc-0905-4299-bfb5-94de8d34398a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:23.309366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:23.310279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.310657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.310951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/ad3df65e206144d2903246c6addcf1bd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.316556 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2539/4992] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:23.317430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:23.321577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:23.324855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:get_role_for_trust(trust_id=850a14b58fca47928e9923ab72abf21e, role_id=ad3df65e206144d2903246c6addcf1bd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:23.326676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:23.349202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333430b9-c56a-4c27-81ba-edaf5f57878f service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:23.356653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:23.358023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.358238 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Could not find role: ad3df65e206144d2903246c6addcf1bd.: keystone.exception.RoleNotFound: Could not find role: ad3df65e206144d2903246c6addcf1bd. Dec 25 21:25:23.358379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.358778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.359983 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2454/4993] 10.222.0.32 () {58 vars in 1368 bytes} [Sat Dec 25 21:25:23 2021] HEAD /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e/roles/ad3df65e206144d2903246c6addcf1bd => generated 0 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Dec 25 21:25:23.360122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:23.360826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:23.363727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:23.363929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:23.382548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b05be-2844-4bb6-8805-592b45eee69a tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:23.393728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:23.393728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.393728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.393728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] PATH_INFO: `/v3/projects/c16db4ecd33749a9aa596352d01cea65` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.396059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16db4ecd33749a9aa596352d01cea65)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:23.399068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:23.526732 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2540/4994] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:23 2021] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:23.527829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:23.543350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16db4ecd33749a9aa596352d01cea65', 'request_id': 'req-635ec554-7083-436c-9200-e1d533fd44e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.561289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16db4ecd33749a9aa596352d01cea65', 'request_id': 'req-635ec554-7083-436c-9200-e1d533fd44e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.629704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80a410-5f4e-4c89-8555-79879326ac5a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:23.634970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:23.636173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.645118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.645118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.645118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorizing `identity:delete_trust(trust_id=850a14b58fca47928e9923ab72abf21e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:23.647329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:23.774401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16db4ecd33749a9aa596352d01cea65', 'request_id': 'req-635ec554-7083-436c-9200-e1d533fd44e9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.787967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] The token cache is being invalidate because project c16db4ecd33749a9aa596352d01cea65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:23.788631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.789405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.791340 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2455/4995] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:23 2021] DELETE /identity/v3/projects/c16db4ecd33749a9aa596352d01cea65 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:23.792204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:23.793880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:23.866713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ec554-7083-436c-9200-e1d533fd44e9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:23.882534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '850a14b58fca47928e9923ab72abf21e', 'request_id': 'req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.887066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '850a14b58fca47928e9923ab72abf21e', 'request_id': 'req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.887066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '850a14b58fca47928e9923ab72abf21e', 'request_id': 'req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:23.932735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:23.939197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:23.939197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:23.939197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:23.939197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:23.939197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:23.988216 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2541/4996] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:25:23 2021] DELETE /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:23.989309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:23.992525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:24.011325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401e8e9-f963-4a69-bc9a-749b8d5f4f3c tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:24.015811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2456/4997] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:23 2021] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:24.017926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:24.018677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:24.018993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:24.019120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:24.019409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] PATH_INFO: `/v3/users/e082c308db82468cbe79e07337e27acb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:24.020770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e082c308db82468cbe79e07337e27acb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:24.021175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:24.022921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:24.039175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c58e-8cdd-4c12-a65a-550978312ccf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:24.046743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:24.047794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:24.048192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:24.048548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] PATH_INFO: `/v3/projects/39002f2653254b3ead7231dc2a1b9797` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:24.049984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39002f2653254b3ead7231dc2a1b9797)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:24.054635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:24.330948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e082c308db82468cbe79e07337e27acb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.340370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e082c308db82468cbe79e07337e27acb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.351576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39002f2653254b3ead7231dc2a1b9797', 'request_id': 'req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.357202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e082c308db82468cbe79e07337e27acb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.359751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e082c308db82468cbe79e07337e27acb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.367238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39002f2653254b3ead7231dc2a1b9797', 'request_id': 'req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.455362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e082c308db82468cbe79e07337e27acb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.464126 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2542/4998] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:23 2021] DELETE /identity/v3/users/e082c308db82468cbe79e07337e27acb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:24.468917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:24.470441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:24.518519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39002f2653254b3ead7231dc2a1b9797', 'request_id': 'req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.534362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] The token cache is being invalidate because project 39002f2653254b3ead7231dc2a1b9797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:24.536573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.538212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:24.542408 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2457/4999] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:24 2021] DELETE /identity/v3/projects/39002f2653254b3ead7231dc2a1b9797 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:24.543697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:24.549995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:24.575014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c4337-6010-4137-8039-38cc76f6769b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:24.580041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f88569624b0d48c28d61138fb583af6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4619cd6167664ff8ba6376a5f3162c1b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-858335538', 'tempest-NotDelegatedRole-2036908357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:24.582749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:24.583320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:24.584257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] PATH_INFO: `/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:24.598502 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Could not find trust: 850a14b58fca47928e9923ab72abf21e.: keystone.exception.TrustNotFound: Could not find trust: 850a14b58fca47928e9923ab72abf21e. Dec 25 21:25:24.600145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2543/5000] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:24 2021] GET /identity/v3/OS-TRUST/trusts/850a14b58fca47928e9923ab72abf21e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:24.600993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:24.603142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:24.679297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696e3b7-7ad3-4ea3-b817-eb7a1d5ced81 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:24.685444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:24.687231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:24.687607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:24.687965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:24.688798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:24.689867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da199a1-09d2-43c4-91fa-7c5c6e552d02 tempest-TrustsV3TestJSON-976983878 tempest-user-1633256220] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:24.690892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:24.696974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:24.697872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:24.698191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:24.698504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] PATH_INFO: `/v3/users/fc152352383e41aa9b76162617f66f0b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:24.700399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc152352383e41aa9b76162617f66f0b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:24.702739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:24.709378 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2458/5001] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:24 2021] GET /identity/v3/roles => generated 1892 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:24.709378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:24.713173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:24.808163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ef996-7340-4d20-9b87-94294192983f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:24.813265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:24.814153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:24.814440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:24.814718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/ad3df65e206144d2903246c6addcf1bd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:24.816657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad3df65e206144d2903246c6addcf1bd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:24.817841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:25.006730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc152352383e41aa9b76162617f66f0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.014772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc152352383e41aa9b76162617f66f0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.030994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc152352383e41aa9b76162617f66f0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.031841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc152352383e41aa9b76162617f66f0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.042668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role ad3df65e206144d2903246c6addcf1bd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:25.043082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.043813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.045922 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2459/5002] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:24 2021] DELETE /identity/v3/roles/ad3df65e206144d2903246c6addcf1bd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:25.050004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:25.051607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:25.123038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc152352383e41aa9b76162617f66f0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.140563 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2544/5003] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:24 2021] DELETE /identity/v3/users/fc152352383e41aa9b76162617f66f0b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:25.141587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:25.143308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:25.161406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c09baa-6b14-43ec-aa2a-68aee824969f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:25.242013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:25.243037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:25.243465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:25.243846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] PATH_INFO: `/v3/projects/13696fe6aa3a4d65b92d5457619cf920/users/89f2447f02f3469d93970c1ad7eb5a5e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:25.268316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11738d77-2a59-4be3-98f1-4c5e07fb218d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:25.282010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13696fe6aa3a4d65b92d5457619cf920, user_id=89f2447f02f3469d93970c1ad7eb5a5e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:25.286058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:25.289841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:25.289841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:25.289841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:25.290190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/02a1c4033e044754bfd38f65ce42bfa5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:25.294136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=02a1c4033e044754bfd38f65ce42bfa5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:25.296630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:25.375989 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2460/5004] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:25 2021] PUT /identity/v3/projects/13696fe6aa3a4d65b92d5457619cf920/users/89f2447f02f3469d93970c1ad7eb5a5e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:25.379925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:25.384162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:25.511096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f97d2-c812-4ada-a9ce-3eeef46ff24a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:25.517705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:25.522162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:25.522162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:25.522162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] PATH_INFO: `/v3/projects/53b80d53bc6e4121b08f23b979a11f31` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:25.522162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b80d53bc6e4121b08f23b979a11f31)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:25.522639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:25.570799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 02a1c4033e044754bfd38f65ce42bfa5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:25.571373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.571826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.574397 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2545/5005] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:25 2021] DELETE /identity/v3/roles/02a1c4033e044754bfd38f65ce42bfa5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:25.575410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:25.576760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:25.650333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b80d53bc6e4121b08f23b979a11f31', 'request_id': 'req-fce4bcb0-8163-4a5a-9031-59c696b483a4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.660502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b80d53bc6e4121b08f23b979a11f31', 'request_id': 'req-fce4bcb0-8163-4a5a-9031-59c696b483a4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.679195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50053f2-0d3b-46d2-ab1e-e10fec320795 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:25.728501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b80d53bc6e4121b08f23b979a11f31', 'request_id': 'req-fce4bcb0-8163-4a5a-9031-59c696b483a4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.745860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d639079-ba2c-4a0b-ade6-80e4a7f217ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:25.746659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d639079-ba2c-4a0b-ade6-80e4a7f217ed admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:25.747069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d639079-ba2c-4a0b-ade6-80e4a7f217ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:25.747444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d639079-ba2c-4a0b-ade6-80e4a7f217ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:25.748778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d639079-ba2c-4a0b-ade6-80e4a7f217ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:25.750798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d639079-ba2c-4a0b-ade6-80e4a7f217ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:25.751597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] The token cache is being invalidate because project 53b80d53bc6e4121b08f23b979a11f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:25.751891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.757494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.765049 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2546/5007] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:25 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:25.765049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:25.765049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:25.765049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:25.769515 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2461/5007] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:25 2021] DELETE /identity/v3/projects/53b80d53bc6e4121b08f23b979a11f31 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:25.770642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:25.772790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:25.790486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4bcb0-8163-4a5a-9031-59c696b483a4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:25.795563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:25.797000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:25.797000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:25.797468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] PATH_INFO: `/v3/projects/0ea361343c314273b0d0a62a792d2d8d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:25.799475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea361343c314273b0d0a62a792d2d8d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:25.804561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:25.817056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] MFA Rules not processed for user `925d8266445c4711bad30f8be395f458`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:25.819059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:25.894881 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2547/5008] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:25.897808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:25.897808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:25.942668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea361343c314273b0d0a62a792d2d8d', 'request_id': 'req-3495c05d-e6a9-4198-a078-5dc34776b8b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.953915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea361343c314273b0d0a62a792d2d8d', 'request_id': 'req-3495c05d-e6a9-4198-a078-5dc34776b8b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:25.978494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9501b-5243-4f4f-9c9c-b8aa7c6a8570 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.014011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea361343c314273b0d0a62a792d2d8d', 'request_id': 'req-3495c05d-e6a9-4198-a078-5dc34776b8b4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.028169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] The token cache is being invalidate because project 0ea361343c314273b0d0a62a792d2d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:26.028369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.029103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3495c05d-e6a9-4198-a078-5dc34776b8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.031415 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2462/5009] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:25 2021] DELETE /identity/v3/projects/0ea361343c314273b0d0a62a792d2d8d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:26.032394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.032672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.033007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.038377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.039580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.040151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.040590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users/f88569624b0d48c28d61138fb583af6e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.043666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f88569624b0d48c28d61138fb583af6e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.045994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.054458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:26.055656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.119609 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2463/5010] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:26.120719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.126368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.139428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6e42e-8a43-4b29-9013-75bb3ba727e5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.144382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b16aec-61cc-4011-b2d4-7776f2307bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.145326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16aec-61cc-4011-b2d4-7776f2307bca admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.145606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16aec-61cc-4011-b2d4-7776f2307bca admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.145884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b16aec-61cc-4011-b2d4-7776f2307bca admin admin] PATH_INFO: `/v3/projects/13696fe6aa3a4d65b92d5457619cf920/users/89f2447f02f3469d93970c1ad7eb5a5e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.148465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b16aec-61cc-4011-b2d4-7776f2307bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=13696fe6aa3a4d65b92d5457619cf920, user_id=89f2447f02f3469d93970c1ad7eb5a5e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.151811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b16aec-61cc-4011-b2d4-7776f2307bca admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.163930 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2464/5011] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:26 2021] PUT /identity/v3/projects/13696fe6aa3a4d65b92d5457619cf920/users/89f2447f02f3469d93970c1ad7eb5a5e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:26.165289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d22d-4946-480d-ab12-33b8df5ad487 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.165573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d22d-4946-480d-ab12-33b8df5ad487 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.165850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d22d-4946-480d-ab12-33b8df5ad487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.184764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1794d22d-4946-480d-ab12-33b8df5ad487 None None] MFA Rules not processed for user `925d8266445c4711bad30f8be395f458`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:26.187148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1794d22d-4946-480d-ab12-33b8df5ad487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.195232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88569624b0d48c28d61138fb583af6e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.202735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88569624b0d48c28d61138fb583af6e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.216725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88569624b0d48c28d61138fb583af6e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.221517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88569624b0d48c28d61138fb583af6e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.247494 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2465/5012] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:26.251301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78877c-6f93-4c02-8e5c-8e6cd10e02e9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.251301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78877c-6f93-4c02-8e5c-8e6cd10e02e9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.251301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78877c-6f93-4c02-8e5c-8e6cd10e02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.272240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7c78877c-6f93-4c02-8e5c-8e6cd10e02e9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:26.273509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7c78877c-6f93-4c02-8e5c-8e6cd10e02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.333734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-40e58b9a-4c90-467a-86e2-8ba92054f7f0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88569624b0d48c28d61138fb583af6e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.340386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2548/5013] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:25 2021] DELETE /identity/v3/users/f88569624b0d48c28d61138fb583af6e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:26.341756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.342048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.342326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.347500 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2466/5014] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:26.349221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.349532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.349811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.367393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:26.368730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.383894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] MFA Rules not processed for user `89f2447f02f3469d93970c1ad7eb5a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:26.385480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.436760 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2549/5015] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:26.437819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.439137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.477415 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2467/5016] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:26.478430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.479894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.533139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53738d-c936-47c8-a826-7ac656fe9ac9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.539927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f0ec0-58df-41ab-9a99-94bbc01951b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.540601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0ec0-58df-41ab-9a99-94bbc01951b4 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.540907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0ec0-58df-41ab-9a99-94bbc01951b4 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.541178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0ec0-58df-41ab-9a99-94bbc01951b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.543043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f1f0ec0-58df-41ab-9a99-94bbc01951b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.562299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae8c3-f6a7-4634-8bd5-16e472bccfe5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.567131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.568537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.568828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.569132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/4619cd6167664ff8ba6376a5f3162c1b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.570377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4619cd6167664ff8ba6376a5f3162c1b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.572418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.606747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f0ec0-58df-41ab-9a99-94bbc01951b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.609804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f0ec0-58df-41ab-9a99-94bbc01951b4 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.625241 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2550/5017] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:26 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:26.627224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39493b6-330c-474f-965f-9e0cdc0f975d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.627566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39493b6-330c-474f-965f-9e0cdc0f975d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.628024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39493b6-330c-474f-965f-9e0cdc0f975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.660278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f39493b6-330c-474f-965f-9e0cdc0f975d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:26.661584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f39493b6-330c-474f-965f-9e0cdc0f975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.728034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4619cd6167664ff8ba6376a5f3162c1b', 'request_id': 'req-ec821e2d-b233-45e9-af92-d92eb8da2e51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.730414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2551/5018] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:26.731350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39493b6-330c-474f-965f-9e0cdc0f975d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.734915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4619cd6167664ff8ba6376a5f3162c1b', 'request_id': 'req-ec821e2d-b233-45e9-af92-d92eb8da2e51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.742020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39493b6-330c-474f-965f-9e0cdc0f975d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.747200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.747969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.748316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.748657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.749504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:26.749867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.759361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.764294 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2552/5019] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:26.764971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.801777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4619cd6167664ff8ba6376a5f3162c1b', 'request_id': 'req-ec821e2d-b233-45e9-af92-d92eb8da2e51'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.813991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] The token cache is being invalidate because project 4619cd6167664ff8ba6376a5f3162c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:26.814283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.815434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:26.817777 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2468/5020] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:26 2021] DELETE /identity/v3/projects/4619cd6167664ff8ba6376a5f3162c1b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:26.818955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.823137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.833603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b6ba-7972-4aec-bd12-0b5d0b44374c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.837462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821e2d-b233-45e9-af92-d92eb8da2e51 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.838512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.839173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.839461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.839742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.840638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.845174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.845544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.846427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.846914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.847194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.847972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:26.848280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.850006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.861833 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2469/5021] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:26.863007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.864722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.878148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ac72-5477-4c42-bee9-06f1812620b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:26.883485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:26.884134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:26.884420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:26.884724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:26.885453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:26.887360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:26.951376 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2553/5022] 10.222.0.32 () {60 vars in 1149 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/domains => generated 277 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:26.953083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:26.954823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:26.991979 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2470/5023] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:26.991979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.034247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda972a-0615-4a57-adbe-86e8c0ec033f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.062621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3d811-4e69-4144-93a1-20fc54aeb72f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.068684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.069203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.069562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.069852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.070553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.072531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.092618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.093318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.093835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.094083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.102559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.102559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.161277 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2471/5024] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.161277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.161277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:27.182070 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2554/5025] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:25:26 2021] POST /identity/v3/projects => generated 329 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.184433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.239714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff55415-6809-4315-b12d-a9b311861670 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.254142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43d87e-800d-4430-bda9-d131da121823 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.260326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.262010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.262461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.262935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.264226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.266639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.298772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.299471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.299762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.300042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.300789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.303106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.369260 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2555/5026] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:27 2021] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.370398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.381069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe63a6-108a-4945-8c7e-960c1ce5d56e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.386136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.386805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.387094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.388928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.388928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.390227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.402529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2472/5027] 10.222.0.32 () {60 vars in 1149 bytes} [Sat Dec 25 21:25:27 2021] POST /identity/v3/domains => generated 276 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.403739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.471183 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2556/5028] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:27 2021] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.472017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.481636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbb8c8-a92b-4b54-b055-c50ca11fb376 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.482289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8edab4-3d8c-4b9b-97d8-51d598414c1e tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.487445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.490490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.490490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.490490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.490490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.492201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.541856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.542818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.543195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.543563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.544405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.546117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.584779 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2557/5029] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:27.584779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.639388 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2473/5030] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:27 2021] POST /identity/v3/users => generated 416 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.646652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.663075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b16ef-6c65-4e48-a97a-bcb8abeb29bd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.676184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.676384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf443e0-b85a-466f-9875-80f28e5c5e63 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.677009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.677880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.678222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.679103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.680963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.690502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.692590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.692590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.692590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.693539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.695020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.707679 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2474/5031] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:27.709319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.720256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d919-77bf-427b-996a-506b17686226 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.727512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.727512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.727512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.727512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.728205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.729830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.742917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2475/5032] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:27.744248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.756097 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2558/5033] 10.222.0.32 () {60 vars in 1149 bytes} [Sat Dec 25 21:25:27 2021] POST /identity/v3/domains => generated 276 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.756097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.761403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec39c8-7abe-48c1-800e-7ed1e6a6c9e7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.821884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.822556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.822841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.823321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.824174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.825811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.825940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277dea-eb55-4c5a-b2d7-0a13c27e1d9f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.831447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.832307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.832858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.833174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.834647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.836596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.847137 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2559/5034] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:27.848014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:27.859497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555d564-8942-44c2-94d6-fa0420226f03 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:27.864178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:27.865107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:27.865387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:27.865660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] PATH_INFO: `/v3/projects/fe72b9abec8c404da78ac27c7e38ee1d/users/9746c75df58f4ad0979581490485baab/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:27.880105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe72b9abec8c404da78ac27c7e38ee1d, user_id=9746c75df58f4ad0979581490485baab, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:27.883286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:27.911792 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2476/5035] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:27 2021] POST /identity/v3/roles => generated 243 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:27.912687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.002894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34a004-2d98-491f-a941-1de883e09a13 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.015177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:28.015988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2560/5036] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:27 2021] PUT /identity/v3/projects/fe72b9abec8c404da78ac27c7e38ee1d/users/9746c75df58f4ad0979581490485baab/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:28.017523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.025387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.025941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.026741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.027768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:28.031991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:28.097689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295339cb-5bb4-44eb-929c-3d8c16280189 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.103523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457bacf-6382-42b2-a52d-45947ecfff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:28.105154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457bacf-6382-42b2-a52d-45947ecfff4d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.109012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457bacf-6382-42b2-a52d-45947ecfff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.109012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457bacf-6382-42b2-a52d-45947ecfff4d admin admin] PATH_INFO: `/v3/projects/62e3a3e79ff243dda1dc96033280341c/users/51fa0d9cfe0f4cff9842c92804a7f153/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.123955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457bacf-6382-42b2-a52d-45947ecfff4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e3a3e79ff243dda1dc96033280341c, user_id=51fa0d9cfe0f4cff9842c92804a7f153, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:28.126747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457bacf-6382-42b2-a52d-45947ecfff4d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:28.143083 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2477/5037] 10.222.0.32 () {60 vars in 1149 bytes} [Sat Dec 25 21:25:27 2021] POST /identity/v3/domains => generated 279 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:28.143083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.204679 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2561/5038] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:28 2021] PUT /identity/v3/projects/62e3a3e79ff243dda1dc96033280341c/users/51fa0d9cfe0f4cff9842c92804a7f153/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:28.208542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc21b4-c6d8-4bc7-8ef3-3be3dfb615c7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.208542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc21b4-c6d8-4bc7-8ef3-3be3dfb615c7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.208542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc21b4-c6d8-4bc7-8ef3-3be3dfb615c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.223212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed11305-54ff-44c3-8696-1bce5f18ce31 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.234523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8fbc21b4-c6d8-4bc7-8ef3-3be3dfb615c7 None None] MFA Rules not processed for user `9746c75df58f4ad0979581490485baab`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:28.235727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8fbc21b4-c6d8-4bc7-8ef3-3be3dfb615c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:28.287772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7859ed-0a44-4a86-9b8b-6d5c8b75b4d0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:28.288634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7859ed-0a44-4a86-9b8b-6d5c8b75b4d0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.289051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7859ed-0a44-4a86-9b8b-6d5c8b75b4d0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.289466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7859ed-0a44-4a86-9b8b-6d5c8b75b4d0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.290273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7859ed-0a44-4a86-9b8b-6d5c8b75b4d0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:28.292351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7859ed-0a44-4a86-9b8b-6d5c8b75b4d0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:28.311988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2562/5039] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:28.315566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc21b4-c6d8-4bc7-8ef3-3be3dfb615c7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.385738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc21b4-c6d8-4bc7-8ef3-3be3dfb615c7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.391305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:28.396790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.396790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.396790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/4f97bcfee49349aab2f8bb81ea6fde13` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.397354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2478/5040] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:28 2021] POST /identity/v3/roles => generated 247 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:28.400166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574529b7-dcaa-4491-b835-a5d0a3231ad0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.400465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574529b7-dcaa-4491-b835-a5d0a3231ad0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.400746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574529b7-dcaa-4491-b835-a5d0a3231ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.410907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4f97bcfee49349aab2f8bb81ea6fde13)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:28.413314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:28.443550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.455304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-574529b7-dcaa-4491-b835-a5d0a3231ad0 None None] MFA Rules not processed for user `51fa0d9cfe0f4cff9842c92804a7f153`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:28.455954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.456523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-574529b7-dcaa-4491-b835-a5d0a3231ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:28.532780 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2479/5041] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:28 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:28.538311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574529b7-dcaa-4491-b835-a5d0a3231ad0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.554648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13', 'request_id': 'req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.604171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574529b7-dcaa-4491-b835-a5d0a3231ad0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.613065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13', 'request_id': 'req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.621251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13', 'request_id': 'req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.632403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] The token cache is being invalidate because project 4f97bcfee49349aab2f8bb81ea6fde13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:28.632806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.633632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.641911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13', 'request_id': 'req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.650676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13', 'request_id': 'req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.650676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4f97bcfee49349aab2f8bb81ea6fde13', 'request_id': 'req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:28.651694 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2563/5042] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:28 2021] DELETE /identity/v3/domains/4f97bcfee49349aab2f8bb81ea6fde13 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:28.652519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.653913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:28.673775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:28.674416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.674814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.675179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.676011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:28.678858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:28.737571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9cae3-2bcf-4e8d-b00d-8d0e47b26b39 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.742558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:28.743453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.743728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.744003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/6e16efee7e2c4b679bc681c12f32b896/users/8a249de1e5374922b50eff1b460e47c7/roles/a3da9f61d5804b389de8367923728b70` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.760725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e16efee7e2c4b679bc681c12f32b896, user_id=8a249de1e5374922b50eff1b460e47c7, role_id=a3da9f61d5804b389de8367923728b70)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:28.763399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:28.810608 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2480/5043] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:28 2021] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:28.811523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.813529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:28.872484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb5e3a-26c7-43a8-a083-9a9607cd1c67 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.876335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:28.877016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:28.877298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:28.877566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:28.879322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:28.894777 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2564/5044] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:28 2021] PUT /identity/v3/projects/6e16efee7e2c4b679bc681c12f32b896/users/8a249de1e5374922b50eff1b460e47c7/roles/a3da9f61d5804b389de8367923728b70 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:28.895880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.898399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:28.947875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:28.949380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:28.960142 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2481/5045] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:28 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:28.961031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:28.962508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:28.983573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110269a-3979-42e6-ac7c-a00e7528f8b0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:28.995733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.005049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.005049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.005049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.005049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.005049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:29.057324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a90f8-3142-44d1-8bb5-00f6ef974cbf service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:29.134449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.135131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.135462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.135685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.136363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.138317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:29.142776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2565/5046] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:25:28 2021] POST /identity/v3/domains => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:29.142776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:29.211335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc3db-cbe9-455c-9a82-122a9d56b325 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:29.218245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.219106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.219391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.219673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/6e16efee7e2c4b679bc681c12f32b896/users/8a249de1e5374922b50eff1b460e47c7/roles/722ec25281f74ec58d83001af7bad3ae` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.222117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e16efee7e2c4b679bc681c12f32b896, user_id=8a249de1e5374922b50eff1b460e47c7, role_id=722ec25281f74ec58d83001af7bad3ae)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.225328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:29.300549 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2482/5047] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:28 2021] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:29.304979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:29.321174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8b70-68b7-4036-ac3b-feebb54a2ea4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:29.357739 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2566/5048] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:29 2021] PUT /identity/v3/projects/6e16efee7e2c4b679bc681c12f32b896/users/8a249de1e5374922b50eff1b460e47c7/roles/722ec25281f74ec58d83001af7bad3ae => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:29.359624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:29.428543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.430613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.431875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.432316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/53870dc2cd57434aab0543751ebb2c46` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.447222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=53870dc2cd57434aab0543751ebb2c46)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.449176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:29.475132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '53870dc2cd57434aab0543751ebb2c46'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:29.475889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '53870dc2cd57434aab0543751ebb2c46'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:29.515574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3598a0-7674-4748-91ee-f2abef1f5ede tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:29.619607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '53870dc2cd57434aab0543751ebb2c46'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:29.621065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '53870dc2cd57434aab0543751ebb2c46'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:29.627646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.629590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.631630 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2483/5049] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:29 2021] PATCH /identity/v3/domains/53870dc2cd57434aab0543751ebb2c46 => generated 249 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:29.631957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.632656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.633041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:29.638398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.638663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:29.638766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:29.672749 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2567/5050] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:29 2021] GET /identity/v3/roles => generated 1892 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:29.677201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:29.684215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:29.801536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd470-cae9-4fd0-8553-1a2bfe668cd7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:29.814540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.815236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.815520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.815798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.816575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.818491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:29.823612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0ef3-ddbb-4004-96b9-89b891a02fc7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:29.830982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.840360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.840360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.840360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/53870dc2cd57434aab0543751ebb2c46` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.846584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=53870dc2cd57434aab0543751ebb2c46)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.848357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:29.853433 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2484/5051] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:29 2021] GET /identity/v3/users => generated 8896 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:29.857737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:29.859603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:29.874208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89968ca5-5a8d-4006-9db4-40c3c257e082 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:29.877967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '53870dc2cd57434aab0543751ebb2c46'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:29.879653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:29.881163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:29.881448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:29.881722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] PATH_INFO: `/v3/projects/74e35b77d702444787850e21bc03163f/users/b3e502fa90cc4d5e8fb42a20e0baedf2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:29.896408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '53870dc2cd57434aab0543751ebb2c46'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:29.901671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e35b77d702444787850e21bc03163f, user_id=b3e502fa90cc4d5e8fb42a20e0baedf2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:29.904426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:30.026107 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2485/5052] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:29 2021] PUT /identity/v3/projects/74e35b77d702444787850e21bc03163f/users/b3e502fa90cc4d5e8fb42a20e0baedf2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:30.026963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:30.028703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.081605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53870dc2cd57434aab0543751ebb2c46', 'request_id': 'req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.105706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8b08-757e-4e84-b4ee-b37ecba95005 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:30.162900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:30.164024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.164423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.164800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] PATH_INFO: `/v3/users/51fa0d9cfe0f4cff9842c92804a7f153` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.166754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51fa0d9cfe0f4cff9842c92804a7f153)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:30.168778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:30.241993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53870dc2cd57434aab0543751ebb2c46', 'request_id': 'req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.249044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53870dc2cd57434aab0543751ebb2c46', 'request_id': 'req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.263546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] The token cache is being invalidate because project 53870dc2cd57434aab0543751ebb2c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:30.263546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.263546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.267511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '53870dc2cd57434aab0543751ebb2c46', 'request_id': 'req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.268134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '53870dc2cd57434aab0543751ebb2c46', 'request_id': 'req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.268732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '53870dc2cd57434aab0543751ebb2c46', 'request_id': 'req-7a5ba106-bb07-4965-b6d9-49b00ecab3bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.277373 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2568/5053] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:29 2021] DELETE /identity/v3/domains/53870dc2cd57434aab0543751ebb2c46 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:30.281388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.281388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.281388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.329709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] MFA Rules not processed for user `8a249de1e5374922b50eff1b460e47c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:30.331267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.398630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2569/5054] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:30 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:30.399638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:30.400984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.416383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd20698-877f-4cef-8c78-aa6dcecf22ae None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:30.421350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:30.422005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.422288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.422563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.423340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:30.424945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:30.436474 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2570/5055] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:30 2021] GET /identity/v3/roles => generated 1892 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:30.437193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:30.439279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.478288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51fa0d9cfe0f4cff9842c92804a7f153'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.491539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51fa0d9cfe0f4cff9842c92804a7f153'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.512720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51fa0d9cfe0f4cff9842c92804a7f153'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.514107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51fa0d9cfe0f4cff9842c92804a7f153'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.514908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4de76426-124f-4645-aaf1-b036cdb4489b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51fa0d9cfe0f4cff9842c92804a7f153'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.528712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323af54-da7e-4b76-a15b-fddaee3b13b2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:30.533655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:30.534318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.534865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.535146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.535918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:30.538100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:30.654095 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2486/5056] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:30 2021] DELETE /identity/v3/users/51fa0d9cfe0f4cff9842c92804a7f153 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:30.655582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22202b-69f2-4be2-8c01-dc5835dd9802 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.655848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22202b-69f2-4be2-8c01-dc5835dd9802 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.656125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22202b-69f2-4be2-8c01-dc5835dd9802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.661786 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2571/5057] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:25:30 2021] POST /identity/v3/domains => generated 277 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:30.661786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:30.661786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.676684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-db22202b-69f2-4be2-8c01-dc5835dd9802 None None] MFA Rules not processed for user `8a249de1e5374922b50eff1b460e47c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:30.678447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-db22202b-69f2-4be2-8c01-dc5835dd9802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.735524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73644088-0de5-41c6-a114-29f63fde45d2 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:30.740652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:30.741662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.741951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.742478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] PATH_INFO: `/v3/projects/74e35b77d702444787850e21bc03163f/users/b3e502fa90cc4d5e8fb42a20e0baedf2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.742597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2487/5058] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:30 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:30.744295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672850f-47d3-4164-89d1-9e8bd094100e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.744577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672850f-47d3-4164-89d1-9e8bd094100e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.744848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672850f-47d3-4164-89d1-9e8bd094100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.755928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e35b77d702444787850e21bc03163f, user_id=b3e502fa90cc4d5e8fb42a20e0baedf2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:30.757980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:30.768210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5672850f-47d3-4164-89d1-9e8bd094100e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:30.768609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5672850f-47d3-4164-89d1-9e8bd094100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.775155 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2572/5059] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:30 2021] PUT /identity/v3/projects/74e35b77d702444787850e21bc03163f/users/b3e502fa90cc4d5e8fb42a20e0baedf2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:30.776349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:30.785165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:30.862398 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2488/5060] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:30.863359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672850f-47d3-4164-89d1-9e8bd094100e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:30.864130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969312-0a52-4175-8641-5cc5861fdbcf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:30.874408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:30.875303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:30.875582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:30.890864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:30.893381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e6c38aa6f7574d22956d9a326d4eeae5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:30.895229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:30.927844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.928977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:30.979189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672850f-47d3-4164-89d1-9e8bd094100e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:31.063462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a249de1e5374922b50eff1b460e47c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e16efee7e2c4b679bc681c12f32b896', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-460257705', 'tempest-NotDelegatedRole-2088639190'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:31.064120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.064400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.064672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.065474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] RBAC: Authorizing `identity:create_trust()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:31.066634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:31.111752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.113167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f9e0f29-1ab2-4bb5-9aa7-d7e0d7801659 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.117455 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2573/5061] 10.222.0.32 () {60 vars in 1249 bytes} [Sat Dec 25 21:25:30 2021] PATCH /identity/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5 => generated 278 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:31.119473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.119964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.120746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.153832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] MFA Rules not processed for user `b3e502fa90cc4d5e8fb42a20e0baedf2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:31.155302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:31.163460 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Dec 25 21:25:31.164804 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2489/5062] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:25:30 2021] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 302 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:25:31.168268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:31.170777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:31.257780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ae0b2-51bf-463d-84f2-cc6eb885ace3 tempest-TrustsV3TestJSON-2103130780 tempest-user-1475485906] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:31.262862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:31.263207 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2574/5063] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:31 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:31.263987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.264634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:31.264904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.265462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.266961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:31.267760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:31.374923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09370a1a-a8d2-42ac-88f5-99653ec09a4b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:31.381222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:31.382912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:31.386519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:31.388162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.388644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.389249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.395696 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2490/5064] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:31.397504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:31.399019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:31.430219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=e6c38aa6f7574d22956d9a326d4eeae5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:31.434389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:31.438010 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2575/5065] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:25:31 2021] GET /identity/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5 => generated 278 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:31.443789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:31.462643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0af13-903a-4e98-9b22-eafb05ac6f5f tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:31.468786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e502fa90cc4d5e8fb42a20e0baedf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e35b77d702444787850e21bc03163f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:31.470939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.471431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.471909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.473241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:31.474696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:31.476957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:31.495682 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2576/5066] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:31.495682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:31.511727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f1c0-9c5b-4a4b-9c21-8108814df9f1 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:31.522664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:31.523933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.524371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.524830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.526342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e6c38aa6f7574d22956d9a326d4eeae5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:31.528094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:31.541517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d64a5d-278a-4451-aa6a-3d44a8437628 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:31.548180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:31.549658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.549929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.550266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/722ec25281f74ec58d83001af7bad3ae` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.551926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=722ec25281f74ec58d83001af7bad3ae)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:31.554462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:31.563333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.575822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.727267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5', 'request_id': 'req-ee8a206e-2bad-4939-b9e6-5e4819438185'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.864491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 722ec25281f74ec58d83001af7bad3ae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:31.865662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.866230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.868096 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2491/5067] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:31 2021] DELETE /identity/v3/roles/722ec25281f74ec58d83001af7bad3ae => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:31.868979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:31.870639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:31.882588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5', 'request_id': 'req-ee8a206e-2bad-4939-b9e6-5e4819438185'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.890364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5', 'request_id': 'req-ee8a206e-2bad-4939-b9e6-5e4819438185'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.901540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] The token cache is being invalidate because project e6c38aa6f7574d22956d9a326d4eeae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:31.901829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.902498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.910300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5', 'request_id': 'req-ee8a206e-2bad-4939-b9e6-5e4819438185'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.910952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5', 'request_id': 'req-ee8a206e-2bad-4939-b9e6-5e4819438185'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.911567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e6c38aa6f7574d22956d9a326d4eeae5', 'request_id': 'req-ee8a206e-2bad-4939-b9e6-5e4819438185'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:31.919595 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2577/5068] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:31 2021] DELETE /identity/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:31.920382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:31.921812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:31.944814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1fdaf-424f-4fd1-aa0b-e24f53a6ac8e tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:31.949471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e502fa90cc4d5e8fb42a20e0baedf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e35b77d702444787850e21bc03163f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:31.950139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:31.950421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:31.950697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:31.951492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:31.953416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:32.007712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a206e-2bad-4939-b9e6-5e4819438185 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.105137 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2492/5069] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:31 2021] POST /identity/v3/projects => generated 348 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:32.105137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:32.108428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.112466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.113387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.113803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.114081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/a3da9f61d5804b389de8367923728b70` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.116615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a3da9f61d5804b389de8367923728b70)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:32.119774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:32.177512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1f93-0d23-4ed6-95db-89ad70ff176f tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.182208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.182867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.183149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.183428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.184153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:32.185769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:32.205220 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2493/5070] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:25:32 2021] GET /identity/v3/domains => generated 1347 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:32.206474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:32.210021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.290658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c3c6-2038-4f36-b496-6f66e645a29b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.296449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.297598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.298085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.298526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] PATH_INFO: `/v3/projects/62e3a3e79ff243dda1dc96033280341c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.299930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e3a3e79ff243dda1dc96033280341c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:32.300076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role a3da9f61d5804b389de8367923728b70 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:32.300356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.301238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.302365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:32.304827 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2578/5071] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:31 2021] DELETE /identity/v3/roles/a3da9f61d5804b389de8367923728b70 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:32.305810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:32.308089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.408915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01239e4d-50ec-4896-9204-02a189c1ee2c tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.417563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e502fa90cc4d5e8fb42a20e0baedf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e35b77d702444787850e21bc03163f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.428612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.428612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.428612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.428612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:32.428612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:32.429692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:32.443109 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2579/5072] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:32.444245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:32.447905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.472455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e3a3e79ff243dda1dc96033280341c', 'request_id': 'req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.481223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e3a3e79ff243dda1dc96033280341c', 'request_id': 'req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.533799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e3a3e79ff243dda1dc96033280341c', 'request_id': 'req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.544337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057af11-987a-4335-9b6a-b0fbf8fe5186 tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.548174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] The token cache is being invalidate because project 62e3a3e79ff243dda1dc96033280341c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:32.548517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.549697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.551645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2494/5073] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:32 2021] DELETE /identity/v3/projects/62e3a3e79ff243dda1dc96033280341c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:32.553346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:32.554890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.631380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.632041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a5bd1-ba3a-462a-9162-88fdb10d724b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.632781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.633320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.633832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.639418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.644721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.644721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.644721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users/8a249de1e5374922b50eff1b460e47c7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.650065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8a249de1e5374922b50eff1b460e47c7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:32.652988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:32.655784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:32.666196 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find domain: e6c38aa6f7574d22956d9a326d4eeae5.: keystone.exception.DomainNotFound: Could not find domain: e6c38aa6f7574d22956d9a326d4eeae5. Dec 25 21:25:32.667795 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2580/5074] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:32 2021] PATCH /identity/v3/domains/e6c38aa6f7574d22956d9a326d4eeae5 => generated 112 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:32.668713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:32.671599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.738415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa9cc-95d1-4dca-9fbc-05bebbf34ab7 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.744770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac93299-a8d3-4efd-82f7-4dfbb9d8cd07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.746715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93299-a8d3-4efd-82f7-4dfbb9d8cd07 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.747729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93299-a8d3-4efd-82f7-4dfbb9d8cd07 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.748246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93299-a8d3-4efd-82f7-4dfbb9d8cd07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.750980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6ac93299-a8d3-4efd-82f7-4dfbb9d8cd07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.829521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac93299-a8d3-4efd-82f7-4dfbb9d8cd07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:32.831026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac93299-a8d3-4efd-82f7-4dfbb9d8cd07 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:32.844265 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2581/5075] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:32 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:32.845896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.846176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.846360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.864252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a249de1e5374922b50eff1b460e47c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.867085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:32.868468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.874747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a249de1e5374922b50eff1b460e47c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.898533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a249de1e5374922b50eff1b460e47c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.899282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a249de1e5374922b50eff1b460e47c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.899882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51937664-151b-4221-93b0-8084dbb0bfcc tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a249de1e5374922b50eff1b460e47c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:32.933796 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2582/5076] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:32.934620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:32.935907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:32.950261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea586477-3828-4848-814c-a5cb28b416a9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:32.955393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:32.956059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:32.956344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:32.956621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:32.957595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:32.959339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.063697 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2495/5077] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:32 2021] DELETE /identity/v3/users/8a249de1e5374922b50eff1b460e47c7 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:33.063697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0bd69-c066-4d94-98c9-af8c5c7e84e8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.063697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0bd69-c066-4d94-98c9-af8c5c7e84e8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.063697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0bd69-c066-4d94-98c9-af8c5c7e84e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.086766 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2583/5078] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:25:32 2021] POST /identity/v3/domains => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:33.087425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:33.091638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b4c0bd69-c066-4d94-98c9-af8c5c7e84e8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:33.092171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:33.094196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b4c0bd69-c066-4d94-98c9-af8c5c7e84e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:33.229563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2496/5079] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:33.230974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0bd69-c066-4d94-98c9-af8c5c7e84e8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:33.242195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924d1a-4d44-4e4c-ae3e-d36f801fead5 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:33.254902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:33.257060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.257464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.257814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/6e16efee7e2c4b679bc681c12f32b896` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.259527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e16efee7e2c4b679bc681c12f32b896)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:33.262200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.322155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0bd69-c066-4d94-98c9-af8c5c7e84e8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:33.327363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:33.328147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.328508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.328862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.329677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:33.331615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.382650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e16efee7e2c4b679bc681c12f32b896', 'request_id': 'req-2a6a37e1-bc3c-4f64-9764-c3a886077fef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:33.469499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2497/5080] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:33 2021] POST /identity/v3/users => generated 348 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:33.476134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:33.488762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e16efee7e2c4b679bc681c12f32b896', 'request_id': 'req-2a6a37e1-bc3c-4f64-9764-c3a886077fef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:33.494083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956274d7-d68d-4cc6-ad6c-b57845bb051b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:33.503863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e16efee7e2c4b679bc681c12f32b896', 'request_id': 'req-2a6a37e1-bc3c-4f64-9764-c3a886077fef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:33.530204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] The token cache is being invalidate because project 6e16efee7e2c4b679bc681c12f32b896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:33.530613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:33.531406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:33.535748 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2584/5081] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:33 2021] DELETE /identity/v3/projects/6e16efee7e2c4b679bc681c12f32b896 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:33.540431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:33.544097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:33.634203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:33.634789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.635074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.635350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.636103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:33.636407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:33.638049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.652335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a37e1-bc3c-4f64-9764-c3a886077fef tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:33.653917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2498/5082] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:33.654845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:33.657276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:33.661974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:33.663073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.663648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.664704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.666089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:33.668656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.725110 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2585/5083] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:25:33 2021] POST /identity/v3/groups => generated 324 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:33.725954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:33.734046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:33.737946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315d31f-d719-4f4f-8738-6d99bce91745 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:33.745324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:33.746388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.747110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.747616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.748363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:33.750998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.770450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db989ff-ed41-4ad1-a0fe-ecedba11f846 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:33.780457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:33.780457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.780457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.780457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.794494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:33.811503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.888489 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2499/5084] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:25:33 2021] POST /identity/v3/projects => generated 329 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:33.888489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:33.983844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9c940-d54c-42e5-ac34-3e31c9a1135d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:33.987858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:33.989491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:33.990341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:33.990622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:33.992215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d65ab1a7cc1d4e78a03b65d7163afa72)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:33.997147 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2586/5085] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:33 2021] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:33.997804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:33.997900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:34.022765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.024104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.079149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d20ca-fb4a-4a0a-a68e-8247d024a74d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:34.116858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.116858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.120560 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2500/5086] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:33 2021] PATCH /identity/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72 => generated 276 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:34.121806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:34.125968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:34.151970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:34.152663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:34.152992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:34.153713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:34.153954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:34.156916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:34.280293 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2587/5087] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:33 2021] POST /identity/v3/users => generated 416 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:34.282528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:34.286105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:34.291068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66169cf4-2848-47ef-a553-e39d4e5b7666 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:34.305673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:34.309034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:34.309034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:34.309034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:34.309034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:34.309717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:34.396393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85607-9efd-4620-9ca9-9a2cedd83c28 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:34.401297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:34.402175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:34.409240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:34.409240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:34.415543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d65ab1a7cc1d4e78a03b65d7163afa72)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:34.417245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:34.442907 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2501/5088] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:34 2021] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:34.445671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:34.446840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.447699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:34.470096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb32b03-8cf4-4ba1-9e6f-149823b75e9a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:34.476231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:34.477109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:34.477399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:34.478071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:34.478606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:34.480248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:34.555100 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2502/5089] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:34 2021] POST /identity/v3/roles => generated 244 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:34.556293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:34.575113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a3b9-858e-4031-b30a-d4371577209d tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:34.679303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:34.680029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:34.680351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:34.681297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:34.682131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:34.687508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:34.710113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869e02732fe1485e87a643a7c9f72c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.716056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2503/5090] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:34 2021] GET /identity/v3/roles => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:34.720609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:34.721025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869e02732fe1485e87a643a7c9f72c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.743952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869e02732fe1485e87a643a7c9f72c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.744864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869e02732fe1485e87a643a7c9f72c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.829299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62e1bb-863a-4fb6-8797-40361b002bb7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:34.833330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:34.834116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:34.834526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:34.834935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:34.836614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:34.837777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:34.859344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869e02732fe1485e87a643a7c9f72c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:34.866155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.000325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2504/5091] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:34 2021] POST /identity/v3/roles => generated 247 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:35.000325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:35.003079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:35.053667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72', 'request_id': 'req-313f26e5-001b-447b-8324-c52f7bea1b53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.058863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb8c9-3a7b-4614-a5b8-e4de5caccea3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:35.145798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72', 'request_id': 'req-313f26e5-001b-447b-8324-c52f7bea1b53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.155209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72', 'request_id': 'req-313f26e5-001b-447b-8324-c52f7bea1b53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.162891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:35.163724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:35.164634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:35.164952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:35.166912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:35.167760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] The token cache is being invalidate because project d65ab1a7cc1d4e78a03b65d7163afa72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:35.168053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.168773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.175362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:35.179318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72', 'request_id': 'req-313f26e5-001b-447b-8324-c52f7bea1b53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.180131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72', 'request_id': 'req-313f26e5-001b-447b-8324-c52f7bea1b53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.180903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd65ab1a7cc1d4e78a03b65d7163afa72', 'request_id': 'req-313f26e5-001b-447b-8324-c52f7bea1b53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:35.194658 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2588/5092] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:34 2021] DELETE /identity/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:35.194658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:35.198329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:35.201874 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2505/5093] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:34 2021] GET /identity/v3/roles => generated 1893 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:35.205973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:35.208199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:35.328116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166bd4-38ff-4446-8730-2598863e4c5c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:35.339138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:35.340280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:35.340731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:35.341106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:35.349905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=d65ab1a7cc1d4e78a03b65d7163afa72)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:35.352104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:35.369608 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find domain: d65ab1a7cc1d4e78a03b65d7163afa72.: keystone.exception.DomainNotFound: Could not find domain: d65ab1a7cc1d4e78a03b65d7163afa72. Dec 25 21:25:35.370046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f26e5-001b-447b-8324-c52f7bea1b53 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:35.371505 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2506/5094] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:25:35 2021] GET /identity/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72 => generated 112 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:35.372397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:35.374746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:35.389830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:35.390762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:35.391063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:35.391332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/727cab90fb534a639e512b3733b61e34/users/bbd6bd5e5225431a8f3befb7270c221f/roles/2ff1487b3bd44a40821d6e92ea820a86` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:35.398495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b6dd6-592a-49b7-b051-3972d663e8ca tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:35.411664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:35.412820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:35.413202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:35.413544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] PATH_INFO: `/v3/projects/00685ab64044408194e2426e71afe583/users/0560cf3b7cd24adea59de526bfc0aa09/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:35.437808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=727cab90fb534a639e512b3733b61e34, user_id=bbd6bd5e5225431a8f3befb7270c221f, role_id=2ff1487b3bd44a40821d6e92ea820a86)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:35.443147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:35.466169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00685ab64044408194e2426e71afe583, user_id=0560cf3b7cd24adea59de526bfc0aa09, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:35.474540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:35.580046 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2589/5095] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:35 2021] PUT /identity/v3/projects/727cab90fb534a639e512b3733b61e34/users/bbd6bd5e5225431a8f3befb7270c221f/roles/2ff1487b3bd44a40821d6e92ea820a86 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:35.581099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:35.654282 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2507/5096] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:35 2021] PUT /identity/v3/projects/00685ab64044408194e2426e71afe583/users/0560cf3b7cd24adea59de526bfc0aa09/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:35.655359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:35.684536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b065d8-6a08-49ef-a25b-811a0fc5954f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:35.753905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896eb83-276b-4d9d-8281-5afe1269adba tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:35.755535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896eb83-276b-4d9d-8281-5afe1269adba tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:35.755976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896eb83-276b-4d9d-8281-5afe1269adba tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:35.756400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896eb83-276b-4d9d-8281-5afe1269adba tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/users/869e02732fe1485e87a643a7c9f72c6c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:35.765490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896eb83-276b-4d9d-8281-5afe1269adba tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:get_user(user_id=869e02732fe1485e87a643a7c9f72c6c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:35.767965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896eb83-276b-4d9d-8281-5afe1269adba tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:35.792359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c6052-ece6-4626-a170-9718ebabd375 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:35.803652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:35.804573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:35.804842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:35.805152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/727cab90fb534a639e512b3733b61e34/users/bbd6bd5e5225431a8f3befb7270c221f/roles/5ce4ea1038f34d32b08ce8198bce7700` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:35.807925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=727cab90fb534a639e512b3733b61e34, user_id=bbd6bd5e5225431a8f3befb7270c221f, role_id=5ce4ea1038f34d32b08ce8198bce7700)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:35.812751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:35.814290 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3896eb83-276b-4d9d-8281-5afe1269adba tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find user: 869e02732fe1485e87a643a7c9f72c6c.: keystone.exception.UserNotFound: Could not find user: 869e02732fe1485e87a643a7c9f72c6c. Dec 25 21:25:35.818209 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2590/5097] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:25:35 2021] GET /identity/v3/users/869e02732fe1485e87a643a7c9f72c6c => generated 110 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:35.821107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5626-8519-4bc9-9ad9-02fdcd06ae7f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:35.822137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5626-8519-4bc9-9ad9-02fdcd06ae7f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:35.822688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a5626-8519-4bc9-9ad9-02fdcd06ae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:35.867149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d38a5626-8519-4bc9-9ad9-02fdcd06ae7f None None] MFA Rules not processed for user `0560cf3b7cd24adea59de526bfc0aa09`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:35.876526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d38a5626-8519-4bc9-9ad9-02fdcd06ae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:35.969225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2508/5098] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:35 2021] PUT /identity/v3/projects/727cab90fb534a639e512b3733b61e34/users/bbd6bd5e5225431a8f3befb7270c221f/roles/5ce4ea1038f34d32b08ce8198bce7700 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:35.970362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.002297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2591/5099] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:36.002297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5626-8519-4bc9-9ad9-02fdcd06ae7f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.028563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a5626-8519-4bc9-9ad9-02fdcd06ae7f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.081352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1b47f-6569-4a13-a1c6-969889a023ae tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.089026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.095019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.095303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.095575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/groups/94cdd85427a54137877feb6d669017c8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.102094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:get_group(group_id=94cdd85427a54137877feb6d669017c8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.104058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.110277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.111384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.111384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.111852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.112747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.114983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.129647 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find group: 94cdd85427a54137877feb6d669017c8.: keystone.exception.GroupNotFound: Could not find group: 94cdd85427a54137877feb6d669017c8. Dec 25 21:25:36.134985 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2509/5100] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:35 2021] GET /identity/v3/groups/94cdd85427a54137877feb6d669017c8 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:36.135974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.138518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:36.163094 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2592/5101] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:35 2021] GET /identity/v3/users => generated 8903 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:36.164140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.178759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73ab0-4322-4bf0-b8e7-4cfb86438c84 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.186937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552437cc-e30a-4605-9214-a5e06b6b2144 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.187866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552437cc-e30a-4605-9214-a5e06b6b2144 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.188095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552437cc-e30a-4605-9214-a5e06b6b2144 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.188372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552437cc-e30a-4605-9214-a5e06b6b2144 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/groups/94cdd85427a54137877feb6d669017c8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.195694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552437cc-e30a-4605-9214-a5e06b6b2144 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:36.207785 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-552437cc-e30a-4605-9214-a5e06b6b2144 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find group: 94cdd85427a54137877feb6d669017c8.: keystone.exception.GroupNotFound: Could not find group: 94cdd85427a54137877feb6d669017c8. Dec 25 21:25:36.210230 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2593/5102] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:25:36 2021] DELETE /identity/v3/groups/94cdd85427a54137877feb6d669017c8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:36.212976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916f2a-eac1-4a72-a715-f966f3b93964 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.213269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916f2a-eac1-4a72-a715-f966f3b93964 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.220175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916f2a-eac1-4a72-a715-f966f3b93964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.232023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aa4c-7957-4dcc-96ac-38c18886f9c3 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.236809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.237626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.238009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.238398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.289077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1b916f2a-eac1-4a72-a715-f966f3b93964 None None] MFA Rules not processed for user `bbd6bd5e5225431a8f3befb7270c221f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:36.290767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b916f2a-eac1-4a72-a715-f966f3b93964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:36.349906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.353620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.369746 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2510/5103] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:36 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:36.370869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.387908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de2c70-e4a1-4b39-a21c-7775109e84ae service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.401871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.404412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.405068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.405663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/users/869e02732fe1485e87a643a7c9f72c6c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.427473 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2594/5104] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:36 2021] POST /identity/v3/auth/tokens => generated 3271 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:36.427717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_user(user_id=869e02732fe1485e87a643a7c9f72c6c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.427717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.433523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25577e3-679c-46d5-a6ae-2d7ad9243b21 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.433810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25577e3-679c-46d5-a6ae-2d7ad9243b21 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.435160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25577e3-679c-46d5-a6ae-2d7ad9243b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.459301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a25577e3-679c-46d5-a6ae-2d7ad9243b21 None None] MFA Rules not processed for user `bbd6bd5e5225431a8f3befb7270c221f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:36.460702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a25577e3-679c-46d5-a6ae-2d7ad9243b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:36.464078 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find user: 869e02732fe1485e87a643a7c9f72c6c.: keystone.exception.UserNotFound: Could not find user: 869e02732fe1485e87a643a7c9f72c6c. Dec 25 21:25:36.465741 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2511/5105] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:36 2021] DELETE /identity/v3/users/869e02732fe1485e87a643a7c9f72c6c => generated 110 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:36.469508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.484086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e932-48c6-46bf-a2cf-f6ad58a87022 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.486955 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2595/5106] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:36 2021] POST /identity/v3/auth/tokens => generated 3271 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:36.487757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.488784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.489330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.490425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.491394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25577e3-679c-46d5-a6ae-2d7ad9243b21 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.499907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:36.507106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25577e3-679c-46d5-a6ae-2d7ad9243b21 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.514448 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find domain: d65ab1a7cc1d4e78a03b65d7163afa72.: keystone.exception.DomainNotFound: Could not find domain: d65ab1a7cc1d4e78a03b65d7163afa72. Dec 25 21:25:36.520146 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2512/5107] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:36 2021] PATCH /identity/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:25:36.522612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.523240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.523934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.530559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.530559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.530559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:create_trust()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.530559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.547922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aece40-c0ef-4c84-a19a-cd39d949df55 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.565763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.566587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.566994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.567427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.568397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.570165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.604143 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2513/5108] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:25:36 2021] GET /identity/v3/domains => generated 1347 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:36.605249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.611454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:36.709069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1fa8a-f4f5-4e19-b4d7-f97f076b424a tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.715029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e502fa90cc4d5e8fb42a20e0baedf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74e35b77d702444787850e21bc03163f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.716113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.716497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.716957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] PATH_INFO: `/v3/projects/65fe8e08853d406695d41c77ea3972bf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.718385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65fe8e08853d406695d41c77ea3972bf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.720960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.760017 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2596/5109] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:25:36 2021] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:36.761259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.774963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b744-39fe-4379-a454-a47ca979bc84 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.780366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.781006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.781348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.781720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.782728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:36.783129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.785291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.807845 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2597/5110] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:36 2021] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:36.808659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.821720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798676b-78c8-4e58-97f2-67ff68e62dc1 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.827866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.828724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.829040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.830032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.837067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:get_trust(trust_id=6cc826d64525430ba7265011bf4881e0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.838510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.846131 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2598/5111] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:36 2021] GET /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0 => generated 834 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:36.847051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.864918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef599f7-6c0f-4e7d-bcad-a39536eb0361 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:36.871653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65fe8e08853d406695d41c77ea3972bf', 'request_id': 'req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:36.877374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65fe8e08853d406695d41c77ea3972bf', 'request_id': 'req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:36.929895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:36.930555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:36.930838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:36.931113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:36.931832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1463566491) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:36.932136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:36.933777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:36.946025 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2599/5112] 10.222.0.32 () {58 vars in 1198 bytes} [Sat Dec 25 21:25:36 2021] GET /identity/v3/domains?name=tempest-test_domain-1463566491 => generated 409 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:36.952497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:36.974893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65fe8e08853d406695d41c77ea3972bf', 'request_id': 'req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:36.990304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] The token cache is being invalidate because project 65fe8e08853d406695d41c77ea3972bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:36.990594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:36.991311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:36.998997 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2514/5113] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:36 2021] DELETE /identity/v3/projects/65fe8e08853d406695d41c77ea3972bf => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:37.000215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.001698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:37.020209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4427df-4f3c-49e5-955c-83e3d7fb4f2d tempest-QuotasNegativeTest-1862831309 tempest-QuotasNegativeTest-1862831309-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.039768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.040691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.041780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.042634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.045756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3d42a-412c-4e3e-8990-8b5c6e01ea76 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.053098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.053859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.054140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.054574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.062006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6cc826d64525430ba7265011bf4881e0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.063768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.073203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:37.074144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2600/5114] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:25:36 2021] GET /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles => generated 371 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:37.075243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.077781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:37.101276 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Could not find domain: d65ab1a7cc1d4e78a03b65d7163afa72.: keystone.exception.DomainNotFound: Could not find domain: d65ab1a7cc1d4e78a03b65d7163afa72. Dec 25 21:25:37.106451 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2515/5115] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:36 2021] PATCH /identity/v3/domains/d65ab1a7cc1d4e78a03b65d7163afa72 => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:37.107365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.110016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:37.126564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc320a6-ec58-43c8-8df3-dec231f7fe2b tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.132228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.134244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.134399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.134642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/2ff1487b3bd44a40821d6e92ea820a86` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.150549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6cc826d64525430ba7265011bf4881e0, role_id=2ff1487b3bd44a40821d6e92ea820a86)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.153058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.165562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2516/5116] 10.222.0.32 () {58 vars in 1367 bytes} [Sat Dec 25 21:25:37 2021] GET /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/2ff1487b3bd44a40821d6e92ea820a86 => generated 244 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:37.166466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.185008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889beda0-a0c7-4091-92dd-9676c765dcae tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.185445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44e158-af31-405b-bc73-002606e8934e tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.189886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.190834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.191177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.191458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/1016472d2b9347378be0750f6f0391aa` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.194065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.195081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.195523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.195824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] PATH_INFO: `/v3/users/9746c75df58f4ad0979581490485baab` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.197134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9746c75df58f4ad0979581490485baab)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.199298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.224179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1016472d2b9347378be0750f6f0391aa)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.225917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.305412 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2517/5117] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:37 2021] PATCH /identity/v3/domains/1016472d2b9347378be0750f6f0391aa => generated 276 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:37.307392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.331347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc65148-47fd-4391-8f50-5e1a23fc890d tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.338384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.339596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.339985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.340542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/2ff1487b3bd44a40821d6e92ea820a86` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.353159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6cc826d64525430ba7265011bf4881e0, role_id=2ff1487b3bd44a40821d6e92ea820a86)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.354622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.364115 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2518/5118] 10.222.0.32 () {58 vars in 1368 bytes} [Sat Dec 25 21:25:37 2021] HEAD /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/2ff1487b3bd44a40821d6e92ea820a86 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Dec 25 21:25:37.364687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.380679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453250a-ad3c-4b20-bd29-27247a4e4cc8 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.386998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.388314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.388314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.388692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/1016472d2b9347378be0750f6f0391aa` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.415251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1016472d2b9347378be0750f6f0391aa)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.420159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.423611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9746c75df58f4ad0979581490485baab'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.444503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9746c75df58f4ad0979581490485baab'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.463586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9746c75df58f4ad0979581490485baab'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.464391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9746c75df58f4ad0979581490485baab'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.479167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1016472d2b9347378be0750f6f0391aa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.500374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1016472d2b9347378be0750f6f0391aa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.562213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9746c75df58f4ad0979581490485baab'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.578980 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2601/5119] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:37 2021] DELETE /identity/v3/users/9746c75df58f4ad0979581490485baab => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:37.580165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.581702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:37.699259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90845-9b5f-4357-8d0d-30d4af7d2fec admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.709989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1016472d2b9347378be0750f6f0391aa', 'request_id': 'req-e99588af-334d-4b9b-9a30-1932420e2906'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.736385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1016472d2b9347378be0750f6f0391aa', 'request_id': 'req-e99588af-334d-4b9b-9a30-1932420e2906'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.811469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc29ab-b1b1-432d-b1f0-6f62a51fcddc tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.813008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc29ab-b1b1-432d-b1f0-6f62a51fcddc tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.813862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc29ab-b1b1-432d-b1f0-6f62a51fcddc tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.814448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc29ab-b1b1-432d-b1f0-6f62a51fcddc tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/5ce4ea1038f34d32b08ce8198bce7700` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.821871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc29ab-b1b1-432d-b1f0-6f62a51fcddc tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6cc826d64525430ba7265011bf4881e0, role_id=5ce4ea1038f34d32b08ce8198bce7700)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.823987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc29ab-b1b1-432d-b1f0-6f62a51fcddc tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.837501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1016472d2b9347378be0750f6f0391aa', 'request_id': 'req-e99588af-334d-4b9b-9a30-1932420e2906'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.845685 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-53bc29ab-b1b1-432d-b1f0-6f62a51fcddc tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Could not find role: 5ce4ea1038f34d32b08ce8198bce7700.: keystone.exception.RoleNotFound: Could not find role: 5ce4ea1038f34d32b08ce8198bce7700. Dec 25 21:25:37.847417 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2602/5120] 10.222.0.32 () {58 vars in 1367 bytes} [Sat Dec 25 21:25:37 2021] GET /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/5ce4ea1038f34d32b08ce8198bce7700 => generated 110 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:37.849644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc391-3280-48ba-a7c8-dc35f4d333ef None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.850076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc391-3280-48ba-a7c8-dc35f4d333ef None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.850357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc391-3280-48ba-a7c8-dc35f4d333ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.853856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] The token cache is being invalidate because project 1016472d2b9347378be0750f6f0391aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:37.854410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.855267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.875672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1016472d2b9347378be0750f6f0391aa', 'request_id': 'req-e99588af-334d-4b9b-9a30-1932420e2906'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.876824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1016472d2b9347378be0750f6f0391aa', 'request_id': 'req-e99588af-334d-4b9b-9a30-1932420e2906'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.877868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1016472d2b9347378be0750f6f0391aa', 'request_id': 'req-e99588af-334d-4b9b-9a30-1932420e2906'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:37.881296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-208cc391-3280-48ba-a7c8-dc35f4d333ef None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:37.883209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-208cc391-3280-48ba-a7c8-dc35f4d333ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:37.903369 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2519/5121] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:37 2021] DELETE /identity/v3/domains/1016472d2b9347378be0750f6f0391aa => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:37.904851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.915341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:37.939117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99588af-334d-4b9b-9a30-1932420e2906 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:37.955709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:37.956735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:37.957117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:37.962284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/5ce4ea1038f34d32b08ce8198bce7700` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:37.969275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6cc826d64525430ba7265011bf4881e0, role_id=5ce4ea1038f34d32b08ce8198bce7700)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:37.971224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:37.990854 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Could not find role: 5ce4ea1038f34d32b08ce8198bce7700.: keystone.exception.RoleNotFound: Could not find role: 5ce4ea1038f34d32b08ce8198bce7700. Dec 25 21:25:37.992790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2520/5122] 10.222.0.32 () {58 vars in 1368 bytes} [Sat Dec 25 21:25:37 2021] HEAD /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0/roles/5ce4ea1038f34d32b08ce8198bce7700 => generated 0 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Dec 25 21:25:37.994041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:37.999093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:38.000133 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2603/5123] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:38.001513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cc391-3280-48ba-a7c8-dc35f4d333ef None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:38.018154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cc391-3280-48ba-a7c8-dc35f4d333ef None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:38.024720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:38.026591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:38.027735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:38.028222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:38.042544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorizing `identity:delete_trust(trust_id=6cc826d64525430ba7265011bf4881e0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:38.046343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:38.123763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d38f8-fd57-4261-95dd-5f8bdeaa7c34 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:38.131628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:38.132545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:38.136765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:38.136765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/90f75ba0d6d546f2804e33b36b8aaf3d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:38.144633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=90f75ba0d6d546f2804e33b36b8aaf3d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:38.146919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:38.157698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6cc826d64525430ba7265011bf4881e0', 'request_id': 'req-bb24e75f-b16b-4b59-98fa-02fe85700497'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.160099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6cc826d64525430ba7265011bf4881e0', 'request_id': 'req-bb24e75f-b16b-4b59-98fa-02fe85700497'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.162509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6cc826d64525430ba7265011bf4881e0', 'request_id': 'req-bb24e75f-b16b-4b59-98fa-02fe85700497'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.173393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.173992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.257895 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2604/5124] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:25:38 2021] DELETE /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:38.257895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:38.261173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:38.313940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.314318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.319871 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2521/5125] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:37 2021] PATCH /identity/v3/domains/90f75ba0d6d546f2804e33b36b8aaf3d => generated 277 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:38.319871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:38.323166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:38.401294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e75f-b16b-4b59-98fa-02fe85700497 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:38.423189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a195be7-0e55-4fb4-ae89-64f1c2b55ab9 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:38.427793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd6bd5e5225431a8f3befb7270c221f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '727cab90fb534a639e512b3733b61e34', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1982163822', 'tempest-DelegatedRole-1661140963'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:38.428652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:38.429453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:38.429453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] PATH_INFO: `/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:38.445263 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Could not find trust: 6cc826d64525430ba7265011bf4881e0.: keystone.exception.TrustNotFound: Could not find trust: 6cc826d64525430ba7265011bf4881e0. Dec 25 21:25:38.446890 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2522/5126] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:38 2021] GET /identity/v3/OS-TRUST/trusts/6cc826d64525430ba7265011bf4881e0 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:38.447958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:38.450643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:38.483960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:38.485238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:38.485596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:38.485993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:38.489017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:38.579841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a374056-f37d-4cf0-b39e-f4c638f68163 tempest-TrustsV3TestJSON-1607912167 tempest-user-1405631153] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:38.586862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:38.587803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:38.588082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:38.588598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/90f75ba0d6d546f2804e33b36b8aaf3d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:38.589594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:38.591267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:38.605932 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2605/5127] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:38.607901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:38.608021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=90f75ba0d6d546f2804e33b36b8aaf3d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:38.608440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:38.610123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:38.669987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.697456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.723398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff3b1-e1fc-4ab8-9903-cbc47107e54f service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:38.733767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:38.735483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:38.736270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:38.736736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/5ce4ea1038f34d32b08ce8198bce7700` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:38.740081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5ce4ea1038f34d32b08ce8198bce7700)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:38.743059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:38.941031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d', 'request_id': 'req-624b500b-f96f-46f1-9602-9936f2bf7381'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:38.951210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d', 'request_id': 'req-624b500b-f96f-46f1-9602-9936f2bf7381'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.009340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 5ce4ea1038f34d32b08ce8198bce7700 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:39.009644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.010584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.013254 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2606/5128] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:38 2021] DELETE /identity/v3/roles/5ce4ea1038f34d32b08ce8198bce7700 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:39.018820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:39.022458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:39.027273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d', 'request_id': 'req-624b500b-f96f-46f1-9602-9936f2bf7381'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.039676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] The token cache is being invalidate because project 90f75ba0d6d546f2804e33b36b8aaf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:39.039877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.041094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.062613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d', 'request_id': 'req-624b500b-f96f-46f1-9602-9936f2bf7381'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.064007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d', 'request_id': 'req-624b500b-f96f-46f1-9602-9936f2bf7381'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.064648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '90f75ba0d6d546f2804e33b36b8aaf3d', 'request_id': 'req-624b500b-f96f-46f1-9602-9936f2bf7381'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.079649 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2523/5129] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:38 2021] DELETE /identity/v3/domains/90f75ba0d6d546f2804e33b36b8aaf3d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:39.087688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:39.089588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:39.164525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2e60d-20f7-4f1f-ac6d-5d92e5ea3f06 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:39.182204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:39.183366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:39.183661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:39.183939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/2ff1487b3bd44a40821d6e92ea820a86` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:39.186653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2ff1487b3bd44a40821d6e92ea820a86)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:39.189900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:39.231302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b500b-f96f-46f1-9602-9936f2bf7381 tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:39.319495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:39.322625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:39.322919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:39.326143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/3f87ada0aa4441dd8045f8fafa06cb25` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:39.351174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3f87ada0aa4441dd8045f8fafa06cb25)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:39.353392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:39.378635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.380385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.415756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 2ff1487b3bd44a40821d6e92ea820a86 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:39.416753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.418099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.423559 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2607/5130] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:39 2021] DELETE /identity/v3/roles/2ff1487b3bd44a40821d6e92ea820a86 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:39.424667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:39.427405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:39.498224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.502070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.506992 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2524/5131] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:25:39 2021] PATCH /identity/v3/domains/3f87ada0aa4441dd8045f8fafa06cb25 => generated 278 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:25:39.508658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:39.512614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:39.523763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc58edf-bdf4-426b-a2b6-260ef4213781 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:39.530295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:39.531195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:39.531541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:39.531923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users/bbd6bd5e5225431a8f3befb7270c221f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:39.533282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bbd6bd5e5225431a8f3befb7270c221f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:39.537797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:39.677987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a6cbf-f6ee-454c-8481-3adc17a201eb tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:39.750591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd6bd5e5225431a8f3befb7270c221f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.765547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd6bd5e5225431a8f3befb7270c221f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.787424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd6bd5e5225431a8f3befb7270c221f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.788268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd6bd5e5225431a8f3befb7270c221f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.833320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89f2447f02f3469d93970c1ad7eb5a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13696fe6aa3a4d65b92d5457619cf920', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:39.834427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:39.834813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:39.835193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] PATH_INFO: `/v3/domains/3f87ada0aa4441dd8045f8fafa06cb25` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:39.852714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3f87ada0aa4441dd8045f8fafa06cb25)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:39.864043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:39.913691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.933588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd6bd5e5225431a8f3befb7270c221f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.943696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:39.948023 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2608/5132] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:39 2021] DELETE /identity/v3/users/bbd6bd5e5225431a8f3befb7270c221f => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:39.950607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:39.956049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:40.113678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25', 'request_id': 'req-542f5ca4-27b8-4f98-92b4-8689a4ce966c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.118768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fc225-558a-43c3-9f4c-eb6002f4e992 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:40.121303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25', 'request_id': 'req-542f5ca4-27b8-4f98-92b4-8689a4ce966c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.195883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25', 'request_id': 'req-542f5ca4-27b8-4f98-92b4-8689a4ce966c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.211357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] The token cache is being invalidate because project 3f87ada0aa4441dd8045f8fafa06cb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:40.211741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.213019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.213452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:40.214532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:40.214979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:40.215636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/727cab90fb534a639e512b3733b61e34` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:40.217870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_project(project_id=727cab90fb534a639e512b3733b61e34)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:40.225450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:40.233351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25', 'request_id': 'req-542f5ca4-27b8-4f98-92b4-8689a4ce966c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.234699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25', 'request_id': 'req-542f5ca4-27b8-4f98-92b4-8689a4ce966c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.237693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3f87ada0aa4441dd8045f8fafa06cb25', 'request_id': 'req-542f5ca4-27b8-4f98-92b4-8689a4ce966c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.257197 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2525/5133] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:25:39 2021] DELETE /identity/v3/domains/3f87ada0aa4441dd8045f8fafa06cb25 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:40.258162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:40.259547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:40.342193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f5ca4-27b8-4f98-92b4-8689a4ce966c tempest-DomainsTestJSON-1713261923 tempest-DomainsTestJSON-1713261923-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:40.348107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:40.349405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:40.349916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:40.350257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] PATH_INFO: `/v3/projects/fe72b9abec8c404da78ac27c7e38ee1d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:40.353079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe72b9abec8c404da78ac27c7e38ee1d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:40.355696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:40.545110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727cab90fb534a639e512b3733b61e34', 'request_id': 'req-39abc426-0007-4d3d-b9e7-ddb991750fc7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.557716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe72b9abec8c404da78ac27c7e38ee1d', 'request_id': 'req-1e10ebea-ffc5-4ef0-bc07-2f1429181883'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.570110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe72b9abec8c404da78ac27c7e38ee1d', 'request_id': 'req-1e10ebea-ffc5-4ef0-bc07-2f1429181883'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.632230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727cab90fb534a639e512b3733b61e34', 'request_id': 'req-39abc426-0007-4d3d-b9e7-ddb991750fc7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.640710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727cab90fb534a639e512b3733b61e34', 'request_id': 'req-39abc426-0007-4d3d-b9e7-ddb991750fc7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.654395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] The token cache is being invalidate because project 727cab90fb534a639e512b3733b61e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:40.654921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.655467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.658394 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2609/5134] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:39 2021] DELETE /identity/v3/projects/727cab90fb534a639e512b3733b61e34 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:40.664195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:40.664195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:40.744677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe72b9abec8c404da78ac27c7e38ee1d', 'request_id': 'req-1e10ebea-ffc5-4ef0-bc07-2f1429181883'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.762399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] The token cache is being invalidate because project fe72b9abec8c404da78ac27c7e38ee1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:40.764644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.764644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:40.766724 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2526/5135] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:40 2021] DELETE /identity/v3/projects/fe72b9abec8c404da78ac27c7e38ee1d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:40.769928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:40.770252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:40.781606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc426-0007-4d3d-b9e7-ddb991750fc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:40.895337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ebea-ffc5-4ef0-bc07-2f1429181883 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:40.904117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:40.905302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:40.905784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:40.907376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] PATH_INFO: `/v3/users/3e1bce380a094237a2eb87a5e1994339` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:40.910788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1bce380a094237a2eb87a5e1994339)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:40.914328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:40.917816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:40.919676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:40.919974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:40.920261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:40.922793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:40.930831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:41.083891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2527/5136] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:25:40 2021] POST /identity/v3/projects => generated 329 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:41.083891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:41.085488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:41.222217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1bce380a094237a2eb87a5e1994339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.242697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1bce380a094237a2eb87a5e1994339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.260374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1bce380a094237a2eb87a5e1994339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.261838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1bce380a094237a2eb87a5e1994339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.271025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85a62c-a27b-42aa-9d67-3a8676d2961f tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:41.300035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:41.301356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:41.305685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:41.306028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] PATH_INFO: `/v3/users/b3e502fa90cc4d5e8fb42a20e0baedf2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:41.307575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e502fa90cc4d5e8fb42a20e0baedf2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:41.309770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:41.413703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1bce380a094237a2eb87a5e1994339'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.421261 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2610/5137] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:40 2021] DELETE /identity/v3/users/3e1bce380a094237a2eb87a5e1994339 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:41.422036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:41.425648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:41.650435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14ec73-7777-4ace-870f-b458925e6db4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:41.664481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc271c82-722c-46bc-b598-70a15b2b6bac tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:41.665605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc271c82-722c-46bc-b598-70a15b2b6bac tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:41.666760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc271c82-722c-46bc-b598-70a15b2b6bac tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:41.667338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc271c82-722c-46bc-b598-70a15b2b6bac tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:41.681391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc271c82-722c-46bc-b598-70a15b2b6bac tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:41.686338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc271c82-722c-46bc-b598-70a15b2b6bac tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:41.738296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e502fa90cc4d5e8fb42a20e0baedf2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.749123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e502fa90cc4d5e8fb42a20e0baedf2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.775326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e502fa90cc4d5e8fb42a20e0baedf2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.776417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e502fa90cc4d5e8fb42a20e0baedf2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.777534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e502fa90cc4d5e8fb42a20e0baedf2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:41.853338 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2611/5138] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:41 2021] POST /identity/v3/users => generated 410 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:41.855208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:41.858283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:41.859907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:41.894600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:41.896813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:41.926813 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2528/5139] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:41 2021] DELETE /identity/v3/users/b3e502fa90cc4d5e8fb42a20e0baedf2 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:41.928040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:41.932457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:42.028502 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2612/5140] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:42.071012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1208b-56d0-4587-9e2b-2a24f8e59925 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:42.072437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:42.073882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:42.077221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:42.078372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:42.078897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:42.079940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:42.081209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:42.083701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:42.169481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63afcba-badd-4e5a-92e3-0d45d7aa8d9c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:42.190801 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2529/5141] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:41 2021] POST /identity/v3/roles => generated 244 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:42.195105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:42.213579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa71e28-b0fd-47c5-bb05-d5426dbda7c0 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:42.232861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:42.234406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:42.236432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:42.237006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:42.238043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:42.238792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:42.241146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:42.242195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:42.242462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:42.244777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:42.340973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:42.342570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:42.357709 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2613/5142] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:42.383841 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2530/5143] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:25:42 2021] POST /identity/v3/roles => generated 247 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:42.388485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:42.410392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8893b37-a714-4359-8947-549adfa1c801 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:42.424472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:42.425675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:42.425970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:42.426245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/5c5c0f68795041759e9c6dc1886e231c/users/1f65454e788f4a0e885afc957cbb9990/roles/0d8f3197532c496ba395f5219e5eb954` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:42.467863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5c5c0f68795041759e9c6dc1886e231c, user_id=1f65454e788f4a0e885afc957cbb9990, role_id=0d8f3197532c496ba395f5219e5eb954)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:42.470791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:42.546275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2614/5144] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:42 2021] PUT /identity/v3/projects/5c5c0f68795041759e9c6dc1886e231c/users/1f65454e788f4a0e885afc957cbb9990/roles/0d8f3197532c496ba395f5219e5eb954 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:42.554623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:42.582635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e01db-a038-4cf3-9f96-7852822b05e6 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:42.723083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddd464-783c-486e-8b48-15564d9b3139 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:42.724101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd464-783c-486e-8b48-15564d9b3139 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:42.724536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd464-783c-486e-8b48-15564d9b3139 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:42.724853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddd464-783c-486e-8b48-15564d9b3139 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/5c5c0f68795041759e9c6dc1886e231c/users/1f65454e788f4a0e885afc957cbb9990/roles/2124dce0b198417baa25399832150f3e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:42.735320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddd464-783c-486e-8b48-15564d9b3139 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5c5c0f68795041759e9c6dc1886e231c, user_id=1f65454e788f4a0e885afc957cbb9990, role_id=2124dce0b198417baa25399832150f3e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:42.738558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddd464-783c-486e-8b48-15564d9b3139 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:42.847552 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2531/5145] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:42 2021] PUT /identity/v3/projects/5c5c0f68795041759e9c6dc1886e231c/users/1f65454e788f4a0e885afc957cbb9990/roles/2124dce0b198417baa25399832150f3e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:42.851827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:42.870595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca25278-05ed-4821-827f-dafdce2ca25b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:43.059630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:43.059630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:43.060414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:43.061529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:43.062926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:43.066166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:43.103716 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2615/5146] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:42 2021] GET /identity/v3/users => generated 8060 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:43.108530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691b32a-ed3f-4c84-9732-63870e2f9e0f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:43.111184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691b32a-ed3f-4c84-9732-63870e2f9e0f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:43.111184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691b32a-ed3f-4c84-9732-63870e2f9e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:43.200276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:43.202124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:43.206970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b691b32a-ed3f-4c84-9732-63870e2f9e0f None None] MFA Rules not processed for user `1f65454e788f4a0e885afc957cbb9990`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:43.209155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b691b32a-ed3f-4c84-9732-63870e2f9e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:43.331438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf94df-8d9a-4d21-8f52-784854c60cc7 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:43.341140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:43.343584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:43.343584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:43.343584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] PATH_INFO: `/v3/projects/83f09455970345ac919d8b99b665dadd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:43.346019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f09455970345ac919d8b99b665dadd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:43.346913 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2532/5147] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:43 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:43.357288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:43.373868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde45e20-eb75-4d9e-b8e5-37ba1a5f42e9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:43.374434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde45e20-eb75-4d9e-b8e5-37ba1a5f42e9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:43.376311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde45e20-eb75-4d9e-b8e5-37ba1a5f42e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:43.415933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cde45e20-eb75-4d9e-b8e5-37ba1a5f42e9 None None] MFA Rules not processed for user `1f65454e788f4a0e885afc957cbb9990`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:43.420486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cde45e20-eb75-4d9e-b8e5-37ba1a5f42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:43.446582 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2533/5148] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:43 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:43.454678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde45e20-eb75-4d9e-b8e5-37ba1a5f42e9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:43.480101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde45e20-eb75-4d9e-b8e5-37ba1a5f42e9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:43.486859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:43.487826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:43.488275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:43.488714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:43.490230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:create_trust()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:43.492993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:43.540809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f09455970345ac919d8b99b665dadd', 'request_id': 'req-dcf3f894-b043-4555-b578-f33a82079716'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:43.601529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f09455970345ac919d8b99b665dadd', 'request_id': 'req-dcf3f894-b043-4555-b578-f33a82079716'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:43.608940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f09455970345ac919d8b99b665dadd', 'request_id': 'req-dcf3f894-b043-4555-b578-f33a82079716'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:43.639709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] The token cache is being invalidate because project 83f09455970345ac919d8b99b665dadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:43.640006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:43.645980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:43.651630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2616/5149] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:43 2021] DELETE /identity/v3/projects/83f09455970345ac919d8b99b665dadd => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:43.655355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:43.658413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:43.759261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3f894-b043-4555-b578-f33a82079716 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:43.771244 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2534/5150] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:25:43 2021] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:43.775060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:43.781949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:43.790100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:43.792282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:43.792572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:43.792849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] PATH_INFO: `/v3/users/89f2447f02f3469d93970c1ad7eb5a5e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:43.798040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f2447f02f3469d93970c1ad7eb5a5e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:43.799988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:43.808848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13460dc-50cf-4eb4-b00d-c66726fa341e tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:43.927122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:43.935049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:43.935690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:43.936436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:43.973802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:get_trust(trust_id=5449bc578ac34f7f9e1d9c7ec178436a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:43.976457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:43.989552 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2535/5151] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:43 2021] GET /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a => generated 835 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:43.993415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.026494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9eb670-592e-4e93-911a-c69b5fa97fa2 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.042651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.043467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.043753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.044031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.053987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=5449bc578ac34f7f9e1d9c7ec178436a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.057530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.079230 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2536/5152] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:25:43 2021] GET /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles => generated 371 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:44.081086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.104570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefdfd3-e18c-4595-9f50-061248985cf8 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.117348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.118257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.118753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.118967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/0d8f3197532c496ba395f5219e5eb954` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.155341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5449bc578ac34f7f9e1d9c7ec178436a, role_id=0d8f3197532c496ba395f5219e5eb954)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.156809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.174926 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2537/5153] 10.222.0.32 () {58 vars in 1367 bytes} [Sat Dec 25 21:25:44 2021] GET /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/0d8f3197532c496ba395f5219e5eb954 => generated 244 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:44.177008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.191051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce20a6-07f3-4823-a02e-1a86a8e83501 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.197857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.198711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.198998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.199279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/0d8f3197532c496ba395f5219e5eb954` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.207388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5449bc578ac34f7f9e1d9c7ec178436a, role_id=0d8f3197532c496ba395f5219e5eb954)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.209230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.220892 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2538/5154] 10.222.0.32 () {58 vars in 1368 bytes} [Sat Dec 25 21:25:44 2021] HEAD /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/0d8f3197532c496ba395f5219e5eb954 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:44.225622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.241177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7a3fa-daaa-456c-b9af-bd15531cf47f tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.248838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.249832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.250122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.250396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/2124dce0b198417baa25399832150f3e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.253098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f2447f02f3469d93970c1ad7eb5a5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.268012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5449bc578ac34f7f9e1d9c7ec178436a, role_id=2124dce0b198417baa25399832150f3e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.270792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.273014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f2447f02f3469d93970c1ad7eb5a5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.308764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f2447f02f3469d93970c1ad7eb5a5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.309586 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Could not find role: 2124dce0b198417baa25399832150f3e.: keystone.exception.RoleNotFound: Could not find role: 2124dce0b198417baa25399832150f3e. Dec 25 21:25:44.310430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f2447f02f3469d93970c1ad7eb5a5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.313422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2539/5155] 10.222.0.32 () {58 vars in 1367 bytes} [Sat Dec 25 21:25:44 2021] GET /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/2124dce0b198417baa25399832150f3e => generated 110 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:44.315489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.320354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:44.344363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fd7bd-9bfa-48fd-a0a2-e9c612f7482c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.350269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.351986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.352324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.352696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] PATH_INFO: `/v3/projects/74e35b77d702444787850e21bc03163f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.354049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e35b77d702444787850e21bc03163f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.356604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.390659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f2447f02f3469d93970c1ad7eb5a5e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.402691 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2617/5156] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:43 2021] DELETE /identity/v3/users/89f2447f02f3469d93970c1ad7eb5a5e => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:44.403525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.408809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:44.517874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e35b77d702444787850e21bc03163f', 'request_id': 'req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.543457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e35b77d702444787850e21bc03163f', 'request_id': 'req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.590304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8af1f-8581-462c-b120-9f2249da27e6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.632406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e35b77d702444787850e21bc03163f', 'request_id': 'req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.654768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] The token cache is being invalidate because project 74e35b77d702444787850e21bc03163f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:44.655144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.658159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb8a4fe-c8eb-4038-b55f-dcdc361a49c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:44.667810 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2540/5157] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:44 2021] DELETE /identity/v3/projects/74e35b77d702444787850e21bc03163f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:44.670373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.670663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.670946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.726769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:44.728369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:44.777632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b819a1-cbc4-46fc-9f44-9776f135e439 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.778484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b819a1-cbc4-46fc-9f44-9776f135e439 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `HEAD` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.778965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b819a1-cbc4-46fc-9f44-9776f135e439 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.779251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b819a1-cbc4-46fc-9f44-9776f135e439 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/2124dce0b198417baa25399832150f3e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.798198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b819a1-cbc4-46fc-9f44-9776f135e439 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5449bc578ac34f7f9e1d9c7ec178436a, role_id=2124dce0b198417baa25399832150f3e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.799680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b819a1-cbc4-46fc-9f44-9776f135e439 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.832003 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-78b819a1-cbc4-46fc-9f44-9776f135e439 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Could not find role: 2124dce0b198417baa25399832150f3e.: keystone.exception.RoleNotFound: Could not find role: 2124dce0b198417baa25399832150f3e. Dec 25 21:25:44.838862 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2618/5158] 10.222.0.32 () {58 vars in 1368 bytes} [Sat Dec 25 21:25:44 2021] HEAD /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a/roles/2124dce0b198417baa25399832150f3e => generated 0 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Dec 25 21:25:44.841739 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2541/5159] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:44.843183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7617-73ea-4c51-a2a7-9c7c81d60661 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.843469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7617-73ea-4c51-a2a7-9c7c81d60661 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.844330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7617-73ea-4c51-a2a7-9c7c81d60661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.846174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.847994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:44.869210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-100d7617-73ea-4c51-a2a7-9c7c81d60661 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:44.870525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-100d7617-73ea-4c51-a2a7-9c7c81d60661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:44.888096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2619/5160] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:25:44.890547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d7617-73ea-4c51-a2a7-9c7c81d60661 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.893338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0027a-b6fd-45cb-a886-d9b5798f5a3e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.910747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.920891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d7617-73ea-4c51-a2a7-9c7c81d60661 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:44.921188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.921188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.921188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.923502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:44.925770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:44.926623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:44.927934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorizing `identity:delete_trust(trust_id=5449bc578ac34f7f9e1d9c7ec178436a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.928345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:44.930426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:44.930840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:44.933064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.933513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:44.967181 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2620/5161] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:44.971851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:44.991865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c485461-7207-4845-9563-fe53bddcb84f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:45.003185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:45.003185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:45.003185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:45.003185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:45.003718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:45.003718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:45.035509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5449bc578ac34f7f9e1d9c7ec178436a', 'request_id': 'req-dbe922c3-47a1-4b0e-bb02-975c8c45995c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:45.036607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5449bc578ac34f7f9e1d9c7ec178436a', 'request_id': 'req-dbe922c3-47a1-4b0e-bb02-975c8c45995c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:45.037285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '5449bc578ac34f7f9e1d9c7ec178436a', 'request_id': 'req-dbe922c3-47a1-4b0e-bb02-975c8c45995c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:45.153113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2542/5162] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:25:44 2021] DELETE /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:45.157515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:45.160517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:45.177414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2621/5163] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:44 2021] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:45.185745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:45.187523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:45.189202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe922c3-47a1-4b0e-bb02-975c8c45995c tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:45.363654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f65454e788f4a0e885afc957cbb9990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5c0f68795041759e9c6dc1886e231c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1036491521', 'tempest-NotDelegatedRole-1066901603'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:45.366431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:45.366585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:45.366752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] PATH_INFO: `/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:45.397970 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Could not find trust: 5449bc578ac34f7f9e1d9c7ec178436a.: keystone.exception.TrustNotFound: Could not find trust: 5449bc578ac34f7f9e1d9c7ec178436a. Dec 25 21:25:45.407857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2543/5164] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:25:45 2021] GET /identity/v3/OS-TRUST/trusts/5449bc578ac34f7f9e1d9c7ec178436a => generated 111 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:45.409747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c6291-ebfb-4871-a5b7-ef90bc8d0abe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:45.412228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:45.421441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:45.430346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:45.431446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:45.431908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:45.432374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:45.433280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:45.438147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:45.601689 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2622/5165] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:45 2021] POST /identity/v3/users => generated 284 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:45.609253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:45.662885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c085-11bb-4c7e-a544-69f9042414a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:45.684327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:45.686348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:45.686564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:45.688471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:45.689290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:45.694159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:45.722011 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2623/5166] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:45 2021] GET /identity/v3/roles => generated 1893 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:45.725495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:45.731262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:45.732865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455953f-5a76-4a97-a91b-8d8d65820625 tempest-TrustsV3TestJSON-1810253628 tempest-user-67588826] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:45.739402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:45.740855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:45.741573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:45.742254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/2124dce0b198417baa25399832150f3e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:45.744062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2124dce0b198417baa25399832150f3e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:45.745982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:45.777730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8342aba-dfbe-4520-820a-ec1705f2c66d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:45.789673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:45.791232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:45.791560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:45.791910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] PATH_INFO: `/v3/projects/13696fe6aa3a4d65b92d5457619cf920` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:45.793274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13696fe6aa3a4d65b92d5457619cf920)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:45.795594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:46.008372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 2124dce0b198417baa25399832150f3e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:46.008794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.011572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.015794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13696fe6aa3a4d65b92d5457619cf920', 'request_id': 'req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.019453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2544/5167] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:45 2021] DELETE /identity/v3/roles/2124dce0b198417baa25399832150f3e => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:46.021262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:46.027885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:46.119037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13696fe6aa3a4d65b92d5457619cf920', 'request_id': 'req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.129079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13696fe6aa3a4d65b92d5457619cf920', 'request_id': 'req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.168743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] The token cache is being invalidate because project 13696fe6aa3a4d65b92d5457619cf920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:46.171485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.180898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.184756 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2624/5168] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:45 2021] DELETE /identity/v3/projects/13696fe6aa3a4d65b92d5457619cf920 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:46.185174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:46.201869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:46.211475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263d339-e70d-4138-bb8a-5dc4b3a77c4b tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:46.230264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694223c-3939-402c-8d45-4dc68975ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:46.230867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694223c-3939-402c-8d45-4dc68975ba91 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:46.231156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694223c-3939-402c-8d45-4dc68975ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:46.231432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694223c-3939-402c-8d45-4dc68975ba91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:46.232172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694223c-3939-402c-8d45-4dc68975ba91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:46.233829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694223c-3939-402c-8d45-4dc68975ba91 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:46.272604 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2545/5169] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:46 2021] GET /identity/v3/roles => generated 1655 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:46.272604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:46.272604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:46.272604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:46.325711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:46.330405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:46.357470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2546/5170] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:46.368038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:46.368038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:46.393223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248ba4-e1f1-47ee-8a43-ab0386367ea7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:46.411515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5d87c-0fe6-4ff9-a7ce-fe2c6ffc67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:46.414670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d87c-0fe6-4ff9-a7ce-fe2c6ffc67d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:46.417907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d87c-0fe6-4ff9-a7ce-fe2c6ffc67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:46.418783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5d87c-0fe6-4ff9-a7ce-fe2c6ffc67d6 admin admin] PATH_INFO: `/v3/projects/1be0d45237a542a49fabfb290667266c/users/49fed5bfc497491b8e6d42fe87da9fdf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:46.434899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764fb6-9d2a-476c-b029-cd2bf3bcf9a1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:46.457250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d87c-0fe6-4ff9-a7ce-fe2c6ffc67d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be0d45237a542a49fabfb290667266c, user_id=49fed5bfc497491b8e6d42fe87da9fdf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:46.460342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5d87c-0fe6-4ff9-a7ce-fe2c6ffc67d6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:46.566517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2547/5171] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:46 2021] PUT /identity/v3/projects/1be0d45237a542a49fabfb290667266c/users/49fed5bfc497491b8e6d42fe87da9fdf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:46.568570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f553610-d750-4685-9e8f-e0b094ca2491 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:46.568860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f553610-d750-4685-9e8f-e0b094ca2491 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:46.569160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f553610-d750-4685-9e8f-e0b094ca2491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:46.585552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:46.586459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:46.586740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:46.587017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/roles/0d8f3197532c496ba395f5219e5eb954` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:46.589886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0d8f3197532c496ba395f5219e5eb954)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:46.591515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:46.628615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7f553610-d750-4685-9e8f-e0b094ca2491 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:46.631047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7f553610-d750-4685-9e8f-e0b094ca2491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:46.720865 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2548/5172] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:46.722633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280839-ac8d-4c16-964c-1e20886c161a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:46.723147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280839-ac8d-4c16-964c-1e20886c161a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:46.723579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280839-ac8d-4c16-964c-1e20886c161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:46.756769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7d280839-ac8d-4c16-964c-1e20886c161a None None] MFA Rules not processed for user `49fed5bfc497491b8e6d42fe87da9fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:46.758853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7d280839-ac8d-4c16-964c-1e20886c161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:46.860194 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2549/5173] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:46 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:46.860194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280839-ac8d-4c16-964c-1e20886c161a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:46.885627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280839-ac8d-4c16-964c-1e20886c161a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:46.897441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invalidating the token cache because role 0d8f3197532c496ba395f5219e5eb954 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:46.898060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.899283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:46.900060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:46.900844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:46.901154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:46.901435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:46.902255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:46.902553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:46.904541 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2625/5174] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:46 2021] DELETE /identity/v3/roles/0d8f3197532c496ba395f5219e5eb954 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:46.905617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:46.905839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:46.918493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:46.921549 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2550/5175] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:46.922818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:46.927075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:47.022460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250db9e7-ead7-40c8-a90a-37af49610589 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:47.108372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:47.109708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:47.110133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:47.110417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/users/1f65454e788f4a0e885afc957cbb9990` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:47.111728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1f65454e788f4a0e885afc957cbb9990)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:47.113782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:47.164903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54248ed-d931-433a-a4bd-8d4751777a20 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:47.179050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:47.179467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:47.180330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:47.180330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:47.185056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:47.187088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:47.272127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f65454e788f4a0e885afc957cbb9990'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:47.293713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f65454e788f4a0e885afc957cbb9990'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:47.294267 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2626/5176] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:46 2021] POST /identity/v3/projects => generated 365 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:47.294267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:47.294267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:47.320184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f65454e788f4a0e885afc957cbb9990'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:47.321275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f65454e788f4a0e885afc957cbb9990'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:47.321997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f65454e788f4a0e885afc957cbb9990'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:47.384778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6801-25bc-4677-bb91-b7bc56df37b1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:47.390498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:47.391503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:47.391726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:47.392494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:47.393600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:47.395688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:47.407665 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2551/5177] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:46 2021] DELETE /identity/v3/users/1f65454e788f4a0e885afc957cbb9990 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:47.409301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:47.417972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:47.489392 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2627/5178] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:47 2021] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:47.490938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:47.494993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:47.537999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746ad70-2dc4-429d-b1de-eeb4aca235f3 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:47.685315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:47.686205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:47.690764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:47.690764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:47.690764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:47.690764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:47.714377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f99f21-5bfd-43f8-8698-d8e74690d811 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:47.722325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '620b573460b841b19ba44e8274e348dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04eefc967ba44a15b0c2cdec757f33f2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:47.724347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:47.724803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:47.725332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] PATH_INFO: `/v3/projects/5c5c0f68795041759e9c6dc1886e231c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:47.727853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c5c0f68795041759e9c6dc1886e231c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:47.733338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:47.831780 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2552/5179] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:47 2021] POST /identity/v3/users => generated 289 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:47.833306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:47.838424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:47.869099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313a230-6abc-47cc-9af5-f61b5d3a94f8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:47.984105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5c0f68795041759e9c6dc1886e231c', 'request_id': 'req-56378c71-f59c-41e0-ba27-f9e5a8c95840'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.001243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.001938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.002220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.002576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.003313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.005509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.036352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5c0f68795041759e9c6dc1886e231c', 'request_id': 'req-56378c71-f59c-41e0-ba27-f9e5a8c95840'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.048506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5c0f68795041759e9c6dc1886e231c', 'request_id': 'req-56378c71-f59c-41e0-ba27-f9e5a8c95840'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.066627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] The token cache is being invalidate because project 5c5c0f68795041759e9c6dc1886e231c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:48.073509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.074357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.076240 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2628/5180] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:47 2021] DELETE /identity/v3/projects/5c5c0f68795041759e9c6dc1886e231c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:48.077490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.082377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:48.093871 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2553/5181] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:47 2021] POST /identity/v3/users => generated 286 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:48.094793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.100682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:48.122026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378c71-f59c-41e0-ba27-f9e5a8c95840 tempest-TrustsV3TestJSON-1354417765 tempest-TrustsV3TestJSON-1354417765-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:48.137324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.140382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.141233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.141596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1d7a8-18f9-4fcb-9395-d7a107169e3e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:48.142606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.145270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.150603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.155631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.156577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.156906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.157154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] PATH_INFO: `/v3/users/afa8c7b5af49428a859caf14d6075bde` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.160349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa8c7b5af49428a859caf14d6075bde)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.162882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.185884 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2629/5182] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:48.187129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.192707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:48.226705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafec17-3ada-4c0b-96dd-29f4e3b9ede8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:48.242738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.243596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.245275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.245627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.246478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.251436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.278758 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2630/5183] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:48.280842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.305727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a649d-23b9-4360-8aff-0b87de141319 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:48.319287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.320548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.320901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.321494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] PATH_INFO: `/v3/projects/52b6f4e629c1439384734404a004a37c/users/e57e4c842d7545ab831f0ad5e820e23d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.360088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b6f4e629c1439384734404a004a37c, user_id=e57e4c842d7545ab831f0ad5e820e23d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.365242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.444847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa8c7b5af49428a859caf14d6075bde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.455234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa8c7b5af49428a859caf14d6075bde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.510508 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2631/5184] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:48 2021] PUT /identity/v3/projects/52b6f4e629c1439384734404a004a37c/users/e57e4c842d7545ab831f0ad5e820e23d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:48.510508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.511164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa8c7b5af49428a859caf14d6075bde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.513025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa8c7b5af49428a859caf14d6075bde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.516086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa8c7b5af49428a859caf14d6075bde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:48.619034 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2554/5185] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:48 2021] DELETE /identity/v3/users/afa8c7b5af49428a859caf14d6075bde => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:48.619034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.621466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:48.733095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e7eba-e150-49cf-bce6-667377ba7463 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:48.823603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02602e-1a61-4945-8783-a5300471b622 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:48.842705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26770e7e-2a3b-4299-bbe1-c96891ae35cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.844306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26770e7e-2a3b-4299-bbe1-c96891ae35cc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.845913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26770e7e-2a3b-4299-bbe1-c96891ae35cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.848986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26770e7e-2a3b-4299-bbe1-c96891ae35cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.850216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26770e7e-2a3b-4299-bbe1-c96891ae35cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.853327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26770e7e-2a3b-4299-bbe1-c96891ae35cc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.874539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.875250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.881249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.881249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.881249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.881249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.884651 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2555/5186] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:48.886331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.888860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.889301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.905251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2632/5187] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:48 2021] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:48.905251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.922691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9431366-944b-455d-8fdf-ba9d46b89abc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:48.940969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:48.943420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beac55-06ad-46ff-9a68-aea52c7b4921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:48.945029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:48.945575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beac55-06ad-46ff-9a68-aea52c7b4921 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:48.945883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beac55-06ad-46ff-9a68-aea52c7b4921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:48.946165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beac55-06ad-46ff-9a68-aea52c7b4921 admin admin] PATH_INFO: `/v3/projects/52b6f4e629c1439384734404a004a37c/users/e57e4c842d7545ab831f0ad5e820e23d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:48.948448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beac55-06ad-46ff-9a68-aea52c7b4921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b6f4e629c1439384734404a004a37c, user_id=e57e4c842d7545ab831f0ad5e820e23d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:48.951218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beac55-06ad-46ff-9a68-aea52c7b4921 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:48.972203 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2556/5188] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:48.973367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:48.985503 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2633/5189] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:48 2021] PUT /identity/v3/projects/52b6f4e629c1439384734404a004a37c/users/e57e4c842d7545ab831f0ad5e820e23d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:48.998034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:49.002748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:49.003047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:49.003366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:49.025812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775295b-f9b1-40b1-b985-dc38ae74e9df None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:49.058634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] MFA Rules not processed for user `e57e4c842d7545ab831f0ad5e820e23d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:49.059971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:49.189032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:49.190398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:49.190903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:49.191383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] PATH_INFO: `/v3/projects/cc520945a1c64d93bea2e9b40c7ad7f4/users/60d492b1263945bdaf852259ad04f0ad/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:49.197882 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2634/5190] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:49 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:49.201092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:49.207898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:49.224581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc520945a1c64d93bea2e9b40c7ad7f4, user_id=60d492b1263945bdaf852259ad04f0ad, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:49.230892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:49.301796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176214d-5508-417a-917c-71ac1bfba147 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:49.306577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc18f15-8c3d-4ae9-ae44-552df998ad7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:49.307526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc18f15-8c3d-4ae9-ae44-552df998ad7c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:49.307915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc18f15-8c3d-4ae9-ae44-552df998ad7c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:49.308302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc18f15-8c3d-4ae9-ae44-552df998ad7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:49.316577 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2557/5191] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:48 2021] PUT /identity/v3/projects/cc520945a1c64d93bea2e9b40c7ad7f4/users/60d492b1263945bdaf852259ad04f0ad/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:49.317680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:49.321616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:49.328756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc18f15-8c3d-4ae9-ae44-552df998ad7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:49.331274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc18f15-8c3d-4ae9-ae44-552df998ad7c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:49.344859 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2635/5192] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:49.346325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a30968-aee9-46f6-a110-4458ebf0fe84 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:49.346914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a30968-aee9-46f6-a110-4458ebf0fe84 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:49.347134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a30968-aee9-46f6-a110-4458ebf0fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:49.429057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-50a30968-aee9-46f6-a110-4458ebf0fe84 None None] MFA Rules not processed for user `60d492b1263945bdaf852259ad04f0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:49.432060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-50a30968-aee9-46f6-a110-4458ebf0fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:49.497167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6703f9-14a1-408a-bc4f-d50ea3c4237a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:49.508867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:49.509568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:49.509960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:49.510230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:49.531077 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2636/5193] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:49 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:49.533155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a30968-aee9-46f6-a110-4458ebf0fe84 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:49.688908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:49.690403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:49.700376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a30968-aee9-46f6-a110-4458ebf0fe84 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:49.719272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:49.719962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:49.720242 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2558/5194] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:49 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:49.720387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:49.720588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:49.721446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:49.727055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:49.944805 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2637/5195] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:49 2021] POST /identity/v3/projects => generated 369 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:49.951089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:49.992268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c804b6-50ee-46d5-90ea-fc0e3bc82688 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:50.156905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:50.157919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:50.158371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:50.159099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:50.160019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:50.163129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:50.297851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:50.301173 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2559/5196] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:49 2021] POST /identity/v3/users => generated 291 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:50.312829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae1e58-02d5-46b5-8ca3-5c9616335ed9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:50.328283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:50.329055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:50.329334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:50.329604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:50.330403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:50.334092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:50.368454 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2638/5197] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:50 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:25:50.369369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:50.386387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e4b60-81e4-45b8-8426-93e2c3f53c62 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:50.403261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:50.405218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:50.405218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:50.405480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] PATH_INFO: `/v3/projects/dd02cfd8a6b7446799871ccafcf314a7/users/fbd117c8111840a386551cd859f45442/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:50.470095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd02cfd8a6b7446799871ccafcf314a7, user_id=fbd117c8111840a386551cd859f45442, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:50.472789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:50.637609 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2560/5198] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:50 2021] PUT /identity/v3/projects/dd02cfd8a6b7446799871ccafcf314a7/users/fbd117c8111840a386551cd859f45442/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:50.640698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:50.651055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:50.652796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:50.654961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf9719-03cc-48ca-a9dd-899ec160cd7f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:50.748759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:50.749663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:50.750048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:50.750428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:50.751278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:50.753081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:50.767100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083430-e711-47cd-b29a-06e80ad56d30 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:50.768759 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2639/5199] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:50 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:50.774500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:50.776959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:50.778270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:50.778270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:50.778683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] PATH_INFO: `/v3/projects/1df382b4626941ada0362a82c4a5ffe1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:50.780111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df382b4626941ada0362a82c4a5ffe1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:50.782599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:50.800514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804b68e-43d3-416e-b823-14b6a82199dc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:50.816421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3914b6-79b0-4f9a-9ee4-5ce752c48345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:50.817716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3914b6-79b0-4f9a-9ee4-5ce752c48345 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:50.818101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3914b6-79b0-4f9a-9ee4-5ce752c48345 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:50.818476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3914b6-79b0-4f9a-9ee4-5ce752c48345 admin admin] PATH_INFO: `/v3/projects/dd02cfd8a6b7446799871ccafcf314a7/users/fbd117c8111840a386551cd859f45442/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:50.821495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3914b6-79b0-4f9a-9ee4-5ce752c48345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd02cfd8a6b7446799871ccafcf314a7, user_id=fbd117c8111840a386551cd859f45442, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:50.824824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3914b6-79b0-4f9a-9ee4-5ce752c48345 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:50.847009 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2640/5200] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:50 2021] PUT /identity/v3/projects/dd02cfd8a6b7446799871ccafcf314a7/users/fbd117c8111840a386551cd859f45442/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:50.858187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490512dc-2e80-40c2-b70b-34a196870369 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:50.858557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490512dc-2e80-40c2-b70b-34a196870369 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:50.858884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490512dc-2e80-40c2-b70b-34a196870369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:50.894403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-490512dc-2e80-40c2-b70b-34a196870369 None None] MFA Rules not processed for user `fbd117c8111840a386551cd859f45442`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:50.895855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-490512dc-2e80-40c2-b70b-34a196870369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:50.930632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df382b4626941ada0362a82c4a5ffe1', 'request_id': 'req-3edcb567-e737-4b3e-804c-e00993c6d63d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:50.959665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df382b4626941ada0362a82c4a5ffe1', 'request_id': 'req-3edcb567-e737-4b3e-804c-e00993c6d63d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.046407 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2641/5201] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:50 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:25:51.047385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490512dc-2e80-40c2-b70b-34a196870369 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:51.065603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df382b4626941ada0362a82c4a5ffe1', 'request_id': 'req-3edcb567-e737-4b3e-804c-e00993c6d63d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.075425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490512dc-2e80-40c2-b70b-34a196870369 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:51.093630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] The token cache is being invalidate because project 1df382b4626941ada0362a82c4a5ffe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:51.094103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.094927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.101822 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2561/5202] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:50 2021] DELETE /identity/v3/projects/1df382b4626941ada0362a82c4a5ffe1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:51.102877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:51.104327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:51.226526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:51.227217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:51.228005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:51.228005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:51.229346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:51.231312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:51.240800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb567-e737-4b3e-804c-e00993c6d63d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:51.247176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:51.247998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:51.248281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:51.248616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] PATH_INFO: `/v3/users/620b573460b841b19ba44e8274e348dc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:51.249966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620b573460b841b19ba44e8274e348dc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:51.252254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:51.359165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2642/5203] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:51 2021] POST /identity/v3/services => generated 286 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:51.363500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:51.367733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:51.400498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7a692-fed9-4ba4-a40f-c336d56ba35e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:51.406778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:51.423920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:51.425197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:51.425701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:51.432815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:51.435604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:51.494979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620b573460b841b19ba44e8274e348dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.510374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620b573460b841b19ba44e8274e348dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.531018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620b573460b841b19ba44e8274e348dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.532236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620b573460b841b19ba44e8274e348dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.533168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620b573460b841b19ba44e8274e348dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:51.549678 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-461730315. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:25:51.549678 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:25:51.549678 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:51.640282 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2562/5204] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:51 2021] DELETE /identity/v3/users/620b573460b841b19ba44e8274e348dc => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:51.700529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2643/5205] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:25:51 2021] POST /identity/v3/endpoints => generated 359 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:51.706737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:51.709111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:51.812212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4e16-eb76-4e98-b7f1-f6c9a4c28c41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:51.832981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:51.833833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:51.834245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:51.834392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-461730315` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:51.835074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-461730315)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:51.836694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:51.840090 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2563/5206] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:25:51 2021] GET /identity/v3/regions/tempest-region-461730315 => generated 178 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:51.844555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:51.855508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e51f-75a3-41ee-b9cd-a6d9fdacd297 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:51.861415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:51.862168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:51.862454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:51.863159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:51.864485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:51.866346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:51.956099 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2644/5207] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:51 2021] POST /identity/v3/services => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:51.959231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:51.971316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470043b-f32a-4e36-882e-9b7edc996116 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:52.012936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:52.013984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:52.014688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:52.015125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:52.016257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:52.018269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:52.081200 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1678507736. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:25:52.081200 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:25:52.081200 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:52.186286 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2564/5208] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:25:51 2021] POST /identity/v3/endpoints => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:52.196482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:52.208339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba649-48e0-49c6-b6b1-08734e805b95 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:52.226649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:52.227501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:52.227776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:52.228060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-1678507736` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:52.228712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1678507736)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:52.229825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:52.235386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2645/5209] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:25:52 2021] GET /identity/v3/regions/tempest-region-1678507736 => generated 180 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:52.237159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:52.265618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b745-2e1e-4ac0-a377-113330610f4f tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:52.271417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:52.272133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:52.272422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:52.272712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:52.273735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:52.275427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:52.396461 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-840085790. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:25:52.396461 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:25:52.396461 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:52.532912 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2565/5210] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:25:52 2021] POST /identity/v3/endpoints => generated 358 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:52.534844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:52.593219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759c8c2-392f-470e-bf1f-a7710a5be0b1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:52.619316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:52.620843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:52.621427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:52.622971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-840085790` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:52.624153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-840085790)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:52.627070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:52.634200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:52.636191 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2646/5211] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:25:52 2021] GET /identity/v3/regions/tempest-region-840085790 => generated 178 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:52.649165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb985ea-ed38-4752-976f-a4586b95a577 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:52.658751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:52.660105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:52.661353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:52.661877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:52.662962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:52.665503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:52.692054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:52.709106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2566/5212] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:25:52 2021] GET /identity/v3/endpoints => generated 4384 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:52.720187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65c370-fe8a-42c2-b268-986ac5a62460 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:52.728062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:52.728977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:52.729483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:52.729931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints/dbac5ccabb5f4f0c9fce5e3d5d1bb00a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:52.737759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=dbac5ccabb5f4f0c9fce5e3d5d1bb00a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:52.739517 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:52.739517 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:25:52.739517 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:52.740562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:52.742927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2647/5213] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:52 2021] GET /identity/v3/endpoints/dbac5ccabb5f4f0c9fce5e3d5d1bb00a => generated 358 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:52.746674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:52.761721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5404c-00ef-4656-b5be-621468e8ef50 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:52.769452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:52.773951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:52.774274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:52.774558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints/dbac5ccabb5f4f0c9fce5e3d5d1bb00a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:52.777661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=dbac5ccabb5f4f0c9fce5e3d5d1bb00a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:52.780644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:52.932285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'dbac5ccabb5f4f0c9fce5e3d5d1bb00a', 'request_id': 'req-5a2db16d-f89f-4293-99db-4c854bc38772'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:52.954003 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2567/5214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:52 2021] DELETE /identity/v3/endpoints/dbac5ccabb5f4f0c9fce5e3d5d1bb00a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:52.957512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:52.971917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26479bb6-956b-4197-afe9-395fbe07ded1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.007122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.007907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.008708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.009313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.010804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.013390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.052609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2648/5215] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:25:52 2021] GET /identity/v3/endpoints => generated 4039 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:53.056183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.084224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2db16d-f89f-4293-99db-4c854bc38772 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.110307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.111193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.111515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.115143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints/dbac5ccabb5f4f0c9fce5e3d5d1bb00a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.124108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:25:53.134499 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Could not find endpoint: dbac5ccabb5f4f0c9fce5e3d5d1bb00a.: keystone.exception.EndpointNotFound: Could not find endpoint: dbac5ccabb5f4f0c9fce5e3d5d1bb00a. Dec 25 21:25:53.136902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2568/5216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:53 2021] DELETE /identity/v3/endpoints/dbac5ccabb5f4f0c9fce5e3d5d1bb00a => generated 114 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:25:53.140706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.159031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.170559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26b11-0de9-43ce-9a44-865d0062423a tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.170683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:53.194228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.198037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.198875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.199218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-840085790` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.205793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-840085790)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.214222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.303644 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-840085790. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:25:53.303644 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:25:53.303644 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:53.317325 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2649/5217] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:25:53 2021] DELETE /identity/v3/regions/tempest-region-840085790 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:53.322750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.351986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92099461-14ac-48a9-9e07-25ff62cce4d1 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.386063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414a1e4-5c4a-4eb1-bfde-b0fb7093b107 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.392391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.393447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.394141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.394426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.395856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.399087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.400101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.401297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.401809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.402363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] PATH_INFO: `/v3/projects/04eefc967ba44a15b0c2cdec757f33f2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.406646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04eefc967ba44a15b0c2cdec757f33f2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.408981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.411184 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2650/5218] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:25:53 2021] GET /identity/v3/endpoints => generated 4039 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:25:53.415478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.446088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0787fe-03a0-4b1a-a3c7-66e760ed78da tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.461932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.463776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.464156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.473854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.474695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Adding query filter params (service_id=988d3900d84e4de997d742c729a42175) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:53.475120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.476836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.490531 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2651/5219] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:25:53 2021] GET /identity/v3/endpoints?service_id=988d3900d84e4de997d742c729a42175 => generated 501 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:53.495884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.511668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67429e6-51c2-435d-9cd5-9a70a290709e tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.517171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.517837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.518122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.518402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.519191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Adding query filter params (service_id=aedae295675646fb9991ea39f6ad02e2) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:53.519551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.523322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.533968 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2652/5220] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:25:53 2021] GET /identity/v3/endpoints?service_id=aedae295675646fb9991ea39f6ad02e2 => generated 505 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:53.537158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.548585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492220d-9dd7-45cd-9755-b53ac72ee6bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.571987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04eefc967ba44a15b0c2cdec757f33f2', 'request_id': 'req-2eb108d6-58bb-4edf-abd4-cb3776f65296'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:53.585946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04eefc967ba44a15b0c2cdec757f33f2', 'request_id': 'req-2eb108d6-58bb-4edf-abd4-cb3776f65296'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:53.649048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.649720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.650323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.651881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.653241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:53.653717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.671980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.683577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2653/5221] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Dec 25 21:25:53 2021] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:53.684770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.688574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04eefc967ba44a15b0c2cdec757f33f2', 'request_id': 'req-2eb108d6-58bb-4edf-abd4-cb3776f65296'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:53.689676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:53.708612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] The token cache is being invalidate because project 04eefc967ba44a15b0c2cdec757f33f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:53.708937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:53.712147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:53.713966 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2569/5222] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:53 2021] DELETE /identity/v3/projects/04eefc967ba44a15b0c2cdec757f33f2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:53.720945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.728445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:53.776773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb108d6-58bb-4edf-abd4-cb3776f65296 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.788456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15454-6b8e-486e-b21a-ec78611343bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.789160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15454-6b8e-486e-b21a-ec78611343bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.789443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15454-6b8e-486e-b21a-ec78611343bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.789716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15454-6b8e-486e-b21a-ec78611343bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.790458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15454-6b8e-486e-b21a-ec78611343bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:53.790762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15454-6b8e-486e-b21a-ec78611343bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.792369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15454-6b8e-486e-b21a-ec78611343bc tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.808082 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2570/5223] 10.222.0.32 () {58 vars in 1170 bytes} [Sat Dec 25 21:25:53 2021] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:53.812858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4404-2a35-43e3-9eef-b24b86547a94 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.812858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4404-2a35-43e3-9eef-b24b86547a94 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.812858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4404-2a35-43e3-9eef-b24b86547a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.829289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed177ccd-6f14-4c66-987f-f821b97f1bbb tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.844701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.850010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.850525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.851211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] PATH_INFO: `/v3/users/925d8266445c4711bad30f8be395f458` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.853663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=925d8266445c4711bad30f8be395f458)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.859651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-14df4404-2a35-43e3-9eef-b24b86547a94 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:53.859801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:53.874946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-14df4404-2a35-43e3-9eef-b24b86547a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:53.898987 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2571/5224] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:53 2021] POST /identity/v3/auth/tokens => generated 3860 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:53.903467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4404-2a35-43e3-9eef-b24b86547a94 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:53.918790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4404-2a35-43e3-9eef-b24b86547a94 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:53.925357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c01b86-ae57-48cf-af37-9dbf69766847 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:53.926606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01b86-ae57-48cf-af37-9dbf69766847 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:53.926938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01b86-ae57-48cf-af37-9dbf69766847 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:53.927223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c01b86-ae57-48cf-af37-9dbf69766847 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:53.927960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c01b86-ae57-48cf-af37-9dbf69766847 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:53.929635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c01b86-ae57-48cf-af37-9dbf69766847 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:54.044742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2572/5225] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:53 2021] POST /identity/v3/services => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:54.046556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f59f4-1317-4e1e-8ca9-7568300ebdae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:54.047306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f59f4-1317-4e1e-8ca9-7568300ebdae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:54.048403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f59f4-1317-4e1e-8ca9-7568300ebdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:54.073061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1e9f59f4-1317-4e1e-8ca9-7568300ebdae None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:54.074783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1e9f59f4-1317-4e1e-8ca9-7568300ebdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:54.102931 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2573/5226] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:54 2021] POST /identity/v3/auth/tokens => generated 3993 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:54.104222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f59f4-1317-4e1e-8ca9-7568300ebdae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.136209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f59f4-1317-4e1e-8ca9-7568300ebdae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:54.139283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:54.140374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:54.141225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:54.141706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:54.143294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:54.146076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:54.147963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925d8266445c4711bad30f8be395f458'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:54.167397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925d8266445c4711bad30f8be395f458'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:54.187461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925d8266445c4711bad30f8be395f458'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:54.188480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925d8266445c4711bad30f8be395f458'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:54.269502 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1967710485. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:25:54.269502 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:25:54.269502 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:54.361253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925d8266445c4711bad30f8be395f458'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:54.374582 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2654/5227] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:53 2021] DELETE /identity/v3/users/925d8266445c4711bad30f8be395f458 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:54.376011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.380999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:54.430364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2574/5228] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:25:54 2021] POST /identity/v3/endpoints => generated 361 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:54.434513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.439759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:54.502975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be71322-92c6-47dd-bf2c-08bd484d1e91 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:54.506531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673e33-4cf3-4370-9657-c53e1df54281 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:54.536996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:54.537959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:54.538425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:54.538922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:54.539832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:54.540512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:54.543889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:54.559976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2655/5229] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:54.564398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.578419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba876-3851-4926-9ce6-0cfd0034b6f9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:54.586051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:54.586954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:54.587456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:54.588802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:54.590625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:54.593429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:54.600439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:54.601540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:54.601966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:54.602371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-1967710485` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:54.606654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1967710485)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:54.607521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:54.610612 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2575/5230] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:25:54 2021] GET /identity/v3/regions/tempest-region-1967710485 => generated 180 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:54.618746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.633007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624920-934d-43d3-9089-f420a1e5d21c tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:54.641370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:54.642437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:54.642779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:54.643416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints/80709dd02b6b42ba838b52c61600b699` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:54.650980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=80709dd02b6b42ba838b52c61600b699)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:54.652786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:54.681170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2656/5231] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:54 2021] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:54.685755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.738994 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1939628279. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:25:54.738994 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:25:54.738994 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:25:54.789091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb95f-125d-441d-b568-6c440f5e4b1f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:54.823567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:54.824505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:54.825670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:54.825670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:54.826079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:54.828934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:54.884701 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2576/5232] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:25:54 2021] PATCH /identity/v3/endpoints/80709dd02b6b42ba838b52c61600b699 => generated 363 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:54.893920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.956860 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2657/5233] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:54 2021] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:54.963066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:54.982411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb30b58-78ac-4c1f-adb0-6e106c033269 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:54.984649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7170d-9d5a-459c-bc93-6a5279ba0683 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:55.023395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.023852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.024259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.025068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.028118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.031181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:55.058275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2658/5234] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:54 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:25:55.059304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:55.066993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:55.088267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c1c5-6e7e-4724-b582-7dcfe3290e7d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:55.111060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.111951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.112233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.112510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] PATH_INFO: `/v3/projects/76f51d39e5e345dbafabc9f8d372fc34` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.115230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.120413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f51d39e5e345dbafabc9f8d372fc34)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.124665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.124665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.124665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-1939628279` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.124665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1939628279)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.125147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:55.125260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:55.134337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2577/5235] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:25:54 2021] GET /identity/v3/regions/tempest-region-1939628279 => generated 180 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:55.137165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:55.161822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f906-81e4-4f5e-a51c-92b31f000899 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:55.168402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.170769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.170769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.170769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.171278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.174154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:55.212162 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2578/5236] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:55 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:55.213053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:55.233554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aec6d2-a5ea-4fa6-adea-6e99c08edf46 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:55.239912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.241047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.241047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.241375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints/80709dd02b6b42ba838b52c61600b699` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.260047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=80709dd02b6b42ba838b52c61600b699)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.261715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:55.321022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f51d39e5e345dbafabc9f8d372fc34', 'request_id': 'req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:55.372178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '80709dd02b6b42ba838b52c61600b699', 'request_id': 'req-62915c8c-4000-4d9d-841c-01ba1da426f6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:55.392921 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2579/5237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:55 2021] DELETE /identity/v3/endpoints/80709dd02b6b42ba838b52c61600b699 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:55.393794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:55.398133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f51d39e5e345dbafabc9f8d372fc34', 'request_id': 'req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:55.412698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f51d39e5e345dbafabc9f8d372fc34', 'request_id': 'req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:55.430667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] The token cache is being invalidate because project 76f51d39e5e345dbafabc9f8d372fc34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:25:55.434501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:55.434501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:55.435256 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2659/5238] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:55 2021] DELETE /identity/v3/projects/76f51d39e5e345dbafabc9f8d372fc34 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:55.436726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:55.439456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:55.466013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915c8c-4000-4d9d-841c-01ba1da426f6 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:55.547277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4910f0-b5d7-4fd9-ab0c-c7149c4a4f06 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:55.577438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb27da6-afdc-4e68-8a14-ba78f253dcd4 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.578975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb27da6-afdc-4e68-8a14-ba78f253dcd4 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.579433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb27da6-afdc-4e68-8a14-ba78f253dcd4 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.579697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.580664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.581051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.581402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] PATH_INFO: `/v3/projects/38adfb746b4a4539b1761aa8a72f66bb/users/1b4432334b2f46f5a2555636af9f8210/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.582025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb27da6-afdc-4e68-8a14-ba78f253dcd4 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-1939628279` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.583823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb27da6-afdc-4e68-8a14-ba78f253dcd4 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1939628279)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.586913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb27da6-afdc-4e68-8a14-ba78f253dcd4 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:55.609801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38adfb746b4a4539b1761aa8a72f66bb, user_id=1b4432334b2f46f5a2555636af9f8210, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.615221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:55.751758 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-dcb27da6-afdc-4e68-8a14-ba78f253dcd4 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1939628279. To ensure interoperability, identifiers should be a valid uuid. Dec 25 21:25:55.751758 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Dec 25 21:25:55.751758 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:55.775356 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2660/5239] 10.222.0.32 () {58 vars in 1208 bytes} [Sat Dec 25 21:25:55 2021] DELETE /identity/v3/regions/tempest-region-1939628279 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:55.779232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06acf-36b0-44c5-8e25-16f0a32cf9c9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.781911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06acf-36b0-44c5-8e25-16f0a32cf9c9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.781911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06acf-36b0-44c5-8e25-16f0a32cf9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.813950 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2580/5240] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:55 2021] PUT /identity/v3/projects/38adfb746b4a4539b1761aa8a72f66bb/users/1b4432334b2f46f5a2555636af9f8210/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:55.815183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:55.823923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ede06acf-36b0-44c5-8e25-16f0a32cf9c9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:55.825689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ede06acf-36b0-44c5-8e25-16f0a32cf9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:55.957114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2709a1-0e52-4807-97fe-80323ccb55f2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:55.975913 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2661/5241] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:55 2021] POST /identity/v3/auth/tokens => generated 3993 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:55.977496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855086-69e8-4c77-bf63-72ff51815c1f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.982357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855086-69e8-4c77-bf63-72ff51815c1f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.982357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57855086-69e8-4c77-bf63-72ff51815c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.986016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624cf67-4a37-4b2b-8951-4a61a4b1a8e3 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:55.989283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624cf67-4a37-4b2b-8951-4a61a4b1a8e3 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:55.989283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624cf67-4a37-4b2b-8951-4a61a4b1a8e3 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:55.989283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624cf67-4a37-4b2b-8951-4a61a4b1a8e3 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-1967710485` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:55.990445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624cf67-4a37-4b2b-8951-4a61a4b1a8e3 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1967710485)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:55.992963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624cf67-4a37-4b2b-8951-4a61a4b1a8e3 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.041074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-57855086-69e8-4c77-bf63-72ff51815c1f None None] MFA Rules not processed for user `1b4432334b2f46f5a2555636af9f8210`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:56.042511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-57855086-69e8-4c77-bf63-72ff51815c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:56.076122 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2581/5242] 10.222.0.32 () {58 vars in 1208 bytes} [Sat Dec 25 21:25:55 2021] DELETE /identity/v3/regions/tempest-region-1967710485 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:56.076122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540f6c-7803-46c6-9237-f71d923a8637 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.076122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540f6c-7803-46c6-9237-f71d923a8637 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.076122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540f6c-7803-46c6-9237-f71d923a8637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.101096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e4540f6c-7803-46c6-9237-f71d923a8637 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:56.110113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e4540f6c-7803-46c6-9237-f71d923a8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:56.135171 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2582/5243] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:56 2021] POST /identity/v3/auth/tokens => generated 3993 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:56.136828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4540f6c-7803-46c6-9237-f71d923a8637 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.163601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4540f6c-7803-46c6-9237-f71d923a8637 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.167352 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2662/5244] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:55 2021] POST /identity/v3/auth/tokens => generated 4022 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:56.170674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855086-69e8-4c77-bf63-72ff51815c1f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.173847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.176611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.177161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.177661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/services/735cafd737eb43b38faefb1e1bd7bc1d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.178606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_service(service_id=735cafd737eb43b38faefb1e1bd7bc1d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.180421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.196093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57855086-69e8-4c77-bf63-72ff51815c1f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.209602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.212491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.212491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.212491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.215321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:25:56.217297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.219091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.244792 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2663/5245] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:25:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:56.244792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.256683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f32bd4-0816-46ff-a1da-505a2f0576e9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.263682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.269807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.269807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.269807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.269807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:create_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.270280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.276855 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2583/5246] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:56 2021] DELETE /identity/v3/services/735cafd737eb43b38faefb1e1bd7bc1d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:56.278400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.322279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55bd2-4084-443c-b417-45881eb0365d tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.328743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.329606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.330077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.330243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.333403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.335730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.484626 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2584/5247] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:25:56 2021] POST /identity/v3/projects => generated 399 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:56.487249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.500335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2664/5248] 10.222.0.32 () {60 vars in 1313 bytes} [Sat Dec 25 21:25:56 2021] POST /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 789 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:56.502951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.518943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e743b-804f-44b6-9ba5-967da2fd72a9 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.619141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.619963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.620334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.620915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.621451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.623479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.629280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b58b6-59be-493a-8048-c9d65caedf87 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.637119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.638223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.638565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.638841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints/e68bc0bebac848f3bf34a0063c612115` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.646063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e68bc0bebac848f3bf34a0063c612115)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.650836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.766340 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2665/5249] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:25:56 2021] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:56.767353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.789479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e68bc0bebac848f3bf34a0063c612115', 'request_id': 'req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:56.814707 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2585/5250] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:56 2021] DELETE /identity/v3/endpoints/e68bc0bebac848f3bf34a0063c612115 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:56.815734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.875377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd78cb3-c76f-4e92-84b4-e0c0e81a6cf0 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.886327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.887027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.891582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.891582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.891582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.891582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.902088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d284c-c55a-44d4-ba37-7e084679f6fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.913410 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2586/5251] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:56.914619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.938920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.940350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.940735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.941130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/bffc7c12c7004937905a9719cb3d479b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.975875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f1f25-4a72-4d9c-8408-690b44c37f04 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:56.976704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:get_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=bffc7c12c7004937905a9719cb3d479b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.982434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:56.989976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2666/5252] 10.222.0.32 () {58 vars in 1391 bytes} [Sat Dec 25 21:25:56 2021] GET /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/bffc7c12c7004937905a9719cb3d479b => generated 689 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:25:56.990380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:56.991239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:56.991525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:56.991804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-1678507736` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:56.992474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1678507736)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:56.992843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:56.994933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:57.012210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f89c9-3851-4f76-a268-244657090201 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:57.021416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d8b90-64b2-4f2c-b2ec-8ceea40caa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:57.024907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d8b90-64b2-4f2c-b2ec-8ceea40caa94 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.024907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d8b90-64b2-4f2c-b2ec-8ceea40caa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.024907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d8b90-64b2-4f2c-b2ec-8ceea40caa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.025587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d8b90-64b2-4f2c-b2ec-8ceea40caa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:57.034778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d8b90-64b2-4f2c-b2ec-8ceea40caa94 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:57.052279 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2667/5253] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:57.054064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc0a4-5620-452b-a597-1fccf91119b3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.054527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc0a4-5620-452b-a597-1fccf91119b3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.054975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc0a4-5620-452b-a597-1fccf91119b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.075388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cb8bc0a4-5620-452b-a597-1fccf91119b3 None None] MFA Rules not processed for user `1b4432334b2f46f5a2555636af9f8210`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:57.076806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cb8bc0a4-5620-452b-a597-1fccf91119b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:57.138339 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2587/5254] 10.222.0.32 () {58 vars in 1208 bytes} [Sat Dec 25 21:25:56 2021] DELETE /identity/v3/regions/tempest-region-1678507736 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:57.139298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:57.191498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb5ef-1055-44ba-a6fc-a08df67e0760 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:57.199605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:57.201021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.212768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.212768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] PATH_INFO: `/v3/projects/5a8dd053b27a426f844ddb32e4f1d6f6/users/e1915a5223074263ae66c1964ca003f4/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.250085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8dd053b27a426f844ddb32e4f1d6f6, user_id=e1915a5223074263ae66c1964ca003f4, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:57.254520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:57.303260 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2668/5255] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:57 2021] POST /identity/v3/auth/tokens => generated 3861 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Dec 25 21:25:57.303260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc0a4-5620-452b-a597-1fccf91119b3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:57.334121 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2588/5256] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:25:57 2021] PUT /identity/v3/projects/5a8dd053b27a426f844ddb32e4f1d6f6/users/e1915a5223074263ae66c1964ca003f4/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:57.335134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:57.354048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc0a4-5620-452b-a597-1fccf91119b3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:57.471185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5138fa6-4509-4632-918c-e89b91b4cab3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:57.483717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a587ed-11e7-4583-8aa5-0e8a4f78b652 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:57.485618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a587ed-11e7-4583-8aa5-0e8a4f78b652 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.485904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a587ed-11e7-4583-8aa5-0e8a4f78b652 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.486183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a587ed-11e7-4583-8aa5-0e8a4f78b652 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/bffc7c12c7004937905a9719cb3d479b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.490893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a587ed-11e7-4583-8aa5-0e8a4f78b652 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=bffc7c12c7004937905a9719cb3d479b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:57.492420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a587ed-11e7-4583-8aa5-0e8a4f78b652 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:57.493526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:57.494463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.494744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.495016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/services/aedae295675646fb9991ea39f6ad02e2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.495691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aedae295675646fb9991ea39f6ad02e2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:57.498190 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:57.498190 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:25:57.498190 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:25:57.499118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:57.639276 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2589/5257] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:25:57 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/bffc7c12c7004937905a9719cb3d479b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:57.641245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35548-831e-4088-9062-7f5e33715379 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.641530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35548-831e-4088-9062-7f5e33715379 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.641803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b35548-831e-4088-9062-7f5e33715379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.643958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2669/5258] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:57 2021] DELETE /identity/v3/services/aedae295675646fb9991ea39f6ad02e2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:57.646061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:57.687705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-12b35548-831e-4088-9062-7f5e33715379 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:57.688972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12b35548-831e-4088-9062-7f5e33715379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:57.694339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d7c72-ee1c-44f9-bb9c-d7a21832b497 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:57.699146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:57.700207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.700496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.700775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.701577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:create_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:57.703330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:57.835278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2590/5259] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:57 2021] POST /identity/v3/auth/tokens => generated 3541 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:25:57.836523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b35548-831e-4088-9062-7f5e33715379 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:57.864044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b35548-831e-4088-9062-7f5e33715379 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:57.869396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:57.870910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:57.870910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:57.870910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/endpoints/75e04c435b494ee29804a1442aa84dcc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:57.877218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=75e04c435b494ee29804a1442aa84dcc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:57.879690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:57.898632 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2670/5260] 10.222.0.32 () {60 vars in 1314 bytes} [Sat Dec 25 21:25:57 2021] POST /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 921 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:57.899858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:57.901636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:57.938121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '75e04c435b494ee29804a1442aa84dcc', 'request_id': 'req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:57.953328 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2591/5261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:57 2021] DELETE /identity/v3/endpoints/75e04c435b494ee29804a1442aa84dcc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:57.954204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:57.992694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f25ad-417f-40f5-ae2f-d214f94cecf8 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.006903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.007864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.008146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.008965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/2e49b6ba110e4c919763a0f04154c4db` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.031684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=2e49b6ba110e4c919763a0f04154c4db)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.033612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0843772-cf14-452b-aa5b-5a4a96c3c31e tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.036742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.065995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.066649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.067011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.067535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.084836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.086746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.117614 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2671/5262] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:57 2021] GET /identity/v3/auth/tokens => generated 3360 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:58.118390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:58.147652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df3e5a-ccd9-473f-9a1d-580bf156e237 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.154159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.155496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.156359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.156696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/regions/tempest-region-461730315` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.157411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-461730315)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.159424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.234340 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2592/5263] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:25:57 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/2e49b6ba110e4c919763a0f04154c4db => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:58.235391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:58.261039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349df5f-7fce-4afb-882c-2aed84117db7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.267080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.269571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.269901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.270206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.270974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:create_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.282839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.321552 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2672/5264] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:25:58 2021] DELETE /identity/v3/regions/tempest-region-461730315 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:58.325612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:58.404933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d26987-49a0-4dc3-9679-ce4402525351 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.414695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd117c8111840a386551cd859f45442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd02cfd8a6b7446799871ccafcf314a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.418126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.419428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.420014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] PATH_INFO: `/v3/services/988d3900d84e4de997d742c729a42175` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.421114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorizing `identity:delete_service(service_id=988d3900d84e4de997d742c729a42175)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.423560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.555683 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2593/5265] 10.222.0.32 () {60 vars in 1314 bytes} [Sat Dec 25 21:25:58 2021] POST /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 812 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:58.560711 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2673/5266] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:25:58 2021] DELETE /identity/v3/services/988d3900d84e4de997d742c729a42175 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:58.561125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:58.562040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:58.569236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:58.585360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711072bd-0a7c-472b-9bd3-954f59b74dad tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.613791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a40911-33a6-450e-b7d1-782575171333 tempest-EndPointsTestJSON-249291212 tempest-EndPointsTestJSON-249291212-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.618932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.619716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.620237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.620693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.620860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.621169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.621444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/74d3a506a86e4d31a03a6bc928ca3e76` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.621725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] PATH_INFO: `/v3/users/60d492b1263945bdaf852259ad04f0ad` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.623441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d492b1263945bdaf852259ad04f0ad)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.625617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.641581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=74d3a506a86e4d31a03a6bc928ca3e76)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.643476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.747198 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2594/5267] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:25:58 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/74d3a506a86e4d31a03a6bc928ca3e76 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:25:58.749643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:58.765409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30407d7-799f-40b2-9fc7-383cfbcb2615 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:58.780460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:58.787778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:58.789155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:58.789456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:58.790245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:create_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:58.791652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:58.865060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d492b1263945bdaf852259ad04f0ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:58.875749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d492b1263945bdaf852259ad04f0ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:58.903697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d492b1263945bdaf852259ad04f0ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:58.904989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d492b1263945bdaf852259ad04f0ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:58.965822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f984bddf-a8e3-4104-9178-2215bae41d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d492b1263945bdaf852259ad04f0ad'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:25:58.970955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2595/5268] 10.222.0.32 () {60 vars in 1313 bytes} [Sat Dec 25 21:25:58 2021] POST /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 789 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:25:58.976305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:58.978315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:58.997036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2674/5269] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:25:58 2021] DELETE /identity/v3/users/60d492b1263945bdaf852259ad04f0ad => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:59.004338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40bf30-2ad4-41b3-a7fa-d260c7e45bc4 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:59.006933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:59.007282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:59.008117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:59.069030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:25:59.071467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:59.096306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:59.098647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:59.099114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:59.099560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:59.100481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:create_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:59.105516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:59.231634 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2675/5270] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:25:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:25:59.275520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:59.278263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:25:59.386562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2596/5271] 10.222.0.32 () {60 vars in 1313 bytes} [Sat Dec 25 21:25:58 2021] POST /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 788 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:25:59.390721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:59.423317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e5a-c8bb-4800-80ce-6a8f7dde9cb7 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:59.444216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:59.451725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:59.451725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:59.451725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:59.451725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:list_application_credentials(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:59.457740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:59.475166 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2597/5272] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:25:59 2021] GET /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 1501 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:25:59.476236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:59.490632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331a60-fda6-4240-8b25-2cebf6595309 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:59.495533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:59.496769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:59.497201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:59.497603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/c6814fa12e5f4b75b954a6cec171fbcb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:59.509131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df7ae-2894-4248-9fc4-909a4636341e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:59.509484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=c6814fa12e5f4b75b954a6cec171fbcb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:59.511118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:59.529399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:59.530058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:59.530336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:59.537335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:59.553912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:59.556393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:59.594117 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2598/5273] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:25:59 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/c6814fa12e5f4b75b954a6cec171fbcb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:59.597087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2676/5274] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:25:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:25:59.599370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:59.621784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9fb4d-3781-4afa-852d-92c8b4c4e16a tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:59.632131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:59.633296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:59.633751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:59.634136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/92b1d7566e044cfd9b232f0c0d4d009e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:59.652336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=92b1d7566e044cfd9b232f0c0d4d009e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:59.654162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:25:59.743702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:25:59.752558 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2599/5275] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:25:59 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/92b1d7566e044cfd9b232f0c0d4d009e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:25:59.761339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c1a0c-78e0-4b38-b033-a600564358bc service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:25:59.768956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:25:59.770651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:25:59.771105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:25:59.771484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:25:59.772430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:create_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:25:59.773876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:00.039652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2677/5276] 10.222.0.32 () {60 vars in 1313 bytes} [Sat Dec 25 21:25:59 2021] POST /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 789 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:00.043967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:00.054431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964192d-1a61-4622-870b-a2a509131eae tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:00.069761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:00.070673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:00.070960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:00.071242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:00.071997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:create_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:00.073218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:00.241515 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2600/5277] 10.222.0.32 () {60 vars in 1313 bytes} [Sat Dec 25 21:26:00 2021] POST /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials => generated 789 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:00.245570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:00.269645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c0d86-99fe-4240-ba33-5f187af18203 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:00.278962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:00.280347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:00.280696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:00.281656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:00.282540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Adding query filter params (name=tempest-application_credential-1969918144) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:00.283428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:list_application_credentials(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:00.285992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:00.302061 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2678/5278] 10.222.0.32 () {58 vars in 1385 bytes} [Sat Dec 25 21:26:00 2021] GET /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials?name=tempest-application_credential-1969918144 => generated 887 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:00.306420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:00.321121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427a04-8e22-4c19-8fb1-d68be923e9d8 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:00.329089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:00.330458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:00.331507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:00.332262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/17f83fb720a94234b454c12a9dee9f90` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:00.347972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=17f83fb720a94234b454c12a9dee9f90)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:00.350323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:00.458742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:00.459337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2601/5279] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:26:00 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/17f83fb720a94234b454c12a9dee9f90 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:00.469645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000862a2-6340-4057-9cf4-8cfb256f8d6b tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:00.474438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4432334b2f46f5a2555636af9f8210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38adfb746b4a4539b1761aa8a72f66bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:00.475513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:00.475938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:00.476315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/6bb41c689eca413093e248a76ae985b1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:00.487205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1b4432334b2f46f5a2555636af9f8210, application_credential_id=6bb41c689eca413093e248a76ae985b1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:00.489567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:00.588655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:00.590512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:00.617619 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2679/5280] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:26:00 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210/application_credentials/6bb41c689eca413093e248a76ae985b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:00.618773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:00.623768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:00.664115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f926e9-1691-4994-8e45-ccfb851fa529 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:00.670336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1cd14-9640-4838-94e6-df1d35b01128 tempest-ApplicationCredentialsV3Test-310706772 tempest-ApplicationCredentialsV3Test-310706772-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:00.676955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:00.680501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:00.682042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:00.684642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] PATH_INFO: `/v3/projects/cc520945a1c64d93bea2e9b40c7ad7f4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:00.689696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:00.689696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:00.689696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:00.689696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] PATH_INFO: `/v3/users/1b4432334b2f46f5a2555636af9f8210` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:00.690072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc520945a1c64d93bea2e9b40c7ad7f4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:00.694638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4432334b2f46f5a2555636af9f8210)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:00.696719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:00.697687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:00.949254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4432334b2f46f5a2555636af9f8210'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:00.961299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc520945a1c64d93bea2e9b40c7ad7f4', 'request_id': 'req-45387ec3-c9e3-47d8-94ce-d657077fcb28'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:00.964553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4432334b2f46f5a2555636af9f8210'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:00.982045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc520945a1c64d93bea2e9b40c7ad7f4', 'request_id': 'req-45387ec3-c9e3-47d8-94ce-d657077fcb28'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.076996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4432334b2f46f5a2555636af9f8210'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.078402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4432334b2f46f5a2555636af9f8210'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.121189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc520945a1c64d93bea2e9b40c7ad7f4', 'request_id': 'req-45387ec3-c9e3-47d8-94ce-d657077fcb28'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.137825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] The token cache is being invalidate because project cc520945a1c64d93bea2e9b40c7ad7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:01.138126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.139460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.167066 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2602/5281] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:00 2021] DELETE /identity/v3/projects/cc520945a1c64d93bea2e9b40c7ad7f4 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:01.168380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:01.171765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:01.195486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1808e77-68a6-4804-9d66-a190b54dcb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4432334b2f46f5a2555636af9f8210'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.206518 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2680/5282] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:00 2021] DELETE /identity/v3/users/1b4432334b2f46f5a2555636af9f8210 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:01.208071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:01.208359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:01.208636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:01.243096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:01.246084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:01.340129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45387ec3-c9e3-47d8-94ce-d657077fcb28 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:01.389344 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2681/5283] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:01.449094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:01.450288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:01.450675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:01.451285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] PATH_INFO: `/v3/users/fbd117c8111840a386551cd859f45442` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:01.452807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd117c8111840a386551cd859f45442)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:01.455044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:01.460646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:01.460646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:01.592082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65754-9478-46bd-a909-4c4b50831f8c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:01.596191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:01.596849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:01.597163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:01.597505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:01.610287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:01.616005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:01.629171 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2682/5284] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:26:01.827594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd117c8111840a386551cd859f45442'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.857571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd117c8111840a386551cd859f45442'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.899279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd117c8111840a386551cd859f45442'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.900153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd117c8111840a386551cd859f45442'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:01.900753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8bc6372-0548-47df-ae25-2af28a7da450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd117c8111840a386551cd859f45442'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.007529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2603/5285] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:01 2021] DELETE /identity/v3/users/fbd117c8111840a386551cd859f45442 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:02.147833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:02.149407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:02.166373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea87a-197e-4676-9dbd-68b4abd7d4c1 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:02.245672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:02.246540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:02.247124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:02.247124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] PATH_INFO: `/v3/projects/38adfb746b4a4539b1761aa8a72f66bb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:02.248273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=38adfb746b4a4539b1761aa8a72f66bb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:02.250204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:02.425153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38adfb746b4a4539b1761aa8a72f66bb', 'request_id': 'req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.459279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524023f5-44a1-463b-aab2-3851c88abe80 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:02.459279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524023f5-44a1-463b-aab2-3851c88abe80 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:02.460389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524023f5-44a1-463b-aab2-3851c88abe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:02.496591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-524023f5-44a1-463b-aab2-3851c88abe80 None None] MFA Rules not processed for user `e1915a5223074263ae66c1964ca003f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:02.497967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-524023f5-44a1-463b-aab2-3851c88abe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:02.512797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38adfb746b4a4539b1761aa8a72f66bb', 'request_id': 'req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.524439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38adfb746b4a4539b1761aa8a72f66bb', 'request_id': 'req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.538147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] The token cache is being invalidate because project 38adfb746b4a4539b1761aa8a72f66bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:02.539523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.539523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef3c9c21-05fd-494c-b66d-686e3cf8a0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.542204 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2683/5286] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:02 2021] DELETE /identity/v3/projects/38adfb746b4a4539b1761aa8a72f66bb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:02.548907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:02.549123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:02.549682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:02.572509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:02.573909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:02.591275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2604/5287] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:02 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:02.603551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:02.604767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:02.605117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:02.646592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] MFA Rules not processed for user `e1915a5223074263ae66c1964ca003f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:02.648411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:02.656602 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2605/5288] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:02 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:02.662614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:02.664218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:02.707736 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2684/5289] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:02.710035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:02.720740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:02.754334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ee11c-e722-40a7-8939-3baaad071fdb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:02.772225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:02.773153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:02.773589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:02.774016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] PATH_INFO: `/v3/projects/dd02cfd8a6b7446799871ccafcf314a7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:02.776308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd02cfd8a6b7446799871ccafcf314a7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:02.778279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:02.902949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b78c-135f-47ca-94eb-b752bd067720 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:02.910711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff2f17-e5ea-42d6-8b6d-96deb0766149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:02.911372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff2f17-e5ea-42d6-8b6d-96deb0766149 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:02.911655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff2f17-e5ea-42d6-8b6d-96deb0766149 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:02.911930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff2f17-e5ea-42d6-8b6d-96deb0766149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:02.923479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff2f17-e5ea-42d6-8b6d-96deb0766149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:02.925284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff2f17-e5ea-42d6-8b6d-96deb0766149 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:02.955267 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2685/5290] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:02 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:02.961671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7ed6c-8d94-4a80-aa7e-a03a93e4c5c3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:02.963241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7ed6c-8d94-4a80-aa7e-a03a93e4c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:02.963241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7ed6c-8d94-4a80-aa7e-a03a93e4c5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:02.974874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd02cfd8a6b7446799871ccafcf314a7', 'request_id': 'req-ee07696e-ee6e-48b1-8b65-c293f501d5ff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.986342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd02cfd8a6b7446799871ccafcf314a7', 'request_id': 'req-ee07696e-ee6e-48b1-8b65-c293f501d5ff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:02.997880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-edd7ed6c-8d94-4a80-aa7e-a03a93e4c5c3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:02.999566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-edd7ed6c-8d94-4a80-aa7e-a03a93e4c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:03.092925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd02cfd8a6b7446799871ccafcf314a7', 'request_id': 'req-ee07696e-ee6e-48b1-8b65-c293f501d5ff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:03.120717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] The token cache is being invalidate because project dd02cfd8a6b7446799871ccafcf314a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:03.123975 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2686/5291] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:03.125262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:03.126308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ee07696e-ee6e-48b1-8b65-c293f501d5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:03.127831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7ed6c-8d94-4a80-aa7e-a03a93e4c5c3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.131460 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2606/5292] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:02 2021] DELETE /identity/v3/projects/dd02cfd8a6b7446799871ccafcf314a7 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:03.138896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd21cc-c2e8-49b9-860d-111d1af25190 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.139177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd21cc-c2e8-49b9-860d-111d1af25190 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.139457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd21cc-c2e8-49b9-860d-111d1af25190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.147275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7ed6c-8d94-4a80-aa7e-a03a93e4c5c3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.155886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.156823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.157406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.157848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.159583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:03.161741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.163537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.179835 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2687/5293] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:03.183807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.185818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:03.189667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2acd21cc-c2e8-49b9-860d-111d1af25190 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:03.190874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2acd21cc-c2e8-49b9-860d-111d1af25190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:03.205099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59983e3-0172-44bb-a286-0f29a4125beb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.211596 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2607/5294] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:03.216129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.217109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.217577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.219329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.220173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9008a-9f22-47fe-bb20-c2d558f89e6c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.220513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9008a-9f22-47fe-bb20-c2d558f89e6c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.220714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9008a-9f22-47fe-bb20-c2d558f89e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.224563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.227126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.251264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-55b9008a-9f22-47fe-bb20-c2d558f89e6c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:03.251264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-55b9008a-9f22-47fe-bb20-c2d558f89e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:03.264779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2608/5295] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:03.267397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9008a-9f22-47fe-bb20-c2d558f89e6c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.280138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9008a-9f22-47fe-bb20-c2d558f89e6c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.292849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.294254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.294906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.295431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.296953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:03.297528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.299570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.315526 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2609/5296] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:03.319799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.332251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e998f2-2146-40bd-ad38-8c94f995d41c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.338600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.339775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.340401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.340938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.341970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.344660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.361251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2688/5297] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:03 2021] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:03.362421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.444320 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2610/5298] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:03 2021] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:03.448436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.513116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01737ab-eaf1-44c1-99f8-489643cd86e9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.607732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb4d4-ecda-4e7d-b8d0-aeb7502f546a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.614676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.615679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.616267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.617448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.618599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.621195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.653807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.654664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.655248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.655605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.656935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.660245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.777567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2611/5299] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:03 2021] POST /identity/v3/users => generated 295 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:03.781269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.795410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569490-c687-4055-aab2-4a25d7b3d9a2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.800664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.801382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.801659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.801927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.802666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.804486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.820426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2612/5300] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:03.821666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.833390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5778596-11c1-49ed-8bbc-fb98ceeaa2cf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.838456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.839351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.839574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.839859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.840720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.842360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.857048 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2613/5301] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:03.858814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.873740 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2689/5302] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:03 2021] POST /identity/v3/users => generated 290 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:03.873984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af6f3d-8e05-463f-990b-0087a963e24a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.874915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.878053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.879749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.880128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.880530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] PATH_INFO: `/v3/projects/b4b92da921c94fee870199c7fd9db47f/users/d40f9bf3c06d4103958adc062c0dd6ee/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.894818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d9f6-91d1-4fd3-a035-c00d2b237ef5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.899103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b92da921c94fee870199c7fd9db47f, user_id=d40f9bf3c06d4103958adc062c0dd6ee, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.902409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.905061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.906043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.906394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.906747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.907865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.910031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:03.948082 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2690/5303] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:03 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:03.948082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:03.961105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:03.977639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198b83e-165e-42a9-9e38-dabb3a163309 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:03.983017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:03.988260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:03.988260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:03.988260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] PATH_INFO: `/v3/users/0560cf3b7cd24adea59de526bfc0aa09` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:03.988260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0560cf3b7cd24adea59de526bfc0aa09)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:03.989265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:04.028992 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2614/5304] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:03 2021] PUT /identity/v3/projects/b4b92da921c94fee870199c7fd9db47f/users/d40f9bf3c06d4103958adc062c0dd6ee/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:04.030187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:04.140325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4cdb0-20fa-4f3d-93aa-a9270394cbc0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:04.145736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861805-cc64-44d5-85c6-42a9aa8f99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:04.146409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861805-cc64-44d5-85c6-42a9aa8f99c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.146690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861805-cc64-44d5-85c6-42a9aa8f99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.146961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861805-cc64-44d5-85c6-42a9aa8f99c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.147960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861805-cc64-44d5-85c6-42a9aa8f99c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:04.149590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861805-cc64-44d5-85c6-42a9aa8f99c2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:04.163016 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2615/5305] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:04 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:04.164713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428df2c-4f63-4768-9983-6633e56eaabb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.165145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428df2c-4f63-4768-9983-6633e56eaabb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.165398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428df2c-4f63-4768-9983-6633e56eaabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.199524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4428df2c-4f63-4768-9983-6633e56eaabb None None] MFA Rules not processed for user `d40f9bf3c06d4103958adc062c0dd6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:04.200247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0560cf3b7cd24adea59de526bfc0aa09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:04.201374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4428df2c-4f63-4768-9983-6633e56eaabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:04.211938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0560cf3b7cd24adea59de526bfc0aa09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:04.226993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0560cf3b7cd24adea59de526bfc0aa09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:04.228790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0560cf3b7cd24adea59de526bfc0aa09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:04.289552 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2616/5306] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:04 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:04.290527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428df2c-4f63-4768-9983-6633e56eaabb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:04.317154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428df2c-4f63-4768-9983-6633e56eaabb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:04.332602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0560cf3b7cd24adea59de526bfc0aa09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:04.345028 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2691/5307] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:03 2021] DELETE /identity/v3/users/0560cf3b7cd24adea59de526bfc0aa09 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:04.345028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:04.345982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c698d4b-9a09-4ef3-8634-c7e1f048516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:04.346885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698d4b-9a09-4ef3-8634-c7e1f048516a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.349084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:04.350236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698d4b-9a09-4ef3-8634-c7e1f048516a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.352056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698d4b-9a09-4ef3-8634-c7e1f048516a admin admin] PATH_INFO: `/v3/projects/71729fa822434d989cdfd47cd1515f1c/users/0ca94bdb96c841058044252f3447d015/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.400510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c698d4b-9a09-4ef3-8634-c7e1f048516a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71729fa822434d989cdfd47cd1515f1c, user_id=0ca94bdb96c841058044252f3447d015, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:04.405154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c698d4b-9a09-4ef3-8634-c7e1f048516a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:04.474161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30128802-288c-4dfe-9f07-ff8f282ad25f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:04.479297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb9029-2f81-4c8e-9e04-b722414b2fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:04.480352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9029-2f81-4c8e-9e04-b722414b2fbc admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.480640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9029-2f81-4c8e-9e04-b722414b2fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.481107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9029-2f81-4c8e-9e04-b722414b2fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.481812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb9029-2f81-4c8e-9e04-b722414b2fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:04.484058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb9029-2f81-4c8e-9e04-b722414b2fbc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:04.499212 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2617/5308] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:04 2021] PUT /identity/v3/projects/71729fa822434d989cdfd47cd1515f1c/users/0ca94bdb96c841058044252f3447d015/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:04.510803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e2e5-01b9-428b-b489-4041c309b492 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.511093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e2e5-01b9-428b-b489-4041c309b492 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.511396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e2e5-01b9-428b-b489-4041c309b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.530042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dc09e2e5-01b9-428b-b489-4041c309b492 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:04.531333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dc09e2e5-01b9-428b-b489-4041c309b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:04.589676 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2692/5309] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:04 2021] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:04.589676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.589676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.589676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.637160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] MFA Rules not processed for user `0ca94bdb96c841058044252f3447d015`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:04.639011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:04.651343 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2618/5310] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:04.652103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09e2e5-01b9-428b-b489-4041c309b492 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:04.672979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09e2e5-01b9-428b-b489-4041c309b492 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:04.761350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:04.763365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.764618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.765157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.767297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:04.777383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:04.842152 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2693/5311] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:04 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:04.843510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:04.847124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:04.910447 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2619/5312] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:04 2021] POST /identity/v3/users => generated 300 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:04.911489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:04.915943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:04.935748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708b11-108e-4936-9d66-0bf400bca14f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:04.949034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:04.951379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.951665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.951942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:04.952656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:04.955856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:04.982865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec0fe8-6de5-4498-80b2-b35731f267bb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:04.992925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:04.993911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:04.994775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:04.995061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.005752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.007329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.020084 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2694/5313] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:05.021136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.033548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc8d8-7510-4da9-8117-acd83557fbd7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.040367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.040733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.041070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.041351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.042132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.044846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.060213 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2695/5314] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:05.066139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.077575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611173d-0a8e-41a6-8820-d09e8da1343e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.085444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.086586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.086945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.087293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] PATH_INFO: `/v3/projects/9570c69bedfe4502bea824c3e2501eee/users/b46a58ea774c463891b9e5f00c6fb17d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.114730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9570c69bedfe4502bea824c3e2501eee, user_id=b46a58ea774c463891b9e5f00c6fb17d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.118258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.156593 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2620/5315] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:04 2021] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:05.161501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.207356 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2696/5316] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:05 2021] PUT /identity/v3/projects/9570c69bedfe4502bea824c3e2501eee/users/b46a58ea774c463891b9e5f00c6fb17d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:05.214523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.314671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcd537-e0d6-498c-9e1f-76187382a956 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.324204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.325261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.325555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.328115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb95209-8da0-40a5-b717-50260f0e9968 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.328376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.330391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.331998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.341498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.342277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.343523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.343802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.344522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.348254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.353043 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2697/5317] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:05.360376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.381926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4ffd3-4fee-48f6-99d1-a56da2913d74 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.384447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696658a-52df-4471-8557-f7e2993d9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.385578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696658a-52df-4471-8557-f7e2993d9393 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.385889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696658a-52df-4471-8557-f7e2993d9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.386279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696658a-52df-4471-8557-f7e2993d9393 admin admin] PATH_INFO: `/v3/projects/9570c69bedfe4502bea824c3e2501eee/users/b46a58ea774c463891b9e5f00c6fb17d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.388957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696658a-52df-4471-8557-f7e2993d9393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9570c69bedfe4502bea824c3e2501eee, user_id=b46a58ea774c463891b9e5f00c6fb17d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.392436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696658a-52df-4471-8557-f7e2993d9393 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.407496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2698/5318] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:05 2021] PUT /identity/v3/projects/9570c69bedfe4502bea824c3e2501eee/users/b46a58ea774c463891b9e5f00c6fb17d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:05.427111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803521f-9054-4b6c-87d7-2df2b347cb4f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.427518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803521f-9054-4b6c-87d7-2df2b347cb4f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.427987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803521f-9054-4b6c-87d7-2df2b347cb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.490773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5803521f-9054-4b6c-87d7-2df2b347cb4f None None] MFA Rules not processed for user `b46a58ea774c463891b9e5f00c6fb17d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:05.492380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5803521f-9054-4b6c-87d7-2df2b347cb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:05.505813 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2621/5319] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:05 2021] POST /identity/v3/users => generated 291 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:05.508803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.513596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:05.545614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8584d-9810-4172-a7a5-9e0f9fa93a50 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.704975 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2699/5320] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:05 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:05.707006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803521f-9054-4b6c-87d7-2df2b347cb4f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.733690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.734743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.735033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.738614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] PATH_INFO: `/v3/projects/00685ab64044408194e2426e71afe583` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.742090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00685ab64044408194e2426e71afe583)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.744030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.854420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803521f-9054-4b6c-87d7-2df2b347cb4f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.859341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.860365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.860744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.861135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.861976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.865157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.881145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2700/5321] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:05.881145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.896305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aad85-6535-4d75-bc42-a254249d9ec6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.916296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.920052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.920357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.922081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects/b4b92da921c94fee870199c7fd9db47f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.924668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4b92da921c94fee870199c7fd9db47f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.927837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.936951 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2701/5322] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:26:05 2021] GET /identity/v3/projects/b4b92da921c94fee870199c7fd9db47f => generated 389 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:05.942709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.963832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b339a-a5b2-45b1-b78f-81ad3d5db38a tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:05.966127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:05.966895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:05.971945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:05.971945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:05.971945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:05.971945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:05.985015 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2702/5323] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:05.988807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:05.998470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea067df-6ba7-4632-bdcd-7642dbdd3f0f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.008781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.009632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.010212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.010563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.011487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.014188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.047141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00685ab64044408194e2426e71afe583', 'request_id': 'req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:06.057302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00685ab64044408194e2426e71afe583', 'request_id': 'req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:06.171589 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2703/5324] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:26:05 2021] POST /identity/v3/projects => generated 339 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:06.172288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.183166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00685ab64044408194e2426e71afe583', 'request_id': 'req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:06.207413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] The token cache is being invalidate because project 00685ab64044408194e2426e71afe583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:06.207702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:06.208568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:06.210912 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2622/5325] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:05 2021] DELETE /identity/v3/projects/00685ab64044408194e2426e71afe583 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:06.213312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.217229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:06.305696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038313ba-3194-46c9-8b75-a32d80689434 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.312180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.313749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.314131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.314488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] PATH_INFO: `/v3/projects/68708112879f4f01a7e13144713d503e/users/b064029a352846bbb3b7e66bd0a3a68b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.338030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882dd0f-28c8-4ae5-948e-f5ee79cdb2b8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.338152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68708112879f4f01a7e13144713d503e, user_id=b064029a352846bbb3b7e66bd0a3a68b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.340115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.402168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcae67-14ad-4684-b613-913e8c383fc6 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.402854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcae67-14ad-4684-b613-913e8c383fc6 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.403120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcae67-14ad-4684-b613-913e8c383fc6 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.404409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcae67-14ad-4684-b613-913e8c383fc6 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.405227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcae67-14ad-4684-b613-913e8c383fc6 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.407085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcae67-14ad-4684-b613-913e8c383fc6 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.429785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2623/5326] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:26:06 2021] GET /identity/v3/projects => generated 6943 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:06.431130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21fcd-08e5-4e79-ab9b-6a7c7b2ed5af None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.431413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21fcd-08e5-4e79-ab9b-6a7c7b2ed5af None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.431689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21fcd-08e5-4e79-ab9b-6a7c7b2ed5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.447139 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2704/5327] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:06 2021] PUT /identity/v3/projects/68708112879f4f01a7e13144713d503e/users/b064029a352846bbb3b7e66bd0a3a68b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:06.456374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.466449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6eb21fcd-08e5-4e79-ab9b-6a7c7b2ed5af None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:06.469157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6eb21fcd-08e5-4e79-ab9b-6a7c7b2ed5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:06.574229 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2624/5328] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:06.575909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fb0db-9d7e-444e-b3b1-329a909be2c5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.576305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fb0db-9d7e-444e-b3b1-329a909be2c5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.576691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fb0db-9d7e-444e-b3b1-329a909be2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.578293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615ee1f-f15b-4c9e-8c9e-dba4cb7b2772 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.584350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70672450-3fb1-4da3-8eca-073d5df1ce10 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.585581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672450-3fb1-4da3-8eca-073d5df1ce10 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.586024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672450-3fb1-4da3-8eca-073d5df1ce10 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.586459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672450-3fb1-4da3-8eca-073d5df1ce10 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects/b4b92da921c94fee870199c7fd9db47f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.587857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70672450-3fb1-4da3-8eca-073d5df1ce10 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4b92da921c94fee870199c7fd9db47f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.594563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70672450-3fb1-4da3-8eca-073d5df1ce10 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.594563 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2705/5329] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:26:06 2021] GET /identity/v3/projects/b4b92da921c94fee870199c7fd9db47f => generated 389 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:06.594563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ea8d8-04fe-40e2-aefa-68c46f323733 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.594563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ea8d8-04fe-40e2-aefa-68c46f323733 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.594563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ea8d8-04fe-40e2-aefa-68c46f323733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.617364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f28ea8d8-04fe-40e2-aefa-68c46f323733 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:06.619827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f28ea8d8-04fe-40e2-aefa-68c46f323733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:06.643742 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2706/5330] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:06.643742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ea8d8-04fe-40e2-aefa-68c46f323733 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.650875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ea8d8-04fe-40e2-aefa-68c46f323733 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.657166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.658302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.660317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c05fb0db-9d7e-444e-b3b1-329a909be2c5 None None] MFA Rules not processed for user `b064029a352846bbb3b7e66bd0a3a68b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:06.661044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.661362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects/6c73dc11efa044c2aa8e9f32046c508f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.663305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c05fb0db-9d7e-444e-b3b1-329a909be2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:06.665198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c73dc11efa044c2aa8e9f32046c508f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.670535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.678620 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2707/5331] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:26:06 2021] GET /identity/v3/projects/6c73dc11efa044c2aa8e9f32046c508f => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:06.683417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.696669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de881f3-51fb-4581-9481-255117922212 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.705293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.705962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.706244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.706568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.707305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:06.707884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.709638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.725423 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2708/5332] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:06.729693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.740869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45a87-c4fc-40c8-b2c1-7cb758a4aa5a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.746319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.746878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.747165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.747448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.748367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.750438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.767738 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2625/5333] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:06 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:06.772849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fb0db-9d7e-444e-b3b1-329a909be2c5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.775701 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2709/5334] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:26:06 2021] GET /identity/v3/projects => generated 6943 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:06.776667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.778397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:06.784728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fb0db-9d7e-444e-b3b1-329a909be2c5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.791170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.791930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.792278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.793336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.793336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.795375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.848034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b60903-2d32-45e1-8130-483ed5f61092 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:06.853074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ca94bdb96c841058044252f3447d015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71729fa822434d989cdfd47cd1515f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:06.854073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:06.854389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:06.854667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] PATH_INFO: `/v3/users/0ca94bdb96c841058044252f3447d015/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:06.856304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] RBAC: Authorizing `identity:list_user_projects(user_id=0ca94bdb96c841058044252f3447d015)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:06.858238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:06.923073 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2626/5335] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:06 2021] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:06.923861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.930738 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2710/5336] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:26:06 2021] GET /identity/v3/users/0ca94bdb96c841058044252f3447d015/projects => generated 515 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:06.931827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:06.947816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecb1a2-cb68-4707-bb77-e9be1ddd892a tempest-IdentityV3ProjectsTest-856167869 tempest-IdentityV3ProjectsTest-856167869-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.021554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.026827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.026827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.026827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.027509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.029489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.075093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353c335-29c3-4c35-9a14-5d5388411580 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.081063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11e829-5c00-414d-b48d-ade65a48d3d7 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.082361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e829-5c00-414d-b48d-ade65a48d3d7 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.082642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e829-5c00-414d-b48d-ade65a48d3d7 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.082915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11e829-5c00-414d-b48d-ade65a48d3d7 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.083678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11e829-5c00-414d-b48d-ade65a48d3d7 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:07.083981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11e829-5c00-414d-b48d-ade65a48d3d7 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.085986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11e829-5c00-414d-b48d-ade65a48d3d7 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.132272 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2627/5337] 10.222.0.32 () {58 vars in 1165 bytes} [Sat Dec 25 21:26:06 2021] GET /identity/v3/projects?domain_id=default => generated 6981 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:07.133707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670e4b-e23b-4c3f-83fd-f4edf4073a62 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.133707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670e4b-e23b-4c3f-83fd-f4edf4073a62 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.133707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7670e4b-e23b-4c3f-83fd-f4edf4073a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.139924 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2711/5338] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:06 2021] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:07.140650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.158829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9b51c-9f1a-401c-9d49-70201769ce50 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.176644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.179140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.179140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.179140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.180433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.182419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.194867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d7670e4b-e23b-4c3f-83fd-f4edf4073a62 None None] MFA Rules not processed for user `0ca94bdb96c841058044252f3447d015`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:07.196101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d7670e4b-e23b-4c3f-83fd-f4edf4073a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:07.218680 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2712/5339] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:26:07 2021] GET /identity/v3/projects => generated 7312 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:07.221465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.235888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454e2a5-89aa-4d01-b1d9-588b2807191f tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.262956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.264658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.264975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.265350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.267146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.271689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.293195 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2713/5340] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:07 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:07.294755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.323459 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2628/5341] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:07.327667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670e4b-e23b-4c3f-83fd-f4edf4073a62 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.337763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19dc64-226a-4ad5-98f8-835034eae801 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.343252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7670e4b-e23b-4c3f-83fd-f4edf4073a62 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.351146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac791d9-97f4-41d8-8056-f9700b3a4825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.352071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac791d9-97f4-41d8-8056-f9700b3a4825 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.352225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac791d9-97f4-41d8-8056-f9700b3a4825 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.352551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac791d9-97f4-41d8-8056-f9700b3a4825 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.353409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac791d9-97f4-41d8-8056-f9700b3a4825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.355160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac791d9-97f4-41d8-8056-f9700b3a4825 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.355748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.357039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.357466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.357836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.359055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:07.359486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.362555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.366719 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2629/5342] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:07 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:07.369056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.369417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.369703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.393974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] MFA Rules not processed for user `0ca94bdb96c841058044252f3447d015`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:07.395832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:07.402031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2714/5343] 10.222.0.32 () {58 vars in 1165 bytes} [Sat Dec 25 21:26:07 2021] GET /identity/v3/projects?domain_id=default => generated 6981 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:07.402940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.418812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d8461-f7ce-4f63-bf72-39fb6cadd9a2 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.424037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.425077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.425576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.426041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] PATH_INFO: `/v3/projects/de2e73a0bdf847d09859985d18e2302e/users/59433cd15fe14962977cec63dd00cf00/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.444590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.models.token_model [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] User 0ca94bdb96c841058044252f3447d015 has no access to project 68708112879f4f01a7e13144713d503e {{(pid=96732) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Dec 25 21:26:07.446793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2e73a0bdf847d09859985d18e2302e, user_id=59433cd15fe14962977cec63dd00cf00, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.449166 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 25 21:26:07.449657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.450880 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2630/5344] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:07 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 84 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 25 21:26:07.451669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.467062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a5074-afc4-486a-9c19-a434afee3cab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.471741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.473116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.473395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.473819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.474550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.476369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.497669 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2631/5345] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:26:07 2021] GET /identity/v3/projects => generated 7312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:07.497669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.501417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:07.521207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87358a84-29c1-4eb6-a641-39f6e0298a1e tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.531690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.531690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.531690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.531690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] PATH_INFO: `/v3/users/0ca94bdb96c841058044252f3447d015` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.532380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca94bdb96c841058044252f3447d015)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.532380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.614368 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2715/5346] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:07 2021] PUT /identity/v3/projects/de2e73a0bdf847d09859985d18e2302e/users/59433cd15fe14962977cec63dd00cf00/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:07.616370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.709315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730888d9-5f31-442b-8efd-537394817c3a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.715016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.715719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.716042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.716313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.717325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1340162134) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:07.717633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.719733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.734988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2716/5347] 10.222.0.32 () {58 vars in 1231 bytes} [Sat Dec 25 21:26:07 2021] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1340162134 => generated 537 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:07.734988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.741661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:07.766008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca94bdb96c841058044252f3447d015'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:07.776300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca94bdb96c841058044252f3447d015'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:07.796470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca94bdb96c841058044252f3447d015'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:07.798153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca94bdb96c841058044252f3447d015'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:07.799105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca94bdb96c841058044252f3447d015'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:07.831079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a82fb-aa5c-4dd5-8408-57a96c6d5595 tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:07.836859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebf9ca-1231-4a3c-85b8-09ad85b567ad tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e57e4c842d7545ab831f0ad5e820e23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b6f4e629c1439384734404a004a37c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:07.837558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebf9ca-1231-4a3c-85b8-09ad85b567ad tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.837864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebf9ca-1231-4a3c-85b8-09ad85b567ad tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.838169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebf9ca-1231-4a3c-85b8-09ad85b567ad tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.839638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebf9ca-1231-4a3c-85b8-09ad85b567ad tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:07.839949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebf9ca-1231-4a3c-85b8-09ad85b567ad tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:07.841989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebf9ca-1231-4a3c-85b8-09ad85b567ad tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:07.854963 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2717/5348] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:07.856957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:07.856957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:07.856957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:07.892127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] MFA Rules not processed for user `59433cd15fe14962977cec63dd00cf00`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:07.893382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:07.978661 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2632/5349] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:07 2021] DELETE /identity/v3/users/0ca94bdb96c841058044252f3447d015 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:07.980363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.982352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:07.990806 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2718/5350] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:07 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:07.992860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:07.998295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:08.016261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17949e61-f3d8-45c5-aed8-b7a4effc0a26 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:08.109110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d900c4-bdb6-4612-9a31-1bfaca654d85 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:08.116960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46a58ea774c463891b9e5f00c6fb17d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9570c69bedfe4502bea824c3e2501eee', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:08.118357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.119154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.119987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] PATH_INFO: `/v3/projects/6c73dc11efa044c2aa8e9f32046c508f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:08.121903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c73dc11efa044c2aa8e9f32046c508f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:08.124501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:08.134769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b918a-8f7c-40bc-99b8-e2fa9078a87c tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e57e4c842d7545ab831f0ad5e820e23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b6f4e629c1439384734404a004a37c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:08.135496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b918a-8f7c-40bc-99b8-e2fa9078a87c tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.137855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b918a-8f7c-40bc-99b8-e2fa9078a87c tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.137855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b918a-8f7c-40bc-99b8-e2fa9078a87c tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:08.137855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b918a-8f7c-40bc-99b8-e2fa9078a87c tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:08.138925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b918a-8f7c-40bc-99b8-e2fa9078a87c tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:08.296933 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2719/5351] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:07 2021] POST /identity/v3/projects => generated 348 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:08.298593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.298989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.299277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:08.321771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c73dc11efa044c2aa8e9f32046c508f', 'request_id': 'req-08c7729d-2c73-467e-b6cf-0d0367988d8b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.329118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c73dc11efa044c2aa8e9f32046c508f', 'request_id': 'req-08c7729d-2c73-467e-b6cf-0d0367988d8b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.335469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:08.342038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:08.401278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c73dc11efa044c2aa8e9f32046c508f', 'request_id': 'req-08c7729d-2c73-467e-b6cf-0d0367988d8b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.417747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] The token cache is being invalidate because project 6c73dc11efa044c2aa8e9f32046c508f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:08.418105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.418842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.421153 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2633/5352] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:07 2021] DELETE /identity/v3/projects/6c73dc11efa044c2aa8e9f32046c508f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:08.422189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:08.424012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:08.430969 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2720/5353] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:08.432022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:08.436154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:08.505824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7729d-2c73-467e-b6cf-0d0367988d8b tempest-ListProjectsStaticTestJSON-871944541 tempest-ListProjectsStaticTestJSON-871944541-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:08.521151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336d1e4-8957-405d-bee5-7765600b979d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:08.528177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e57e4c842d7545ab831f0ad5e820e23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b6f4e629c1439384734404a004a37c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:08.528979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.529271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.529552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:08.530333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:08.530647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:08.532356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:08.549219 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2721/5354] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:08.550099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:08.554933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:08.574638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d54f8-5846-45b1-862c-4732c5c75c05 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:08.585564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:08.586134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:08.586466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.586815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.587094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] PATH_INFO: `/v3/users/d40f9bf3c06d4103958adc062c0dd6ee` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:08.587762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.588151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.589231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40f9bf3c06d4103958adc062c0dd6ee)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:08.589432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:08.591424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:08.591578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:08.666577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:08.668056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:08.678505 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2634/5355] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:08 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:08.679174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:08.691324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774cb4d-1c9c-4f72-9469-ee10a8b9806b service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:08.695067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889597c-04a8-49e9-ac62-37bd7e1d1969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:08.695707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889597c-04a8-49e9-ac62-37bd7e1d1969 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.695990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889597c-04a8-49e9-ac62-37bd7e1d1969 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.696504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889597c-04a8-49e9-ac62-37bd7e1d1969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:08.709260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889597c-04a8-49e9-ac62-37bd7e1d1969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:08.710809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889597c-04a8-49e9-ac62-37bd7e1d1969 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:08.723686 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2635/5356] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:08.843980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40f9bf3c06d4103958adc062c0dd6ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.852262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40f9bf3c06d4103958adc062c0dd6ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.866680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40f9bf3c06d4103958adc062c0dd6ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.867472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40f9bf3c06d4103958adc062c0dd6ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.978081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40f9bf3c06d4103958adc062c0dd6ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:08.986831 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2722/5357] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:08 2021] DELETE /identity/v3/users/d40f9bf3c06d4103958adc062c0dd6ee => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:08.991863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:08.992229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:08.992637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:09.013477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:09.014991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:09.146248 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2636/5358] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:09.195808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:09.198015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:09.290184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812dcb-5a3e-4987-93f1-092141121b52 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:09.298690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:09.303285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:09.304270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:09.305057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:09.320528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:09.323952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:09.340751 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2723/5359] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:09.406846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:09.408626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:09.431853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a0b9d-be23-4285-9190-af72148d8471 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:09.438690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:09.450262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:09.451909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:09.452425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] PATH_INFO: `/v3/projects/71729fa822434d989cdfd47cd1515f1c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:09.454116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=71729fa822434d989cdfd47cd1515f1c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:09.457037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:09.615632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71729fa822434d989cdfd47cd1515f1c', 'request_id': 'req-2c920403-ad4b-4bb1-bac9-19554b9f5ece'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:09.625434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71729fa822434d989cdfd47cd1515f1c', 'request_id': 'req-2c920403-ad4b-4bb1-bac9-19554b9f5ece'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:09.761224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71729fa822434d989cdfd47cd1515f1c', 'request_id': 'req-2c920403-ad4b-4bb1-bac9-19554b9f5ece'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:09.774512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] The token cache is being invalidate because project 71729fa822434d989cdfd47cd1515f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:09.775368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:09.776214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:09.778322 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2637/5360] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:09 2021] DELETE /identity/v3/projects/71729fa822434d989cdfd47cd1515f1c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:09.782515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:09.799850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:09.805600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:09.806185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17b0dc-4a76-4919-888e-a04d1b3f64ae service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:09.934250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920403-ad4b-4bb1-bac9-19554b9f5ece admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:09.934466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:09.935214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:09.935526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:09.935801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] PATH_INFO: `/v3/users/b064029a352846bbb3b7e66bd0a3a68b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:09.937696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b064029a352846bbb3b7e66bd0a3a68b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:09.939640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:09.946849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e57e4c842d7545ab831f0ad5e820e23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52b6f4e629c1439384734404a004a37c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:09.947891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:09.948227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:09.948505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] PATH_INFO: `/v3/projects/94e6a540cce74ba1a6eae31ab17ff968` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:09.949797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94e6a540cce74ba1a6eae31ab17ff968)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:09.951711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:10.105328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e6a540cce74ba1a6eae31ab17ff968', 'request_id': 'req-07cc859d-c636-47ed-ab92-f4cf69db8454'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.113269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e6a540cce74ba1a6eae31ab17ff968', 'request_id': 'req-07cc859d-c636-47ed-ab92-f4cf69db8454'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.184298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e6a540cce74ba1a6eae31ab17ff968', 'request_id': 'req-07cc859d-c636-47ed-ab92-f4cf69db8454'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.197547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] The token cache is being invalidate because project 94e6a540cce74ba1a6eae31ab17ff968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:10.198155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.199082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.201313 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2638/5361] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:09 2021] DELETE /identity/v3/projects/94e6a540cce74ba1a6eae31ab17ff968 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:10.232783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b064029a352846bbb3b7e66bd0a3a68b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.245224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b064029a352846bbb3b7e66bd0a3a68b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.247364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:10.249696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:10.289031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b064029a352846bbb3b7e66bd0a3a68b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.289988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b064029a352846bbb3b7e66bd0a3a68b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.355726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc859d-c636-47ed-ab92-f4cf69db8454 tempest-RoutersAdminTest-58483452 tempest-RoutersAdminTest-58483452-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:10.364414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:10.371419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:10.371419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:10.371419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:10.371419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:10.389266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b064029a352846bbb3b7e66bd0a3a68b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:10.398763 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2724/5362] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:09 2021] DELETE /identity/v3/users/b064029a352846bbb3b7e66bd0a3a68b => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:10.495085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:10.499527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:10.530047 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2639/5363] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:10 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:10.817655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:10.821280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:10.930090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e7bd3-8f64-4660-89c5-41772dd170ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:10.937666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:10.939823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:10.940397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:10.941412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] PATH_INFO: `/v3/projects/b4b92da921c94fee870199c7fd9db47f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:10.944140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b92da921c94fee870199c7fd9db47f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:10.947698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:11.061396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b92da921c94fee870199c7fd9db47f', 'request_id': 'req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.269998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b92da921c94fee870199c7fd9db47f', 'request_id': 'req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.284200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b92da921c94fee870199c7fd9db47f', 'request_id': 'req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.300386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] The token cache is being invalidate because project b4b92da921c94fee870199c7fd9db47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:11.301275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.302507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.304234 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2725/5364] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:10 2021] DELETE /identity/v3/projects/b4b92da921c94fee870199c7fd9db47f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:11.308334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:11.310682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:11.385229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383a82e-1b45-4bd5-9006-790eed17ac54 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:11.465054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:11.465943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:11.466227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:11.466484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] PATH_INFO: `/v3/users/b46a58ea774c463891b9e5f00c6fb17d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:11.468104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46a58ea774c463891b9e5f00c6fb17d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:11.475243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:11.574419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:11.578229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:11.597553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d9e53-8739-42a7-a4b4-074fd6cbe357 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:11.602851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:11.603779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:11.604113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:11.604448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] PATH_INFO: `/v3/projects/68708112879f4f01a7e13144713d503e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:11.606842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68708112879f4f01a7e13144713d503e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:11.609201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:11.697445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46a58ea774c463891b9e5f00c6fb17d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.708621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46a58ea774c463891b9e5f00c6fb17d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.723757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46a58ea774c463891b9e5f00c6fb17d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.724676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46a58ea774c463891b9e5f00c6fb17d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.726511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8bac9eb4-936c-43ba-a6e5-a30872f7d3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46a58ea774c463891b9e5f00c6fb17d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.780662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68708112879f4f01a7e13144713d503e', 'request_id': 'req-65ee57ec-21a1-4038-a5d1-3908dd753d91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:11.853624 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2640/5365] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:11 2021] DELETE /identity/v3/users/b46a58ea774c463891b9e5f00c6fb17d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:12.001014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68708112879f4f01a7e13144713d503e', 'request_id': 'req-65ee57ec-21a1-4038-a5d1-3908dd753d91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:12.008613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68708112879f4f01a7e13144713d503e', 'request_id': 'req-65ee57ec-21a1-4038-a5d1-3908dd753d91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:12.019367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] The token cache is being invalidate because project 68708112879f4f01a7e13144713d503e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:12.019709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:12.020293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-65ee57ec-21a1-4038-a5d1-3908dd753d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:12.021970 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2726/5366] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:11 2021] DELETE /identity/v3/projects/68708112879f4f01a7e13144713d503e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:12.029919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bba6-ce2c-4dc6-80df-0e0de831c337 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.030232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bba6-ce2c-4dc6-80df-0e0de831c337 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.030507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bba6-ce2c-4dc6-80df-0e0de831c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.049955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0c51bba6-ce2c-4dc6-80df-0e0de831c337 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:12.051770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0c51bba6-ce2c-4dc6-80df-0e0de831c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:12.120512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2641/5367] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:12.129295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202e53b-3e5d-448a-a79e-085d233291e3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.129586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202e53b-3e5d-448a-a79e-085d233291e3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.129864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202e53b-3e5d-448a-a79e-085d233291e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.153197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8202e53b-3e5d-448a-a79e-085d233291e3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:12.154459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8202e53b-3e5d-448a-a79e-085d233291e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:12.169217 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2727/5368] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:12.173479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bba6-ce2c-4dc6-80df-0e0de831c337 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.185130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bba6-ce2c-4dc6-80df-0e0de831c337 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.192094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:12.192849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.193292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.193688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.194470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:12.194982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:12.196808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:12.211787 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2642/5369] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:12.223763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202e53b-3e5d-448a-a79e-085d233291e3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.242849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202e53b-3e5d-448a-a79e-085d233291e3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.250429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:12.251152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.251621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.252096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.258683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:12.258683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:12.362808 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2728/5370] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:12 2021] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:12.367109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.382678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd56ac-f0d5-4554-b6ae-34f10031b35e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.460611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:12.462226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.463117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.463554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.464501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:12.466513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:12.559275 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2643/5371] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:12 2021] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:12.564039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.578645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45070-3710-4aa1-bc94-4e36a624b099 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.585347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:12.586182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.586641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.587127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.587974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:12.589752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:12.630728 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2729/5372] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:12 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:12.635113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.647229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ba698-fee9-45d5-947f-faaccb56f5bf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.652619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:12.653637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.653921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.654224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] PATH_INFO: `/v3/projects/0e1ea91b564c4ce3b5f386aca8f4d86f/users/c9285849bef3463f8a0007d3268dfdd8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.673684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1ea91b564c4ce3b5f386aca8f4d86f, user_id=c9285849bef3463f8a0007d3268dfdd8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:12.676564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:12.774252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2644/5373] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:12 2021] PUT /identity/v3/projects/0e1ea91b564c4ce3b5f386aca8f4d86f/users/c9285849bef3463f8a0007d3268dfdd8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:12.779671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.794241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582b2a6-34a6-4c14-8608-4f107147b365 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.860518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.864695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:12.890960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:12.891979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.892465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.892967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.893951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:12.895775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:12.912321 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2730/5374] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:12 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:12.913536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:12.926676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f4d3b-c8bb-447f-b029-0280b0c10ff9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.934082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4bd6-7b16-4fbd-8016-2e37df4ea06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:12.934752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4bd6-7b16-4fbd-8016-2e37df4ea06e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.935194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4bd6-7b16-4fbd-8016-2e37df4ea06e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.935641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4bd6-7b16-4fbd-8016-2e37df4ea06e admin admin] PATH_INFO: `/v3/projects/0e1ea91b564c4ce3b5f386aca8f4d86f/users/c9285849bef3463f8a0007d3268dfdd8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:12.938616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4bd6-7b16-4fbd-8016-2e37df4ea06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1ea91b564c4ce3b5f386aca8f4d86f, user_id=c9285849bef3463f8a0007d3268dfdd8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:12.942060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4bd6-7b16-4fbd-8016-2e37df4ea06e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:12.974155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd971-dc22-4af1-b468-d4254fe0b17d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:12.974472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2731/5375] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:12 2021] PUT /identity/v3/projects/0e1ea91b564c4ce3b5f386aca8f4d86f/users/c9285849bef3463f8a0007d3268dfdd8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:12.987057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9c75-2dfe-4bde-b9cc-96c5196207b1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:12.989348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9c75-2dfe-4bde-b9cc-96c5196207b1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:12.991681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9c75-2dfe-4bde-b9cc-96c5196207b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.037384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-31db9c75-2dfe-4bde-b9cc-96c5196207b1 None None] MFA Rules not processed for user `c9285849bef3463f8a0007d3268dfdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:13.043423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-31db9c75-2dfe-4bde-b9cc-96c5196207b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:13.063666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.064625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.065172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.066083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] PATH_INFO: `/v3/projects/9570c69bedfe4502bea824c3e2501eee` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.067480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9570c69bedfe4502bea824c3e2501eee)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.069552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.168759 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2732/5376] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:12 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:13.172965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9c75-2dfe-4bde-b9cc-96c5196207b1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.186705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9c75-2dfe-4bde-b9cc-96c5196207b1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:13.193274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.194015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.194305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.194663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.198308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.198308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.264524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9570c69bedfe4502bea824c3e2501eee', 'request_id': 'req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:13.279429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9570c69bedfe4502bea824c3e2501eee', 'request_id': 'req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:13.313184 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2733/5377] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:13 2021] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:13.317519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.394939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9570c69bedfe4502bea824c3e2501eee', 'request_id': 'req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:13.395074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fa96e-6b30-46ab-b8e8-bb22ddd3abe4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:13.404297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.405774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.406143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.406500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.407031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] The token cache is being invalidate because project 9570c69bedfe4502bea824c3e2501eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:13.407508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.408047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:13.408993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6aaf4f9f-24de-44a4-8d44-e7d5fa38eb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:13.411093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.416336 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2645/5378] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:12 2021] DELETE /identity/v3/projects/9570c69bedfe4502bea824c3e2501eee => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:13.418457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b41c-afff-4bd6-a9f6-d949dd1a1085 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.418979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b41c-afff-4bd6-a9f6-d949dd1a1085 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.420163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b41c-afff-4bd6-a9f6-d949dd1a1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.444432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4d57b41c-afff-4bd6-a9f6-d949dd1a1085 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:13.445793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d57b41c-afff-4bd6-a9f6-d949dd1a1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:13.456962 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2646/5379] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:13.465827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea4ea9-0eab-4a03-9562-76927ac10f95 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.465827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea4ea9-0eab-4a03-9562-76927ac10f95 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.465827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea4ea9-0eab-4a03-9562-76927ac10f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.486108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2734/5380] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:13 2021] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:13.488038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-17ea4ea9-0eab-4a03-9562-76927ac10f95 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:13.489056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-17ea4ea9-0eab-4a03-9562-76927ac10f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:13.492816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.495281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:13.503203 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2647/5381] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:13.504225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea4ea9-0eab-4a03-9562-76927ac10f95 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.515717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea4ea9-0eab-4a03-9562-76927ac10f95 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:13.516352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a32da-18b0-4204-934f-2f63bf8de57d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:13.524210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.525362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.525867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.526016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.526488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.527093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.527736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.528028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:13.528373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.528503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.529423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.531023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.531497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.548082 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2735/5382] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:13.549128 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2648/5383] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:13.550887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.551711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.562877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1608-84e4-4ace-8c30-665bc58485d4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:13.567287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71041-d245-4590-8dec-86538ae1a3de admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:13.569373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.574147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.574147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.574147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.574147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.574147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.577474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7134-cd87-469f-b2e2-b24377f50263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.578369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7134-cd87-469f-b2e2-b24377f50263 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.578836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7134-cd87-469f-b2e2-b24377f50263 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.579280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7134-cd87-469f-b2e2-b24377f50263 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.580745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7134-cd87-469f-b2e2-b24377f50263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.583922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7134-cd87-469f-b2e2-b24377f50263 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.588401 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2649/5384] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:13 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:13.591439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.604431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf3d3-8f40-4e99-ab9f-87dca95641dd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:13.611333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:13.612346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.613224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.613505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] PATH_INFO: `/v3/projects/93debc50e0c44687ad3412c4afdb185c/users/20dab82c705c4c47a1b289794e0b9256/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.632313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93debc50e0c44687ad3412c4afdb185c, user_id=20dab82c705c4c47a1b289794e0b9256, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:13.632724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:13.822644 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2650/5385] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:13 2021] PUT /identity/v3/projects/93debc50e0c44687ad3412c4afdb185c/users/20dab82c705c4c47a1b289794e0b9256/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:13.824933 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2736/5386] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:13 2021] POST /identity/v3/projects => generated 367 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:13.825627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:13.835588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff849-9791-494c-9033-239089828b51 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:13.836086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff849-9791-494c-9033-239089828b51 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:13.836532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceff849-9791-494c-9033-239089828b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:13.872474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5ceff849-9791-494c-9033-239089828b51 None None] MFA Rules not processed for user `20dab82c705c4c47a1b289794e0b9256`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:13.873483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5ceff849-9791-494c-9033-239089828b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:13.930308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8445d94-a16d-461d-9c7b-bba1738dbc16 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:14.024328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2737/5387] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:13 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:14.039865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff849-9791-494c-9033-239089828b51 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:14.041909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5ceff849-9791-494c-9033-239089828b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:14.108856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:14.109931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:14.110422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:14.111495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:14.113521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:14.116130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:14.146308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceff849-9791-494c-9033-239089828b51 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:14.150619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:14.150804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:14.151193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:14.152026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:14.154936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:14.228508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2651/5388] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:13 2021] POST /identity/v3/users => generated 284 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:14.231736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:14.246025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1c46-8cc5-4e29-a282-e52e9857be27 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:14.251086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:14.252826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:14.254602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:14.255670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:14.256131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:14.256571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:14.257540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:14.260313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:14.265758 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2738/5389] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:14 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:14.278394 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2652/5390] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:14.283214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:14.295602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc06c-2ab9-4d77-b2e6-14119f54251d service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:14.301419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3615-5a62-4e07-b409-cdddf959cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:14.302013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3615-5a62-4e07-b409-cdddf959cd62 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:14.302403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3615-5a62-4e07-b409-cdddf959cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:14.302785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3615-5a62-4e07-b409-cdddf959cd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:14.303628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da3615-5a62-4e07-b409-cdddf959cd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:14.305707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da3615-5a62-4e07-b409-cdddf959cd62 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:14.317636 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2739/5391] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:14 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:14.321820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:14.334027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668af2b-ec7a-4d36-a749-3969c8f2fb91 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:14.341409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:14.341997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:14.342139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:14.342734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] PATH_INFO: `/v3/projects/8bc60d15c4ed4d478b3e90fbb2ec1587/users/7d517b6a7c5a40d3b05c04f92c550e82/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:14.361006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc60d15c4ed4d478b3e90fbb2ec1587, user_id=7d517b6a7c5a40d3b05c04f92c550e82, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:14.364221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:14.482154 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2653/5392] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:14 2021] PUT /identity/v3/projects/8bc60d15c4ed4d478b3e90fbb2ec1587/users/7d517b6a7c5a40d3b05c04f92c550e82/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:14.483961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdecf43-5629-4225-afa8-0d9dfa794863 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:14.484464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdecf43-5629-4225-afa8-0d9dfa794863 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:14.485042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdecf43-5629-4225-afa8-0d9dfa794863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:14.513234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4cdecf43-5629-4225-afa8-0d9dfa794863 None None] MFA Rules not processed for user `7d517b6a7c5a40d3b05c04f92c550e82`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:14.514478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4cdecf43-5629-4225-afa8-0d9dfa794863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:14.611142 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2740/5393] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:14 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:14.616020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:14.720338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2858619-35d9-43d6-9f87-63091efab5e2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:14.733566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:14.734371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:14.734809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:14.735218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:14.737353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:14.740009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:14.881512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2654/5394] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:14 2021] POST /identity/v3/projects => generated 369 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:14.882401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdecf43-5629-4225-afa8-0d9dfa794863 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:14.898631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdecf43-5629-4225-afa8-0d9dfa794863 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:15.051613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:15.053150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:15.053150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:15.053412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:15.054025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:15.056316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:15.600472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2741/5395] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:14 2021] POST /identity/v3/users => generated 291 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:15.602274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:15.614897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f99f-1526-460d-a48f-5df93c054c57 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:15.619977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:15.620636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:15.620942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:15.621218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:15.622073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:15.624070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:15.637436 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2655/5396] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:15 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:15.642055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:15.655228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1fc6-3fca-47b7-8643-cfa2711cc23a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:15.670024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:15.674008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:15.674008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:15.674008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] PATH_INFO: `/v3/projects/45f87fef523849fbaaaeebe09221376c/users/9f42d7d1e54f48bd9688e8a3f0c78a68/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:15.692930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:15.695129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f87fef523849fbaaaeebe09221376c, user_id=9f42d7d1e54f48bd9688e8a3f0c78a68, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:15.697111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:15.704910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572aa8-02b8-48c0-9a71-39ec14a641a8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:15.713323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:15.714387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:15.714708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:15.715061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] PATH_INFO: `/v3/users/c9285849bef3463f8a0007d3268dfdd8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:15.716379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9285849bef3463f8a0007d3268dfdd8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:15.718881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:15.820398 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2742/5397] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:15 2021] PUT /identity/v3/projects/45f87fef523849fbaaaeebe09221376c/users/9f42d7d1e54f48bd9688e8a3f0c78a68/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:15.824350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:15.988824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4bb21-ef7e-4ff2-8da0-0995332ec9ee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:16.007945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:16.011838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.012098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.012391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.013192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:16.022870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9285849bef3463f8a0007d3268dfdd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:16.027054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:16.044146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9285849bef3463f8a0007d3268dfdd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:16.044309 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2743/5398] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:15 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:16.047557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:16.064385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015234-4a94-4b75-a07a-5fab84408459 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:16.071440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9285849bef3463f8a0007d3268dfdd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:16.072704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fba1d-eb69-4e55-a703-3c4defe97d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:16.072868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9285849bef3463f8a0007d3268dfdd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:16.073532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3d7e942b-b0cf-4d0f-9b65-35f8a67b0910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9285849bef3463f8a0007d3268dfdd8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:16.073980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fba1d-eb69-4e55-a703-3c4defe97d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.074510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fba1d-eb69-4e55-a703-3c4defe97d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.074969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fba1d-eb69-4e55-a703-3c4defe97d3a admin admin] PATH_INFO: `/v3/projects/45f87fef523849fbaaaeebe09221376c/users/9f42d7d1e54f48bd9688e8a3f0c78a68/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.079133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fba1d-eb69-4e55-a703-3c4defe97d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f87fef523849fbaaaeebe09221376c, user_id=9f42d7d1e54f48bd9688e8a3f0c78a68, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:16.084362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fba1d-eb69-4e55-a703-3c4defe97d3a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:16.107358 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2744/5399] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:16 2021] PUT /identity/v3/projects/45f87fef523849fbaaaeebe09221376c/users/9f42d7d1e54f48bd9688e8a3f0c78a68/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:16.119408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c4b4-681f-4903-8027-bc2f88eb30cc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.119791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c4b4-681f-4903-8027-bc2f88eb30cc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.120690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c4b4-681f-4903-8027-bc2f88eb30cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.162087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-78a7c4b4-681f-4903-8027-bc2f88eb30cc None None] MFA Rules not processed for user `9f42d7d1e54f48bd9688e8a3f0c78a68`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:16.164374 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2656/5400] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:15 2021] DELETE /identity/v3/users/c9285849bef3463f8a0007d3268dfdd8 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:16.168607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-78a7c4b4-681f-4903-8027-bc2f88eb30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:16.169423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.169893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.171227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.217342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:16.218613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:16.303598 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2745/5401] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:16 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:16.312470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c4b4-681f-4903-8027-bc2f88eb30cc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:16.326782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c4b4-681f-4903-8027-bc2f88eb30cc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:16.336768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:16.338083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.338550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.339012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.339943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:16.342565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:16.350106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2657/5402] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:16.361386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:16.363321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:16.446908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de81db-4e1b-4c37-9f98-325ab596fab0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:16.453149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:16.455933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.456771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.457275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.476176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:16.477777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:16.486889 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2746/5403] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:26:16 2021] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:16.489418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:16.491865 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2658/5404] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:26:16.514569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11415d-0a60-405b-acce-ac6bbe636257 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:16.520692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:16.521139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.521412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.521783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/084ca336c76b43cabf3f6632dbf49810` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.522525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:delete_service(service_id=084ca336c76b43cabf3f6632dbf49810)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:16.524241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:16.646213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:16.657372 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2747/5405] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:16 2021] DELETE /identity/v3/services/084ca336c76b43cabf3f6632dbf49810 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:16.658207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e7c12-b307-459f-8eb7-a169e53d9cb6 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:16.674578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:16.675975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.676797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.676797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.677310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:16.679060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:16.815862 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2659/5406] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:16 2021] POST /identity/v3/services => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:16.817215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:16.827888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276d35-5e2e-46d1-a322-f75fe318a508 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:16.842483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:16.843331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:16.843613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:16.843890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:16.844621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:update_service(service_id=7ce8749c4ad14d7e8a0a1dfb8538a468)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:16.845657 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:26:16.845657 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:26:16.845657 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:26:16.846531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.032401 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2748/5407] 10.222.0.32 () {60 vars in 1251 bytes} [Sat Dec 25 21:26:16 2021] PATCH /identity/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:17.037514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.062007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcc145-0721-4db5-87a4-cceeca29f8d2 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.084947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.085955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.086308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.086703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.087449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:get_service(service_id=7ce8749c4ad14d7e8a0a1dfb8538a468)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.089379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.100033 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2660/5408] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:26:17 2021] GET /identity/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468 => generated 283 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:17.103929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.120115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cbe83-e94f-40a5-bc53-95f787cf5814 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.125644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.126585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.126942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.127287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.129439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7ce8749c4ad14d7e8a0a1dfb8538a468)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.139343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.212926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2749/5409] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:17 2021] DELETE /identity/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:17.216811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.233318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a23e6-d687-4633-9b1d-c3d52b105cd0 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.264392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.265621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.265903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.266171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.266841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:get_service(service_id=7ce8749c4ad14d7e8a0a1dfb8538a468)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.269088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.285834 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Could not find service: 7ce8749c4ad14d7e8a0a1dfb8538a468.: keystone.exception.ServiceNotFound: Could not find service: 7ce8749c4ad14d7e8a0a1dfb8538a468. Dec 25 21:26:17.299928 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2661/5410] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:26:17 2021] GET /identity/v3/services/7ce8749c4ad14d7e8a0a1dfb8538a468 => generated 113 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:26:17.301838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.318279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e978b-d270-45eb-b130-9a7401e9ce4f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.323654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.326671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.326966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.327281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.328621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.330303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.432826 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2750/5411] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:17 2021] POST /identity/v3/services => generated 275 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:17.434076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.444904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41827de1-a67e-4ea0-80ff-c452b8592a3d tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.460767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.461487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.461796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.462071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.462791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.464411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.542383 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2662/5412] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:17 2021] POST /identity/v3/services => generated 273 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:17.546385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.568801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308639c-4424-4d00-a63a-00544447ee01 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.574222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.574894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.575179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.575615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.576348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.578043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.652908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.655391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:17.680716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039d1b1-019d-4318-94a1-7e845eb5afaa tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.685166 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2751/5413] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:17 2021] POST /identity/v3/services => generated 274 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:17.688627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.699695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.700908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.700908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.701281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] PATH_INFO: `/v3/projects/0e1ea91b564c4ce3b5f386aca8f4d86f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.702607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1ea91b564c4ce3b5f386aca8f4d86f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.704587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.716157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c4828-ae94-4e53-a536-bd0e67198614 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.725327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.725838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.726665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.726665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.727333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.729157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.740821 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2752/5414] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:26:17 2021] GET /identity/v3/services => generated 2977 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:17.746005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.761867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c181ac0-43dc-49c5-acfe-4d0397d87a97 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.768341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.769167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.769432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.769718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.770554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1589926968) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:17.770867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.773555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.779680 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2753/5415] 10.222.0.32 () {58 vars in 1221 bytes} [Sat Dec 25 21:26:17 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1589926968 => generated 418 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:17.783721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.796339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13c75-f248-42b5-ba4b-a31f8f987f9f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.807238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.808009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.809595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.809945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.810807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1953895737) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:17.811180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.813141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.826013 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2754/5416] 10.222.0.32 () {58 vars in 1221 bytes} [Sat Dec 25 21:26:17 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1953895737 => generated 416 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:26:17.827862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.842825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1ea91b564c4ce3b5f386aca8f4d86f', 'request_id': 'req-2118b432-93b9-420e-b0f1-80df34a35f1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:17.853252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e99415-7c38-4728-8058-6bd49f9042bf tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:17.856209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1ea91b564c4ce3b5f386aca8f4d86f', 'request_id': 'req-2118b432-93b9-420e-b0f1-80df34a35f1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:17.915488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1ea91b564c4ce3b5f386aca8f4d86f', 'request_id': 'req-2118b432-93b9-420e-b0f1-80df34a35f1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:17.932581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] The token cache is being invalidate because project 0e1ea91b564c4ce3b5f386aca8f4d86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:17.933118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:17.939313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:17.943007 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2663/5417] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:17 2021] DELETE /identity/v3/projects/0e1ea91b564c4ce3b5f386aca8f4d86f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:17.951380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:17.952197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:17.952600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:17.953628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:17.954439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1555192144) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:17.954868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:17.955236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.957748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:17.963963 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2755/5418] 10.222.0.32 () {58 vars in 1221 bytes} [Sat Dec 25 21:26:17 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1555192144 => generated 417 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:17.965594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:17.968618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:17.975150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:17.999802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14840-92bb-46c0-aea7-1e02038a06b7 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:18.014010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:18.015392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:18.015846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:18.018084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/7a51d6b1e5a04d5f893fbfc808eb4375` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:18.018989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7a51d6b1e5a04d5f893fbfc808eb4375)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:18.022787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:18.080863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b432-93b9-420e-b0f1-80df34a35f1a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:18.088660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:18.089911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:18.090196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:18.090707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] PATH_INFO: `/v3/users/20dab82c705c4c47a1b289794e0b9256` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:18.092043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20dab82c705c4c47a1b289794e0b9256)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:18.094080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:18.128283 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2756/5419] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:17 2021] DELETE /identity/v3/services/7a51d6b1e5a04d5f893fbfc808eb4375 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:18.135836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:18.152652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d35643-2222-4f0b-9768-fd3f56245803 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:18.160203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:18.160203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:18.160203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:18.160572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/85c333bf7bac46428230ed148fd672ae` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:18.160572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:delete_service(service_id=85c333bf7bac46428230ed148fd672ae)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:18.161874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:18.319182 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2757/5420] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:18 2021] DELETE /identity/v3/services/85c333bf7bac46428230ed148fd672ae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:18.328571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:18.355444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bc234-2b16-4e4d-b0e8-a21d7fc5460f tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:18.364787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f42d7d1e54f48bd9688e8a3f0c78a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45f87fef523849fbaaaeebe09221376c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:18.372124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:18.372124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:18.372124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] PATH_INFO: `/v3/services/47f76a11b9fa44609134b0876765b8b5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:18.372124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorizing `identity:delete_service(service_id=47f76a11b9fa44609134b0876765b8b5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:18.372124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:18.466420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20dab82c705c4c47a1b289794e0b9256'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.478535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20dab82c705c4c47a1b289794e0b9256'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.485361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2758/5421] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:18 2021] DELETE /identity/v3/services/47f76a11b9fa44609134b0876765b8b5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:18.497223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20dab82c705c4c47a1b289794e0b9256'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.504284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:18.504431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20dab82c705c4c47a1b289794e0b9256'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.504431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-001e7fd3-26f1-4641-b144-3a6e6fff450d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20dab82c705c4c47a1b289794e0b9256'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.504637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:18.525374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f71f1-f1a7-4f39-9d87-ef9091470b73 tempest-ServicesTestJSON-1276565916 tempest-ServicesTestJSON-1276565916-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:18.534256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:18.534256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:18.534256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:18.534256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] PATH_INFO: `/v3/users/7d517b6a7c5a40d3b05c04f92c550e82` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:18.534973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d517b6a7c5a40d3b05c04f92c550e82)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:18.535562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:18.607106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2664/5422] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:17 2021] DELETE /identity/v3/users/20dab82c705c4c47a1b289794e0b9256 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:18.687033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d517b6a7c5a40d3b05c04f92c550e82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.698567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d517b6a7c5a40d3b05c04f92c550e82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.718074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d517b6a7c5a40d3b05c04f92c550e82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.719236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d517b6a7c5a40d3b05c04f92c550e82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.783226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d517b6a7c5a40d3b05c04f92c550e82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:18.790686 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2759/5423] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:18 2021] DELETE /identity/v3/users/7d517b6a7c5a40d3b05c04f92c550e82 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:18.795554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:18.795860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:18.796117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:18.813070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:18.814313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:18.872677 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2665/5424] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:18.883634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:18.885722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:18.965198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04485a-da11-4733-ac58-abb501d46217 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:18.969983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d36dbb-dff7-4db0-97e3-4ece68210093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:18.970926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36dbb-dff7-4db0-97e3-4ece68210093 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:18.971309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36dbb-dff7-4db0-97e3-4ece68210093 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:18.972281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36dbb-dff7-4db0-97e3-4ece68210093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:18.984330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d36dbb-dff7-4db0-97e3-4ece68210093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:18.986048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d36dbb-dff7-4db0-97e3-4ece68210093 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:19.000664 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2760/5425] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:19.674437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:19.676054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:19.695610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075ad2c-9ea3-4d3c-a79b-3386c61773f5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:19.703162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:19.704612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:19.705176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:19.705685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] PATH_INFO: `/v3/projects/93debc50e0c44687ad3412c4afdb185c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:19.708734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93debc50e0c44687ad3412c4afdb185c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:19.710916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:19.890017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93debc50e0c44687ad3412c4afdb185c', 'request_id': 'req-4852a946-9b18-4f9b-b84f-5788b9373fd7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:19.897409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93debc50e0c44687ad3412c4afdb185c', 'request_id': 'req-4852a946-9b18-4f9b-b84f-5788b9373fd7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:20.020576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93debc50e0c44687ad3412c4afdb185c', 'request_id': 'req-4852a946-9b18-4f9b-b84f-5788b9373fd7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:20.053010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] The token cache is being invalidate because project 93debc50e0c44687ad3412c4afdb185c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:20.054062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:20.054576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4852a946-9b18-4f9b-b84f-5788b9373fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:20.057864 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2666/5426] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:19 2021] DELETE /identity/v3/projects/93debc50e0c44687ad3412c4afdb185c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:20.063104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbcf2d-71c4-46e0-978c-278cff527b54 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.063620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbcf2d-71c4-46e0-978c-278cff527b54 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.063736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbcf2d-71c4-46e0-978c-278cff527b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.095250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-efcbcf2d-71c4-46e0-978c-278cff527b54 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:20.098112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-efcbcf2d-71c4-46e0-978c-278cff527b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:20.204096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2761/5427] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:20.207898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285b9c5-e015-42d2-91c1-b0dcc529d9a5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.208355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285b9c5-e015-42d2-91c1-b0dcc529d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.208747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285b9c5-e015-42d2-91c1-b0dcc529d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.231291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c285b9c5-e015-42d2-91c1-b0dcc529d9a5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:20.234182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c285b9c5-e015-42d2-91c1-b0dcc529d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:20.250151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbcf2d-71c4-46e0-978c-278cff527b54 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:20.262946 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2667/5428] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:20.265016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbcf2d-71c4-46e0-978c-278cff527b54 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:20.270154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:20.270960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.271348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.271728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.273241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:20.274005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:20.276381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:20.301850 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2762/5429] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:20.301996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285b9c5-e015-42d2-91c1-b0dcc529d9a5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:20.314611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285b9c5-e015-42d2-91c1-b0dcc529d9a5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:20.320341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:20.321186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.321539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.321926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.322771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:20.325372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:20.470627 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2668/5430] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:20 2021] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:20.475594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:20.486680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8b3b4-efee-4712-b4b6-330b22d7d12a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:20.538301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:20.540279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:20.566527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:20.567085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.567369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.568618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.571257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:20.575829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:20.649865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff9d0-4555-4eec-959b-8f61716f68be admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:20.672561 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2763/5431] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:20 2021] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:20.673248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:20.675815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:20.684435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.691807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.692479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] PATH_INFO: `/v3/projects/8bc60d15c4ed4d478b3e90fbb2ec1587` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.692963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b2839-324a-4fcb-9394-f5cf852771fa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:20.695063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc60d15c4ed4d478b3e90fbb2ec1587)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:20.698563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:20.703453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:20.704141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.705559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.705895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.707210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:20.713426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:20.738407 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2764/5432] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:20.739521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:20.766766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2a03-2362-45b8-ace0-0cc199f686d3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:20.779135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:20.780133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.781324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.781797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.782943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:20.784859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:20.804569 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2765/5433] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:20.805707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:20.818655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bb53-1b65-464a-ba94-2f442429c95d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:20.824986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e4142-d9d5-4ece-8993-b9c101231479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:20.826103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4142-d9d5-4ece-8993-b9c101231479 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:20.827712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4142-d9d5-4ece-8993-b9c101231479 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:20.828160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e4142-d9d5-4ece-8993-b9c101231479 admin admin] PATH_INFO: `/v3/projects/f8d8dbb7b1994728a7acb1d884aa30d6/users/5b0b101a0f70492f9670ce1e8e104c54/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:20.871151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e4142-d9d5-4ece-8993-b9c101231479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d8dbb7b1994728a7acb1d884aa30d6, user_id=5b0b101a0f70492f9670ce1e8e104c54, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:20.879305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e4142-d9d5-4ece-8993-b9c101231479 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:20.928059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc60d15c4ed4d478b3e90fbb2ec1587', 'request_id': 'req-e4a60005-a42f-4dfb-b06d-70e2f732daf6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:20.994498 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2766/5434] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:20 2021] PUT /identity/v3/projects/f8d8dbb7b1994728a7acb1d884aa30d6/users/5b0b101a0f70492f9670ce1e8e104c54/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:20.997200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc60d15c4ed4d478b3e90fbb2ec1587', 'request_id': 'req-e4a60005-a42f-4dfb-b06d-70e2f732daf6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.003783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:21.004087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:21.004398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:21.092356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc60d15c4ed4d478b3e90fbb2ec1587', 'request_id': 'req-e4a60005-a42f-4dfb-b06d-70e2f732daf6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.112060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] MFA Rules not processed for user `5b0b101a0f70492f9670ce1e8e104c54`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:21.113485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:21.118421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] The token cache is being invalidate because project 8bc60d15c4ed4d478b3e90fbb2ec1587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:21.118421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.118421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.123891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2669/5435] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:20 2021] DELETE /identity/v3/projects/8bc60d15c4ed4d478b3e90fbb2ec1587 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:21.129037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:21.133442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:21.306682 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2767/5436] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:21.310308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:21.324942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:21.367058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60005-a42f-4dfb-b06d-70e2f732daf6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:21.521709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fd7b9-4535-4f7b-bf60-0a94934bc1d0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:21.528858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:21.531128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:21.533520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:21.534325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] PATH_INFO: `/v3/users/9f42d7d1e54f48bd9688e8a3f0c78a68` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:21.535155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:21.536747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:21.537671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f42d7d1e54f48bd9688e8a3f0c78a68)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:21.538204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:21.540398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:21.541365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:21.542727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:21.545941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:21.681355 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2768/5437] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:21 2021] POST /identity/v3/projects => generated 385 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:21.682393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:21.788164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43bb7-6c5f-4ad9-a890-a5da846bd9bc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:21.798888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f42d7d1e54f48bd9688e8a3f0c78a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.801942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:21.808341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:21.809009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:21.809696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:21.815536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f42d7d1e54f48bd9688e8a3f0c78a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.821117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:21.829574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:21.837976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f42d7d1e54f48bd9688e8a3f0c78a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.839152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f42d7d1e54f48bd9688e8a3f0c78a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.847248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f42d7d1e54f48bd9688e8a3f0c78a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:21.927782 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2670/5438] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:21 2021] DELETE /identity/v3/users/9f42d7d1e54f48bd9688e8a3f0c78a68 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:21.981742 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2769/5439] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:21 2021] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:21.985428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:21.994857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:22.062762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b488c3d-11fb-4f68-b6f3-4f76f08e0197 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:22.068369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:22.069363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:22.069874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:22.072200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:22.072200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:22.073363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:22.089526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:22.097319 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2671/5440] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:22.101477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997fcb-2a68-4d32-9a43-e802d1282e51 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:22.107002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:22.108469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:22.109225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:22.109750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] PATH_INFO: `/v3/projects/85b9f37084a94243b3bf7fdbb9b03f1b/users/b65c52c2f5334471be33d3867f9506be/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:22.128209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b9f37084a94243b3bf7fdbb9b03f1b, user_id=b65c52c2f5334471be33d3867f9506be, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:22.133495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:22.197796 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2770/5441] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:22 2021] PUT /identity/v3/projects/85b9f37084a94243b3bf7fdbb9b03f1b/users/b65c52c2f5334471be33d3867f9506be/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:22.202478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:22.215418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968820fe-9286-4ca3-8897-5f3900b70273 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:22.294840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12758a5-f296-475a-bba7-85d212a912d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:22.295770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12758a5-f296-475a-bba7-85d212a912d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:22.297266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12758a5-f296-475a-bba7-85d212a912d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:22.297725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12758a5-f296-475a-bba7-85d212a912d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:22.298764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12758a5-f296-475a-bba7-85d212a912d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:22.300967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12758a5-f296-475a-bba7-85d212a912d1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:22.319383 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2672/5442] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:22 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:22.327954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:22.344333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194837aa-25ba-40ee-93f2-958861d912c2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:22.365914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:22.367050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:22.367419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:22.368018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] PATH_INFO: `/v3/projects/85b9f37084a94243b3bf7fdbb9b03f1b/users/b65c52c2f5334471be33d3867f9506be/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:22.371235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b9f37084a94243b3bf7fdbb9b03f1b, user_id=b65c52c2f5334471be33d3867f9506be, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:22.375957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:22.404124 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2771/5443] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:22 2021] PUT /identity/v3/projects/85b9f37084a94243b3bf7fdbb9b03f1b/users/b65c52c2f5334471be33d3867f9506be/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:22.410993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:22.411459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:22.411866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:22.463221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] MFA Rules not processed for user `b65c52c2f5334471be33d3867f9506be`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:22.464495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:22.564906 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2673/5444] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:22 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:22.665378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:22.667888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:22.802783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779d30e-23b8-42e8-8b84-fc1933b0f6d1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:22.813458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ec1bb-3f9f-4667-aa89-94f0b9daa15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:22.814130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec1bb-3f9f-4667-aa89-94f0b9daa15c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:22.814415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec1bb-3f9f-4667-aa89-94f0b9daa15c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:22.814696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ec1bb-3f9f-4667-aa89-94f0b9daa15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:22.819706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e41ec1bb-3f9f-4667-aa89-94f0b9daa15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:22.977543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ec1bb-3f9f-4667-aa89-94f0b9daa15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:22.979323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ec1bb-3f9f-4667-aa89-94f0b9daa15c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:22.994038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2772/5445] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:22 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:23.427872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:23.429571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:23.610403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888d7db-a38e-4e4d-a04c-51bac7a58060 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:23.621404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:23.622681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:23.623203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:23.623713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] PATH_INFO: `/v3/projects/45f87fef523849fbaaaeebe09221376c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:23.627380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f87fef523849fbaaaeebe09221376c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:23.629672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:23.823288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f87fef523849fbaaaeebe09221376c', 'request_id': 'req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:23.841006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f87fef523849fbaaaeebe09221376c', 'request_id': 'req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:23.937172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f87fef523849fbaaaeebe09221376c', 'request_id': 'req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:23.961131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] The token cache is being invalidate because project 45f87fef523849fbaaaeebe09221376c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:23.961732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:23.962917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0eea3ffd-4d00-4de0-9ba9-3db04e29f07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:23.979370 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2674/5446] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:23 2021] DELETE /identity/v3/projects/45f87fef523849fbaaaeebe09221376c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:23.983094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0800e-2f55-4ab5-af1a-41b7bf4f43fa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:23.983951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0800e-2f55-4ab5-af1a-41b7bf4f43fa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:23.984391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0800e-2f55-4ab5-af1a-41b7bf4f43fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.073765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-22b0800e-2f55-4ab5-af1a-41b7bf4f43fa None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:24.076031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-22b0800e-2f55-4ab5-af1a-41b7bf4f43fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:24.235515 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2773/5447] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:24.237809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53b85-a731-497f-b077-b33f8b825337 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.239316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53b85-a731-497f-b077-b33f8b825337 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.239316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53b85-a731-497f-b077-b33f8b825337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.280299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f3d53b85-a731-497f-b077-b33f8b825337 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:24.284915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f3d53b85-a731-497f-b077-b33f8b825337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:24.325861 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2675/5448] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:24.330537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0800e-2f55-4ab5-af1a-41b7bf4f43fa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:24.359529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0800e-2f55-4ab5-af1a-41b7bf4f43fa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:24.364102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:24.365022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.365735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.366152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.367007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:24.367395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:24.369309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:24.391958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2774/5449] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:24.392098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53b85-a731-497f-b077-b33f8b825337 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:24.404320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:24.406239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:24.406594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53b85-a731-497f-b077-b33f8b825337 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:24.417048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:24.417919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.422500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.422500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.422500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:24.422500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:24.507334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51694889-4039-4e51-82b6-2252f05874a0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:24.511725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:24.512785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.513517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.513880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.516371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:24.540564 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2676/5450] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:24 2021] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:24.545864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:24.638140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b6ed-9461-4921-b4ee-f3e4afd65265 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:24.645597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:24.646674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.647344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.647821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.651480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:24.653097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:24.654274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:24.656687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:24.675469 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2775/5451] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:24 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:26:24.833335 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2677/5452] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:24 2021] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:24.839935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:24.859441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53af6b5-fb94-483d-b405-2642e79c61e3 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:24.877075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:24.878767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.881791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.881791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.881791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:24.882785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:24.896510 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2776/5453] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:24 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:24.899633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:24.923031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41debe8-9c5a-48dc-9bbd-c3aeaf01699d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:24.929595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffbe99-ab1a-41ff-8165-00d0bd78fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:24.932106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbe99-ab1a-41ff-8165-00d0bd78fbbc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.933372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbe99-ab1a-41ff-8165-00d0bd78fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.933923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbe99-ab1a-41ff-8165-00d0bd78fbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.934920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffbe99-ab1a-41ff-8165-00d0bd78fbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:24.936859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffbe99-ab1a-41ff-8165-00d0bd78fbbc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:24.952599 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2678/5454] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:24 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:24.954206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:24.967095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143dd39-bc9b-4705-8da4-0a54094ddba7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:24.972714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:24.973835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:24.974125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:24.974406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] PATH_INFO: `/v3/projects/3748ea7dd8cc4b04b0a0e226a60f3f79/users/6ca93eab1bad465aad3c90db965fe659/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:24.991825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3748ea7dd8cc4b04b0a0e226a60f3f79, user_id=6ca93eab1bad465aad3c90db965fe659, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:24.994768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:25.082949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2777/5455] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:24 2021] PUT /identity/v3/projects/3748ea7dd8cc4b04b0a0e226a60f3f79/users/6ca93eab1bad465aad3c90db965fe659/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:25.191180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419bd9-8662-4b69-a41b-c9eaab81cb56 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:25.191523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419bd9-8662-4b69-a41b-c9eaab81cb56 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:25.191809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419bd9-8662-4b69-a41b-c9eaab81cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:25.231839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-01419bd9-8662-4b69-a41b-c9eaab81cb56 None None] MFA Rules not processed for user `6ca93eab1bad465aad3c90db965fe659`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:25.233556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-01419bd9-8662-4b69-a41b-c9eaab81cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:25.329932 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2679/5456] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:25 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:25.330429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:25.473193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459dd0d-cd69-4bf1-ac1c-dd444e163e26 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:25.485157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:25.490193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:25.490734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:25.491190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:25.494683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:25.500739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:25.640511 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2778/5457] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:25 2021] POST /identity/v3/projects => generated 367 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:25.644641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419bd9-8662-4b69-a41b-c9eaab81cb56 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:25.663897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419bd9-8662-4b69-a41b-c9eaab81cb56 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:25.779263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:25.780184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:25.780486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:25.780818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:25.781821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:25.784238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:25.884999 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2680/5458] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:25 2021] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:25.886334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:25.898507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e395b-28cb-4ca0-be9a-f882c00090a0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:25.903962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:25.904843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:25.905302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:25.905679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:25.906550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:25.908760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:25.928228 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2779/5459] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:25 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:25.929702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:25.953198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c866-1b66-4b62-bee8-5cb6b15da405 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:25.960061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:25.961431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:25.961914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:25.962396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] PATH_INFO: `/v3/projects/9708fb097a7849e0b167e061b9a58ab9/users/e24a8b5c777e4039899bcd1e9e0f5d70/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:25.988195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9708fb097a7849e0b167e061b9a58ab9, user_id=e24a8b5c777e4039899bcd1e9e0f5d70, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:25.992598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:26.081671 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2681/5460] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:25 2021] PUT /identity/v3/projects/9708fb097a7849e0b167e061b9a58ab9/users/e24a8b5c777e4039899bcd1e9e0f5d70/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:26.087305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:26.142745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ebb87-1ec2-428e-bb6e-7e0e9d727823 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:26.247572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bf561-d2ce-40f6-b1e1-0cd303de042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:26.248620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf561-d2ce-40f6-b1e1-0cd303de042e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:26.249224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf561-d2ce-40f6-b1e1-0cd303de042e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:26.255170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf561-d2ce-40f6-b1e1-0cd303de042e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:26.255170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bf561-d2ce-40f6-b1e1-0cd303de042e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:26.255170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bf561-d2ce-40f6-b1e1-0cd303de042e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:26.266602 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2780/5461] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:26 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:26.271006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:26.283371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaeca1-5c1c-4f1b-8eb1-a394b8c80379 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:26.303761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:26.305043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:26.305331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:26.305603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] PATH_INFO: `/v3/projects/9708fb097a7849e0b167e061b9a58ab9/users/e24a8b5c777e4039899bcd1e9e0f5d70/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:26.309920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9708fb097a7849e0b167e061b9a58ab9, user_id=e24a8b5c777e4039899bcd1e9e0f5d70, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:26.313323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:26.343723 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2682/5462] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:26 2021] PUT /identity/v3/projects/9708fb097a7849e0b167e061b9a58ab9/users/e24a8b5c777e4039899bcd1e9e0f5d70/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:26.350846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a962-1a8e-4ed1-a08c-4d0808dd7221 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:26.351136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a962-1a8e-4ed1-a08c-4d0808dd7221 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:26.351411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a962-1a8e-4ed1-a08c-4d0808dd7221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:26.401448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b945a962-1a8e-4ed1-a08c-4d0808dd7221 None None] MFA Rules not processed for user `e24a8b5c777e4039899bcd1e9e0f5d70`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:26.404608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b945a962-1a8e-4ed1-a08c-4d0808dd7221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:26.507874 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2781/5463] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:26 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:26.509481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:26.521298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39ba50-053a-4f79-b508-654f79765cf6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:26.526764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:26.527881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:26.527881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:26.529467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:26.530171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:26.538501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:26.736525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a962-1a8e-4ed1-a08c-4d0808dd7221 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:26.738407 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2683/5464] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:26 2021] POST /identity/v3/projects => generated 359 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:26.749262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a962-1a8e-4ed1-a08c-4d0808dd7221 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:26.898674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:26.899492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:26.899712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:26.900519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:26.901287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:26.907518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:27.032746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2782/5465] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:26 2021] POST /identity/v3/users => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:27.036589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:27.047671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25db5-3b7d-46f7-8e27-0ac92f5eed83 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:27.053477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:27.055253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:27.055747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:27.056090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/405aec6db8b0445bb6df9793e608ba9a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:27.079246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:get_user(user_id=405aec6db8b0445bb6df9793e608ba9a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:27.084483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:27.084483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2684/5466] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:26:27 2021] GET /identity/v3/users/405aec6db8b0445bb6df9793e608ba9a => generated 373 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:27.088499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:27.109549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498632-049d-4910-8d34-0cf1039064a4 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:27.115636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:27.116821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:27.117790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:27.118540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/405aec6db8b0445bb6df9793e608ba9a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:27.138692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_user(user_id=405aec6db8b0445bb6df9793e608ba9a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:27.141017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:27.301731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405aec6db8b0445bb6df9793e608ba9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:27.311454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405aec6db8b0445bb6df9793e608ba9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:27.335752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405aec6db8b0445bb6df9793e608ba9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:27.337222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405aec6db8b0445bb6df9793e608ba9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:27.421739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405aec6db8b0445bb6df9793e608ba9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:27.443307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:27.447171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:27.451266 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2783/5467] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:27 2021] DELETE /identity/v3/users/405aec6db8b0445bb6df9793e608ba9a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:27.494142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f9072-3fd7-4629-ae69-fd398882bebb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:27.627975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:27.632650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:27.633217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:27.633743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/4c74e8555c2f46cbadf1e292c2f940bf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:27.635385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c74e8555c2f46cbadf1e292c2f940bf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:27.637731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:27.888795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c74e8555c2f46cbadf1e292c2f940bf', 'request_id': 'req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:27.916608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c74e8555c2f46cbadf1e292c2f940bf', 'request_id': 'req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:27.942668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:27.951564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:28.000598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c74e8555c2f46cbadf1e292c2f940bf', 'request_id': 'req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.022450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] The token cache is being invalidate because project 4c74e8555c2f46cbadf1e292c2f940bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:28.022747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.023705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.027981 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2685/5468] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:27 2021] DELETE /identity/v3/projects/4c74e8555c2f46cbadf1e292c2f940bf => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:28.057754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:28.062888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:28.136726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9ca1d-3f46-4028-a580-ec369d341437 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:28.176811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1a9ad-28b5-4ea6-ac76-3579b3de92f8 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:28.193832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:28.194787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:28.196933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:28.196933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:28.196933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:28.198783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:28.216285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:28.217946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:28.218376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:28.218902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] PATH_INFO: `/v3/users/7fafe1898f1b4b40adf4ff7a1de2a06f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:28.222673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fafe1898f1b4b40adf4ff7a1de2a06f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:28.225953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:28.335104 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2686/5469] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:28 2021] POST /identity/v3/projects => generated 358 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:28.341815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:28.484236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fafe1898f1b4b40adf4ff7a1de2a06f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.538890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fafe1898f1b4b40adf4ff7a1de2a06f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.603893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b24fc-bdee-4e34-a0fe-5f2e88b6aadb tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:28.605790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fafe1898f1b4b40adf4ff7a1de2a06f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.610032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fafe1898f1b4b40adf4ff7a1de2a06f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.623960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:28.624732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:28.625048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:28.625328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:28.626155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:28.638086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:28.701092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7a7eabac-be50-4182-aab8-cfc72df375fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fafe1898f1b4b40adf4ff7a1de2a06f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:28.708065 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2784/5470] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:27 2021] DELETE /identity/v3/users/7fafe1898f1b4b40adf4ff7a1de2a06f => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:28.712849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:28.713182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:28.713461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:28.753449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2687/5471] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:28 2021] POST /identity/v3/users => generated 414 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:28.763605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:28.767293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:28.770254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:28.771020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:28.813045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2c3f-884e-4bef-98ea-c67afa8117e5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:28.901713 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2785/5472] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:28.947004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:28.949455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:28.954807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:28.959553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:28.959553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:28.959553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:28.959553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:28.961019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:29.062946 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2688/5473] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:26:28 2021] POST /identity/v3/roles => generated 239 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:29.063070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd82f32-23cb-4431-b1d6-393175cbb077 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:29.063751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:29.077479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:29.077479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:29.077479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:29.077479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:29.080541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b132fc2-e923-4ffa-ba34-2d3d87448508 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:29.101172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:29.102186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:29.104635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:29.105075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/2700557ceed34f97bc3ff57aba8b4d1a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:29.105247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:29.111388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:29.144555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:get_user(user_id=2700557ceed34f97bc3ff57aba8b4d1a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:29.150218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:29.154852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2786/5474] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:29.159643 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2689/5475] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:26:29 2021] GET /identity/v3/users/2700557ceed34f97bc3ff57aba8b4d1a => generated 414 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:29.161598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:29.195453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b195edf-2db5-4524-9703-f627d02d6ac2 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:29.202271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:29.208356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:29.209099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:29.209607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:29.225831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:get_role(role_id=66eb09a0b1bd4e91b73b8a0f1deb28d5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:29.228140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:29.236645 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2787/5476] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:26:29 2021] GET /identity/v3/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5 => generated 239 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:26:29.240741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:29.263156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff34d3d-e28c-42bd-9cb7-533a948a94c3 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:29.279683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:29.280040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:29.280286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:29.280558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:29.281291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:29.283490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:29.433225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2690/5477] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:29 2021] POST /identity/v3/projects => generated 360 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:29.434727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:29.457247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb0d8-b07d-46c6-aa71-e4d82b8d5725 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:29.605861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:29.607160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:29.607710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:29.608271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/dc5ef460cee94130897711e62fb73dc0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:29.610776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:get_project(project_id=dc5ef460cee94130897711e62fb73dc0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:29.617411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:29.619777 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2788/5478] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:26:29 2021] GET /identity/v3/projects/dc5ef460cee94130897711e62fb73dc0 => generated 360 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:29.626385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:29.646546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb43e-bff4-468f-90a0-92f0f84116f0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:29.661965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:29.663283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:29.663651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:29.664006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/dc5ef460cee94130897711e62fb73dc0/users/2700557ceed34f97bc3ff57aba8b4d1a/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:29.681829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dc5ef460cee94130897711e62fb73dc0, user_id=2700557ceed34f97bc3ff57aba8b4d1a, role_id=66eb09a0b1bd4e91b73b8a0f1deb28d5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:29.688075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:29.789916 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2691/5479] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:29 2021] PUT /identity/v3/projects/dc5ef460cee94130897711e62fb73dc0/users/2700557ceed34f97bc3ff57aba8b4d1a/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:29.797420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:29.814335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd286ecd-1da1-4de4-af25-d8fe9b8a818a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:29.931089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:29.931932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:29.932320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:29.932837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:29.933741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:29.935976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:30.099792 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2789/5480] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:29 2021] POST /identity/v3/projects => generated 359 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:30.104221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:30.121788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5bb94-eb6b-4e3e-a6c1-8d05c124f6c7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:30.248839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:30.251242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:30.251808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:30.252824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/f91d5e3a34e0403d8ae52bd13386f154` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:30.256532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:get_project(project_id=f91d5e3a34e0403d8ae52bd13386f154)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:30.266135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:30.273584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:30.290074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c673d-a948-4345-8d48-fb42b43dfdd5 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:30.304845 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2692/5481] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:26:30 2021] GET /identity/v3/projects/f91d5e3a34e0403d8ae52bd13386f154 => generated 359 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:30.306177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:30.307286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:30.307831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:30.308371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/f91d5e3a34e0403d8ae52bd13386f154/users/2700557ceed34f97bc3ff57aba8b4d1a/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:30.315210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f91d5e3a34e0403d8ae52bd13386f154, user_id=2700557ceed34f97bc3ff57aba8b4d1a, role_id=66eb09a0b1bd4e91b73b8a0f1deb28d5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:30.319626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:30.402753 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2790/5482] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:30 2021] PUT /identity/v3/projects/f91d5e3a34e0403d8ae52bd13386f154/users/2700557ceed34f97bc3ff57aba8b4d1a/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:30.408202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:30.430563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5c49b-f6ac-4ffe-8eca-12c98cef385a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:30.615043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:30.616299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:30.616990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:30.617518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/2700557ceed34f97bc3ff57aba8b4d1a/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:30.619174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=2700557ceed34f97bc3ff57aba8b4d1a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:30.621843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:30.694866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:30.699687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2693/5483] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:26:30 2021] GET /identity/v3/users/2700557ceed34f97bc3ff57aba8b4d1a/projects => generated 843 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:30.707231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a1a4f-8e1c-49b3-84c7-48e26be2621b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:30.713340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:30.714964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:30.715250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:30.715863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/f91d5e3a34e0403d8ae52bd13386f154` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:30.717888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f91d5e3a34e0403d8ae52bd13386f154)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:30.720616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:30.731610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:30.733759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:30.932202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b748c2-486b-4370-b9fc-0b09d9f0f81c tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:30.955340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:30.963396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:30.963396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:30.963396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] PATH_INFO: `/v3/projects/3075932236c24ad8974bea0414dd1507` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:30.972305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3075932236c24ad8974bea0414dd1507)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:30.972305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:31.001573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91d5e3a34e0403d8ae52bd13386f154', 'request_id': 'req-be022180-faf5-4211-b16b-db0286f333ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.077863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91d5e3a34e0403d8ae52bd13386f154', 'request_id': 'req-be022180-faf5-4211-b16b-db0286f333ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.084959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91d5e3a34e0403d8ae52bd13386f154', 'request_id': 'req-be022180-faf5-4211-b16b-db0286f333ba'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.119162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] The token cache is being invalidate because project f91d5e3a34e0403d8ae52bd13386f154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:31.121247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.123368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.130553 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2791/5484] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:30 2021] DELETE /identity/v3/projects/f91d5e3a34e0403d8ae52bd13386f154 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:31.133053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:31.136784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:31.167556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3075932236c24ad8974bea0414dd1507', 'request_id': 'req-243a1e9f-7f27-40be-9e5b-194d01aa8438'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.197971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3075932236c24ad8974bea0414dd1507', 'request_id': 'req-243a1e9f-7f27-40be-9e5b-194d01aa8438'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.263053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3075932236c24ad8974bea0414dd1507', 'request_id': 'req-243a1e9f-7f27-40be-9e5b-194d01aa8438'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.273986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be022180-faf5-4211-b16b-db0286f333ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:31.295470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] The token cache is being invalidate because project 3075932236c24ad8974bea0414dd1507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:31.299549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.299549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.303354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2694/5485] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:30 2021] DELETE /identity/v3/projects/3075932236c24ad8974bea0414dd1507 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:31.307213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:31.311933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:31.374026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:31.375192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:31.375725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:31.376230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] PATH_INFO: `/v3/users/e1915a5223074263ae66c1964ca003f4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:31.378617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1915a5223074263ae66c1964ca003f4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:31.380801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:31.468964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a1e9f-7f27-40be-9e5b-194d01aa8438 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:31.476416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:31.477716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:31.478180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:31.478622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/dc5ef460cee94130897711e62fb73dc0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:31.480249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dc5ef460cee94130897711e62fb73dc0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:31.482530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:31.739442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5ef460cee94130897711e62fb73dc0', 'request_id': 'req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.750387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5ef460cee94130897711e62fb73dc0', 'request_id': 'req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.837440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1915a5223074263ae66c1964ca003f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.850502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1915a5223074263ae66c1964ca003f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.864439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5ef460cee94130897711e62fb73dc0', 'request_id': 'req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.879731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1915a5223074263ae66c1964ca003f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.880649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1915a5223074263ae66c1964ca003f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.891184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] The token cache is being invalidate because project dc5ef460cee94130897711e62fb73dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:31.891772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.893461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1c4aaa8d-55d7-4a0f-bf3b-a544a409884b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.895314 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2695/5486] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:31 2021] DELETE /identity/v3/projects/dc5ef460cee94130897711e62fb73dc0 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:31.898280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bc21-f629-44ea-8df5-40d94cf585ec None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:31.899863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bc21-f629-44ea-8df5-40d94cf585ec None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:31.901251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bc21-f629-44ea-8df5-40d94cf585ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:31.927002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-69c8bc21-f629-44ea-8df5-40d94cf585ec None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:31.931677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-69c8bc21-f629-44ea-8df5-40d94cf585ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:31.971625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1915a5223074263ae66c1964ca003f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:31.980303 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2792/5487] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:31 2021] DELETE /identity/v3/users/e1915a5223074263ae66c1964ca003f4 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:31.981459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:31.982946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:32.025902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2696/5488] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:32.034083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65643001-cb64-4f54-8c47-6764831dbdb9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.034669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65643001-cb64-4f54-8c47-6764831dbdb9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.035163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65643001-cb64-4f54-8c47-6764831dbdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.093509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-65643001-cb64-4f54-8c47-6764831dbdb9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:32.096042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-65643001-cb64-4f54-8c47-6764831dbdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:32.140014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc4e15-4633-4635-99ab-abaaa4cdedec admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:32.145489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:32.146348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.146630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.146905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.148713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_role(role_id=66eb09a0b1bd4e91b73b8a0f1deb28d5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:32.151047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:32.209929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2697/5489] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:32.219876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65643001-cb64-4f54-8c47-6764831dbdb9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:32.233391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65643001-cb64-4f54-8c47-6764831dbdb9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:32.239688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:32.240441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.240791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.241169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.241974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:32.242349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:32.244116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:32.267528 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2698/5490] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:32.269347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:32.280772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdb15-6eb5-413b-9064-e761e6c17e22 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:32.286584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invalidating the token cache because role 66eb09a0b1bd4e91b73b8a0f1deb28d5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:32.287353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:32.288228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.288363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.288730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.289237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.289807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.290231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:32.292526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:32.293413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2793/5491] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:31 2021] DELETE /identity/v3/roles/66eb09a0b1bd4e91b73b8a0f1deb28d5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:32.297701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:32.299344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:32.407960 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2699/5492] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:32 2021] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:32.409630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:32.411842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:32.411983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a05dc-8dab-456d-a39d-fae0ee7e7de7 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:32.480141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:32.481140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.481420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.481715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/2700557ceed34f97bc3ff57aba8b4d1a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.483232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2700557ceed34f97bc3ff57aba8b4d1a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:32.486258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:32.506615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e17ee-4245-409c-9f05-4a937b97bcea admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:32.512385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:32.513594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.514066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.514555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.515471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:32.517747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:32.645955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2700557ceed34f97bc3ff57aba8b4d1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.655193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2700557ceed34f97bc3ff57aba8b4d1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.677617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2700557ceed34f97bc3ff57aba8b4d1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.678703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2700557ceed34f97bc3ff57aba8b4d1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.728176 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2700/5493] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:32 2021] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:32.729558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:32.732131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:32.746461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c462-e279-4c1f-9c74-af351003a129 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:32.751365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:32.752261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.752542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.753316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] PATH_INFO: `/v3/projects/5a8dd053b27a426f844ddb32e4f1d6f6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.754508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8dd053b27a426f844ddb32e4f1d6f6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:32.756399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:32.776839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2700557ceed34f97bc3ff57aba8b4d1a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.785760 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2794/5494] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:32 2021] DELETE /identity/v3/users/2700557ceed34f97bc3ff57aba8b4d1a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:32.786683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:32.788150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:32.864632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3e1c-1364-483f-a14a-de5c99b850c1 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:32.871479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:32.872951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:32.873571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:32.877957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:32.877957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:32.877957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:32.892056 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2795/5495] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:32 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:32.893751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:32.897266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:32.942117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8dd053b27a426f844ddb32e4f1d6f6', 'request_id': 'req-5e5b9776-1246-40ea-bf8e-5b3110017d5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.955076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8dd053b27a426f844ddb32e4f1d6f6', 'request_id': 'req-5e5b9776-1246-40ea-bf8e-5b3110017d5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:32.986186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4888a2-85a3-4586-8dc5-5acf9e5e1658 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.046360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.047236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.047519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.047795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/7b32c1f34c524019808deae5eaaa3c8c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.049915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7b32c1f34c524019808deae5eaaa3c8c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.057661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:33.068832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8dd053b27a426f844ddb32e4f1d6f6', 'request_id': 'req-5e5b9776-1246-40ea-bf8e-5b3110017d5d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.103503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] The token cache is being invalidate because project 5a8dd053b27a426f844ddb32e4f1d6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:33.103847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.104681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.110406 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2701/5496] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:32 2021] DELETE /identity/v3/projects/5a8dd053b27a426f844ddb32e4f1d6f6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:33.110406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.110406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.210436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b32c1f34c524019808deae5eaaa3c8c', 'request_id': 'req-e2a1dd68-df19-41c4-bb57-d7994df0e368'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.294752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b9776-1246-40ea-bf8e-5b3110017d5d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.365350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a1c42-8290-40ce-946c-a6c91db7873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.366040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a1c42-8290-40ce-946c-a6c91db7873b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.366291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b32c1f34c524019808deae5eaaa3c8c', 'request_id': 'req-e2a1dd68-df19-41c4-bb57-d7994df0e368'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.366800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a1c42-8290-40ce-946c-a6c91db7873b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.366800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a1c42-8290-40ce-946c-a6c91db7873b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.367323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a1c42-8290-40ce-946c-a6c91db7873b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.368956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a1c42-8290-40ce-946c-a6c91db7873b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:33.376447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b32c1f34c524019808deae5eaaa3c8c', 'request_id': 'req-e2a1dd68-df19-41c4-bb57-d7994df0e368'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.385291 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2702/5497] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:33 2021] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:33.389905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] The token cache is being invalidate because project 7b32c1f34c524019808deae5eaaa3c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:33.390103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.390264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.390539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.390735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.391696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.395578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2796/5498] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:32 2021] DELETE /identity/v3/projects/7b32c1f34c524019808deae5eaaa3c8c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:33.401804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.401804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.414546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:33.415831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.418943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1dd68-df19-41c4-bb57-d7994df0e368 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.428469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e7fff-8024-4555-8935-f6b41ceee482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.429344 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2703/5499] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:33.431116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.432440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.436274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e7fff-8024-4555-8935-f6b41ceee482 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.436676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e7fff-8024-4555-8935-f6b41ceee482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.437251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e7fff-8024-4555-8935-f6b41ceee482 admin admin] PATH_INFO: `/v3/projects/1a30408bfc1c43ddad1910ff6dced273/users/d3e5ee346c3441fc921bf4c5fde1ef4b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.456508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e7fff-8024-4555-8935-f6b41ceee482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a30408bfc1c43ddad1910ff6dced273, user_id=d3e5ee346c3441fc921bf4c5fde1ef4b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.460001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e7fff-8024-4555-8935-f6b41ceee482 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:33.514428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fc502-9552-4d84-94a1-f63d1aa16f6d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.523155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.524423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.525019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.528160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/6ca93eab1bad465aad3c90db965fe659` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.528160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:update_user(user_id=6ca93eab1bad465aad3c90db965fe659)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.528160 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:26:33.528160 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:26:33.528160 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:26:33.528692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2797/5500] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:33 2021] PUT /identity/v3/projects/1a30408bfc1c43ddad1910ff6dced273/users/d3e5ee346c3441fc921bf4c5fde1ef4b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:33.530357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434d47-17c6-4e24-992c-f0e8dec8b7f9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.530647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434d47-17c6-4e24-992c-f0e8dec8b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.530924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a434d47-17c6-4e24-992c-f0e8dec8b7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.534737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:33.555341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5a434d47-17c6-4e24-992c-f0e8dec8b7f9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:33.556562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a434d47-17c6-4e24-992c-f0e8dec8b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.624282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.631849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2798/5501] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:33.631849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820836-8f04-4354-a92c-c85165646191 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.631849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820836-8f04-4354-a92c-c85165646191 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.631849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820836-8f04-4354-a92c-c85165646191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.660326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f0820836-8f04-4354-a92c-c85165646191 None None] MFA Rules not processed for user `d3e5ee346c3441fc921bf4c5fde1ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:33.661556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f0820836-8f04-4354-a92c-c85165646191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.680578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invalidating the token cache because user 6ca93eab1bad465aad3c90db965fe659 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:33.681006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.681786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:33.686819 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2704/5502] 10.222.0.32 () {60 vars in 1242 bytes} [Sat Dec 25 21:26:33 2021] PATCH /identity/v3/users/6ca93eab1bad465aad3c90db965fe659 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:33.686819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.686819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.700994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27483-b6aa-4e61-85d6-a588d0efb210 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.707248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2ff9-effa-4676-921b-ab8e9f5ea010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.708012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2ff9-effa-4676-921b-ab8e9f5ea010 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.708364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2ff9-effa-4676-921b-ab8e9f5ea010 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.708698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2ff9-effa-4676-921b-ab8e9f5ea010 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.710069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2ff9-effa-4676-921b-ab8e9f5ea010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:33.710069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2ff9-effa-4676-921b-ab8e9f5ea010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.712164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2ff9-effa-4676-921b-ab8e9f5ea010 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:33.730255 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2705/5503] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:33.730255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.730255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.730255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.738245 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2799/5504] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:33 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:33.738245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0820836-8f04-4354-a92c-c85165646191 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.749312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0820836-8f04-4354-a92c-c85165646191 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.754609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.755505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.755683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.756032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.756800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.759018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:33.770207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] MFA Rules not processed for user `6ca93eab1bad465aad3c90db965fe659`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:33.771427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.775785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2706/5505] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:33 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:26:33.778399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.782727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.842125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552807c0-9120-44bb-b0f4-51f18aaf5f6a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.845853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.846497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.846778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.847053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.855527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.856974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:33.866610 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2707/5506] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:33 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:33.867407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.868754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:33.892474 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2800/5507] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:33 2021] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:33.894425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:33.964606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99bf11-8b74-4240-8640-e57ae5b480ca service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.984607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ddfc4-0d94-4b23-b3a8-d9ea2f15aef6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:33.990889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:33.991571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:33.991852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:33.992130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:33.993635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:33.995909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.049919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.051288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.051988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.052430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/6ca93eab1bad465aad3c90db965fe659` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.054208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:update_user(user_id=6ca93eab1bad465aad3c90db965fe659)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.056482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.101612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2801/5508] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:33 2021] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:34.102514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:34.124835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4ba2f-c1d3-4417-ae49-75b211af84d0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:34.139517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.141458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.141458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.141458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.144371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.149997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.161160 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2802/5509] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:34.164280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:34.178670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dfa96-d561-4bbd-b5dd-c98177a2b198 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:34.184778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.185982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.186440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.186945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.188031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.190595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.209470 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2803/5510] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:34 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:34.210858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:34.221343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:34.222349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2cb86-288f-4911-ba8b-2f833d9b8383 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:34.229164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cb8f7-be14-4b56-87a2-5459f3b151f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.230151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb8f7-be14-4b56-87a2-5459f3b151f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.230532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb8f7-be14-4b56-87a2-5459f3b151f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.230905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cb8f7-be14-4b56-87a2-5459f3b151f0 admin admin] PATH_INFO: `/v3/projects/50c82fdad4ce4f1baa2fadc462065246/users/2583d9468356444b832d5701712f6f2a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.249073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cb8f7-be14-4b56-87a2-5459f3b151f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c82fdad4ce4f1baa2fadc462065246, user_id=2583d9468356444b832d5701712f6f2a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.252977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cb8f7-be14-4b56-87a2-5459f3b151f0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.308378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invalidating the token cache because user 6ca93eab1bad465aad3c90db965fe659 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:34.309994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:34.309994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:34.312622 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2708/5511] 10.222.0.32 () {60 vars in 1242 bytes} [Sat Dec 25 21:26:33 2021] PATCH /identity/v3/users/6ca93eab1bad465aad3c90db965fe659 => generated 297 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:34.323155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:34.325791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:34.335308 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2804/5512] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:34 2021] PUT /identity/v3/projects/50c82fdad4ce4f1baa2fadc462065246/users/2583d9468356444b832d5701712f6f2a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:34.341618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.342325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.342888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.349612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1910b-334a-4d01-a920-d77fc90477ea tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:34.366198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:34.367652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:34.431451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.432578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.433216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.433597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/6ca93eab1bad465aad3c90db965fe659` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.451338 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2805/5513] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:34.462497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:update_user(user_id=6ca93eab1bad465aad3c90db965fe659)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.464686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.477063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:34.484407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:34.572993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8be1-9f5e-4b91-90ee-f81b62bce7bf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:34.582512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b623f8-465e-40fc-bd1d-07b8b11954be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.583188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b623f8-465e-40fc-bd1d-07b8b11954be service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.583470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b623f8-465e-40fc-bd1d-07b8b11954be service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.584103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b623f8-465e-40fc-bd1d-07b8b11954be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.599413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b623f8-465e-40fc-bd1d-07b8b11954be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.601158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b623f8-465e-40fc-bd1d-07b8b11954be service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.616645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:34.628731 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2806/5514] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:34.708942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invalidating the token cache because user 6ca93eab1bad465aad3c90db965fe659 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:34.709258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:34.709978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:34.714820 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2709/5515] 10.222.0.32 () {60 vars in 1242 bytes} [Sat Dec 25 21:26:34 2021] PATCH /identity/v3/users/6ca93eab1bad465aad3c90db965fe659 => generated 297 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:34.716795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.717135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.717521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.751205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] MFA Rules not processed for user `6ca93eab1bad465aad3c90db965fe659`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:34.752431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:34.755569 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2807/5516] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:34 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:26:34.759886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:34.761376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:34.774468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd588-a1d2-4664-a590-fbda41ce668b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:34.779830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.780898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.781290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.781666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/6ca93eab1bad465aad3c90db965fe659` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.783857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:update_user(user_id=6ca93eab1bad465aad3c90db965fe659)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.786003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.823577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:34.826552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:34.843886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925e5a-abbd-407d-a41f-335c630df302 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:34.850633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:34.851654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:34.852030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:34.852397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] PATH_INFO: `/v3/users/59433cd15fe14962977cec63dd00cf00` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:34.853863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59433cd15fe14962977cec63dd00cf00)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:34.859420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:34.891911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.039932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invalidating the token cache because user 6ca93eab1bad465aad3c90db965fe659 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:35.040281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.040983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.047354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2710/5517] 10.222.0.32 () {60 vars in 1242 bytes} [Sat Dec 25 21:26:34 2021] PATCH /identity/v3/users/6ca93eab1bad465aad3c90db965fe659 => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:35.049356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:35.050731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:35.065346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b1b08-ef05-4924-8d3f-a96e1a56d94d tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:35.071386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:35.072526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:35.072526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:35.074237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:35.074237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:35.076143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:35.163442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59433cd15fe14962977cec63dd00cf00'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.175906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59433cd15fe14962977cec63dd00cf00'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.199760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59433cd15fe14962977cec63dd00cf00'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.202095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59433cd15fe14962977cec63dd00cf00'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.208547 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2711/5518] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:26:35 2021] POST /identity/v3/users => generated 264 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:35.219780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:35.231694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b404b23-0585-40ca-a423-f3de9c19b6c0 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:35.237182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eecea-12f7-40da-af9c-a69922536820 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:35.238364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eecea-12f7-40da-af9c-a69922536820 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:35.238856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eecea-12f7-40da-af9c-a69922536820 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:35.239194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eecea-12f7-40da-af9c-a69922536820 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/778323e394194cb1a625254ae4ab6cf3/password` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:35.286691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ecba5da-ac43-4d7b-a3fe-2a0b3e09466e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59433cd15fe14962977cec63dd00cf00'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.299676 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2808/5519] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:34 2021] DELETE /identity/v3/users/59433cd15fe14962977cec63dd00cf00 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:35.301554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:35.302250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:35.303532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:35.362192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:35.364856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:35.451623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-407eecea-12f7-40da-af9c-a69922536820 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '778323e394194cb1a625254ae4ab6cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:35.467941 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2809/5520] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:35.505821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:35.507643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:35.510102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2712/5521] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:26:35 2021] POST /identity/v3/users/778323e394194cb1a625254ae4ab6cf3/password => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:35.578938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355a7e5-0dfa-46e0-920c-1125d3766bfb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:35.583348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df3ea-600c-4a1d-9c3a-f8082e99b2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:35.584282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df3ea-600c-4a1d-9c3a-f8082e99b2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:35.584787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df3ea-600c-4a1d-9c3a-f8082e99b2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:35.585329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df3ea-600c-4a1d-9c3a-f8082e99b2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:35.598125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5df3ea-600c-4a1d-9c3a-f8082e99b2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:35.598778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5df3ea-600c-4a1d-9c3a-f8082e99b2e0 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:35.611316 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2810/5522] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:35.758594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:35.758876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:35.759176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:35.807838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] MFA Rules not processed for user `2583d9468356444b832d5701712f6f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:35.809554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:35.899092 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2713/5523] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:35.911586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:35.912031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:35.912676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:35.939156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] MFA Rules not processed for user `2583d9468356444b832d5701712f6f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:35.941233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:35.950225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2811/5524] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:35.967636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:35.967636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.009358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.010880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.025273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a3ed-f11e-4237-9de8-13f1be247d84 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.030569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.036389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.036389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.036389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] PATH_INFO: `/v3/projects/de2e73a0bdf847d09859985d18e2302e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.036389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2e73a0bdf847d09859985d18e2302e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.036389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.085670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cb8a6-5af9-43ba-9bbc-94ae5ba6a2ab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.091780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed1fb3-db7f-42d4-8e79-97bcdf687307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.092414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1fb3-db7f-42d4-8e79-97bcdf687307 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.092700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1fb3-db7f-42d4-8e79-97bcdf687307 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.093004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1fb3-db7f-42d4-8e79-97bcdf687307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.102838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed1fb3-db7f-42d4-8e79-97bcdf687307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.104576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed1fb3-db7f-42d4-8e79-97bcdf687307 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.115620 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2714/5525] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:35 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:36.165540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2e73a0bdf847d09859985d18e2302e', 'request_id': 'req-679d11ed-ef4b-4542-8b67-e8946fd6d80a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.257545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2e73a0bdf847d09859985d18e2302e', 'request_id': 'req-679d11ed-ef4b-4542-8b67-e8946fd6d80a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.264284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2e73a0bdf847d09859985d18e2302e', 'request_id': 'req-679d11ed-ef4b-4542-8b67-e8946fd6d80a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.275463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] The token cache is being invalidate because project de2e73a0bdf847d09859985d18e2302e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:36.275748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.276407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-679d11ed-ef4b-4542-8b67-e8946fd6d80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.277983 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2812/5526] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:36 2021] DELETE /identity/v3/projects/de2e73a0bdf847d09859985d18e2302e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:36.284953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00e647-b03e-4f72-91c7-b076f0ddc25c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.285725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00e647-b03e-4f72-91c7-b076f0ddc25c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.285725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00e647-b03e-4f72-91c7-b076f0ddc25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.305125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2e00e647-b03e-4f72-91c7-b076f0ddc25c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:36.306535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2e00e647-b03e-4f72-91c7-b076f0ddc25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.372649 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2715/5527] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:36.376823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f374a-6f94-40e2-a5e1-64a99dc55613 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.377761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f374a-6f94-40e2-a5e1-64a99dc55613 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.380783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f374a-6f94-40e2-a5e1-64a99dc55613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.399351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f69f374a-6f94-40e2-a5e1-64a99dc55613 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:36.400586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f69f374a-6f94-40e2-a5e1-64a99dc55613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.409242 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2813/5528] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:36.413618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00e647-b03e-4f72-91c7-b076f0ddc25c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.424188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00e647-b03e-4f72-91c7-b076f0ddc25c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.429734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a3ed8-9817-4add-9e20-8282e9ba5f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.430657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a3ed8-9817-4add-9e20-8282e9ba5f69 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.431006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a3ed8-9817-4add-9e20-8282e9ba5f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.431349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a3ed8-9817-4add-9e20-8282e9ba5f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.432346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a3ed8-9817-4add-9e20-8282e9ba5f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:36.432648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a3ed8-9817-4add-9e20-8282e9ba5f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.434471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a3ed8-9817-4add-9e20-8282e9ba5f69 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.453083 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2716/5529] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:26:36.462953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f374a-6f94-40e2-a5e1-64a99dc55613 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.473922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f374a-6f94-40e2-a5e1-64a99dc55613 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.479024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.479692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.479971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.480248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.482126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.484105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.518508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.518508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.518508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.535777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] MFA Rules not processed for user `778323e394194cb1a625254ae4ab6cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:36.537070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.540316 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2717/5530] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:36 2021] POST /identity/v3/auth/tokens => generated 329 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Dec 25 21:26:36.544357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.545739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.616294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c39e1-9f49-4979-8056-a18dc9d74b34 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.624628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.625357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.625643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.625923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.632796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.635017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.636724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2814/5531] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:36 2021] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:36.642407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.649111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2718/5532] 10.222.0.32 () {56 vars in 1262 bytes} [Sat Dec 25 21:26:36 2021] GET /identity/v3/auth/tokens => generated 329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Dec 25 21:26:36.653095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.661415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70427-2d5c-41d2-b4eb-2d5de6012c22 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.712022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001a5c-5859-45e6-a521-15aa7ee3768c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.717034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.717924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.718335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.718850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.719658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.722345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.723291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.724477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.724764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.725075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/778323e394194cb1a625254ae4ab6cf3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.726346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_user(user_id=778323e394194cb1a625254ae4ab6cf3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.728249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.818045 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2815/5533] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:36 2021] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:36.822392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.834826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc1c31-2462-42e2-ae9f-4453d0599029 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.840525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.841553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.841838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.841969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778323e394194cb1a625254ae4ab6cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.842178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.843008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.845624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.849119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778323e394194cb1a625254ae4ab6cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.859013 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2816/5534] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:36.860744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.862230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778323e394194cb1a625254ae4ab6cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.863034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778323e394194cb1a625254ae4ab6cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.863902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778323e394194cb1a625254ae4ab6cf3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:36.871404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976f051-a633-427b-974e-03bf070d75d1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.876500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.877756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.878020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.878381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.879114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.880739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:36.899326 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2817/5535] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:36.903509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.906011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.920684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df36ee-d818-4bcf-a52d-2b9aa413e535 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:36.926548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ef8b-b2f2-4f25-a593-0721b75c1c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:36.927972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ef8b-b2f2-4f25-a593-0721b75c1c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:36.928316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ef8b-b2f2-4f25-a593-0721b75c1c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:36.928695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ef8b-b2f2-4f25-a593-0721b75c1c63 admin admin] PATH_INFO: `/v3/projects/596be925895b4ede995a5f893bdae840/users/870cef142a964d95b8866fb8857f0c84/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:36.936572 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2719/5536] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:36 2021] DELETE /identity/v3/users/778323e394194cb1a625254ae4ab6cf3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:36.938289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:36.940350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:36.955386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ef8b-b2f2-4f25-a593-0721b75c1c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596be925895b4ede995a5f893bdae840, user_id=870cef142a964d95b8866fb8857f0c84, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:36.959062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ef8b-b2f2-4f25-a593-0721b75c1c63 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.025335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a658c6-516b-4b0e-83c9-673e875d295b tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:37.030294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:37.030974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.031392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.031991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.032788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:37.044589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.069561 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2818/5537] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:36 2021] PUT /identity/v3/projects/596be925895b4ede995a5f893bdae840/users/870cef142a964d95b8866fb8857f0c84/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:37.079537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.079883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.080189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.115160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] MFA Rules not processed for user `870cef142a964d95b8866fb8857f0c84`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:37.116476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:37.161934 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2720/5538] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:36 2021] POST /identity/v3/users => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:37.163242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:37.175334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b294-d6fd-4c13-951e-ceec6349b8ba tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:37.200778 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2819/5539] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:37 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:37.219879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:37.223885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:37.251178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:37.252837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.253405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.253889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.254780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:37.257377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.316892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44341fbe-a2b5-46cf-a728-6af99c35ee04 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:37.322501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:37.323205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.326114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.326114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.336404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:37.338272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.349867 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2820/5540] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:37 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:37.399046 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2721/5541] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:37 2021] POST /identity/v3/projects => generated 360 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:37.404793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:37.424182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c741-b6b8-4289-91e3-c326629aef9b service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:37.525833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:37.527561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.527922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.528412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/adab6160eb6d4402a100a650e31b97bf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.554063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:update_user(user_id=adab6160eb6d4402a100a650e31b97bf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:37.555809 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:26:37.555809 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:26:37.555809 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:26:37.557323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.686880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:37.691509 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2821/5542] 10.222.0.32 () {60 vars in 1243 bytes} [Sat Dec 25 21:26:37 2021] PATCH /identity/v3/users/adab6160eb6d4402a100a650e31b97bf => generated 522 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:37.708641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a689ef-e7bb-4c66-9628-30ba9fd44fb2 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:37.717404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:37.718376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.719405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.719710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/adab6160eb6d4402a100a650e31b97bf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.738148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:get_user(user_id=adab6160eb6d4402a100a650e31b97bf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:37.740611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.750248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:37.750406 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2722/5543] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:26:37 2021] GET /identity/v3/users/adab6160eb6d4402a100a650e31b97bf => generated 388 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:37.758946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b010294-b1c8-41fb-890e-5ab4ad2dba8a tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:37.769068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:37.769951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.770233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.770507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/projects/130ac901395642b2862568d17e2357fa` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.772928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:37.775608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:37.786631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=130ac901395642b2862568d17e2357fa)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:37.789266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.857859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1bebc-afa3-4a62-9490-d85a1256afbc tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:37.871946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:37.874194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:37.874194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:37.874194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] PATH_INFO: `/v3/users/2583d9468356444b832d5701712f6f2a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:37.876843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2583d9468356444b832d5701712f6f2a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:37.899113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:37.937473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130ac901395642b2862568d17e2357fa', 'request_id': 'req-ba71a0f2-6587-4d48-bb73-8ed243e3d767'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.035286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130ac901395642b2862568d17e2357fa', 'request_id': 'req-ba71a0f2-6587-4d48-bb73-8ed243e3d767'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.045841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130ac901395642b2862568d17e2357fa', 'request_id': 'req-ba71a0f2-6587-4d48-bb73-8ed243e3d767'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.061010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] The token cache is being invalidate because project 130ac901395642b2862568d17e2357fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:38.068994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.068994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.068994 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2822/5544] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:37 2021] DELETE /identity/v3/projects/130ac901395642b2862568d17e2357fa => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:38.068994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:38.070071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:38.189118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a0f2-6587-4d48-bb73-8ed243e3d767 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:38.199825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a8b5c777e4039899bcd1e9e0f5d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9708fb097a7849e0b167e061b9a58ab9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:38.200067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2583d9468356444b832d5701712f6f2a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.201902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:38.202156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:38.205622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] PATH_INFO: `/v3/users/adab6160eb6d4402a100a650e31b97bf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:38.207760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorizing `identity:delete_user(user_id=adab6160eb6d4402a100a650e31b97bf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:38.214740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:38.216832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2583d9468356444b832d5701712f6f2a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.245764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2583d9468356444b832d5701712f6f2a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.247189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2583d9468356444b832d5701712f6f2a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.247980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2583d9468356444b832d5701712f6f2a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.351356 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2723/5545] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:37 2021] DELETE /identity/v3/users/2583d9468356444b832d5701712f6f2a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:38.399009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adab6160eb6d4402a100a650e31b97bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.411519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adab6160eb6d4402a100a650e31b97bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.494597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adab6160eb6d4402a100a650e31b97bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.494597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adab6160eb6d4402a100a650e31b97bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.579103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8c53425c-65f0-468a-ad36-50ef1ba60270 tempest-UsersV3TestJSON-1106544989 tempest-UsersV3TestJSON-1106544989-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adab6160eb6d4402a100a650e31b97bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:38.589462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2823/5546] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:38 2021] DELETE /identity/v3/users/adab6160eb6d4402a100a650e31b97bf => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:38.593878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:38.596120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:38.707841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08cf1a-10ea-48b5-860b-ce34656aeb9b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:38.823952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:38.825482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:38.825906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:38.826275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] PATH_INFO: `/v3/users/6ca93eab1bad465aad3c90db965fe659` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:38.857575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca93eab1bad465aad3c90db965fe659)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:38.861387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:39.157832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.174626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.208865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.212388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.213597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca93eab1bad465aad3c90db965fe659'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.339449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2724/5547] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:38 2021] DELETE /identity/v3/users/6ca93eab1bad465aad3c90db965fe659 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:39.351688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:39.357013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:39.357013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:39.382050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:39.390117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:39.391846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:39.396126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:39.541414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2824/5548] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:39.577659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395e98-ebcf-49be-b4df-122756d05c11 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:39.584621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:39.585893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:39.586296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:39.586672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] PATH_INFO: `/v3/projects/50c82fdad4ce4f1baa2fadc462065246` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:39.588849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c82fdad4ce4f1baa2fadc462065246)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:39.591702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:39.593237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:39.601595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:39.699220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4148f-8e2f-4f00-9d52-e837b305b46c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:39.715692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340781e0-780d-4c18-acce-c246120ca3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:39.717564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340781e0-780d-4c18-acce-c246120ca3de service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:39.718128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340781e0-780d-4c18-acce-c246120ca3de service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:39.718634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340781e0-780d-4c18-acce-c246120ca3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:39.741674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340781e0-780d-4c18-acce-c246120ca3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:39.743632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340781e0-780d-4c18-acce-c246120ca3de service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:39.766540 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2825/5549] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:26:39.780374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c82fdad4ce4f1baa2fadc462065246', 'request_id': 'req-a30ab784-61e7-46af-96d8-a6926da46e25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.804344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c82fdad4ce4f1baa2fadc462065246', 'request_id': 'req-a30ab784-61e7-46af-96d8-a6926da46e25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.959574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c82fdad4ce4f1baa2fadc462065246', 'request_id': 'req-a30ab784-61e7-46af-96d8-a6926da46e25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.985061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] The token cache is being invalidate because project 50c82fdad4ce4f1baa2fadc462065246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:39.985351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.988055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a30ab784-61e7-46af-96d8-a6926da46e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:39.990759 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2725/5550] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:39 2021] DELETE /identity/v3/projects/50c82fdad4ce4f1baa2fadc462065246 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:39.996940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527dcf-c16f-4d90-919c-ed1f8747c223 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:39.996940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527dcf-c16f-4d90-919c-ed1f8747c223 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:39.997337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527dcf-c16f-4d90-919c-ed1f8747c223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.018660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ba527dcf-c16f-4d90-919c-ed1f8747c223 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:40.020030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba527dcf-c16f-4d90-919c-ed1f8747c223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:40.116080 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2826/5551] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:40.118624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44274-ee81-4995-8da8-58402833702c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.119018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44274-ee81-4995-8da8-58402833702c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.119400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44274-ee81-4995-8da8-58402833702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.140411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2dc44274-ee81-4995-8da8-58402833702c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:40.141855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2dc44274-ee81-4995-8da8-58402833702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:40.157364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527dcf-c16f-4d90-919c-ed1f8747c223 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:40.167354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2726/5552] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:40.169413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527dcf-c16f-4d90-919c-ed1f8747c223 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:40.176014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:40.176906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.177296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.177678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.178592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:40.179038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:40.181797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:40.199747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44274-ee81-4995-8da8-58402833702c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:40.208945 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2827/5553] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:26:40.214245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44274-ee81-4995-8da8-58402833702c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:40.219596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:40.220554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.221012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.221404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.222233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:40.224438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:40.354266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:40.366442 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2727/5554] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:40 2021] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:40.371201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde2493-cff7-4490-a92c-58c0574af6a4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:40.513867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:40.514731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.515122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.515538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.518747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:40.522944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:40.670957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:40.671810 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2828/5555] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:40 2021] POST /identity/v3/users => generated 295 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:40.689656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3cf4d-9260-441c-9979-27b4a2303e72 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:40.704813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:40.705582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.705866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.706258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.713862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:40.713862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:40.731069 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2728/5556] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:40 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:40.735800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:40.751084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0be89-a482-4518-ac04-bd1e5a28c8fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:40.759609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:40.760428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.760987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.761394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.762248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:40.764380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:40.784828 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2829/5557] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:40 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:40.786216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:40.826485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7964-fa4c-4a91-a153-f6cf9da861f9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:40.842007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709339aa-7731-4f38-ac31-2204bf400cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:40.858726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709339aa-7731-4f38-ac31-2204bf400cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.863676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709339aa-7731-4f38-ac31-2204bf400cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.864203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709339aa-7731-4f38-ac31-2204bf400cdc admin admin] PATH_INFO: `/v3/projects/0560c323ec8e41b3bc05939e12e049d5/users/517838d2d4a942bfa8b332c767c60904/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.873959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:40.877073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:40.904707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2b5a-e405-469d-823a-9fdd69d74f6a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:40.926881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:40.928433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:40.931074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:40.933170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] PATH_INFO: `/v3/projects/3748ea7dd8cc4b04b0a0e226a60f3f79` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:40.935981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3748ea7dd8cc4b04b0a0e226a60f3f79)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:40.937307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709339aa-7731-4f38-ac31-2204bf400cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0560c323ec8e41b3bc05939e12e049d5, user_id=517838d2d4a942bfa8b332c767c60904, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:40.940445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:40.944037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709339aa-7731-4f38-ac31-2204bf400cdc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:41.063718 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2729/5558] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:40 2021] PUT /identity/v3/projects/0560c323ec8e41b3bc05939e12e049d5/users/517838d2d4a942bfa8b332c767c60904/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:41.071574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:41.071574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:41.071574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:41.119612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:41.120960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:41.190963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3748ea7dd8cc4b04b0a0e226a60f3f79', 'request_id': 'req-6417d6a9-942e-4fa9-940f-e82dc97d6bed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.256414 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2730/5559] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:41.291405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3748ea7dd8cc4b04b0a0e226a60f3f79', 'request_id': 'req-6417d6a9-942e-4fa9-940f-e82dc97d6bed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.301430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3748ea7dd8cc4b04b0a0e226a60f3f79', 'request_id': 'req-6417d6a9-942e-4fa9-940f-e82dc97d6bed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.301761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:41.303229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:41.332361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] The token cache is being invalidate because project 3748ea7dd8cc4b04b0a0e226a60f3f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:41.332664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.335421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.341217 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2830/5560] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:40 2021] DELETE /identity/v3/projects/3748ea7dd8cc4b04b0a0e226a60f3f79 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:41.342115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:41.344987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:41.437338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33413d1-2bdc-4a92-b61e-7590db537e0c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:41.497779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417d6a9-942e-4fa9-940f-e82dc97d6bed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:41.500002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:41.500806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:41.501269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:41.502227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:41.504670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:41.505319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:41.506860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:41.507273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:41.507556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] PATH_INFO: `/v3/users/e24a8b5c777e4039899bcd1e9e0f5d70` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:41.509121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24a8b5c777e4039899bcd1e9e0f5d70)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:41.511179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:41.523984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:41.526782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:41.541282 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2731/5561] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:41.811213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24a8b5c777e4039899bcd1e9e0f5d70'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.828977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24a8b5c777e4039899bcd1e9e0f5d70'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.857869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24a8b5c777e4039899bcd1e9e0f5d70'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.861043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24a8b5c777e4039899bcd1e9e0f5d70'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.931012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24a8b5c777e4039899bcd1e9e0f5d70'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:41.943359 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2831/5562] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:41 2021] DELETE /identity/v3/users/e24a8b5c777e4039899bcd1e9e0f5d70 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:43.209842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:43.231275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a041a60-e3b8-4056-96cd-612b4b0b950d service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:43.329312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:43.344549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:43.344549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:43.344549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] PATH_INFO: `/v3/projects/9708fb097a7849e0b167e061b9a58ab9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:43.344549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9708fb097a7849e0b167e061b9a58ab9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:43.344549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:43.415861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:43.421507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:43.443682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb24d7-6455-4eb1-8171-bb6cb569325f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:43.449374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:43.450716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:43.451337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:43.451782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] PATH_INFO: `/v3/users/5b0b101a0f70492f9670ce1e8e104c54` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:43.453277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0b101a0f70492f9670ce1e8e104c54)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:43.455431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:43.551676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9708fb097a7849e0b167e061b9a58ab9', 'request_id': 'req-99e4584f-0be9-44ff-b112-d392003bf2db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.559405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9708fb097a7849e0b167e061b9a58ab9', 'request_id': 'req-99e4584f-0be9-44ff-b112-d392003bf2db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.652600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9708fb097a7849e0b167e061b9a58ab9', 'request_id': 'req-99e4584f-0be9-44ff-b112-d392003bf2db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.675682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] The token cache is being invalidate because project 9708fb097a7849e0b167e061b9a58ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:43.675984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.677974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99e4584f-0be9-44ff-b112-d392003bf2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.684838 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2732/5563] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:43 2021] DELETE /identity/v3/projects/9708fb097a7849e0b167e061b9a58ab9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:43.687176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405593ca-b2a6-4be8-b5d1-2df33c274193 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:43.687937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405593ca-b2a6-4be8-b5d1-2df33c274193 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:43.688504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405593ca-b2a6-4be8-b5d1-2df33c274193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:43.717417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0b101a0f70492f9670ce1e8e104c54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.740324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0b101a0f70492f9670ce1e8e104c54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.743214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-405593ca-b2a6-4be8-b5d1-2df33c274193 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:43.752225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-405593ca-b2a6-4be8-b5d1-2df33c274193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:43.773643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0b101a0f70492f9670ce1e8e104c54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.774519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0b101a0f70492f9670ce1e8e104c54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.851669 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2733/5564] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:43.854382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5fc6c-da59-4e74-a64a-87f8a385fcf0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:43.854682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5fc6c-da59-4e74-a64a-87f8a385fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:43.856607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5fc6c-da59-4e74-a64a-87f8a385fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:43.906915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-efb5fc6c-da59-4e74-a64a-87f8a385fcf0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:43.909905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-efb5fc6c-da59-4e74-a64a-87f8a385fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:43.926244 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2734/5565] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:43.932088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5fc6c-da59-4e74-a64a-87f8a385fcf0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:43.951719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5b13653e-0188-4508-82ed-0bb6531ad5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0b101a0f70492f9670ce1e8e104c54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:43.961312 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2832/5566] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:43 2021] DELETE /identity/v3/users/5b0b101a0f70492f9670ce1e8e104c54 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:43.967819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:43.968118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:43.968555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:43.975752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5fc6c-da59-4e74-a64a-87f8a385fcf0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:44.006612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:44.009093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:44.080480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:44.082400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.082865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.083338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.084792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:44.085324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:44.088921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:44.108352 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2735/5567] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:44.112665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:44.117422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:44.129706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2833/5568] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:44.147058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:44.149681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:44.151961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94c4a5-78c8-4700-a267-af5187e62454 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:44.170244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:44.172257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.172884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.174042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.174172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:44.176199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:44.276699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9060ec-7556-493f-89bf-3ab60afc465c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:44.283510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:44.284619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.285138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.288905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.292373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2736/5569] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:44 2021] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:44.296340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:44.302647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:44.307957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:44.350240 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2834/5570] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:44.392380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55202a44-7ce2-45ba-b91a-cb2ccdae1965 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:44.400056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:44.401593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.402124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.403080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.404008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:44.407220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:44.505516 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2737/5571] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:44 2021] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:44.510834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:44.526670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b5e41-095d-4626-b759-047980550f66 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:44.533497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:44.538780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.538780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.538780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.538780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:44.538780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:44.552566 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2835/5572] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:44 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:44.556017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:44.567900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798c9b9-15c8-4e0c-95a5-b521aa496812 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:44.573740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf620a-26b4-466e-a80b-3af4d8908912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:44.574575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf620a-26b4-466e-a80b-3af4d8908912 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.575120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf620a-26b4-466e-a80b-3af4d8908912 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.575471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf620a-26b4-466e-a80b-3af4d8908912 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.576285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf620a-26b4-466e-a80b-3af4d8908912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:44.578028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf620a-26b4-466e-a80b-3af4d8908912 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:44.590025 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2738/5573] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:44 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:44.594306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:44.607633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b2919-7edc-4112-899c-9ee8984c151a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:44.614628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:44.616111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.616567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.617061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] PATH_INFO: `/v3/projects/1f75cbf0b709404db13ce82be430699d/users/1107247fd405466e9dd6775fb2db567a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.637429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f75cbf0b709404db13ce82be430699d, user_id=1107247fd405466e9dd6775fb2db567a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:44.640607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:44.757230 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2836/5574] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:44 2021] PUT /identity/v3/projects/1f75cbf0b709404db13ce82be430699d/users/1107247fd405466e9dd6775fb2db567a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:44.768411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077fabb-8845-48d0-a636-b00fda7ceda3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:44.768757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077fabb-8845-48d0-a636-b00fda7ceda3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:44.769073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077fabb-8845-48d0-a636-b00fda7ceda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:44.815658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a077fabb-8845-48d0-a636-b00fda7ceda3 None None] MFA Rules not processed for user `1107247fd405466e9dd6775fb2db567a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:44.817222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a077fabb-8845-48d0-a636-b00fda7ceda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:44.897300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:44.899609 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2739/5575] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:44 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:45.010628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ededb85-f894-490c-9733-00ae53df9374 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.016275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.017870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.018391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.019593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.021159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.023795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.149549 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2837/5576] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:44 2021] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:45.151103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077fabb-8845-48d0-a636-b00fda7ceda3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:45.163015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077fabb-8845-48d0-a636-b00fda7ceda3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.236812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.237858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.238242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.238607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.239571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.242239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.274536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:45.277923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:45.299518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7956c-b484-4564-83b1-8093645c60bd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.311251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.312136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.312416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.312923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] PATH_INFO: `/v3/projects/f8d8dbb7b1994728a7acb1d884aa30d6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.316564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d8dbb7b1994728a7acb1d884aa30d6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.319624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.351127 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2740/5577] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:45 2021] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:45.354663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:45.382740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c129-3d36-4b7b-9660-d030c376da46 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.389851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.390843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.391292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.391732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.393274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.398024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.417973 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2741/5578] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:45 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:45.428102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:45.443773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e34bdb-28a1-4eec-895b-eac4e19c36e5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.456483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.457465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.457753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.458029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] PATH_INFO: `/v3/projects/1c99393438ab4764907962338cc234de/users/92cb0091d0654237830127eef6ad4154/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.502816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c99393438ab4764907962338cc234de, user_id=92cb0091d0654237830127eef6ad4154, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.506647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.515938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d8dbb7b1994728a7acb1d884aa30d6', 'request_id': 'req-bdd5ed90-db15-41d3-9cff-06d3f14238ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:45.610513 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2742/5579] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:45 2021] PUT /identity/v3/projects/1c99393438ab4764907962338cc234de/users/92cb0091d0654237830127eef6ad4154/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:45.610513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:45.627923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d8dbb7b1994728a7acb1d884aa30d6', 'request_id': 'req-bdd5ed90-db15-41d3-9cff-06d3f14238ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:45.641242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d8dbb7b1994728a7acb1d884aa30d6', 'request_id': 'req-bdd5ed90-db15-41d3-9cff-06d3f14238ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:45.686378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] The token cache is being invalidate because project f8d8dbb7b1994728a7acb1d884aa30d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:45.689815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:45.691916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:45.695440 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2838/5580] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:45 2021] DELETE /identity/v3/projects/f8d8dbb7b1994728a7acb1d884aa30d6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:45.699402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:45.701432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:45.760321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759632-07cf-40f6-946f-6904fcae4d92 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.774072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.778385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.779008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.779366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.782598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.787127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.803362 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2743/5581] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:45 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:45.810028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:45.813650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:45.835945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d656c7-42f8-4923-b2c7-de4e9ea68248 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.841504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b171-d97b-4738-ab7b-341d453176e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.841895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ed90-db15-41d3-9cff-06d3f14238ce admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:45.842412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b171-d97b-4738-ab7b-341d453176e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.842844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b171-d97b-4738-ab7b-341d453176e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.843259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b171-d97b-4738-ab7b-341d453176e4 admin admin] PATH_INFO: `/v3/projects/1c99393438ab4764907962338cc234de/users/92cb0091d0654237830127eef6ad4154/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.847242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8b171-d97b-4738-ab7b-341d453176e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c99393438ab4764907962338cc234de, user_id=92cb0091d0654237830127eef6ad4154, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.850526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:45.850526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.850876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.850876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] PATH_INFO: `/v3/users/b65c52c2f5334471be33d3867f9506be` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.851053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8b171-d97b-4738-ab7b-341d453176e4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.852353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65c52c2f5334471be33d3867f9506be)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:45.854593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:45.875916 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2744/5582] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:45 2021] PUT /identity/v3/projects/1c99393438ab4764907962338cc234de/users/92cb0091d0654237830127eef6ad4154/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:45.878646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f718ec-f4d7-4145-b98e-6b3cc2ba9f37 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:45.880021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f718ec-f4d7-4145-b98e-6b3cc2ba9f37 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:45.880021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f718ec-f4d7-4145-b98e-6b3cc2ba9f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:45.920681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-98f718ec-f4d7-4145-b98e-6b3cc2ba9f37 None None] MFA Rules not processed for user `92cb0091d0654237830127eef6ad4154`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:45.924284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-98f718ec-f4d7-4145-b98e-6b3cc2ba9f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:46.018084 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2745/5583] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:45 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:46.022816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f718ec-f4d7-4145-b98e-6b3cc2ba9f37 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:46.037114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f718ec-f4d7-4145-b98e-6b3cc2ba9f37 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:46.045449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92cb0091d0654237830127eef6ad4154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c99393438ab4764907962338cc234de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:46.046533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:46.046999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:46.047490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:46.048974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:46.053192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:46.301162 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2746/5584] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:46 2021] POST /identity/v3/projects => generated 358 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:46.305324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:46.348932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65c52c2f5334471be33d3867f9506be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:46.370374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65c52c2f5334471be33d3867f9506be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:46.387890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8ee8-7fcf-4bda-bc70-5e6777926bb1 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:46.394358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65c52c2f5334471be33d3867f9506be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:46.396294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65c52c2f5334471be33d3867f9506be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:46.415985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92cb0091d0654237830127eef6ad4154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c99393438ab4764907962338cc234de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:46.415985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:46.415985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:46.418379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:46.418379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:46.418379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:46.531047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65c52c2f5334471be33d3867f9506be'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:46.538480 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2839/5585] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:45 2021] DELETE /identity/v3/users/b65c52c2f5334471be33d3867f9506be => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:46.621524 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2747/5586] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:46 2021] POST /identity/v3/users => generated 371 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:46.625723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:46.628130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:46.772724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593a16b-9682-44c5-83b9-be7e1090fa5e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:46.784682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39220-2afc-446e-806b-4b76c0ecdf8f tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92cb0091d0654237830127eef6ad4154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c99393438ab4764907962338cc234de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:46.786840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39220-2afc-446e-806b-4b76c0ecdf8f tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:46.787428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39220-2afc-446e-806b-4b76c0ecdf8f tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:46.787974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39220-2afc-446e-806b-4b76c0ecdf8f tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:46.790446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f39220-2afc-446e-806b-4b76c0ecdf8f tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:46.791324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f39220-2afc-446e-806b-4b76c0ecdf8f tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:46.795024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f39220-2afc-446e-806b-4b76c0ecdf8f tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:46.849795 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2840/5587] 10.222.0.32 () {58 vars in 1156 bytes} [Sat Dec 25 21:26:46 2021] GET /identity/v3/users?domain_id=default => generated 8015 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:46.860863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:46.873303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab6ac-90cf-4734-8859-5f3eeaf60a9b tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:46.880015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92cb0091d0654237830127eef6ad4154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c99393438ab4764907962338cc234de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:46.881748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:46.882073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:46.882402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] PATH_INFO: `/v3/users/7442af69807e449e9a27a5139221d090` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:46.915331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorizing `identity:update_user(user_id=7442af69807e449e9a27a5139221d090)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:46.918718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:47.026096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7442af69807e449e9a27a5139221d090'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.120565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invalidating the token cache because user 7442af69807e449e9a27a5139221d090 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:47.120868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.121612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.128566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:47.130344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:47.130344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:47.132608 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2748/5588] 10.222.0.32 () {60 vars in 1243 bytes} [Sat Dec 25 21:26:46 2021] PATCH /identity/v3/users/7442af69807e449e9a27a5139221d090 => generated 485 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:47.148082 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.auth.plugins.core [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] User is disabled: 7442af69807e449e9a27a5139221d090: AssertionError: User is disabled: 7442af69807e449e9a27a5139221d090 Dec 25 21:26:47.184261 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 25 21:26:47.191715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:47.193518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:47.202586 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2841/5589] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:47 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 69 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Dec 25 21:26:47.230979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5415b-8ac1-40e7-a932-72279e4803db tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:47.242149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92cb0091d0654237830127eef6ad4154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c99393438ab4764907962338cc234de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:47.243389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:47.244972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:47.245455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] PATH_INFO: `/v3/users/7442af69807e449e9a27a5139221d090` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:47.267630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7442af69807e449e9a27a5139221d090)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:47.335250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:47.414413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:47.414635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:47.525296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7442af69807e449e9a27a5139221d090'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.540355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7442af69807e449e9a27a5139221d090'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.555643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580b2e4-e38f-406c-85ee-c826e34099e8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:47.569122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:47.570001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:47.570660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:47.571512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7442af69807e449e9a27a5139221d090'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.572032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] PATH_INFO: `/v3/projects/85b9f37084a94243b3bf7fdbb9b03f1b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:47.572914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7442af69807e449e9a27a5139221d090'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.574912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b9f37084a94243b3bf7fdbb9b03f1b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:47.575636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7442af69807e449e9a27a5139221d090'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.584383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:47.681873 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2749/5590] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:47 2021] DELETE /identity/v3/users/7442af69807e449e9a27a5139221d090 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:47.685922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:47.687879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:47.789354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b9f37084a94243b3bf7fdbb9b03f1b', 'request_id': 'req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.803409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e944080-fc51-4071-b8fb-be946dc4ef73 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:47.891372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b9f37084a94243b3bf7fdbb9b03f1b', 'request_id': 'req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.905773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b9f37084a94243b3bf7fdbb9b03f1b', 'request_id': 'req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.907326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92cb0091d0654237830127eef6ad4154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c99393438ab4764907962338cc234de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:47.908250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:47.908537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:47.908810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] PATH_INFO: `/v3/projects/0e7e1a2381874c44b53a0f87a129008e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:47.911854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0e7e1a2381874c44b53a0f87a129008e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:47.922230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:47.963506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] The token cache is being invalidate because project 85b9f37084a94243b3bf7fdbb9b03f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:47.964145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.968314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-54bcb2f2-49c8-4fd3-8410-55d9fb5da7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:47.971354 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2842/5591] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:47 2021] DELETE /identity/v3/projects/85b9f37084a94243b3bf7fdbb9b03f1b => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:47.981778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583736e-ae3f-4e60-beaa-6fc1730c1ba4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:47.982071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583736e-ae3f-4e60-beaa-6fc1730c1ba4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:47.982352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583736e-ae3f-4e60-beaa-6fc1730c1ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:48.037688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f583736e-ae3f-4e60-beaa-6fc1730c1ba4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:48.042158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f583736e-ae3f-4e60-beaa-6fc1730c1ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:48.111056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7e1a2381874c44b53a0f87a129008e', 'request_id': 'req-99d30cfb-006c-4891-afee-4da1120dee15'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.121461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7e1a2381874c44b53a0f87a129008e', 'request_id': 'req-99d30cfb-006c-4891-afee-4da1120dee15'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.203952 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2843/5592] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:48.207893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454e24-f401-4667-9367-72a0a5c4ac69 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:48.211200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454e24-f401-4667-9367-72a0a5c4ac69 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:48.211719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454e24-f401-4667-9367-72a0a5c4ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:48.245893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7e1a2381874c44b53a0f87a129008e', 'request_id': 'req-99d30cfb-006c-4891-afee-4da1120dee15'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.261784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] The token cache is being invalidate because project 0e7e1a2381874c44b53a0f87a129008e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:48.262456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.263444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1c454e24-f401-4667-9367-72a0a5c4ac69 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:48.263647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.268963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1c454e24-f401-4667-9367-72a0a5c4ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:48.273227 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2750/5593] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:47 2021] DELETE /identity/v3/projects/0e7e1a2381874c44b53a0f87a129008e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:48.274786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:48.276702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:48.389951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d30cfb-006c-4891-afee-4da1120dee15 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:48.396790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92cb0091d0654237830127eef6ad4154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c99393438ab4764907962338cc234de', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:48.397925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:48.398393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:48.398832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:48.399723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:48.401978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:48.420339 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2844/5594] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:48.421678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454e24-f401-4667-9367-72a0a5c4ac69 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:48.441336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454e24-f401-4667-9367-72a0a5c4ac69 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:48.445095 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Could not find domain: 34eec519dc634f2b8288113040213a80.: keystone.exception.DomainNotFound: Could not find domain: 34eec519dc634f2b8288113040213a80. Dec 25 21:26:48.445095 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2751/5595] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:48 2021] POST /identity/v3/users => generated 112 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:26:48.450250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:48.452987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:48.453857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:48.454913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:48.454913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:48.456059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:48.456625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:48.460544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:48.464368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:48.487292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640631c4-90cd-49d2-bccc-bc36cc6568c9 tempest-UsersNegativeTest-215120999 tempest-UsersNegativeTest-215120999-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:48.496720 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2845/5596] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:48.497391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:48.497768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:48.500140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:48.500422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:48.500861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] PATH_INFO: `/v3/users/1107247fd405466e9dd6775fb2db567a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:48.502287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1107247fd405466e9dd6775fb2db567a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:48.504379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:48.519411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61a889-550e-4285-9cd6-3786b9c7064e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:48.531994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:48.533278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:48.533541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:48.533820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:48.534550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:48.536470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:48.664338 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2846/5597] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:48 2021] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:48.666193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:48.791513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1107247fd405466e9dd6775fb2db567a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.812129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bd1-32d2-49c3-8e21-966baf23d408 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:48.816220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1107247fd405466e9dd6775fb2db567a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.831059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:48.831759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:48.832035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:48.832503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:48.836219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:48.841894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:48.866856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1107247fd405466e9dd6775fb2db567a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.867982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1107247fd405466e9dd6775fb2db567a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:48.868826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4ac26454-7a4c-440e-b14e-bf78f2d88390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1107247fd405466e9dd6775fb2db567a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:49.031765 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2847/5598] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:48 2021] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:49.036293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:49.039848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:49.063474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f36ea-2d9e-4a7a-b571-4f13a8894d95 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:49.076438 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2752/5599] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:48 2021] DELETE /identity/v3/users/1107247fd405466e9dd6775fb2db567a => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:49.084202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:49.084718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:49.085226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:49.090949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:49.091205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:49.094330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:49.094330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:49.094330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:49.095493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:49.114960 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2848/5600] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:49 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:49.118832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:49.138395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b5b1-92f6-4e3a-be0f-b9b63d01ee52 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:49.152302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:49.158375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:49.274287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:49.275369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:49.275744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:49.276106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:49.276983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:49.279030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:49.303071 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2849/5601] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:49 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:49.308489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:49.343190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99208-8c4c-4782-951d-cc2b064fd673 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:49.353468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf2bf1-a878-46f5-a162-693f32457de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:49.354527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf2bf1-a878-46f5-a162-693f32457de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:49.354908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf2bf1-a878-46f5-a162-693f32457de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:49.355283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf2bf1-a878-46f5-a162-693f32457de1 admin admin] PATH_INFO: `/v3/projects/ff72aabb652f4d1f9fa7c43e59b98ad9/users/b87f37a9c1c2488d98ff23ecf4406ad0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:49.367322 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2753/5602] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:49.405166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:49.405166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:49.426382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf2bf1-a878-46f5-a162-693f32457de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff72aabb652f4d1f9fa7c43e59b98ad9, user_id=b87f37a9c1c2488d98ff23ecf4406ad0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:49.439101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf2bf1-a878-46f5-a162-693f32457de1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:49.529558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ecca3-efab-4754-9e4d-81851f720808 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:49.545729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:49.546595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:49.546883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:49.547162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:49.559884 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2850/5603] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:49 2021] PUT /identity/v3/projects/ff72aabb652f4d1f9fa7c43e59b98ad9/users/b87f37a9c1c2488d98ff23ecf4406ad0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:49.568015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:49.570669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fafcd-71d0-4255-8dd2-5c9029125e58 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:49.570962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fafcd-71d0-4255-8dd2-5c9029125e58 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:49.571301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fafcd-71d0-4255-8dd2-5c9029125e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:49.576236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:49.600169 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2754/5604] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:26:49.640423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7a2fafcd-71d0-4255-8dd2-5c9029125e58 None None] MFA Rules not processed for user `b87f37a9c1c2488d98ff23ecf4406ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:49.642039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7a2fafcd-71d0-4255-8dd2-5c9029125e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:49.746435 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2851/5605] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:49.747587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:49.767430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed83ea5-c0a5-4e2c-8f55-54ad83557573 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:49.846615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:49.848013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:49.848468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:49.848981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:49.850415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:49.852589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:49.990605 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2755/5606] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:49 2021] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:49.992070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fafcd-71d0-4255-8dd2-5c9029125e58 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:50.007943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fafcd-71d0-4255-8dd2-5c9029125e58 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:50.111607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:50.112886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:50.112886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:50.113149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:50.113765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:50.115710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:50.238605 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2852/5607] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:49 2021] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:50.241691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:50.261607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adece01-aa92-4fba-8194-5f4758bbecf9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:50.292479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:50.294266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:50.294804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:50.295333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:50.299087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:50.303381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:50.328920 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2756/5608] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:50 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:50.333500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:50.350190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66787c9c-8f29-4901-bb93-9bae24feac7f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:50.359978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:50.361748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:50.362043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:50.362327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] PATH_INFO: `/v3/projects/0cff6c8279a744cc82a373811f8da64b/users/420b232861044b72b1c19f65d7e054a3/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:50.382270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff6c8279a744cc82a373811f8da64b, user_id=420b232861044b72b1c19f65d7e054a3, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:50.388471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:50.512274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:50.513232 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2853/5609] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:50 2021] PUT /identity/v3/projects/0cff6c8279a744cc82a373811f8da64b/users/420b232861044b72b1c19f65d7e054a3/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:50.523551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c4fd1-7c80-4743-8260-bce0e187112d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:50.600344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039853c-1569-4c3e-887c-c58e35d0388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:50.601059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039853c-1569-4c3e-887c-c58e35d0388a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:50.601535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039853c-1569-4c3e-887c-c58e35d0388a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:50.601990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039853c-1569-4c3e-887c-c58e35d0388a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:50.602730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039853c-1569-4c3e-887c-c58e35d0388a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:50.604562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039853c-1569-4c3e-887c-c58e35d0388a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:50.616831 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2757/5610] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:50 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:26:50.624343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:50.658874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059b59-7553-42ae-9734-c26acba9f398 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:50.668628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:50.669935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:50.671936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:50.672720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] PATH_INFO: `/v3/projects/0cff6c8279a744cc82a373811f8da64b/users/420b232861044b72b1c19f65d7e054a3/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:50.678360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff6c8279a744cc82a373811f8da64b, user_id=420b232861044b72b1c19f65d7e054a3, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:50.684239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:50.717424 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2854/5611] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:50 2021] PUT /identity/v3/projects/0cff6c8279a744cc82a373811f8da64b/users/420b232861044b72b1c19f65d7e054a3/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:50.728000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:50.728592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:50.729181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:50.779277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] MFA Rules not processed for user `420b232861044b72b1c19f65d7e054a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:50.780599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:50.849694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:50.851917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:50.900485 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2758/5612] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:50 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:50.962740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736e4c-7bab-4256-b4b0-e22ef5935bdb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:50.970053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:50.971097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:50.972242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:50.972535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] PATH_INFO: `/v3/projects/1f75cbf0b709404db13ce82be430699d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:50.973912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f75cbf0b709404db13ce82be430699d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:50.976159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:50.984976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:50.993334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:51.100410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21799fd5-2197-4c8f-93ef-f7f93da2e7d4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:51.105075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:51.106074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:51.113235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:51.113699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:51.128452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:51.131182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:51.167810 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2759/5613] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:50 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:51.171038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f75cbf0b709404db13ce82be430699d', 'request_id': 'req-53724ef8-51f1-458f-955b-84a2a3639553'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.256530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f75cbf0b709404db13ce82be430699d', 'request_id': 'req-53724ef8-51f1-458f-955b-84a2a3639553'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.263848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f75cbf0b709404db13ce82be430699d', 'request_id': 'req-53724ef8-51f1-458f-955b-84a2a3639553'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.281672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] The token cache is being invalidate because project 1f75cbf0b709404db13ce82be430699d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:51.284266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.284266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.287648 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2855/5614] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:50 2021] DELETE /identity/v3/projects/1f75cbf0b709404db13ce82be430699d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:26:51.291231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:51.304115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230594b-44c4-45b2-872d-1c184fda0af8 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:51.376545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:51.378816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:51.379103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:51.379383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] PATH_INFO: `/v3/users/92cb0091d0654237830127eef6ad4154` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:51.380740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92cb0091d0654237830127eef6ad4154)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:51.382952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:51.674975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92cb0091d0654237830127eef6ad4154'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.691135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92cb0091d0654237830127eef6ad4154'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.717223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92cb0091d0654237830127eef6ad4154'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.718297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92cb0091d0654237830127eef6ad4154'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.719278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37315bf2-d4f5-49f2-ba6e-2f497fdf7647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92cb0091d0654237830127eef6ad4154'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:51.879517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2760/5615] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:51 2021] DELETE /identity/v3/users/92cb0091d0654237830127eef6ad4154 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:53.037015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:53.040993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:53.061583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53724ef8-51f1-458f-955b-84a2a3639553 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:53.156502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:53.158049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:53.158556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:53.159125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] PATH_INFO: `/v3/projects/1c99393438ab4764907962338cc234de` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:53.161658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c99393438ab4764907962338cc234de)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:53.164163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:53.356047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c99393438ab4764907962338cc234de', 'request_id': 'req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:53.446094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c99393438ab4764907962338cc234de', 'request_id': 'req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:53.459193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c99393438ab4764907962338cc234de', 'request_id': 'req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:53.482415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] The token cache is being invalidate because project 1c99393438ab4764907962338cc234de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:53.482694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:53.483950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f430b3e-3de0-48da-b6a7-5a3d92a22d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:53.492753 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2856/5616] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:53 2021] DELETE /identity/v3/projects/1c99393438ab4764907962338cc234de => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:53.495730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e2ee4-e911-4ead-93a5-108f76b8d893 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:53.495730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e2ee4-e911-4ead-93a5-108f76b8d893 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:53.495730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e2ee4-e911-4ead-93a5-108f76b8d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:53.524697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-293e2ee4-e911-4ead-93a5-108f76b8d893 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:53.530413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-293e2ee4-e911-4ead-93a5-108f76b8d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:53.632650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805b52-fbb8-4915-b03f-e645892ed21e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:53.633119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805b52-fbb8-4915-b03f-e645892ed21e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:53.634244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805b52-fbb8-4915-b03f-e645892ed21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:53.636660 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2761/5617] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:26:53.678398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-16805b52-fbb8-4915-b03f-e645892ed21e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:53.681374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-16805b52-fbb8-4915-b03f-e645892ed21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:53.695880 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2857/5618] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:53.697141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e2ee4-e911-4ead-93a5-108f76b8d893 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:53.707517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e2ee4-e911-4ead-93a5-108f76b8d893 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:53.712843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:53.713545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:53.714244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:53.714244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:53.714863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:53.715167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:53.717129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:53.736745 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2762/5619] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:26:53.737723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16805b52-fbb8-4915-b03f-e645892ed21e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:53.750934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16805b52-fbb8-4915-b03f-e645892ed21e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:53.757929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:53.758921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:53.759560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:53.760297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:53.760774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:53.764597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:53.993007 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2858/5620] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:53 2021] POST /identity/v3/projects => generated 359 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:53.998313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:54.014653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c41b1-e50f-4aa4-ae9d-f3a497bc6ac0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:54.150061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:54.154847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:54.158757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:54.158757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:54.158757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:54.165302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:54.274396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:54.283889 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2763/5621] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:53 2021] POST /identity/v3/users => generated 280 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:54.288930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abffc-cd9c-4c70-a2da-c7d3976712ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:54.296762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:54.298722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:54.299213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:54.299684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:54.300652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:54.305269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:54.330726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:54.337924 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2859/5622] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:54 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:54.346151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcfcd9-ed18-4772-a6cc-657d62bdde9c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:54.362166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce179-86dc-42fe-bf66-07619385dcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:54.363178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce179-86dc-42fe-bf66-07619385dcdc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:54.363825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce179-86dc-42fe-bf66-07619385dcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:54.364291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce179-86dc-42fe-bf66-07619385dcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:54.365414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ce179-86dc-42fe-bf66-07619385dcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:54.373502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ce179-86dc-42fe-bf66-07619385dcdc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:54.391347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:54.403395 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2764/5623] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:54 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:54.404086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776d21d-1fee-4dee-9209-73b46f288321 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:54.410951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:54.411912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:54.412381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:54.412838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] PATH_INFO: `/v3/projects/6f25a8a67e9a4924a00357fba275b09b/users/266d70de6df74449a6d1925248bd6238/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:54.442485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f25a8a67e9a4924a00357fba275b09b, user_id=266d70de6df74449a6d1925248bd6238, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:54.445663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:54.549558 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2860/5624] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:54 2021] PUT /identity/v3/projects/6f25a8a67e9a4924a00357fba275b09b/users/266d70de6df74449a6d1925248bd6238/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:54.552082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611bf9-665c-4972-af18-b7a0dd41bb1a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:54.553865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611bf9-665c-4972-af18-b7a0dd41bb1a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:54.561207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85611bf9-665c-4972-af18-b7a0dd41bb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:54.628073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-85611bf9-665c-4972-af18-b7a0dd41bb1a None None] MFA Rules not processed for user `266d70de6df74449a6d1925248bd6238`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:54.629383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-85611bf9-665c-4972-af18-b7a0dd41bb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:54.747825 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2765/5625] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:54 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:54.760850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:54.852507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bd489-78a9-4486-a5f8-1b0eb398c5ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:54.858417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:54.861056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:54.861056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:54.861301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] PATH_INFO: `/v3/users/266d70de6df74449a6d1925248bd6238` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:54.863008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266d70de6df74449a6d1925248bd6238)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:54.866018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:55.094162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266d70de6df74449a6d1925248bd6238'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:55.106225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266d70de6df74449a6d1925248bd6238'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:55.132584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266d70de6df74449a6d1925248bd6238'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:55.133702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266d70de6df74449a6d1925248bd6238'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:55.218524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266d70de6df74449a6d1925248bd6238'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:55.233005 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2861/5626] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:54 2021] DELETE /identity/v3/users/266d70de6df74449a6d1925248bd6238 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:55.243304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:55.247267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:55.247825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:55.322499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:55.325616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:55.503289 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2766/5627] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:55.529619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:55.531489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:55.658721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f721-e000-438f-be76-48438efcd7e3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:55.662620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:55.663390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:55.664099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:55.664868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:55.681592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:55.683751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:55.714289 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2862/5628] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:26:56.646375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:56.647956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:56.667637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95f625-7411-4667-933b-d6973a659da7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:56.682646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:56.686337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:56.690863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:56.691240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] PATH_INFO: `/v3/projects/6f25a8a67e9a4924a00357fba275b09b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:56.694002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f25a8a67e9a4924a00357fba275b09b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:56.699477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:56.749979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:56.753191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:56.796050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edbfa-e406-4136-9be4-b47b759a4726 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:56.810430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:56.812296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:56.812831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:56.815784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] PATH_INFO: `/v3/users/b87f37a9c1c2488d98ff23ecf4406ad0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:56.822729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87f37a9c1c2488d98ff23ecf4406ad0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:56.825476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:56.955153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f25a8a67e9a4924a00357fba275b09b', 'request_id': 'req-63d30400-1763-4b72-bcb0-efd4ad33b484'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:56.965908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f25a8a67e9a4924a00357fba275b09b', 'request_id': 'req-63d30400-1763-4b72-bcb0-efd4ad33b484'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.049067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f25a8a67e9a4924a00357fba275b09b', 'request_id': 'req-63d30400-1763-4b72-bcb0-efd4ad33b484'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.074987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] The token cache is being invalidate because project 6f25a8a67e9a4924a00357fba275b09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:26:57.076515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.078323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-63d30400-1763-4b72-bcb0-efd4ad33b484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.081546 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2767/5629] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:56 2021] DELETE /identity/v3/projects/6f25a8a67e9a4924a00357fba275b09b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:57.089181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e60fc-86b1-4c85-82e7-130f3526c0dd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:57.095057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e60fc-86b1-4c85-82e7-130f3526c0dd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:57.095057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e60fc-86b1-4c85-82e7-130f3526c0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:57.124300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-aa5e60fc-86b1-4c85-82e7-130f3526c0dd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:57.126563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aa5e60fc-86b1-4c85-82e7-130f3526c0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:57.180786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87f37a9c1c2488d98ff23ecf4406ad0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.210179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87f37a9c1c2488d98ff23ecf4406ad0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.248523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87f37a9c1c2488d98ff23ecf4406ad0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.249814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87f37a9c1c2488d98ff23ecf4406ad0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.342912 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2768/5630] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:57.344788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099e52-f451-44d8-adb5-8e191b702f6f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:57.345113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099e52-f451-44d8-adb5-8e191b702f6f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:57.345563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099e52-f451-44d8-adb5-8e191b702f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:57.381910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-67099e52-f451-44d8-adb5-8e191b702f6f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:57.383167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-67099e52-f451-44d8-adb5-8e191b702f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:57.393974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d36d72f4-3803-48a7-9489-75d1cda5cb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87f37a9c1c2488d98ff23ecf4406ad0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:26:57.401259 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2863/5631] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:26:56 2021] DELETE /identity/v3/users/b87f37a9c1c2488d98ff23ecf4406ad0 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:57.406685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd91a5-5744-4841-9dd1-30e26539d3e7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:57.407681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd91a5-5744-4841-9dd1-30e26539d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:57.407968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd91a5-5744-4841-9dd1-30e26539d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:57.410634 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2769/5632] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:57.415853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099e52-f451-44d8-adb5-8e191b702f6f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:57.433932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099e52-f451-44d8-adb5-8e191b702f6f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:57.458809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9cfd91a5-5744-4841-9dd1-30e26539d3e7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:57.460297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9cfd91a5-5744-4841-9dd1-30e26539d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:57.573165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2864/5633] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:57.580742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:57.580742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:57.580742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:57.580742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:57.581970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:57.582414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:57.584091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:57.597787 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2770/5634] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:26:57.601826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd91a5-5744-4841-9dd1-30e26539d3e7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:57.612845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd91a5-5744-4841-9dd1-30e26539d3e7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:57.618260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:57.619038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:57.619417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:57.619793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:57.620929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:57.622930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:57.656810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:57.660307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:57.734499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4103-40d2-46bc-a1bd-f7e496f582ec admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:57.740298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:57.741491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:57.742020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:57.742528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:57.755043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:57.757424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:57.769567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2771/5635] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:26:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:26:57.855105 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2865/5636] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:57 2021] POST /identity/v3/projects => generated 355 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:57.860285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:57.878561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a17906-8992-44cf-99e1-b78218e60d36 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:57.987871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:57.988574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:57.989066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:57.989347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:57.990549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:57.993079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:58.177568 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2772/5637] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:57 2021] POST /identity/v3/users => generated 278 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:58.181771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:58.203334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379c9aa-8c79-48f0-bb2f-63a1046d8243 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:58.214209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:58.216202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:58.217404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:58.218322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:58.224987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:58.229303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:58.257958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2866/5638] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:58 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:58.261823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:58.276150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078820e-48dc-4846-8182-694300a9d505 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:58.307936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e796-1e24-4b72-ab34-ca102a0af4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:58.313259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e796-1e24-4b72-ab34-ca102a0af4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:58.314446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e796-1e24-4b72-ab34-ca102a0af4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:58.315125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e796-1e24-4b72-ab34-ca102a0af4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:58.317594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e796-1e24-4b72-ab34-ca102a0af4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:58.319498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e796-1e24-4b72-ab34-ca102a0af4a3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:58.340085 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2773/5639] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:58 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:58.344382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:58.361949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d0e9a-a05d-494d-813a-369f24154916 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:58.372923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:58.374133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:58.374648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:58.379358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] PATH_INFO: `/v3/projects/5f2ddb58a7434af8b135d89174a9a1fe/users/69b1e0291daa4593a7ff397f2e46d374/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:58.415739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2ddb58a7434af8b135d89174a9a1fe, user_id=69b1e0291daa4593a7ff397f2e46d374, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:58.418999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:58.529598 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2867/5640] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:58 2021] PUT /identity/v3/projects/5f2ddb58a7434af8b135d89174a9a1fe/users/69b1e0291daa4593a7ff397f2e46d374/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:58.543124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd063-8c0d-47e3-a1ba-5584a285b59a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:58.543361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd063-8c0d-47e3-a1ba-5584a285b59a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:58.543645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd063-8c0d-47e3-a1ba-5584a285b59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:58.600630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a78cd063-8c0d-47e3-a1ba-5584a285b59a None None] MFA Rules not processed for user `69b1e0291daa4593a7ff397f2e46d374`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:58.601958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a78cd063-8c0d-47e3-a1ba-5584a285b59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:58.698653 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2774/5641] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:58 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:58.708189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:58.830466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ef594-5f2c-442f-ae69-36892f2709ec admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:58.838949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:58.839863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:58.840308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:58.840770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:58.842194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:58.845838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:58.961679 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2868/5642] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:58 2021] POST /identity/v3/projects => generated 357 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:26:58.962328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd063-8c0d-47e3-a1ba-5584a285b59a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:58.982187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd063-8c0d-47e3-a1ba-5584a285b59a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:59.095327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:59.096135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.096499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.096855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.097666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:59.099723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:59.198589 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2775/5643] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:26:58 2021] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:26:59.201325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:59.216598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2ba0b-bc68-4aba-bb58-7ade8dff1731 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:59.227846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:59.228827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.229359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.229768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.230692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:59.232822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:59.249799 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2869/5644] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:59 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:59.251525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:59.268854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b12d48-8b26-4bd9-9503-d91f42c14a18 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:59.278259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:59.279726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.280554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.281295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] PATH_INFO: `/v3/projects/f6a2587ba0a344da9eb3c7c6d4d2184b/users/cf32667c7ad44e4b85977ed1a5f7df43/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.319172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a2587ba0a344da9eb3c7c6d4d2184b, user_id=cf32667c7ad44e4b85977ed1a5f7df43, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:59.338675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:59.451105 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2776/5645] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:59 2021] PUT /identity/v3/projects/f6a2587ba0a344da9eb3c7c6d4d2184b/users/cf32667c7ad44e4b85977ed1a5f7df43/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:59.455713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:59.467443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3ee1e-7b0d-45e0-9969-ada7173716c2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:59.550769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542eda6-bf1a-47db-af58-0a449d2dc06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:59.551712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542eda6-bf1a-47db-af58-0a449d2dc06e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.552277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542eda6-bf1a-47db-af58-0a449d2dc06e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.552852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542eda6-bf1a-47db-af58-0a449d2dc06e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.553947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542eda6-bf1a-47db-af58-0a449d2dc06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:59.556610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542eda6-bf1a-47db-af58-0a449d2dc06e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:59.570093 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2870/5646] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:26:59 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:26:59.574814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:59.589226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2fc9c-a405-473e-b427-b5d040ce3ae9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:59.594720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:59.595739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.596113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.597424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] PATH_INFO: `/v3/projects/f6a2587ba0a344da9eb3c7c6d4d2184b/users/cf32667c7ad44e4b85977ed1a5f7df43/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.599080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a2587ba0a344da9eb3c7c6d4d2184b, user_id=cf32667c7ad44e4b85977ed1a5f7df43, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:59.601834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:59.616382 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2777/5647] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:26:59 2021] PUT /identity/v3/projects/f6a2587ba0a344da9eb3c7c6d4d2184b/users/cf32667c7ad44e4b85977ed1a5f7df43/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:26:59.631901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a5f5-ed0a-4924-b509-81c07040aa0a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.631901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a5f5-ed0a-4924-b509-81c07040aa0a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.631901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a5f5-ed0a-4924-b509-81c07040aa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.661130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-be55a5f5-ed0a-4924-b509-81c07040aa0a None None] MFA Rules not processed for user `cf32667c7ad44e4b85977ed1a5f7df43`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:26:59.662857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be55a5f5-ed0a-4924-b509-81c07040aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:26:59.798477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:59.804818 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2871/5648] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:26:59 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:26:59.810843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b5043-82f3-4a4d-937a-55e7c4d06b9b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:59.817670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf32667c7ad44e4b85977ed1a5f7df43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a2587ba0a344da9eb3c7c6d4d2184b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:59.818872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.819595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.820093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.821990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:26:59.822527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:59.826840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:59.858381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2778/5649] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:26:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:26:59.862366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a5f5-ed0a-4924-b509-81c07040aa0a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:59.880289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a5f5-ed0a-4924-b509-81c07040aa0a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:26:59.888225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf32667c7ad44e4b85977ed1a5f7df43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a2587ba0a344da9eb3c7c6d4d2184b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:26:59.889379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:26:59.889903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:26:59.890458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:26:59.892176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:26:59.895920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:26:59.956297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:26:59.958466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:00.008144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2872/5650] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:26:59 2021] POST /identity/v3/projects => generated 349 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:00.012555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:00.098766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f64d0-22e3-443c-b4e1-4107c809550a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:00.127435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63692b30-c340-4ea2-8a34-35722a65ba6a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:00.134592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf32667c7ad44e4b85977ed1a5f7df43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a2587ba0a344da9eb3c7c6d4d2184b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:00.135302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:00.135631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:00.136073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:00.136906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:00.137286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:00.139808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:00.155263 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2873/5651] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:27:00.180273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:00.186606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:00.203628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:00.204563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:00.209400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:00.209852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] PATH_INFO: `/v3/projects/ff72aabb652f4d1f9fa7c43e59b98ad9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:00.214068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff72aabb652f4d1f9fa7c43e59b98ad9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:00.218560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:00.332450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71595d5-ce85-45c5-9e55-3e446550a18a tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:00.347921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:00.348858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:00.349455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:00.349881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:00.362749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:00.364174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:00.380601 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2874/5652] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:00 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:00.409310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff72aabb652f4d1f9fa7c43e59b98ad9', 'request_id': 'req-246a37b5-feb0-477b-9327-5d750e88da4d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.417312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff72aabb652f4d1f9fa7c43e59b98ad9', 'request_id': 'req-246a37b5-feb0-477b-9327-5d750e88da4d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.558565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff72aabb652f4d1f9fa7c43e59b98ad9', 'request_id': 'req-246a37b5-feb0-477b-9327-5d750e88da4d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.572410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] The token cache is being invalidate because project ff72aabb652f4d1f9fa7c43e59b98ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:00.573029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.573896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-246a37b5-feb0-477b-9327-5d750e88da4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.576165 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2779/5653] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:26:59 2021] DELETE /identity/v3/projects/ff72aabb652f4d1f9fa7c43e59b98ad9 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:00.581218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:00.600544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577b3f9-e03b-49da-ad16-5b5d6c64d3f2 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:00.669154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:00.670035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:00.670321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:00.670702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] PATH_INFO: `/v3/users/420b232861044b72b1c19f65d7e054a3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:00.671941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420b232861044b72b1c19f65d7e054a3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:00.674001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:00.902361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420b232861044b72b1c19f65d7e054a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.916508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420b232861044b72b1c19f65d7e054a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.942647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:00.943156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:00.943277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:00.956567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420b232861044b72b1c19f65d7e054a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:00.970622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420b232861044b72b1c19f65d7e054a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:01.013549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] MFA Rules not processed for user `517838d2d4a942bfa8b332c767c60904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:01.015837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:01.073709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420b232861044b72b1c19f65d7e054a3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:01.083231 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2875/5654] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:00 2021] DELETE /identity/v3/users/420b232861044b72b1c19f65d7e054a3 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:01.084469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:01.089872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:01.135597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2780/5655] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:00 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:01.148624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:01.152254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:01.203653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23f13a-6c84-4373-b9cd-92f581ba5c16 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:01.219316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf32667c7ad44e4b85977ed1a5f7df43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a2587ba0a344da9eb3c7c6d4d2184b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:01.220359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:01.220636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:01.220939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] PATH_INFO: `/v3/projects/1e9cc58ceed74d79a2420eddfe5fdfd6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:01.222534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e9cc58ceed74d79a2420eddfe5fdfd6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:01.224976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:01.280535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1e11b-bcc7-4caa-8aac-017d1ce0efab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:01.345155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:01.345731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:01.346102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:01.346435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:01.406510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9cc58ceed74d79a2420eddfe5fdfd6', 'request_id': 'req-95587b7c-a115-49bb-a589-2da5ad2436ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:01.416683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:01.418530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:01.429407 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2781/5656] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:01 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:01.486339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9cc58ceed74d79a2420eddfe5fdfd6', 'request_id': 'req-95587b7c-a115-49bb-a589-2da5ad2436ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:01.495270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9cc58ceed74d79a2420eddfe5fdfd6', 'request_id': 'req-95587b7c-a115-49bb-a589-2da5ad2436ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:01.542636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] The token cache is being invalidate because project 1e9cc58ceed74d79a2420eddfe5fdfd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:01.543190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:01.545244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:01.549239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2876/5657] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:01 2021] DELETE /identity/v3/projects/1e9cc58ceed74d79a2420eddfe5fdfd6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:02.299242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:02.302160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:02.403278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b47c-c331-4b1d-8678-e518430619ba service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:02.477825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:02.479468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:02.480293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:02.480670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] PATH_INFO: `/v3/users/69b1e0291daa4593a7ff397f2e46d374` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:02.482863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b1e0291daa4593a7ff397f2e46d374)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:02.485783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:02.563767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:02.566415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:02.602248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587b7c-a115-49bb-a589-2da5ad2436ac tempest-QuotasTest-1310269404 tempest-QuotasTest-1310269404-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:02.615161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:02.615161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:02.615438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:02.620682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] PATH_INFO: `/v3/projects/0cff6c8279a744cc82a373811f8da64b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:02.622458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cff6c8279a744cc82a373811f8da64b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:02.624525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:02.753684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b1e0291daa4593a7ff397f2e46d374'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:02.786721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b1e0291daa4593a7ff397f2e46d374'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:02.823092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b1e0291daa4593a7ff397f2e46d374'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:02.826344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b1e0291daa4593a7ff397f2e46d374'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:02.827300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-369c153d-e2ae-497c-bc8f-cc022c985230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b1e0291daa4593a7ff397f2e46d374'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:02.856126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cff6c8279a744cc82a373811f8da64b', 'request_id': 'req-d796c869-2dab-45c3-832f-1078d5f8a43b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:02.938645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2782/5658] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:02 2021] DELETE /identity/v3/users/69b1e0291daa4593a7ff397f2e46d374 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:02.943495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66470fba-7a9e-40c9-b4f4-f202071c7041 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:02.944655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66470fba-7a9e-40c9-b4f4-f202071c7041 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:02.945289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66470fba-7a9e-40c9-b4f4-f202071c7041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:02.974193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-66470fba-7a9e-40c9-b4f4-f202071c7041 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:02.992962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-66470fba-7a9e-40c9-b4f4-f202071c7041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:03.045781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cff6c8279a744cc82a373811f8da64b', 'request_id': 'req-d796c869-2dab-45c3-832f-1078d5f8a43b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:03.055452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cff6c8279a744cc82a373811f8da64b', 'request_id': 'req-d796c869-2dab-45c3-832f-1078d5f8a43b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:03.084597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] The token cache is being invalidate because project 0cff6c8279a744cc82a373811f8da64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:03.085235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:03.086863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d796c869-2dab-45c3-832f-1078d5f8a43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:03.090695 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2877/5659] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:02 2021] DELETE /identity/v3/projects/0cff6c8279a744cc82a373811f8da64b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:03.097681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:03.098211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:03.098688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:03.154661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:03.156496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:03.164974 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2783/5660] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:03.177000 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2878/5661] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:03.189408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:03.192671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ebf78-682a-473a-9514-4fe7b4abe3aa None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:03.193237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ebf78-682a-473a-9514-4fe7b4abe3aa None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:03.193404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:03.193992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ebf78-682a-473a-9514-4fe7b4abe3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:03.224050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3f5ebf78-682a-473a-9514-4fe7b4abe3aa None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:03.226320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3f5ebf78-682a-473a-9514-4fe7b4abe3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:03.259327 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2784/5662] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:03.263420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ebf78-682a-473a-9514-4fe7b4abe3aa None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:03.320224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ebf78-682a-473a-9514-4fe7b4abe3aa None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:03.331995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:03.333108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:03.333556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:03.333962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:03.335782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:03.336521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:03.342919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:03.378145 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2785/5663] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:03.382654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a591a-c294-4e48-9636-22d782a3e15d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:03.383248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:03.401822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:03.405388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:03.405940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:03.406606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:03.408133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf920db-c76d-4098-bda2-0a43713dc4d5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:03.425000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:03.429433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:03.440216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:03.441351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:03.441904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:03.442402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:03.443339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:03.448709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:03.471016 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2879/5664] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:03.604561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2786/5665] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:03 2021] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:03.610669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:03.630227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfd16-75c8-40f2-881b-0f113575c3a1 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:03.765771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:03.770931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:03.771056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:03.771328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:03.777833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:03.777833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:03.935948 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2880/5666] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:03 2021] POST /identity/v3/users => generated 284 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:03.936922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:03.950154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c1588-5f2c-4ede-8ed3-437e38b7d33e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:03.973719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:03.973719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:03.973719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:03.973719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:03.974211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:03.978685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:04.003328 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2787/5667] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:04.005817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:04.028528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2596ed-c5c2-43a2-b83d-ebe380c2bc96 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:04.045142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0ee84-04d5-4b62-88f0-4d91adc543b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:04.046519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ee84-04d5-4b62-88f0-4d91adc543b8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:04.046983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ee84-04d5-4b62-88f0-4d91adc543b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:04.048040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ee84-04d5-4b62-88f0-4d91adc543b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:04.049369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0ee84-04d5-4b62-88f0-4d91adc543b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:04.052114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0ee84-04d5-4b62-88f0-4d91adc543b8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:04.077493 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2881/5668] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:04 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:04.081374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:04.091951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b38a-86ea-499e-a69f-b9af60e897e2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:04.111605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:04.112573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:04.112902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:04.113181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] PATH_INFO: `/v3/projects/75848700487f4c02a434ecc788fafae6/users/cc470c11191844fd8f489ad02b859c94/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:04.131666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75848700487f4c02a434ecc788fafae6, user_id=cc470c11191844fd8f489ad02b859c94, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:04.135140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:04.280138 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2788/5669] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:04 2021] PUT /identity/v3/projects/75848700487f4c02a434ecc788fafae6/users/cc470c11191844fd8f489ad02b859c94/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:04.295720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6ceb-477b-4290-a1c3-1e4a258ef0cb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:04.295720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6ceb-477b-4290-a1c3-1e4a258ef0cb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:04.295720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b6ceb-477b-4290-a1c3-1e4a258ef0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:04.395362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e32b6ceb-477b-4290-a1c3-1e4a258ef0cb None None] MFA Rules not processed for user `cc470c11191844fd8f489ad02b859c94`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:04.396866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e32b6ceb-477b-4290-a1c3-1e4a258ef0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:04.623185 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2882/5670] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:04 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:04.627226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:04.883415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1137b-9c99-4388-a531-746a25edb540 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:04.909809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:04.910762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:04.911217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:04.911689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:04.912584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:04.927860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:05.065929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2789/5671] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:04 2021] POST /identity/v3/projects => generated 369 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:05.069682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6ceb-477b-4290-a1c3-1e4a258ef0cb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:05.094458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b6ceb-477b-4290-a1c3-1e4a258ef0cb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:05.242947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:05.243762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:05.244729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:05.245162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:05.247513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:05.250157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:05.354137 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2883/5672] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:05 2021] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:05.358506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:05.373513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caedecf-45ad-4053-9c09-f0176abe0ecd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:05.380384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:05.381451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:05.381931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:05.382370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:05.389131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:05.389131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:05.408161 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2790/5673] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:05 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:05.412557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:05.432096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cec147-8990-4482-aa6d-0950bbba834d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:05.446428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:05.452421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:05.452421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:05.452421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] PATH_INFO: `/v3/projects/1332fd4206ee4e3ca09e322448860007/users/ee439fe3c2d74ff289441fbe8e122b1f/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:05.479633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1332fd4206ee4e3ca09e322448860007, user_id=ee439fe3c2d74ff289441fbe8e122b1f, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:05.488057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:05.638299 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2884/5674] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:05 2021] PUT /identity/v3/projects/1332fd4206ee4e3ca09e322448860007/users/ee439fe3c2d74ff289441fbe8e122b1f/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:05.639754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:05.658833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e477f0a-a389-4034-ba2b-9f74716065c3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:05.741205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:05.742985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:05.830981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:05.833600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:05.834149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:05.834867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:05.842975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:05.842975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:05.854789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954b2c-ccb7-476b-aeed-2ff49de819a7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:05.866652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:05.866652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:05.868381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:05.868844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] PATH_INFO: `/v3/projects/5f2ddb58a7434af8b135d89174a9a1fe` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:05.870608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2ddb58a7434af8b135d89174a9a1fe)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:05.873149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:05.874620 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2791/5675] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:05 2021] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:05.881179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:05.912124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7b420-76e3-401d-bad4-10e58172130c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:05.918443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f55802-11c5-45dc-93f3-f465dfe46f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:05.921586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55802-11c5-45dc-93f3-f465dfe46f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:05.921586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55802-11c5-45dc-93f3-f465dfe46f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:05.921586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55802-11c5-45dc-93f3-f465dfe46f1c admin admin] PATH_INFO: `/v3/projects/1332fd4206ee4e3ca09e322448860007/users/ee439fe3c2d74ff289441fbe8e122b1f/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:05.924127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f55802-11c5-45dc-93f3-f465dfe46f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1332fd4206ee4e3ca09e322448860007, user_id=ee439fe3c2d74ff289441fbe8e122b1f, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:05.928276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f55802-11c5-45dc-93f3-f465dfe46f1c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:05.954991 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2792/5676] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:05 2021] PUT /identity/v3/projects/1332fd4206ee4e3ca09e322448860007/users/ee439fe3c2d74ff289441fbe8e122b1f/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:05.972080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:05.972080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:05.972080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:06.028094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] MFA Rules not processed for user `ee439fe3c2d74ff289441fbe8e122b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:06.032770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:06.081005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2ddb58a7434af8b135d89174a9a1fe', 'request_id': 'req-460b7929-3d23-4557-83cb-019afd562d3d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.188327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2ddb58a7434af8b135d89174a9a1fe', 'request_id': 'req-460b7929-3d23-4557-83cb-019afd562d3d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.196014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2ddb58a7434af8b135d89174a9a1fe', 'request_id': 'req-460b7929-3d23-4557-83cb-019afd562d3d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.211748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] The token cache is being invalidate because project 5f2ddb58a7434af8b135d89174a9a1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:06.212380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.213353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.216302 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2885/5677] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:05 2021] DELETE /identity/v3/projects/5f2ddb58a7434af8b135d89174a9a1fe => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:06.221279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:06.222987 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2793/5678] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:05 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:06.224695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:06.382243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b7929-3d23-4557-83cb-019afd562d3d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:06.388656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:06.390124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:06.390124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:06.390372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] PATH_INFO: `/v3/users/cf32667c7ad44e4b85977ed1a5f7df43` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:06.392062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf32667c7ad44e4b85977ed1a5f7df43)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:06.394852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:06.436768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:06.439021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:06.520403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a78eba-71d9-4d57-b2cd-ed89aa19cdc9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:06.629257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf32667c7ad44e4b85977ed1a5f7df43'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.630045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:06.636916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:06.636916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:06.637497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:06.639751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:06.649653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf32667c7ad44e4b85977ed1a5f7df43'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.675239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf32667c7ad44e4b85977ed1a5f7df43'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.678845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf32667c7ad44e4b85977ed1a5f7df43'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.761335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:06.763891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:06.779528 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2794/5679] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:06 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:06.787359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-adc7a92c-0dde-441f-8c6f-1ef8cb94773c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf32667c7ad44e4b85977ed1a5f7df43'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:06.795565 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2886/5680] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:06 2021] DELETE /identity/v3/users/cf32667c7ad44e4b85977ed1a5f7df43 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:08.436193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:08.447128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d915eea-6b2b-4f74-a16c-b2314403c10c service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:08.566658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:08.567621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:08.567910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:08.569155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] PATH_INFO: `/v3/projects/f6a2587ba0a344da9eb3c7c6d4d2184b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:08.570600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a2587ba0a344da9eb3c7c6d4d2184b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:08.572910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:08.666801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:08.670867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:08.670867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:08.688792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a2587ba0a344da9eb3c7c6d4d2184b', 'request_id': 'req-fb0729f8-1740-48cb-bcf2-893366e0b3ca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:08.689226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] MFA Rules not processed for user `517838d2d4a942bfa8b332c767c60904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:08.690996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:08.698952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a2587ba0a344da9eb3c7c6d4d2184b', 'request_id': 'req-fb0729f8-1740-48cb-bcf2-893366e0b3ca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:08.755727 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2887/5681] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:08 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:08.805764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:08.807985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:08.856548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a2587ba0a344da9eb3c7c6d4d2184b', 'request_id': 'req-fb0729f8-1740-48cb-bcf2-893366e0b3ca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:08.873772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] The token cache is being invalidate because project f6a2587ba0a344da9eb3c7c6d4d2184b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:08.874333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:08.876385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fb0729f8-1740-48cb-bcf2-893366e0b3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:08.879448 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2795/5682] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:08 2021] DELETE /identity/v3/projects/f6a2587ba0a344da9eb3c7c6d4d2184b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:08.886584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf1c8d-0009-44a7-bf35-b44e48a6ba22 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:08.887119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf1c8d-0009-44a7-bf35-b44e48a6ba22 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:08.887393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf1c8d-0009-44a7-bf35-b44e48a6ba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:08.908504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1daf1c8d-0009-44a7-bf35-b44e48a6ba22 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:08.909754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1daf1c8d-0009-44a7-bf35-b44e48a6ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:08.913626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1bf1-7b99-4002-bee3-0a1281d19ef0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:08.918004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:08.918659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:08.918998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:08.919282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:08.921085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:08.989604 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2796/5683] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:08.998967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa31cb-9c95-4456-8917-a2fa131ce27a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:08.998967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa31cb-9c95-4456-8917-a2fa131ce27a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:08.999443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa31cb-9c95-4456-8917-a2fa131ce27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.022602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-afaa31cb-9c95-4456-8917-a2fa131ce27a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:09.022888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-afaa31cb-9c95-4456-8917-a2fa131ce27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:09.039168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:09.040623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:09.056808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2797/5684] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:09.058735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa31cb-9c95-4456-8917-a2fa131ce27a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:09.062969 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2888/5685] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:27:09.082374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa31cb-9c95-4456-8917-a2fa131ce27a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:09.096002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:09.097445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:09.097909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:09.105461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.106836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:09.107328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:09.109302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:09.133144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:09.134084 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2798/5686] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:09.144747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23e603-27ce-4d26-afb7-13b62c0b49dc service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:09.150816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:09.151673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:09.152165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:09.152706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.153622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:09.155981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:09.324125 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2889/5687] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:09 2021] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:09.328094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:09.338430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6c9c-55a0-48bb-99a8-e0dc762e2550 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:09.409403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:09.410384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:09.410735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:09.411127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.412427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:09.415086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:09.505149 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2799/5688] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:09 2021] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:09.506307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:09.523229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cec97-e01d-438c-b5d1-fd4c1b9dfd4b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:09.528757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:09.529610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:09.530034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:09.530658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.532204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:09.535034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:09.581663 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2890/5689] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:09 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:27:09.582018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:09.604589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b6f8e-1b73-457b-a358-1fca17fba98d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:09.623637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941036-21ce-4031-bd59-0509f45d2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:09.624678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941036-21ce-4031-bd59-0509f45d2c6c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:09.625896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941036-21ce-4031-bd59-0509f45d2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:09.626328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941036-21ce-4031-bd59-0509f45d2c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.627281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941036-21ce-4031-bd59-0509f45d2c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:09.629390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941036-21ce-4031-bd59-0509f45d2c6c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:09.644132 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2800/5690] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:09 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:09.645641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:09.657817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d71d-7a53-4651-ade6-4e66d1ae9b32 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:09.666220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:09.669895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:09.669895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:09.669895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] PATH_INFO: `/v3/projects/a952d5c0b31746ef88cf747a4aa50f9f/users/1ed5effe2d764fe583f7ce5bb4376959/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.684459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a952d5c0b31746ef88cf747a4aa50f9f, user_id=1ed5effe2d764fe583f7ce5bb4376959, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:09.687514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:09.774197 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2891/5691] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:09 2021] PUT /identity/v3/projects/a952d5c0b31746ef88cf747a4aa50f9f/users/1ed5effe2d764fe583f7ce5bb4376959/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:09.785829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:09.786643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:09.787553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:09.824380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] MFA Rules not processed for user `1ed5effe2d764fe583f7ce5bb4376959`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:09.827009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:09.936959 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2801/5692] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:09.942255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:10.029748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:10.032085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:10.040411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29ab6b-b1b0-4f28-b2d6-0aceea0503c6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:10.050310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:10.051341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.051847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137571c2-6d48-45f2-bddb-ac854381e8a7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:10.052003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.053023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.054647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:10.056998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:10.059123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:10.060272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.060684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.061092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] PATH_INFO: `/v3/users/cc470c11191844fd8f489ad02b859c94` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.065860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc470c11191844fd8f489ad02b859c94)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:10.065860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:10.227220 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2892/5693] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:09 2021] POST /identity/v3/projects => generated 385 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:10.228682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:10.366132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7638cf-39de-4f56-88e2-967ed6412828 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:10.373576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:10.374428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.380574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.380574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.380574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:10.380574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:10.394076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc470c11191844fd8f489ad02b859c94'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:10.408854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc470c11191844fd8f489ad02b859c94'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:10.426446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc470c11191844fd8f489ad02b859c94'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:10.427383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc470c11191844fd8f489ad02b859c94'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:10.428954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc470c11191844fd8f489ad02b859c94'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:10.552898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2893/5694] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:10 2021] POST /identity/v3/users => generated 299 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:10.552898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:10.555657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:10.565902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2802/5695] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:10 2021] DELETE /identity/v3/users/cc470c11191844fd8f489ad02b859c94 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:10.567591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:10.569836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:10.715064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67791765-df8d-4239-b84b-6f8407c4b2e5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:10.727612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17c127-8ce4-4de6-bf06-2df24272b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:10.728482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17c127-8ce4-4de6-bf06-2df24272b0fc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.728771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17c127-8ce4-4de6-bf06-2df24272b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.729076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17c127-8ce4-4de6-bf06-2df24272b0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.735371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17c127-8ce4-4de6-bf06-2df24272b0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:10.737100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17c127-8ce4-4de6-bf06-2df24272b0fc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:10.749749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6ed76-f0c0-4519-9bc4-2798195477a8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:10.765370 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2803/5696] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:10 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:10.767097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.767392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.767673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.790993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:10.792313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:10.820422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2804/5697] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:10.820422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:10.820422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:10.881112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:10.881800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.882240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.882523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.886745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:10.918510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:10.921148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:10.938763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5e6b5-3d8d-43ee-92bb-e346e204bd87 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:10.940733 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2894/5698] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:10.941611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:10.942962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:10.943706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.943989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.944349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.954865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:10.962339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b459e-ab64-43fb-844b-b4cb57b1181c service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:10.969465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:10.970611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:10.971690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:10.971967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] PATH_INFO: `/v3/projects/859576f2b9e245feab22c9ddf0bab93d/users/4d277c09114a4ae597f2e840f5f9aa72/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:10.997433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859576f2b9e245feab22c9ddf0bab93d, user_id=4d277c09114a4ae597f2e840f5f9aa72, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:11.001580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:11.075124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:11.076406 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2895/5699] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:10 2021] PUT /identity/v3/projects/859576f2b9e245feab22c9ddf0bab93d/users/4d277c09114a4ae597f2e840f5f9aa72/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:11.079414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:11.079574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:11.093481 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2805/5700] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:11.105265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:11.131150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376cbc-ab1a-4ebc-9ca6-e448e93a2c8f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:11.152556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea13f4-e5bf-4e9c-bdaa-979a2e482791 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:11.159487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:11.160700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:11.161018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:11.161391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:11.279975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:11.282472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:11.296798 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2896/5701] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:11.298935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1ae68-d5e3-4c52-a4c4-543a7aa0ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:11.299631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1ae68-d5e3-4c52-a4c4-543a7aa0ff21 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:11.300487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1ae68-d5e3-4c52-a4c4-543a7aa0ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:11.300487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1ae68-d5e3-4c52-a4c4-543a7aa0ff21 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:11.300954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1ae68-d5e3-4c52-a4c4-543a7aa0ff21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:11.305965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1ae68-d5e3-4c52-a4c4-543a7aa0ff21 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:11.324506 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2806/5702] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:11.330701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:11.344857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b3825-3d06-424e-8b3c-3cf316a8bf73 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:11.350700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:11.351814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:11.356445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:11.356445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] PATH_INFO: `/v3/projects/859576f2b9e245feab22c9ddf0bab93d/users/4d277c09114a4ae597f2e840f5f9aa72/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:11.356445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859576f2b9e245feab22c9ddf0bab93d, user_id=4d277c09114a4ae597f2e840f5f9aa72, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:11.359101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:11.379510 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2897/5703] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:11 2021] PUT /identity/v3/projects/859576f2b9e245feab22c9ddf0bab93d/users/4d277c09114a4ae597f2e840f5f9aa72/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:11.389846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:11.390945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:11.391710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:11.430930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] MFA Rules not processed for user `4d277c09114a4ae597f2e840f5f9aa72`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:11.433018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:11.558823 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2807/5704] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:11 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:11.593779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:11.596355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:11.691434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c807d-125e-4d39-a786-13409d3db783 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:11.697803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:11.698645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:11.699091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:11.699370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:11.713140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:11.715234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:11.762771 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2898/5705] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:11 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:12.955687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:12.955687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:13.063016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfce26-6573-4f37-9257-d6407490f159 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:13.068900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:13.071077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:13.071463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:13.071799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] PATH_INFO: `/v3/projects/75848700487f4c02a434ecc788fafae6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:13.073385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75848700487f4c02a434ecc788fafae6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:13.075503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:13.255014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75848700487f4c02a434ecc788fafae6', 'request_id': 'req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.262309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75848700487f4c02a434ecc788fafae6', 'request_id': 'req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.331410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75848700487f4c02a434ecc788fafae6', 'request_id': 'req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.361312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] The token cache is being invalidate because project 75848700487f4c02a434ecc788fafae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:13.361312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.362197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.368824 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2808/5706] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:12 2021] DELETE /identity/v3/projects/75848700487f4c02a434ecc788fafae6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:13.370103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:13.390026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab453a-15f5-4200-8fae-d01a58fd58ea service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:13.479115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:13.479115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:13.479115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:13.479115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] PATH_INFO: `/v3/users/ee439fe3c2d74ff289441fbe8e122b1f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:13.479588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee439fe3c2d74ff289441fbe8e122b1f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:13.481117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:13.687903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee439fe3c2d74ff289441fbe8e122b1f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.702995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee439fe3c2d74ff289441fbe8e122b1f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.735674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee439fe3c2d74ff289441fbe8e122b1f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.738158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee439fe3c2d74ff289441fbe8e122b1f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.837819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7ff61fd8-f129-4c4a-a420-e42affc8a5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee439fe3c2d74ff289441fbe8e122b1f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:13.848923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2899/5707] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:13 2021] DELETE /identity/v3/users/ee439fe3c2d74ff289441fbe8e122b1f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:15.113798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:15.116578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:15.134033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5c221-b5b1-47e8-a7f7-d2b907853c7c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:15.217962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:15.219635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:15.220435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:15.220824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] PATH_INFO: `/v3/projects/1332fd4206ee4e3ca09e322448860007` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:15.223268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1332fd4206ee4e3ca09e322448860007)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:15.226310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:15.400518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1332fd4206ee4e3ca09e322448860007', 'request_id': 'req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:15.409866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1332fd4206ee4e3ca09e322448860007', 'request_id': 'req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:15.513189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1332fd4206ee4e3ca09e322448860007', 'request_id': 'req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:15.527979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] The token cache is being invalidate because project 1332fd4206ee4e3ca09e322448860007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:15.528314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:15.531147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8ba84bbf-5a12-4c1f-af4a-4dd9dd77ebfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:15.542742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2809/5708] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:15 2021] DELETE /identity/v3/projects/1332fd4206ee4e3ca09e322448860007 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:15.549570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da102-0c63-4e8b-a1cb-47134fd35b69 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:15.550449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da102-0c63-4e8b-a1cb-47134fd35b69 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:15.550929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179da102-0c63-4e8b-a1cb-47134fd35b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:15.597052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-179da102-0c63-4e8b-a1cb-47134fd35b69 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:15.606735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-179da102-0c63-4e8b-a1cb-47134fd35b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:15.687802 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2900/5709] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:15.696056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16735ed8-3d46-4f88-8416-256d5a805784 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:15.696433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16735ed8-3d46-4f88-8416-256d5a805784 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:15.697472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16735ed8-3d46-4f88-8416-256d5a805784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:15.721301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-16735ed8-3d46-4f88-8416-256d5a805784 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:15.722538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-16735ed8-3d46-4f88-8416-256d5a805784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:15.735982 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2810/5710] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:15.740278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da102-0c63-4e8b-a1cb-47134fd35b69 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:15.750375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179da102-0c63-4e8b-a1cb-47134fd35b69 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:15.760250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:15.760250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:15.760250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:15.760250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:15.760718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:15.760718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:15.761381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:15.781157 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2901/5711] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:15.786502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16735ed8-3d46-4f88-8416-256d5a805784 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:15.797265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16735ed8-3d46-4f88-8416-256d5a805784 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:15.802344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:15.803111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:15.803489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:15.803863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:15.804671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:15.807201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:15.932568 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2811/5712] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:15 2021] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:15.937040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:15.951538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9369b95-0f1a-4c3b-b92e-28e76712e843 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:16.024777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:16.025674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:16.026084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:16.026463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:16.027291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:16.029417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:16.114757 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2902/5713] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:15 2021] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:16.119355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:16.133107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf41fb-b0fc-42b1-b8cf-14b1bc27f513 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:16.138883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:16.139963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:16.141175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:16.141375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:16.142553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:16.144772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:16.157514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2812/5714] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:16 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:16.161941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:16.173685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1654f4-3304-4a4c-be2f-5fd75269d386 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:16.179720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b93e6-80ac-49da-95f5-7b9fe1b6050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:16.180544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b93e6-80ac-49da-95f5-7b9fe1b6050b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:16.180966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b93e6-80ac-49da-95f5-7b9fe1b6050b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:16.181344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b93e6-80ac-49da-95f5-7b9fe1b6050b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:16.182179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b93e6-80ac-49da-95f5-7b9fe1b6050b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:16.184045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b93e6-80ac-49da-95f5-7b9fe1b6050b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:16.195862 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2903/5715] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:16 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:16.201099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:16.215588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dbf79-37ae-44f5-b778-a5a12f20fb0c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:16.222085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:16.223261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:16.224166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:16.224623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] PATH_INFO: `/v3/projects/f2ae4213c5284c2e83951c885ed24c07/users/03c79cffce92412ca4dc094bf247e699/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:16.250387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ae4213c5284c2e83951c885ed24c07, user_id=03c79cffce92412ca4dc094bf247e699, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:16.253640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:16.366427 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2813/5716] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:16 2021] PUT /identity/v3/projects/f2ae4213c5284c2e83951c885ed24c07/users/03c79cffce92412ca4dc094bf247e699/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:16.368295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a881-bad9-41da-9282-4d69536bbc0a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:16.369198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a881-bad9-41da-9282-4d69536bbc0a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:16.369198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a881-bad9-41da-9282-4d69536bbc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:16.401104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b241a881-bad9-41da-9282-4d69536bbc0a None None] MFA Rules not processed for user `03c79cffce92412ca4dc094bf247e699`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:16.402398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b241a881-bad9-41da-9282-4d69536bbc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:16.474749 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2904/5717] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:16.475888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:16.553994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddb807-8e0b-4c19-b501-44dade8bd369 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:16.558994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:16.559648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:16.559929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:16.560203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:16.560920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:16.563521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:16.704243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2814/5718] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:16 2021] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:16.708847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a881-bad9-41da-9282-4d69536bbc0a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:16.722278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a881-bad9-41da-9282-4d69536bbc0a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:16.788292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:16.789016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:16.789304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:16.789580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:16.790282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:16.792296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:16.959672 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2905/5719] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:16 2021] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:16.965567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:16.987906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b277c10-f2be-43f8-a1bf-3716516c1542 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:16.997806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:17.003559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:17.003936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:17.004069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:17.005008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:17.006718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:17.023215 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2815/5720] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:16 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:17.035878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:17.046423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257e363-2a45-4e24-b3bb-be129645dd88 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:17.061714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:17.063741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:17.066314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:17.067150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] PATH_INFO: `/v3/projects/11dbaf75025641a583f8da351941d2bc/users/02dd8b1a0ddb48b5b5a78d378b689e30/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:17.101708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11dbaf75025641a583f8da351941d2bc, user_id=02dd8b1a0ddb48b5b5a78d378b689e30, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:17.105802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:17.204432 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2906/5721] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:17 2021] PUT /identity/v3/projects/11dbaf75025641a583f8da351941d2bc/users/02dd8b1a0ddb48b5b5a78d378b689e30/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:17.206664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:17.219545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb107e-a994-40a7-9b37-63df70f0a43c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:17.293688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056c6e-9a66-4b7a-84f7-8c8ba550cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:17.294842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056c6e-9a66-4b7a-84f7-8c8ba550cfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:17.295317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056c6e-9a66-4b7a-84f7-8c8ba550cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:17.295774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056c6e-9a66-4b7a-84f7-8c8ba550cfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:17.297285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056c6e-9a66-4b7a-84f7-8c8ba550cfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:17.299217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49056c6e-9a66-4b7a-84f7-8c8ba550cfb5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:17.317073 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2816/5722] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:17 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:17.320919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:17.337418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f12ef-9174-4092-a557-8f63f4cb87d5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:17.344711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:17.350841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:17.351185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:17.351475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] PATH_INFO: `/v3/projects/11dbaf75025641a583f8da351941d2bc/users/02dd8b1a0ddb48b5b5a78d378b689e30/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:17.353916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11dbaf75025641a583f8da351941d2bc, user_id=02dd8b1a0ddb48b5b5a78d378b689e30, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:17.356950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:17.373072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2907/5723] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:17 2021] PUT /identity/v3/projects/11dbaf75025641a583f8da351941d2bc/users/02dd8b1a0ddb48b5b5a78d378b689e30/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:17.384775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:17.385114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:17.385398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:17.416368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] MFA Rules not processed for user `02dd8b1a0ddb48b5b5a78d378b689e30`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:17.417593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:17.507149 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2817/5724] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:17 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:17.527427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:17.540369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:17.760427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ab284-8387-4d6e-9ced-ce54ccc81cb6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:17.765219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae24cd-1581-49a8-afe0-4a98ce71a9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:17.766823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae24cd-1581-49a8-afe0-4a98ce71a9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:17.767338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae24cd-1581-49a8-afe0-4a98ce71a9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:17.768165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae24cd-1581-49a8-afe0-4a98ce71a9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:17.789275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae24cd-1581-49a8-afe0-4a98ce71a9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:17.791620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae24cd-1581-49a8-afe0-4a98ce71a9f0 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:17.809385 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2908/5725] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:17 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:18.057690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:18.057690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:18.121684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c1c1-e2e9-47dc-a240-84386fd179c7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:18.131321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:18.131321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:18.131321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:18.131321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] PATH_INFO: `/v3/users/1ed5effe2d764fe583f7ce5bb4376959` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:18.131783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed5effe2d764fe583f7ce5bb4376959)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:18.133073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:18.413440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed5effe2d764fe583f7ce5bb4376959'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:18.429339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed5effe2d764fe583f7ce5bb4376959'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:18.481898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed5effe2d764fe583f7ce5bb4376959'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:18.483312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed5effe2d764fe583f7ce5bb4376959'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:18.487530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed5effe2d764fe583f7ce5bb4376959'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:18.558675 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2818/5726] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:18 2021] DELETE /identity/v3/users/1ed5effe2d764fe583f7ce5bb4376959 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:18.563544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:18.564389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:18.564862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:18.599023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:18.604930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:18.631817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:18.633051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:18.790760 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2909/5727] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:18.809884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:18.813693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:18.918699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639c9c1-4ef3-4112-bbef-1c6fadd2b8f6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:18.926461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7a188-7b16-4b2f-a966-5d0e4cc5d1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:18.926461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a188-7b16-4b2f-a966-5d0e4cc5d1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:18.926461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a188-7b16-4b2f-a966-5d0e4cc5d1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:18.926461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a188-7b16-4b2f-a966-5d0e4cc5d1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:18.949172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7a188-7b16-4b2f-a966-5d0e4cc5d1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:18.957636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7a188-7b16-4b2f-a966-5d0e4cc5d1a9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:18.981558 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2910/5728] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:27:19.053230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b855e48-f5b5-471f-b541-434277c52090 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:19.064910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:19.068276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:19.068276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:19.068276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] PATH_INFO: `/v3/users/49fed5bfc497491b8e6d42fe87da9fdf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:19.068276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fed5bfc497491b8e6d42fe87da9fdf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:19.069653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:19.322158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fed5bfc497491b8e6d42fe87da9fdf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:19.329897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fed5bfc497491b8e6d42fe87da9fdf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:19.346698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fed5bfc497491b8e6d42fe87da9fdf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:19.348200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fed5bfc497491b8e6d42fe87da9fdf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:19.350074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fed5bfc497491b8e6d42fe87da9fdf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:19.419102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2819/5729] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:18 2021] DELETE /identity/v3/users/49fed5bfc497491b8e6d42fe87da9fdf => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:19.424335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:19.424842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:19.425327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:19.445722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:19.447426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:19.522098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2911/5730] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:19.535135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:19.536521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:19.634872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289d6e3-591c-46ef-aa85-7e1563dd34d9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:19.641305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:19.642390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:19.642748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:19.643106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:19.661049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:19.667122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:19.676341 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2820/5731] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:20.174359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:20.177360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:20.200417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1487c7-f7e1-4550-9bc4-3e180b4835c2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:20.217013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:20.218670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:20.219326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:20.220056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] PATH_INFO: `/v3/projects/a952d5c0b31746ef88cf747a4aa50f9f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:20.221593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a952d5c0b31746ef88cf747a4aa50f9f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:20.225198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:20.404059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a952d5c0b31746ef88cf747a4aa50f9f', 'request_id': 'req-6868e6cc-23ce-4279-b6e4-244dfb2f578b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:20.473699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a952d5c0b31746ef88cf747a4aa50f9f', 'request_id': 'req-6868e6cc-23ce-4279-b6e4-244dfb2f578b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:20.482003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a952d5c0b31746ef88cf747a4aa50f9f', 'request_id': 'req-6868e6cc-23ce-4279-b6e4-244dfb2f578b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:20.497242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] The token cache is being invalidate because project a952d5c0b31746ef88cf747a4aa50f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:20.497485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:20.498086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:20.503428 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2912/5732] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:20 2021] DELETE /identity/v3/projects/a952d5c0b31746ef88cf747a4aa50f9f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:20.504852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:20.516189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf662b8-1ed7-4264-b31f-0922d17e0060 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:20.605421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:20.606986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:20.625332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:20.626549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:20.627699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:20.628266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] PATH_INFO: `/v3/users/4d277c09114a4ae597f2e840f5f9aa72` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:20.629986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d277c09114a4ae597f2e840f5f9aa72)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:20.632240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:20.723078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868e6cc-23ce-4279-b6e4-244dfb2f578b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:20.729467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:20.730869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:20.731333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:20.731799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] PATH_INFO: `/v3/users/d3e5ee346c3441fc921bf4c5fde1ef4b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:20.733337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e5ee346c3441fc921bf4c5fde1ef4b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:20.736414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:21.291426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e5ee346c3441fc921bf4c5fde1ef4b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.292011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d277c09114a4ae597f2e840f5f9aa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.306546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e5ee346c3441fc921bf4c5fde1ef4b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.308634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d277c09114a4ae597f2e840f5f9aa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.333604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d277c09114a4ae597f2e840f5f9aa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.335312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d277c09114a4ae597f2e840f5f9aa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.336101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d277c09114a4ae597f2e840f5f9aa72'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.336858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e5ee346c3441fc921bf4c5fde1ef4b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.337789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e5ee346c3441fc921bf4c5fde1ef4b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.456200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2821/5733] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:20 2021] DELETE /identity/v3/users/4d277c09114a4ae597f2e840f5f9aa72 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:21.457088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:21.464992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:21.559443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9f4d7d8d-0203-4204-9d37-fb011ad6c33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e5ee346c3441fc921bf4c5fde1ef4b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.573575 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2913/5734] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:20 2021] DELETE /identity/v3/users/d3e5ee346c3441fc921bf4c5fde1ef4b => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:21.575857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:21.578306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:21.578807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:21.629326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:21.634245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:21.650814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bb119-d73c-4c79-9c4a-2ab9b401cfb0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:21.746386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:21.748199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:21.748809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:21.749289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] PATH_INFO: `/v3/projects/1be0d45237a542a49fabfb290667266c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:21.750821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be0d45237a542a49fabfb290667266c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:21.753226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:21.796426 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2914/5735] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:21.809310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:21.811084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:21.889397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d49ac-a9f3-4ddd-b237-8aa27ed9c4c6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:21.897050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:21.899214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:21.899638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:21.900555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:21.918344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:21.920431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:21.937539 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2915/5736] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:21.941716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be0d45237a542a49fabfb290667266c', 'request_id': 'req-af8ae840-39c1-4599-8acf-997bede984ec'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.952363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be0d45237a542a49fabfb290667266c', 'request_id': 'req-af8ae840-39c1-4599-8acf-997bede984ec'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:21.986408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:21.988256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:22.011115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dd024-6530-4b20-a033-b8dd415f6fc9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:22.090619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be0d45237a542a49fabfb290667266c', 'request_id': 'req-af8ae840-39c1-4599-8acf-997bede984ec'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.108957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] The token cache is being invalidate because project 1be0d45237a542a49fabfb290667266c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:22.109273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.110467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.112658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2822/5737] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:21 2021] DELETE /identity/v3/projects/1be0d45237a542a49fabfb290667266c => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:22.119059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:22.121086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:22.132479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:22.133538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:22.133897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:22.134312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] PATH_INFO: `/v3/projects/859576f2b9e245feab22c9ddf0bab93d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:22.148555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859576f2b9e245feab22c9ddf0bab93d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:22.149691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae840-39c1-4599-8acf-997bede984ec admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:22.150563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:22.156969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:22.158849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:22.159528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:22.159980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] PATH_INFO: `/v3/users/e57e4c842d7545ab831f0ad5e820e23d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:22.162873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57e4c842d7545ab831f0ad5e820e23d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:22.166838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:22.557563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859576f2b9e245feab22c9ddf0bab93d', 'request_id': 'req-172ad695-1ce1-4ee0-851f-426d81e17637'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.561249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57e4c842d7545ab831f0ad5e820e23d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.586833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57e4c842d7545ab831f0ad5e820e23d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.610678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57e4c842d7545ab831f0ad5e820e23d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.611551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57e4c842d7545ab831f0ad5e820e23d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.612239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9fdf748c-3845-4455-b35c-9476041db290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57e4c842d7545ab831f0ad5e820e23d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.645033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859576f2b9e245feab22c9ddf0bab93d', 'request_id': 'req-172ad695-1ce1-4ee0-851f-426d81e17637'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.668658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859576f2b9e245feab22c9ddf0bab93d', 'request_id': 'req-172ad695-1ce1-4ee0-851f-426d81e17637'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.687928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] The token cache is being invalidate because project 859576f2b9e245feab22c9ddf0bab93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:22.689154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.690037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:22.697293 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2916/5738] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:21 2021] DELETE /identity/v3/projects/859576f2b9e245feab22c9ddf0bab93d => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:22.698535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:22.702023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:22.759446 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2823/5739] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:22 2021] DELETE /identity/v3/users/e57e4c842d7545ab831f0ad5e820e23d => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:22.762126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9525-128c-4453-8a25-0bc2bc46f3b6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:22.763528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9525-128c-4453-8a25-0bc2bc46f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:22.767656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9525-128c-4453-8a25-0bc2bc46f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:22.861508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ad695-1ce1-4ee0-851f-426d81e17637 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:22.897696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-59ba9525-128c-4453-8a25-0bc2bc46f3b6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:22.899332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-59ba9525-128c-4453-8a25-0bc2bc46f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:22.991414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:22.993244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:22.993703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:22.997682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] PATH_INFO: `/v3/projects/1a30408bfc1c43ddad1910ff6dced273` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:22.997682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a30408bfc1c43ddad1910ff6dced273)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.000361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.033254 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2824/5740] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:23.037405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f03d-70ab-4696-93ec-8c4209acbde0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.037920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f03d-70ab-4696-93ec-8c4209acbde0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.038378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7f03d-70ab-4696-93ec-8c4209acbde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.064845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-aff7f03d-70ab-4696-93ec-8c4209acbde0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:23.066392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aff7f03d-70ab-4696-93ec-8c4209acbde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.081796 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2825/5741] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:23.082873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7f03d-70ab-4696-93ec-8c4209acbde0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.096459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7f03d-70ab-4696-93ec-8c4209acbde0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.102808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.104148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.104543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.105912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.105912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:23.107583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.111258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.126499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2826/5742] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:23.135089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.145332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ff457-94cf-4ff6-93cf-39b546370c26 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.164658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a30408bfc1c43ddad1910ff6dced273', 'request_id': 'req-a2acb913-666d-4729-9c0a-c9cd8f87d480'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.231756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b430a9-7ab8-49af-a5e6-a3428b3f9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.232430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b430a9-7ab8-49af-a5e6-a3428b3f9dbd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.232715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b430a9-7ab8-49af-a5e6-a3428b3f9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.233180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b430a9-7ab8-49af-a5e6-a3428b3f9dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.234423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b430a9-7ab8-49af-a5e6-a3428b3f9dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.236726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b430a9-7ab8-49af-a5e6-a3428b3f9dbd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.294232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a30408bfc1c43ddad1910ff6dced273', 'request_id': 'req-a2acb913-666d-4729-9c0a-c9cd8f87d480'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.301642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a30408bfc1c43ddad1910ff6dced273', 'request_id': 'req-a2acb913-666d-4729-9c0a-c9cd8f87d480'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.325988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] The token cache is being invalidate because project 1a30408bfc1c43ddad1910ff6dced273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:23.326130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.327202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.338516 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2917/5743] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:22 2021] DELETE /identity/v3/projects/1a30408bfc1c43ddad1910ff6dced273 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:23.339729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.341829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.363915 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2827/5744] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:23.365521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.365906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.366243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.384266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acb913-666d-4729-9c0a-c9cd8f87d480 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.400965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:23.404330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.497391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.498276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.498561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.498897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] PATH_INFO: `/v3/projects/52b6f4e629c1439384734404a004a37c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.500778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b6f4e629c1439384734404a004a37c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.502949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.521917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2828/5745] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:23.522568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.531047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.556007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3a3a4-dbec-46ae-aaf4-d895d827ad8c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.561385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb2376-d9d2-4a3c-8fc9-3d30a5412b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.562797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb2376-d9d2-4a3c-8fc9-3d30a5412b83 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.563912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb2376-d9d2-4a3c-8fc9-3d30a5412b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.564207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb2376-d9d2-4a3c-8fc9-3d30a5412b83 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.564954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb2376-d9d2-4a3c-8fc9-3d30a5412b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.566906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb2376-d9d2-4a3c-8fc9-3d30a5412b83 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.645187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b6f4e629c1439384734404a004a37c', 'request_id': 'req-55522683-6b2d-43ad-a02e-0e70a4b6e749'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.675272 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2829/5746] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:23.675272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee395e2-646d-4ce4-b85b-ed3b66552032 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.675272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee395e2-646d-4ce4-b85b-ed3b66552032 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.675587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee395e2-646d-4ce4-b85b-ed3b66552032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.702598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bee395e2-646d-4ce4-b85b-ed3b66552032 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:23.704976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bee395e2-646d-4ce4-b85b-ed3b66552032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.722318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b6f4e629c1439384734404a004a37c', 'request_id': 'req-55522683-6b2d-43ad-a02e-0e70a4b6e749'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.731279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b6f4e629c1439384734404a004a37c', 'request_id': 'req-55522683-6b2d-43ad-a02e-0e70a4b6e749'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.745821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] The token cache is being invalidate because project 52b6f4e629c1439384734404a004a37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:23.746967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.747691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:23.750420 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2918/5747] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:23 2021] DELETE /identity/v3/projects/52b6f4e629c1439384734404a004a37c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:23.755448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.755448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.789200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2830/5748] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:23.792064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eede3-ac3b-4293-994f-27574c7d213d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.792353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eede3-ac3b-4293-994f-27574c7d213d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.792616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eede3-ac3b-4293-994f-27574c7d213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.824160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-520eede3-ac3b-4293-994f-27574c7d213d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:23.825445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-520eede3-ac3b-4293-994f-27574c7d213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.835490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522683-6b2d-43ad-a02e-0e70a4b6e749 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.842714 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2831/5749] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:23.845085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eede3-ac3b-4293-994f-27574c7d213d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.849756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4074013-6e64-42dd-867c-3eb7ae5fc69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.852804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074013-6e64-42dd-867c-3eb7ae5fc69e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.853155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074013-6e64-42dd-867c-3eb7ae5fc69e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.853447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4074013-6e64-42dd-867c-3eb7ae5fc69e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.855366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4074013-6e64-42dd-867c-3eb7ae5fc69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.855739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eede3-ac3b-4293-994f-27574c7d213d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.858065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4074013-6e64-42dd-867c-3eb7ae5fc69e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.874026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.874775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.875107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.875412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.876136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:23.876626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.878278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.888964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2919/5750] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:23 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:23.893621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b4a9-9b13-49e1-ac00-397aa1558187 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.894139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b4a9-9b13-49e1-ac00-397aa1558187 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.897745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b4a9-9b13-49e1-ac00-397aa1558187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.920980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2832/5751] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:23.921741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.936726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f667b4a9-9b13-49e1-ac00-397aa1558187 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:23.938613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f667b4a9-9b13-49e1-ac00-397aa1558187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:23.942220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23d19b-062c-424f-bdbb-90b3051c3d49 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.949394 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2920/5752] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:23.951384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667b4a9-9b13-49e1-ac00-397aa1558187 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:23.962601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667b4a9-9b13-49e1-ac00-397aa1558187 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:23.975490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.976610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.977217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:23.977611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.977893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:23.978175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:23.978455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.979443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.979659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:23.980524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:23.981443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:23.984838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.016653 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2833/5753] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:23 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:24.017661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.055418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc318354-94a0-49de-afd9-4f633a04bb40 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.078712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.080108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.080108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.080108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.083956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:24.083956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.083956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.102041 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2834/5754] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:24.104279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.114820 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2921/5755] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:23 2021] POST /identity/v3/projects => generated 359 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:24.116212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.120697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c795f-1213-4202-bfa6-c6eba66f2f5e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.201375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.202557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.202839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.203311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] PATH_INFO: `/v3/projects/99d6c9e78d524ae1bc3a93046439d34f/users/ba78d3d0b3c04afb9df27775a15310e5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.223602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd79e-1d67-4659-9c1f-a6d8a294b96e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.229696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d6c9e78d524ae1bc3a93046439d34f, user_id=ba78d3d0b3c04afb9df27775a15310e5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.231083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac24151-f7c0-4551-8bb0-be202944a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.231852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24151-f7c0-4551-8bb0-be202944a9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.232212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24151-f7c0-4551-8bb0-be202944a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.232588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac24151-f7c0-4551-8bb0-be202944a9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.233424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac24151-f7c0-4551-8bb0-be202944a9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.235369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.236510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac24151-f7c0-4551-8bb0-be202944a9d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.352004 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2835/5756] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:24 2021] PUT /identity/v3/projects/99d6c9e78d524ae1bc3a93046439d34f/users/ba78d3d0b3c04afb9df27775a15310e5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:24.352004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.455019 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2922/5757] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:24 2021] POST /identity/v3/projects => generated 369 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:24.458243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e09b7-a701-4388-acdf-a005fdb69127 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.458895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e09b7-a701-4388-acdf-a005fdb69127 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.459696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e09b7-a701-4388-acdf-a005fdb69127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.499722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd6d1f-c34b-4b15-b1ca-ef8a0beddf83 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.559637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-382e09b7-a701-4388-acdf-a005fdb69127 None None] MFA Rules not processed for user `ba78d3d0b3c04afb9df27775a15310e5`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:24.561086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-382e09b7-a701-4388-acdf-a005fdb69127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:24.635591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.637440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.637897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.638377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.639433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.643044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.657829 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2923/5758] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:24 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:24.665656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e09b7-a701-4388-acdf-a005fdb69127 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.679323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e09b7-a701-4388-acdf-a005fdb69127 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.684256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.685042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.685388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.685730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.686699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.688785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.767339 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2836/5759] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:24 2021] POST /identity/v3/users => generated 280 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:24.768167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.771454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:24.833864 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2924/5760] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:24 2021] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:24.834555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.845149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71fb8-f082-4780-9265-356546fc6a7d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.849690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e06e-9938-4856-bdcf-1c44bc4eb1d8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.850217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.850452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.850727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.850999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.851716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.853336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.853922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.854695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.854982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.855252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.865329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.867023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.875918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2925/5761] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:24.876792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.878224 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2837/5762] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:24 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:24.879452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.893034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f439e8-8aad-4f04-b0c5-d626aeb44cb9 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.905396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.910579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.910579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.910579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.910579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.910579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.917271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f480d38-c623-47ab-a3d9-8cec1cab128c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.924213 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2838/5763] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:27:24.925226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.925897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.926181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.926459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.927193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.928251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.928810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.949835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122536e-27a9-4bcb-be6d-f73e4a3a8476 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.950067 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2926/5764] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:24.955275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:24.967772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09b02c-ce3e-4749-aea5-185603acec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.970157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09b02c-ce3e-4749-aea5-185603acec45 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.970157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09b02c-ce3e-4749-aea5-185603acec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.970157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09b02c-ce3e-4749-aea5-185603acec45 admin admin] PATH_INFO: `/v3/projects/4bad81526f144678b49f493aa5d860d1/users/44e26685d0584786a0a870ec0f8eb6f5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.973684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52469f-2213-4ee5-a8ef-40cd2ce00831 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:24.985310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:24.986068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:24.986476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:24.986910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:24.987141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09b02c-ce3e-4749-aea5-185603acec45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bad81526f144678b49f493aa5d860d1, user_id=44e26685d0584786a0a870ec0f8eb6f5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.987859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:24.989658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:24.989926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09b02c-ce3e-4749-aea5-185603acec45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:25.002876 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2927/5765] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:25.007051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:25.021428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ad45-92e6-4551-8b16-83e847460442 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:25.031839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c26e0-d768-4eb4-ba5d-bb5488e1d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:25.032990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c26e0-d768-4eb4-ba5d-bb5488e1d854 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:25.033489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c26e0-d768-4eb4-ba5d-bb5488e1d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:25.033972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c26e0-d768-4eb4-ba5d-bb5488e1d854 admin admin] PATH_INFO: `/v3/projects/70fdeb50a23f42c4bedba3950b7fce5c/users/3ede6f3f62de4cb0bf9c54f76856078f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:25.045941 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2839/5766] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:24 2021] PUT /identity/v3/projects/4bad81526f144678b49f493aa5d860d1/users/44e26685d0584786a0a870ec0f8eb6f5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:25.056491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:25.056785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:25.057095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:25.058221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c26e0-d768-4eb4-ba5d-bb5488e1d854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fdeb50a23f42c4bedba3950b7fce5c, user_id=3ede6f3f62de4cb0bf9c54f76856078f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:25.066766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c26e0-d768-4eb4-ba5d-bb5488e1d854 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:25.112663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] MFA Rules not processed for user `44e26685d0584786a0a870ec0f8eb6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:25.116786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:25.163164 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2928/5767] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:25 2021] PUT /identity/v3/projects/70fdeb50a23f42c4bedba3950b7fce5c/users/3ede6f3f62de4cb0bf9c54f76856078f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:25.175302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed493-cee7-4bae-a071-fd0cc25227c0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:25.175716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed493-cee7-4bae-a071-fd0cc25227c0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:25.176112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed493-cee7-4bae-a071-fd0cc25227c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:25.226910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a63ed493-cee7-4bae-a071-fd0cc25227c0 None None] MFA Rules not processed for user `3ede6f3f62de4cb0bf9c54f76856078f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:25.227882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a63ed493-cee7-4bae-a071-fd0cc25227c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:25.260411 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2840/5768] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:25 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:25.290982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:25.294059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:25.336162 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2929/5769] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:25 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:25.345828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ed493-cee7-4bae-a071-fd0cc25227c0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:25.401938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831059da-1da1-45cf-9487-9a918ceac52b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:25.447149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ed493-cee7-4bae-a071-fd0cc25227c0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:25.458954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:25.460283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:25.460869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:25.461953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] PATH_INFO: `/v3/users/ba78d3d0b3c04afb9df27775a15310e5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:25.462614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:25.465097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:25.465481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:25.465827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:25.466290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba78d3d0b3c04afb9df27775a15310e5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:25.489634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:25.554205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:25.556980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:25.567675 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2841/5770] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:25 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:27:25.569293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:25.581717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab2525-8088-4ecb-8989-46e80fa23cb8 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:25.585874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0283a7-68e1-4e3a-b318-ddf961430654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:25.586592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0283a7-68e1-4e3a-b318-ddf961430654 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:25.586960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0283a7-68e1-4e3a-b318-ddf961430654 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:25.587267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0283a7-68e1-4e3a-b318-ddf961430654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:25.601502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0283a7-68e1-4e3a-b318-ddf961430654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:25.603588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0283a7-68e1-4e3a-b318-ddf961430654 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:25.612690 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2842/5771] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:25 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:25.700254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba78d3d0b3c04afb9df27775a15310e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:25.713780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba78d3d0b3c04afb9df27775a15310e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:25.733212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba78d3d0b3c04afb9df27775a15310e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:25.737168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba78d3d0b3c04afb9df27775a15310e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:25.855036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba78d3d0b3c04afb9df27775a15310e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:25.862961 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2930/5772] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:25 2021] DELETE /identity/v3/users/ba78d3d0b3c04afb9df27775a15310e5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:25.866510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:25.867009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:25.867108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:25.890614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:25.892044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:26.004514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2843/5773] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:26.035552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:26.042188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:26.106952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ac10-23f0-499d-a2b3-9856053fdc73 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:26.112539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091bf2c-b536-48e7-8a6c-06ebbe9ccb1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:26.113898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091bf2c-b536-48e7-8a6c-06ebbe9ccb1d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:26.113898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091bf2c-b536-48e7-8a6c-06ebbe9ccb1d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:26.114136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091bf2c-b536-48e7-8a6c-06ebbe9ccb1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:26.129248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091bf2c-b536-48e7-8a6c-06ebbe9ccb1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:26.131040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091bf2c-b536-48e7-8a6c-06ebbe9ccb1d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:26.143820 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2931/5774] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:27:27.982279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:27.984905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:28.004023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15896c1-a798-4c9b-a54f-8ffcbceea9f9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:28.031936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:28.034152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:28.034669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:28.035169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] PATH_INFO: `/v3/projects/99d6c9e78d524ae1bc3a93046439d34f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:28.038226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d6c9e78d524ae1bc3a93046439d34f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:28.042864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:28.194204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d6c9e78d524ae1bc3a93046439d34f', 'request_id': 'req-ccfe0a2c-cd97-47d0-9512-35b96610de0a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:28.201949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d6c9e78d524ae1bc3a93046439d34f', 'request_id': 'req-ccfe0a2c-cd97-47d0-9512-35b96610de0a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:28.317337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d6c9e78d524ae1bc3a93046439d34f', 'request_id': 'req-ccfe0a2c-cd97-47d0-9512-35b96610de0a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:28.331283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] The token cache is being invalidate because project 99d6c9e78d524ae1bc3a93046439d34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:28.333411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:28.333411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ccfe0a2c-cd97-47d0-9512-35b96610de0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:28.338518 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2844/5775] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:27 2021] DELETE /identity/v3/projects/99d6c9e78d524ae1bc3a93046439d34f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:28.340281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e173c3-9800-4c84-a54c-52c9e10bd5e5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:28.340757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e173c3-9800-4c84-a54c-52c9e10bd5e5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:28.340866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e173c3-9800-4c84-a54c-52c9e10bd5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:28.369839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-08e173c3-9800-4c84-a54c-52c9e10bd5e5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:28.371211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-08e173c3-9800-4c84-a54c-52c9e10bd5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:28.483206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc9c82-5432-47c7-a46c-7490cc06b8da None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:28.483370 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2932/5776] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:28.483484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc9c82-5432-47c7-a46c-7490cc06b8da None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:28.484328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc9c82-5432-47c7-a46c-7490cc06b8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:28.553760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f2cc9c82-5432-47c7-a46c-7490cc06b8da None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:28.556466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2cc9c82-5432-47c7-a46c-7490cc06b8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:28.575248 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2845/5777] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:28.581083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e173c3-9800-4c84-a54c-52c9e10bd5e5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:28.596359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e173c3-9800-4c84-a54c-52c9e10bd5e5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:28.602426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:28.603836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:28.605084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:28.605366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:28.606128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:28.606482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:28.609141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:28.637753 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2933/5778] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:28.639552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc9c82-5432-47c7-a46c-7490cc06b8da None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:28.651662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc9c82-5432-47c7-a46c-7490cc06b8da None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:28.660793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:28.663109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:28.663502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:28.666595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:28.667485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:28.673385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:28.895574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2846/5779] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:28 2021] POST /identity/v3/projects => generated 353 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:28.899628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:28.918305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f571c-f6c7-43c1-bdc1-89abdcbc87a6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:29.018898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:29.019670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:29.020019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:29.020368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:29.021187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:29.023617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:29.128324 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2934/5780] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:28 2021] POST /identity/v3/users => generated 277 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:29.133319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:29.150142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b84cf-2c97-421a-b7e6-2b420eae08bd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:29.161365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:29.162059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:29.162341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:29.162807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:29.163725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:29.165547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:29.193629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2847/5781] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:29 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:29.197972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:29.220998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6894d3-ffff-493b-9378-a9e29c3b7893 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:29.229770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb77f5-7e49-43e0-beec-fa15a1975fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:29.230852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb77f5-7e49-43e0-beec-fa15a1975fcb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:29.231382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb77f5-7e49-43e0-beec-fa15a1975fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:29.231742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb77f5-7e49-43e0-beec-fa15a1975fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:29.232676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb77f5-7e49-43e0-beec-fa15a1975fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:29.235045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb77f5-7e49-43e0-beec-fa15a1975fcb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:29.252442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2935/5782] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:29 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:29.256319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:29.266959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78aa85-8e91-4c02-a82d-aa358e4d2688 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:29.271843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:29.272988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:29.273480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:29.273935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] PATH_INFO: `/v3/projects/b500bad506714b458fe3459f05f62f29/users/bdd2a841da6c40b199ae939e2c84e3fb/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:29.299848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b500bad506714b458fe3459f05f62f29, user_id=bdd2a841da6c40b199ae939e2c84e3fb, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:29.305358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:29.391694 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2848/5783] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:29 2021] PUT /identity/v3/projects/b500bad506714b458fe3459f05f62f29/users/bdd2a841da6c40b199ae939e2c84e3fb/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:29.402682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:29.407327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:29.407327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:29.434509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] MFA Rules not processed for user `bdd2a841da6c40b199ae939e2c84e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:29.438531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:29.521018 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2936/5784] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:29 2021] POST /identity/v3/auth/tokens => generated 3220 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:29.559298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:29.562125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:29.653609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54a5d-6d7f-40fc-bca6-b0e5eec8dbba admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:29.659071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:29.660055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:29.660375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:29.661192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:29.679707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:29.681428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:29.693107 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2849/5785] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:29 2021] GET /identity/v3/auth/tokens => generated 3220 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:32.238130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:32.239711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:32.430321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55bde5-f486-484b-976c-35a3e4a21618 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:32.442453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dd8b1a0ddb48b5b5a78d378b689e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11dbaf75025641a583f8da351941d2bc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:32.443112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:32.443403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:32.443682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:32.445132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:32.445802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:32.448033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:32.486161 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2937/5786] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:32.488361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:32.507951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c955-49bb-4b8e-b2d3-bc6e2c03765d service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:32.519585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dd8b1a0ddb48b5b5a78d378b689e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11dbaf75025641a583f8da351941d2bc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:32.521090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:32.521558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:32.522036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:32.522995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:32.526397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:32.612710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:32.614571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:32.638834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344ec7e-e1d9-477c-ae3b-c7241f9291ac tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:32.648307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:32.649790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:32.658158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:32.658591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:32.660700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:32.703637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2850/5787] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:32 2021] POST /identity/v3/projects => generated 347 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:32.704746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:32.812464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:32.814384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:32.828732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9959c3-a636-4c29-a2f7-38ba518aa623 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:32.842543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dd8b1a0ddb48b5b5a78d378b689e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11dbaf75025641a583f8da351941d2bc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:32.843274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:32.843561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:32.843898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:32.847577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:32.847577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:32.847577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:32.853705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2938/5788] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:32.883081 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2851/5789] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:27:33.986920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:34.016396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d554625-088e-4a10-bc39-c4f8b3a69d5a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:34.025166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dd8b1a0ddb48b5b5a78d378b689e30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11dbaf75025641a583f8da351941d2bc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:34.026051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:34.026339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:34.026619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] PATH_INFO: `/v3/projects/2cb6a690bb164c92962478fa98dc010a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:34.028053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2cb6a690bb164c92962478fa98dc010a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:34.032058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:34.197380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb6a690bb164c92962478fa98dc010a', 'request_id': 'req-e77da0d5-caa7-4af2-b828-669544020c3f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:34.304793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb6a690bb164c92962478fa98dc010a', 'request_id': 'req-e77da0d5-caa7-4af2-b828-669544020c3f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:34.318270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb6a690bb164c92962478fa98dc010a', 'request_id': 'req-e77da0d5-caa7-4af2-b828-669544020c3f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:34.337289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] The token cache is being invalidate because project 2cb6a690bb164c92962478fa98dc010a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:34.338748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:34.339887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:34.344780 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2939/5790] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:33 2021] DELETE /identity/v3/projects/2cb6a690bb164c92962478fa98dc010a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:34.364330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:34.373822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:34.477243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bcd8-d14c-42d4-a48a-673941ad7482 tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:34.598551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3244-875f-474e-9b70-1e24c77a6b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:34.599593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3244-875f-474e-9b70-1e24c77a6b3f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:34.600389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3244-875f-474e-9b70-1e24c77a6b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:34.601135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3244-875f-474e-9b70-1e24c77a6b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:34.604440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ae6b3244-875f-474e-9b70-1e24c77a6b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:34.726182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3244-875f-474e-9b70-1e24c77a6b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:34.727838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3244-875f-474e-9b70-1e24c77a6b3f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:34.741302 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2852/5791] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:34 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:35.720097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:35.722459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:35.833962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da0d5-caa7-4af2-b828-669544020c3f tempest-RoutersIpV6AdminTest-611111169 tempest-RoutersIpV6AdminTest-611111169-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:35.839865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:35.841303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:35.841670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:35.842015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] PATH_INFO: `/v3/users/bdd2a841da6c40b199ae939e2c84e3fb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:35.844257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd2a841da6c40b199ae939e2c84e3fb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:35.846184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:36.076257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd2a841da6c40b199ae939e2c84e3fb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:36.084623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd2a841da6c40b199ae939e2c84e3fb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:36.101025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd2a841da6c40b199ae939e2c84e3fb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:36.102990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd2a841da6c40b199ae939e2c84e3fb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:36.248416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd2a841da6c40b199ae939e2c84e3fb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:36.260091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2940/5792] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:35 2021] DELETE /identity/v3/users/bdd2a841da6c40b199ae939e2c84e3fb => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:36.265478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:36.266042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:36.266252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:36.286073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:36.287701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:36.372364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2853/5793] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:36.404628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:36.408664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:36.511480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1129036-7bf5-482d-bf2e-508cebaefa2f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:36.520182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027e27e-b4a2-47aa-a416-d34d4cd817bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:36.521082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e27e-b4a2-47aa-a416-d34d4cd817bd service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:36.525437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e27e-b4a2-47aa-a416-d34d4cd817bd service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:36.525437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027e27e-b4a2-47aa-a416-d34d4cd817bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:36.543649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027e27e-b4a2-47aa-a416-d34d4cd817bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:36.545474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027e27e-b4a2-47aa-a416-d34d4cd817bd service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:36.558627 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2941/5794] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:37.071229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:37.073016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:37.094258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0289ace-9046-4c05-9c0a-1c28041c3f40 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:37.099423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:37.100293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:37.101176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:37.101652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] PATH_INFO: `/v3/projects/b500bad506714b458fe3459f05f62f29` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:37.106453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b500bad506714b458fe3459f05f62f29)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:37.108401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:37.335092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b500bad506714b458fe3459f05f62f29', 'request_id': 'req-9228329c-2415-4388-9a39-e95e862af6be'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:37.343753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b500bad506714b458fe3459f05f62f29', 'request_id': 'req-9228329c-2415-4388-9a39-e95e862af6be'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:37.454983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b500bad506714b458fe3459f05f62f29', 'request_id': 'req-9228329c-2415-4388-9a39-e95e862af6be'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:37.478514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] The token cache is being invalidate because project b500bad506714b458fe3459f05f62f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:37.479963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:37.482067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9228329c-2415-4388-9a39-e95e862af6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:37.485664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2854/5795] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:37 2021] DELETE /identity/v3/projects/b500bad506714b458fe3459f05f62f29 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:37.494013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430d5ad-57eb-436c-997f-ca72010ee915 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:37.495281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430d5ad-57eb-436c-997f-ca72010ee915 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:37.496781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430d5ad-57eb-436c-997f-ca72010ee915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:37.524822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e430d5ad-57eb-436c-997f-ca72010ee915 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:37.527161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e430d5ad-57eb-436c-997f-ca72010ee915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:37.626844 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2942/5796] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:37.628279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d05964-9b55-446c-960b-b35c2f87dce3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:37.631535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d05964-9b55-446c-960b-b35c2f87dce3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:37.632147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d05964-9b55-446c-960b-b35c2f87dce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:37.682191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-73d05964-9b55-446c-960b-b35c2f87dce3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:37.684584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-73d05964-9b55-446c-960b-b35c2f87dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:37.698949 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2855/5797] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:37.700089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430d5ad-57eb-436c-997f-ca72010ee915 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:37.711551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430d5ad-57eb-436c-997f-ca72010ee915 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:37.720930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:37.721737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:37.722089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:37.722473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:37.723651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:37.723651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:37.725763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:37.743225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2943/5798] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:37.747358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d05964-9b55-446c-960b-b35c2f87dce3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:37.757791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d05964-9b55-446c-960b-b35c2f87dce3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:37.763078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:37.763832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:37.767363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:37.767363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:37.767363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:37.768047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:37.888850 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2856/5799] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:37 2021] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:37.894238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:37.907953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314bdc09-2677-486f-8a2e-26ea28257fc0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:38.015971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:38.016432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:38.017810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:38.018109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:38.018927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:38.022556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:38.122914 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2944/5800] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:37 2021] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:38.124738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:38.147184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16006e-ff8c-4f47-bcc6-d9f7b3ea8e3b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:38.154380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:38.156122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:38.156615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:38.157282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:38.158265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:38.160981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:38.176294 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2857/5801] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:38 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:38.181212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:38.196680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592427-d047-4098-9c43-8c7e987783ca admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:38.204336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc165b8-9eac-451c-bcac-c88bb3c85c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:38.205660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc165b8-9eac-451c-bcac-c88bb3c85c33 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:38.205660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc165b8-9eac-451c-bcac-c88bb3c85c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:38.205660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc165b8-9eac-451c-bcac-c88bb3c85c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:38.206331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc165b8-9eac-451c-bcac-c88bb3c85c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:38.208374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc165b8-9eac-451c-bcac-c88bb3c85c33 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:38.220033 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2945/5802] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:38 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:38.224191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:38.235791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb97d2-51cb-4c66-b9f1-83379f03b974 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:38.244777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:38.245752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:38.246164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:38.246499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] PATH_INFO: `/v3/projects/badc508160ed49a5b6deb902e922e239/users/fcc009d66def440abe5c37258cd228d7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:38.261964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badc508160ed49a5b6deb902e922e239, user_id=fcc009d66def440abe5c37258cd228d7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:38.265238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:38.398775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2858/5803] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:38 2021] PUT /identity/v3/projects/badc508160ed49a5b6deb902e922e239/users/fcc009d66def440abe5c37258cd228d7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:38.402461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73ce4-133d-4d3e-9000-7c87e022c452 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:38.402820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73ce4-133d-4d3e-9000-7c87e022c452 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:38.405545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73ce4-133d-4d3e-9000-7c87e022c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:38.443015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4bb73ce4-133d-4d3e-9000-7c87e022c452 None None] MFA Rules not processed for user `fcc009d66def440abe5c37258cd228d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:38.443840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4bb73ce4-133d-4d3e-9000-7c87e022c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:38.676541 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2946/5804] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:38 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:38.681168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:38.768665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddfc8b-0a42-4720-8cf8-c44cfcccd7f6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:38.780558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:38.781546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:38.782199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:38.782650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:38.783552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:38.786423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:38.884237 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2859/5805] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:38 2021] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:38.888628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb73ce4-133d-4d3e-9000-7c87e022c452 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:38.907579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb73ce4-133d-4d3e-9000-7c87e022c452 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:39.018609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:39.019652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:39.020108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:39.021533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:39.022657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:39.025090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:39.117275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2947/5806] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:38 2021] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:39.118588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:39.135484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be446a02-a46c-47e0-8d13-e9adbede2fea admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:39.152825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:39.156010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:39.157553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:39.158217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:39.159154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:39.162165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:39.179255 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2860/5807] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:39 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:39.180391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:39.195583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98205b-a5d2-42e8-828c-1e1bd9e4121b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:39.215470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:39.216799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:39.217303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:39.219157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] PATH_INFO: `/v3/projects/a91e16e541274275b8519036f991ece8/users/b35119d430354264b016d221a545ac5a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:39.248181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91e16e541274275b8519036f991ece8, user_id=b35119d430354264b016d221a545ac5a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:39.254208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:39.343860 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2948/5808] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:39 2021] PUT /identity/v3/projects/a91e16e541274275b8519036f991ece8/users/b35119d430354264b016d221a545ac5a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:39.348952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:39.366972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52243bdb-a36f-40b4-a039-ae9f70e2c76c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:39.502553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d064-dc55-4124-a9e0-582d15a52be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:39.505133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d064-dc55-4124-a9e0-582d15a52be5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:39.508016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d064-dc55-4124-a9e0-582d15a52be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:39.508441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d064-dc55-4124-a9e0-582d15a52be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:39.509168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d064-dc55-4124-a9e0-582d15a52be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:39.512242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d064-dc55-4124-a9e0-582d15a52be5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:39.533219 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2861/5809] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:39 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:39.540425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:39.554726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48609a2-1f83-4372-bcdb-9998d507f740 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:39.560277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:39.561869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:39.562417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:39.563089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] PATH_INFO: `/v3/projects/a91e16e541274275b8519036f991ece8/users/b35119d430354264b016d221a545ac5a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:39.566244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91e16e541274275b8519036f991ece8, user_id=b35119d430354264b016d221a545ac5a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:39.570451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:39.587665 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2949/5810] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:39 2021] PUT /identity/v3/projects/a91e16e541274275b8519036f991ece8/users/b35119d430354264b016d221a545ac5a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:39.601553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa4f6-edc9-432c-8303-be5bf1466489 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:39.601672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa4f6-edc9-432c-8303-be5bf1466489 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:39.602229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa4f6-edc9-432c-8303-be5bf1466489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:39.652455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-beffa4f6-edc9-432c-8303-be5bf1466489 None None] MFA Rules not processed for user `b35119d430354264b016d221a545ac5a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:39.654516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-beffa4f6-edc9-432c-8303-be5bf1466489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:39.747769 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2862/5811] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:39 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:39.771422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:39.773937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:39.859628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d9adc-2d02-450b-a6be-e0271d7f982d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:39.863616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ef6f-aef9-4350-9d47-4899d6b6b084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:39.864143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ef6f-aef9-4350-9d47-4899d6b6b084 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:39.864426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ef6f-aef9-4350-9d47-4899d6b6b084 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:39.864703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ef6f-aef9-4350-9d47-4899d6b6b084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:39.881188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ef6f-aef9-4350-9d47-4899d6b6b084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:39.883161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031ef6f-aef9-4350-9d47-4899d6b6b084 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:39.895120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2950/5812] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:39 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:27:40.988930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffa4f6-edc9-432c-8303-be5bf1466489 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:41.061587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffa4f6-edc9-432c-8303-be5bf1466489 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:41.068815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:41.070427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:41.070922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:41.071381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] PATH_INFO: `/v3/users/fcc009d66def440abe5c37258cd228d7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:41.073253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc009d66def440abe5c37258cd228d7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:41.075556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:41.321524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc009d66def440abe5c37258cd228d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:41.331562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc009d66def440abe5c37258cd228d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:41.351923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc009d66def440abe5c37258cd228d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:41.353462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc009d66def440abe5c37258cd228d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:41.354557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc009d66def440abe5c37258cd228d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:41.437961 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2863/5813] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:40 2021] DELETE /identity/v3/users/fcc009d66def440abe5c37258cd228d7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:41.442522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:41.443376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:41.443815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:41.464671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:41.465789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:41.535769 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2951/5814] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:41.547571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:41.550402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:41.638858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875c441-f3ef-4034-b387-3e037471ab7b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:41.644045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:41.645360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:41.645707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:41.646081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:41.658686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:41.660564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:41.679327 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2864/5815] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:43.191684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:43.193271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:43.239823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f3349-be6e-4f36-82f8-5e259980f5cd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:43.253612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:43.255058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:43.256094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:43.256867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] PATH_INFO: `/v3/projects/badc508160ed49a5b6deb902e922e239` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:43.258840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badc508160ed49a5b6deb902e922e239)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:43.261632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:43.427481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badc508160ed49a5b6deb902e922e239', 'request_id': 'req-86b5fead-30ef-4038-899f-5f05cb18cdf3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.506507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badc508160ed49a5b6deb902e922e239', 'request_id': 'req-86b5fead-30ef-4038-899f-5f05cb18cdf3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.513564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badc508160ed49a5b6deb902e922e239', 'request_id': 'req-86b5fead-30ef-4038-899f-5f05cb18cdf3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.525930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] The token cache is being invalidate because project badc508160ed49a5b6deb902e922e239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:43.526223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.526890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.529381 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2952/5816] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:43 2021] DELETE /identity/v3/projects/badc508160ed49a5b6deb902e922e239 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:43.533574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:43.546651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1ab66-4fcb-4318-87dd-b497037d532c service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:43.620749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:43.621899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:43.622479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:43.622942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] PATH_INFO: `/v3/users/b35119d430354264b016d221a545ac5a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:43.624897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35119d430354264b016d221a545ac5a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:43.627197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:43.707411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:43.709626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:43.726200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5fead-30ef-4038-899f-5f05cb18cdf3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:43.732038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:43.733341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:43.733622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:43.734254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] PATH_INFO: `/v3/users/81821563e0034d1e9743c4ec82245ed6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:43.735536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81821563e0034d1e9743c4ec82245ed6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:43.737695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:43.869378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35119d430354264b016d221a545ac5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.891055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35119d430354264b016d221a545ac5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.913525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35119d430354264b016d221a545ac5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.914708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35119d430354264b016d221a545ac5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.917139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35119d430354264b016d221a545ac5a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.956199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81821563e0034d1e9743c4ec82245ed6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.977406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81821563e0034d1e9743c4ec82245ed6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.997652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81821563e0034d1e9743c4ec82245ed6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:43.998976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81821563e0034d1e9743c4ec82245ed6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:44.024408 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2865/5817] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:43 2021] DELETE /identity/v3/users/b35119d430354264b016d221a545ac5a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:44.130903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81821563e0034d1e9743c4ec82245ed6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:44.143893 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2953/5818] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:43 2021] DELETE /identity/v3/users/81821563e0034d1e9743c4ec82245ed6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:44.667609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:44.669239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:44.752951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661ba9-1880-417f-bc05-1c6182217064 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:44.823193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:44.824070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:44.824352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:44.824627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] PATH_INFO: `/v3/projects/ba1ca2fcc2ce4d41b609fa6a753fc806` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:44.826053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1ca2fcc2ce4d41b609fa6a753fc806)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:44.828485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:44.982185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'request_id': 'req-57b44390-453c-4c39-9956-0fb68a64352d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:44.993759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'request_id': 'req-57b44390-453c-4c39-9956-0fb68a64352d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.059657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.061689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:45.080714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2602b-d241-4580-a74f-dcda1792cfe2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.107164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'request_id': 'req-57b44390-453c-4c39-9956-0fb68a64352d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.130903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] The token cache is being invalidate because project ba1ca2fcc2ce4d41b609fa6a753fc806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:45.131196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.132208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-57b44390-453c-4c39-9956-0fb68a64352d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.134454 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2866/5819] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:44 2021] DELETE /identity/v3/projects/ba1ca2fcc2ce4d41b609fa6a753fc806 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:45.141590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ba626-f7be-4ea8-8f70-2b71d9cd7fe1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.145117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ba626-f7be-4ea8-8f70-2b71d9cd7fe1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.145117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ba626-f7be-4ea8-8f70-2b71d9cd7fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.167695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.168659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.169006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.169294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] PATH_INFO: `/v3/projects/a91e16e541274275b8519036f991ece8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.173559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91e16e541274275b8519036f991ece8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.173937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.183637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b13ba626-f7be-4ea8-8f70-2b71d9cd7fe1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:45.185213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b13ba626-f7be-4ea8-8f70-2b71d9cd7fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:45.197775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2867/5820] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:45.206090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d205f-af28-4f4f-94c4-6f6bfe41b50d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.206567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d205f-af28-4f4f-94c4-6f6bfe41b50d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.207092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d205f-af28-4f4f-94c4-6f6bfe41b50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.228801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c33d205f-af28-4f4f-94c4-6f6bfe41b50d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:45.230199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c33d205f-af28-4f4f-94c4-6f6bfe41b50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:45.239309 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2868/5821] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:45.243490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d205f-af28-4f4f-94c4-6f6bfe41b50d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.255000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d205f-af28-4f4f-94c4-6f6bfe41b50d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.261497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.262421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.262709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.262979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.264062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:45.265149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.267079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.288499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2869/5822] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:27:45.289831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.303749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff1cc8-f793-4237-850a-ef1431c2f84b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.307216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91e16e541274275b8519036f991ece8', 'request_id': 'req-2a868211-e0ab-411a-b659-c6ee0baa047b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.383871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.384695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.385007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.385375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.386883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.389795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.478002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91e16e541274275b8519036f991ece8', 'request_id': 'req-2a868211-e0ab-411a-b659-c6ee0baa047b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.486831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91e16e541274275b8519036f991ece8', 'request_id': 'req-2a868211-e0ab-411a-b659-c6ee0baa047b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.499330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] The token cache is being invalidate because project a91e16e541274275b8519036f991ece8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:45.504030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.504030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2a868211-e0ab-411a-b659-c6ee0baa047b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:45.504030 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2954/5823] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:45 2021] DELETE /identity/v3/projects/a91e16e541274275b8519036f991ece8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:45.508655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d36a-48ae-45e8-89b2-d164452d2af9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.509226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d36a-48ae-45e8-89b2-d164452d2af9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.509698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2d36a-48ae-45e8-89b2-d164452d2af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.535307 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2870/5824] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:45.539276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.540580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2ec2d36a-48ae-45e8-89b2-d164452d2af9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:45.542223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2ec2d36a-48ae-45e8-89b2-d164452d2af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:45.542448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:45.657071 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2955/5825] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:45.659986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214eca-6912-4adc-b23f-70fedff07349 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.660682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214eca-6912-4adc-b23f-70fedff07349 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.661164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214eca-6912-4adc-b23f-70fedff07349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.677997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9ef7a-8f5f-421e-b13d-f0b19fac5bc5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.690134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ce214eca-6912-4adc-b23f-70fedff07349 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:45.690378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.691056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.691277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.691555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.692430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce214eca-6912-4adc-b23f-70fedff07349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:45.692581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.694819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.708984 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2956/5826] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:45.710944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214eca-6912-4adc-b23f-70fedff07349 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.724629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214eca-6912-4adc-b23f-70fedff07349 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.732216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.733811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.734266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.734738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.735848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:45.736356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.738308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.759384 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2957/5827] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:45.761432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.777704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121b27-1bb4-42eb-948d-beac81dcc87f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.786577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.787650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.788106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.788554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.790004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.793709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.822177 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2871/5828] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:45.826388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.838472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cfff7-6a7e-440f-8e62-1c09174408c6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.844750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.845835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.846527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.846968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.847872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.850772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.863202 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2872/5829] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:45.866890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.886798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8a91-c9d9-44c1-87c3-421d5d2f3471 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.894116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.895596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.896175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.896908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.898141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.900133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.914209 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2873/5830] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:45.917895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:45.929174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5242-ee5e-4b72-8c1d-b16ba5fc3c69 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:45.933755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376c50a-082a-41cc-a2cc-f0bd411a0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:45.935378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376c50a-082a-41cc-a2cc-f0bd411a0c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:45.935378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376c50a-082a-41cc-a2cc-f0bd411a0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:45.935678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376c50a-082a-41cc-a2cc-f0bd411a0c4a admin admin] PATH_INFO: `/v3/projects/980165331b334d7795b91adc96459725/users/0d9b0c5962544b66b24db53b7e9b8333/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:45.959547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376c50a-082a-41cc-a2cc-f0bd411a0c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=980165331b334d7795b91adc96459725, user_id=0d9b0c5962544b66b24db53b7e9b8333, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:45.963364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376c50a-082a-41cc-a2cc-f0bd411a0c4a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:45.977624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2958/5831] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:45.981578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.070172 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2874/5832] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:45 2021] PUT /identity/v3/projects/980165331b334d7795b91adc96459725/users/0d9b0c5962544b66b24db53b7e9b8333/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:46.072690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.074584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.074976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.087109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cb6ad-fae4-4a07-9f2b-1e0d6ab85e5b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:46.099116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:46.101565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:46.154544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:46.156344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.156910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.157418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.158343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:46.165251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:46.193526 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2875/5833] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:46.205259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.206788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:46.275312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc480ba-9020-4606-a4c8-794060ce7e99 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:46.280513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:46.281205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.281586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.282222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.292218 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2959/5834] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:45 2021] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:46.299311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.300522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:46.302475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:46.315462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a850b9-e5cb-43ce-a8bc-eaa72266cd5b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:46.316043 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2876/5835] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:27:46.322037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:46.322729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.325081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.325081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.325081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:46.325782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:46.337817 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2960/5836] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:46 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:46.345114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.356705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128109-2e4f-4ed0-ab44-f68153681db9 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:46.362027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282e903-2b48-42a4-8dab-eeeace263212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:46.362699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282e903-2b48-42a4-8dab-eeeace263212 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.362980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282e903-2b48-42a4-8dab-eeeace263212 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.363253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282e903-2b48-42a4-8dab-eeeace263212 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.364001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282e903-2b48-42a4-8dab-eeeace263212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:46.365679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282e903-2b48-42a4-8dab-eeeace263212 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:46.382688 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2877/5837] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:46 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:46.385033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.396691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d031-63fe-40a5-aa1d-27ad9a9336a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:46.402466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:46.403391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.403678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.404222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] PATH_INFO: `/v3/projects/5fffde8e60b542fe8de3476b022c1d0a/users/a80e5db2dcba483e9f4ea0d1ba505255/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.435543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fffde8e60b542fe8de3476b022c1d0a, user_id=a80e5db2dcba483e9f4ea0d1ba505255, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:46.438370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:46.507314 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2961/5838] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:46 2021] PUT /identity/v3/projects/5fffde8e60b542fe8de3476b022c1d0a/users/a80e5db2dcba483e9f4ea0d1ba505255/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:46.520619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb631e-0189-416e-89f3-fbc6afdec871 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.529247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb631e-0189-416e-89f3-fbc6afdec871 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.529247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb631e-0189-416e-89f3-fbc6afdec871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.558244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c1eb631e-0189-416e-89f3-fbc6afdec871 None None] MFA Rules not processed for user `a80e5db2dcba483e9f4ea0d1ba505255`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:46.561451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c1eb631e-0189-416e-89f3-fbc6afdec871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:46.703871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.704423 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2878/5839] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:46 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:46.792147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7ee13-6a45-41ec-ae08-c8d5329e11ac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:46.798188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:46.799161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:46.799819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:46.800201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:46.801016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:46.803001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:46.918890 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2962/5840] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:46 2021] POST /identity/v3/projects => generated 367 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:46.924414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb631e-0189-416e-89f3-fbc6afdec871 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.939965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:46.942044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb631e-0189-416e-89f3-fbc6afdec871 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:46.950274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:47.077823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3c44-c2f8-4185-9ca5-8120ea2d0be2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:47.084447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:47.087215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.088456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.089291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] PATH_INFO: `/v3/users/870cef142a964d95b8866fb8857f0c84` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.091190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870cef142a964d95b8866fb8857f0c84)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:47.094643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:47.095357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:47.096487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.097034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.097747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.098820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:47.105381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:47.232637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2879/5841] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:46 2021] POST /identity/v3/users => generated 290 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:47.238421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:47.264475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a1501-bef1-494a-932c-198e272de0bf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:47.281237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:47.282179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.282753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.283120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.284594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:47.286446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:47.302453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2880/5842] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:47 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:47.306318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:47.328496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8646-a5ee-4151-943c-412d8e89424f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:47.328496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:47.328496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.328496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.329179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] PATH_INFO: `/v3/projects/cb949d61bddd4eba8edcb2a493b76f9a/users/c9ef5e85de884279ac04fcc5c4fd81df/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.351909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb949d61bddd4eba8edcb2a493b76f9a, user_id=c9ef5e85de884279ac04fcc5c4fd81df, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:47.357135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:47.397348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870cef142a964d95b8866fb8857f0c84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:47.407872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870cef142a964d95b8866fb8857f0c84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:47.422019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870cef142a964d95b8866fb8857f0c84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:47.422845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870cef142a964d95b8866fb8857f0c84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:47.442554 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2881/5843] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:47 2021] PUT /identity/v3/projects/cb949d61bddd4eba8edcb2a493b76f9a/users/c9ef5e85de884279ac04fcc5c4fd81df/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:27:47.446903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:47.487708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-737a1648-81c8-446b-9351-299bb419d252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870cef142a964d95b8866fb8857f0c84'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:47.499656 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2963/5844] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:46 2021] DELETE /identity/v3/users/870cef142a964d95b8866fb8857f0c84 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:47.503017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da198-482a-442c-ba38-877360dad827 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.503591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da198-482a-442c-ba38-877360dad827 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.504133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100da198-482a-442c-ba38-877360dad827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.536367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-100da198-482a-442c-ba38-877360dad827 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:47.538371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-100da198-482a-442c-ba38-877360dad827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:47.591290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a9191-9c0d-4a9a-94de-da3f648f5874 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:47.638867 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2964/5845] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:47.652407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da198-482a-442c-ba38-877360dad827 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:47.655912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-100da198-482a-442c-ba38-877360dad827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:47.696510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:47.697718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.698679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.699308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.700628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:47.703199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:47.716804 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2882/5846] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:47 2021] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:27:47.720676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:47.723795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:47.750804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d7e45-47fe-4064-99d1-90b0fbbe5d4c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:47.759274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352fd01-e3bb-4420-b6ad-a7094bdbc52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:47.761061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352fd01-e3bb-4420-b6ad-a7094bdbc52b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.761573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352fd01-e3bb-4420-b6ad-a7094bdbc52b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.762656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352fd01-e3bb-4420-b6ad-a7094bdbc52b admin admin] PATH_INFO: `/v3/projects/cb949d61bddd4eba8edcb2a493b76f9a/users/c9ef5e85de884279ac04fcc5c4fd81df/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.765869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352fd01-e3bb-4420-b6ad-a7094bdbc52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb949d61bddd4eba8edcb2a493b76f9a, user_id=c9ef5e85de884279ac04fcc5c4fd81df, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:47.770499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352fd01-e3bb-4420-b6ad-a7094bdbc52b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:47.781879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100da198-482a-442c-ba38-877360dad827 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:47.785317 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2883/5847] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:47 2021] PUT /identity/v3/projects/cb949d61bddd4eba8edcb2a493b76f9a/users/c9ef5e85de884279ac04fcc5c4fd81df/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:47.796013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.797063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.797565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.855708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:47.856303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:47.856593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:47.856887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:47.858534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] MFA Rules not processed for user `c9ef5e85de884279ac04fcc5c4fd81df`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:47.859804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:47.941771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:47.959569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:47.959569 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2965/5848] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:47.965017 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2884/5849] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:47 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:27:47.974506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:47.976182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:48.058831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c7793-3ce8-47ea-83d6-d7bb75f8a416 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:48.074915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:48.077195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:48.077710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:48.078727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:48.093772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:48.095812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:48.111207 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2966/5850] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:47 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:48.304794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:48.311305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:48.329795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6048-7c4b-4f0d-ae6c-377132abf363 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:48.341819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e869f-0cb7-4ab6-b300-64d9fe8d5fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:48.341819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e869f-0cb7-4ab6-b300-64d9fe8d5fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:48.342806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e869f-0cb7-4ab6-b300-64d9fe8d5fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:48.343679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e869f-0cb7-4ab6-b300-64d9fe8d5fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:48.350153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-714e869f-0cb7-4ab6-b300-64d9fe8d5fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:48.392806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:48.394697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:48.421560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a14b-cc86-4dbb-baef-73d9f3b37686 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:48.436627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:48.437828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:48.438295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:48.438740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] PATH_INFO: `/v3/projects/596be925895b4ede995a5f893bdae840` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:48.441714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596be925895b4ede995a5f893bdae840)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:48.444071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:48.489742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e869f-0cb7-4ab6-b300-64d9fe8d5fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:48.491399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e869f-0cb7-4ab6-b300-64d9fe8d5fc7 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:48.506695 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2885/5851] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:48 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:48.617246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596be925895b4ede995a5f893bdae840', 'request_id': 'req-cf801130-eee8-41db-bda3-ca46df2eb616'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:48.717351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596be925895b4ede995a5f893bdae840', 'request_id': 'req-cf801130-eee8-41db-bda3-ca46df2eb616'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:48.729747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596be925895b4ede995a5f893bdae840', 'request_id': 'req-cf801130-eee8-41db-bda3-ca46df2eb616'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:48.750688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] The token cache is being invalidate because project 596be925895b4ede995a5f893bdae840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:48.751261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:48.752745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf801130-eee8-41db-bda3-ca46df2eb616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:48.758636 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2967/5852] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:48 2021] DELETE /identity/v3/projects/596be925895b4ede995a5f893bdae840 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:48.762446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3788e-4ef6-44da-9c1d-898fa6a57f41 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:48.763334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3788e-4ef6-44da-9c1d-898fa6a57f41 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:48.763939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3788e-4ef6-44da-9c1d-898fa6a57f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:48.791292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-25f3788e-4ef6-44da-9c1d-898fa6a57f41 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:48.798075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-25f3788e-4ef6-44da-9c1d-898fa6a57f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:48.901597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2886/5853] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:48.910333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654db47-4e63-461e-acff-f252ef50ac0e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:48.911170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654db47-4e63-461e-acff-f252ef50ac0e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:48.911952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654db47-4e63-461e-acff-f252ef50ac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:48.933977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0654db47-4e63-461e-acff-f252ef50ac0e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:48.935605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0654db47-4e63-461e-acff-f252ef50ac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:48.944500 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2968/5854] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:48.949650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3788e-4ef6-44da-9c1d-898fa6a57f41 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:48.964580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3788e-4ef6-44da-9c1d-898fa6a57f41 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:48.979517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:48.985016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:48.985016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:48.985016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:48.985016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:48.985016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:48.986211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:49.013577 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2887/5855] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:27:49.014840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654db47-4e63-461e-acff-f252ef50ac0e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:49.024652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654db47-4e63-461e-acff-f252ef50ac0e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:49.030180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:49.031294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:49.031583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:49.031809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:49.032549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:49.034752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:49.171370 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2969/5856] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:49 2021] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:49.175758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:49.204993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827580ff-daf5-4f9c-876d-b9036267f15c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:49.285315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:49.291445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:49.291445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:49.291445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:49.291445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:49.291445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:49.461933 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2888/5857] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:49 2021] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:49.462508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:49.477440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c634e3-d6c2-43a5-a3ad-97e4fd90c7d5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:49.487931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:49.489024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:49.489464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:49.489905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:49.490813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:49.494761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:49.522441 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2970/5858] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:49 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:27:49.524085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:49.542321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc11f1f-165b-4f57-b716-05abd40fea5c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:49.549361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840b08-da13-4702-9ae3-0a966a657fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:49.550824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840b08-da13-4702-9ae3-0a966a657fdf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:49.551615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840b08-da13-4702-9ae3-0a966a657fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:49.552755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840b08-da13-4702-9ae3-0a966a657fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:49.555027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840b08-da13-4702-9ae3-0a966a657fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:49.559632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840b08-da13-4702-9ae3-0a966a657fdf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:49.592169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:49.608200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2889/5859] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:49 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:49.614380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94f6f-a599-4061-80fe-95f9037202af admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:49.628675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:49.632256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:49.634948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:49.634948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] PATH_INFO: `/v3/projects/e27ea19f90cf4e0c934675615d455854/users/8d5535c04fab47d3b13e358932d3cea2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:49.690753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27ea19f90cf4e0c934675615d455854, user_id=8d5535c04fab47d3b13e358932d3cea2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:49.699503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:49.953126 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2971/5860] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:49 2021] PUT /identity/v3/projects/e27ea19f90cf4e0c934675615d455854/users/8d5535c04fab47d3b13e358932d3cea2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:49.975112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:49.981859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:49.981859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:50.054590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] MFA Rules not processed for user `8d5535c04fab47d3b13e358932d3cea2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:50.057569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:50.158550 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2890/5861] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:49 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:50.220136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:50.222103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:50.359869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e445-a6a9-4698-b443-f601b72600ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:50.365164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff191a80-763e-4431-8934-7ae9364430f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:50.366157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191a80-763e-4431-8934-7ae9364430f3 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:50.366663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191a80-763e-4431-8934-7ae9364430f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:50.367110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191a80-763e-4431-8934-7ae9364430f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:50.378933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff191a80-763e-4431-8934-7ae9364430f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:50.382088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff191a80-763e-4431-8934-7ae9364430f3 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:50.409054 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2972/5862] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:50 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:51.836531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:51.838049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:51.976034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc046d-0826-4ec2-8e08-005289635797 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:51.993367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:51.993367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:51.993367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:51.993367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] PATH_INFO: `/v3/users/44e26685d0584786a0a870ec0f8eb6f5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:51.995758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e26685d0584786a0a870ec0f8eb6f5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:51.997847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:52.268764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e26685d0584786a0a870ec0f8eb6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:52.282760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e26685d0584786a0a870ec0f8eb6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:52.300941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e26685d0584786a0a870ec0f8eb6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:52.302101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e26685d0584786a0a870ec0f8eb6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:52.302916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e26685d0584786a0a870ec0f8eb6f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:52.393493 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2891/5863] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:51 2021] DELETE /identity/v3/users/44e26685d0584786a0a870ec0f8eb6f5 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:52.404165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:52.405318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:52.405430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:52.430415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:52.432724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:52.559536 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2973/5864] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:52.582618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:52.585171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:52.827888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74a7b1-1443-443a-b04c-50c15892a474 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:52.833132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:52.833956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:52.834346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:52.834726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:52.866041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:52.868368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:52.910460 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2892/5865] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:53.554549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:53.556087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:53.600705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4946e-d75c-4e17-aac5-682ef1b201cc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:53.622041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd6d8c-88cc-40a2-9e65-e79dd3f31d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:53.622041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6d8c-88cc-40a2-9e65-e79dd3f31d6a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:53.622041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6d8c-88cc-40a2-9e65-e79dd3f31d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:53.622041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6d8c-88cc-40a2-9e65-e79dd3f31d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:53.628182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-15cd6d8c-88cc-40a2-9e65-e79dd3f31d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:53.666901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd6d8c-88cc-40a2-9e65-e79dd3f31d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:53.669890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd6d8c-88cc-40a2-9e65-e79dd3f31d6a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:53.694287 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2974/5866] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:53 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:54.103733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:54.106009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:54.129685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad5773-dcfa-49cd-83f2-95cae52d2d1e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:54.136149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:54.137321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:54.137861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:54.138355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] PATH_INFO: `/v3/projects/4bad81526f144678b49f493aa5d860d1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:54.140764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bad81526f144678b49f493aa5d860d1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:54.147465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:54.345177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bad81526f144678b49f493aa5d860d1', 'request_id': 'req-28025cad-f24a-4dd7-b991-da2ef42edda1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:54.364808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bad81526f144678b49f493aa5d860d1', 'request_id': 'req-28025cad-f24a-4dd7-b991-da2ef42edda1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:54.503384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bad81526f144678b49f493aa5d860d1', 'request_id': 'req-28025cad-f24a-4dd7-b991-da2ef42edda1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:54.534954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] The token cache is being invalidate because project 4bad81526f144678b49f493aa5d860d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:54.534954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:54.543858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28025cad-f24a-4dd7-b991-da2ef42edda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:54.550757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2893/5867] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:54 2021] DELETE /identity/v3/projects/4bad81526f144678b49f493aa5d860d1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:54.556150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8c96-2611-4382-99c8-09ca9590f38f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:54.556150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8c96-2611-4382-99c8-09ca9590f38f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:54.556150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8c96-2611-4382-99c8-09ca9590f38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:54.606039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-38db8c96-2611-4382-99c8-09ca9590f38f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:54.607709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-38db8c96-2611-4382-99c8-09ca9590f38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:54.789857 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2975/5868] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:54.804140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65651a0-d4df-4a76-a0ea-64467a205a49 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:54.804423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65651a0-d4df-4a76-a0ea-64467a205a49 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:54.804961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65651a0-d4df-4a76-a0ea-64467a205a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:54.842995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f65651a0-d4df-4a76-a0ea-64467a205a49 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:54.844573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f65651a0-d4df-4a76-a0ea-64467a205a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:54.858743 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2894/5869] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:54.859700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db8c96-2611-4382-99c8-09ca9590f38f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:54.870468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db8c96-2611-4382-99c8-09ca9590f38f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:54.886551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:54.889195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:54.889195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:54.889195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:54.889522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:27:54.889649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:54.891463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:54.926609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2976/5870] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:27:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:27:54.931977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65651a0-d4df-4a76-a0ea-64467a205a49 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:54.961566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65651a0-d4df-4a76-a0ea-64467a205a49 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:54.985373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:54.986347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:54.986832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:54.987266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:54.991777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:54.994047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:55.107978 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2895/5871] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:27:54 2021] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:27:55.113469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:55.125988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7f1fb-2e7b-45e7-a26d-bbebef587ae9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:55.157751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:55.160008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:55.381641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:55.382333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:55.382617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:55.382898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:55.383622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:55.390839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:55.398156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61d32-85af-4d26-aaf3-52d20fd18808 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:55.418616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:55.422204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:55.424716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:55.424716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] PATH_INFO: `/v3/users/a80e5db2dcba483e9f4ea0d1ba505255` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:55.431493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80e5db2dcba483e9f4ea0d1ba505255)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:55.433512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:55.524000 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2977/5872] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:27:55 2021] POST /identity/v3/users => generated 301 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:27:55.530610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:55.550824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21818b-8fc4-4cdf-a9f7-4a1e25fa54a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:55.566960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:55.568359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:55.568815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:55.569280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:55.572297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:55.576646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:55.606036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2978/5873] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:55 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:55.610527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:55.636441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dfeba-81d0-48bb-9a84-9119384695f0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:55.648796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:55.649929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:55.650398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:55.650843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:55.652060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:55.655984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:55.687235 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2979/5874] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:27:55 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:27:55.690649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80e5db2dcba483e9f4ea0d1ba505255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:55.691237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:55.705978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80e5db2dcba483e9f4ea0d1ba505255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:55.714391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4394733-7d72-4fea-aa78-eb1c12f81972 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:55.723124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa790c-0bc2-4c85-812e-20d42512bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:55.724381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa790c-0bc2-4c85-812e-20d42512bb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:55.724848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa790c-0bc2-4c85-812e-20d42512bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:55.725318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa790c-0bc2-4c85-812e-20d42512bb4c admin admin] PATH_INFO: `/v3/projects/5b73d07b223d4a46b519eb55b7891ff6/users/2d0410ac4e644b03b61cad1c2a1273e7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:55.736229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80e5db2dcba483e9f4ea0d1ba505255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:55.737402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80e5db2dcba483e9f4ea0d1ba505255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:55.740480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-101adfe2-d8d4-451d-b670-77bf2efb0cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80e5db2dcba483e9f4ea0d1ba505255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:55.756127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa790c-0bc2-4c85-812e-20d42512bb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b73d07b223d4a46b519eb55b7891ff6, user_id=2d0410ac4e644b03b61cad1c2a1273e7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:55.758848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa790c-0bc2-4c85-812e-20d42512bb4c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:55.856356 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2896/5875] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:55 2021] DELETE /identity/v3/users/a80e5db2dcba483e9f4ea0d1ba505255 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:55.856809 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2980/5876] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:27:55 2021] PUT /identity/v3/projects/5b73d07b223d4a46b519eb55b7891ff6/users/2d0410ac4e644b03b61cad1c2a1273e7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:55.868579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:55.868898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:55.869175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:55.873587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:55.873587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:55.873587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:55.925239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:55.934674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:55.935757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:27:55.938584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:56.044834 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2981/5877] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:56.054236 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2897/5878] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:27:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:27:56.124914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:56.126510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:56.131551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:56.132580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:56.229528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320334-4651-4ae5-9c07-845019e57721 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:56.240694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:56.241603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:56.241960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:56.242312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:56.267593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0832bb-0ddb-4ea8-af9a-314aeee7a028 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:56.267856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:56.267856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:56.270664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:56.271387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:56.271675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:56.271949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:56.287818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2898/5879] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:56.289019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:56.290068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:56.304349 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2982/5880] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:27:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:27:57.644237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:57.647767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:27:57.672640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125697d-198a-410d-a3f3-2be38347c634 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:57.702333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:57.704134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:57.706624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:57.707235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] PATH_INFO: `/v3/projects/5fffde8e60b542fe8de3476b022c1d0a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:57.716054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fffde8e60b542fe8de3476b022c1d0a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:57.721881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:58.040997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fffde8e60b542fe8de3476b022c1d0a', 'request_id': 'req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.055921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fffde8e60b542fe8de3476b022c1d0a', 'request_id': 'req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.157753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fffde8e60b542fe8de3476b022c1d0a', 'request_id': 'req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.178038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] The token cache is being invalidate because project 5fffde8e60b542fe8de3476b022c1d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:27:58.178324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.179713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2805611-ea21-4a2f-97a8-d7f5023aa7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.181529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2899/5881] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:27:57 2021] DELETE /identity/v3/projects/5fffde8e60b542fe8de3476b022c1d0a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:27:58.186118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:27:58.202434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddde1ff-03ea-4ef3-87c1-73b59e0b5ee5 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:27:58.354837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:27:58.356650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:27:58.359018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:27:58.359575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] PATH_INFO: `/v3/users/c9ef5e85de884279ac04fcc5c4fd81df` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:27:58.374104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ef5e85de884279ac04fcc5c4fd81df)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:27:58.380146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:27:58.597342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ef5e85de884279ac04fcc5c4fd81df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.628218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ef5e85de884279ac04fcc5c4fd81df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.663391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ef5e85de884279ac04fcc5c4fd81df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.669767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ef5e85de884279ac04fcc5c4fd81df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.775064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ef5e85de884279ac04fcc5c4fd81df'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:27:58.786521 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2983/5882] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:27:58 2021] DELETE /identity/v3/users/c9ef5e85de884279ac04fcc5c4fd81df => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:00.416086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda52c-bd2a-4d98-8007-1a7dd600004b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:00.418041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda52c-bd2a-4d98-8007-1a7dd600004b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:00.418490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cda52c-bd2a-4d98-8007-1a7dd600004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:00.487260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b5cda52c-bd2a-4d98-8007-1a7dd600004b None None] MFA Rules not processed for user `2d0410ac4e644b03b61cad1c2a1273e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:00.489917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b5cda52c-bd2a-4d98-8007-1a7dd600004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:00.551145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:00.552678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:00.628756 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2900/5883] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:00 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:00.634729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:00.634729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:00.634729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:00.704349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] MFA Rules not processed for user `0d9b0c5962544b66b24db53b7e9b8333`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:00.705932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:00.707134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48917fa-7a7e-46d4-8983-c7c19379e85e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:00.720194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:00.721135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:00.721414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:00.721689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] PATH_INFO: `/v3/projects/cb949d61bddd4eba8edcb2a493b76f9a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:00.727258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb949d61bddd4eba8edcb2a493b76f9a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:00.729203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:00.838437 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2901/5884] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:00 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:00.839309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:00.843775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:00.859783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe620f-a2fb-490e-9b8d-3ff487667f0f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:00.864976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:00.865786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:00.866050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:00.866323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:00.867083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:00.869157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:00.906864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb949d61bddd4eba8edcb2a493b76f9a', 'request_id': 'req-08428fd1-ee0f-4120-b4de-9593aecf8b6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:00.977724 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2902/5885] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:00 2021] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:00.978590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:00.980393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:00.981121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb949d61bddd4eba8edcb2a493b76f9a', 'request_id': 'req-08428fd1-ee0f-4120-b4de-9593aecf8b6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:01.004526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb949d61bddd4eba8edcb2a493b76f9a', 'request_id': 'req-08428fd1-ee0f-4120-b4de-9593aecf8b6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:01.022159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] The token cache is being invalidate because project cb949d61bddd4eba8edcb2a493b76f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:01.022450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:01.023386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:01.026255 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2984/5886] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:00 2021] DELETE /identity/v3/projects/cb949d61bddd4eba8edcb2a493b76f9a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:01.027130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.030229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:01.084425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14608224-3f9f-43f7-89f8-9b9c447c7baf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.090054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca37be-b367-4c8c-9e29-cea6f4e3cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.090963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca37be-b367-4c8c-9e29-cea6f4e3cc24 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.091974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca37be-b367-4c8c-9e29-cea6f4e3cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.092436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca37be-b367-4c8c-9e29-cea6f4e3cc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.093507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca37be-b367-4c8c-9e29-cea6f4e3cc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.095787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca37be-b367-4c8c-9e29-cea6f4e3cc24 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.169280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428fd1-ee0f-4120-b4de-9593aecf8b6c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.176202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.178085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.178085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.178500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.179301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.181559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.221039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2903/5887] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:00 2021] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:01.221039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37e7c-c950-4fc3-87d1-eb8ce7e55938 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.221039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37e7c-c950-4fc3-87d1-eb8ce7e55938 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.221039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37e7c-c950-4fc3-87d1-eb8ce7e55938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.246753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a3a37e7c-c950-4fc3-87d1-eb8ce7e55938 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:01.249345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3a37e7c-c950-4fc3-87d1-eb8ce7e55938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:01.305042 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2985/5888] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:01 2021] POST /identity/v3/users => generated 308 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:01.306344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.309361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:01.333028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2b732-721c-4bcc-8ff4-d743efbffcb7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.363098 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2904/5889] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:01.364218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a37e7c-c950-4fc3-87d1-eb8ce7e55938 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.379802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a37e7c-c950-4fc3-87d1-eb8ce7e55938 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.387807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb56ce6-b9a2-4469-b2d6-ced8aa8cb72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.389163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56ce6-b9a2-4469-b2d6-ced8aa8cb72e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.389740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56ce6-b9a2-4469-b2d6-ced8aa8cb72e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.390013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56ce6-b9a2-4469-b2d6-ced8aa8cb72e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.392653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56ce6-b9a2-4469-b2d6-ced8aa8cb72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.394786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56ce6-b9a2-4469-b2d6-ced8aa8cb72e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.414455 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2905/5890] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:01.415879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d83bc-46b2-44a8-8853-8d07d98934ae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.416235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d83bc-46b2-44a8-8853-8d07d98934ae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.418038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d83bc-46b2-44a8-8853-8d07d98934ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.444930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cb2d83bc-46b2-44a8-8853-8d07d98934ae None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:01.446821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cb2d83bc-46b2-44a8-8853-8d07d98934ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:01.458771 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2906/5891] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:01.464372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.467760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.468400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.468739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.469782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.469926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d83bc-46b2-44a8-8853-8d07d98934ae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.472682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.485410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d83bc-46b2-44a8-8853-8d07d98934ae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.493092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.494484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.495719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.496306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] PATH_INFO: `/v3/projects/750305cebc0f493c9d5a42bc8178f480/users/87d768fb6277460588c4f47f8b0f31dc/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.518888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750305cebc0f493c9d5a42bc8178f480, user_id=87d768fb6277460588c4f47f8b0f31dc, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.521902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.646972 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2986/5892] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:01 2021] POST /identity/v3/users => generated 296 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:01.648342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.663761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb241ab0-f764-4f64-ad29-3b6b7bf30a74 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.671135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.671956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.672356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.673209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.674457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:01.675093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.676893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.699231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2907/5893] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:01 2021] PUT /identity/v3/projects/750305cebc0f493c9d5a42bc8178f480/users/87d768fb6277460588c4f47f8b0f31dc/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:01.700526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.705049 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2987/5894] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:28:01.706159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.743634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d556b7-e1e8-4516-a931-767bb4c30b75 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.830439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.833086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d318-f181-43ff-9f27-973398374408 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.836671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.836671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.836671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.836671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.837939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.847462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.848363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.848845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.849322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.850319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.852134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.868012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2908/5895] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:01.869092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.880753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbba740-9fc4-4a13-997f-b319baffb800 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.886335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:01.887504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:01.888008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:01.889061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:01.889994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:01.892515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:01.908738 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2909/5896] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:01.912993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:01.926767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99668de-fe1f-4761-949e-0335a03be614 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:01.928911 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2988/5897] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:01 2021] POST /identity/v3/projects => generated 389 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:01.933331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:02.018211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.019409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.019694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.020002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] PATH_INFO: `/v3/projects/fbd3af0654c34dd8b4518ab7708aed91/users/2e1d04230c7b45cab2d2fcb72fb218ad/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.035440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13792a-9983-4ee9-a078-db1fd1088db6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:02.038502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd3af0654c34dd8b4518ab7708aed91, user_id=2e1d04230c7b45cab2d2fcb72fb218ad, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.041578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.041772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.042626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.042917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.043199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] PATH_INFO: `/v3/projects/750305cebc0f493c9d5a42bc8178f480/users/87d768fb6277460588c4f47f8b0f31dc/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.045714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750305cebc0f493c9d5a42bc8178f480, user_id=87d768fb6277460588c4f47f8b0f31dc, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.048837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.061451 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2989/5898] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:01 2021] PUT /identity/v3/projects/750305cebc0f493c9d5a42bc8178f480/users/87d768fb6277460588c4f47f8b0f31dc/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:02.062077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:02.128260 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2910/5899] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:01 2021] PUT /identity/v3/projects/fbd3af0654c34dd8b4518ab7708aed91/users/2e1d04230c7b45cab2d2fcb72fb218ad/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:02.129656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:02.158040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b28e9-b0d4-4da5-bd54-aeaff8620644 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:02.211375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85b039-54d3-4e52-8eb6-3f3b63f44b9e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:02.222993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.223728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.224014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.224295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.225070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.229232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.260468 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2911/5900] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:02 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:02.261006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:02.263791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.264557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.264957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.265622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.266462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.268647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.280147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8058b6a-b172-4524-b419-9c517ccfe8c2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:02.285942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.287023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.287388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.287781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] PATH_INFO: `/v3/projects/fbd3af0654c34dd8b4518ab7708aed91/users/2e1d04230c7b45cab2d2fcb72fb218ad/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.290139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd3af0654c34dd8b4518ab7708aed91, user_id=2e1d04230c7b45cab2d2fcb72fb218ad, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.293273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.315222 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2912/5901] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:02 2021] PUT /identity/v3/projects/fbd3af0654c34dd8b4518ab7708aed91/users/2e1d04230c7b45cab2d2fcb72fb218ad/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:02.410432 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2990/5902] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:02 2021] POST /identity/v3/users => generated 295 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:02.414410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:02.512012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece92fd-9149-4165-97fb-ba4b0c112a0d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:02.554127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.558187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.559138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.563558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.567763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.578743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.610098 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2913/5903] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:02 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:02.611347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:02.628987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d662b-83c3-4906-a4fb-d9468ee6f8e0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:02.640520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc7d13-cf52-4e31-9596-b93ebc53b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.641333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7d13-cf52-4e31-9596-b93ebc53b62d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.641674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7d13-cf52-4e31-9596-b93ebc53b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.641954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc7d13-cf52-4e31-9596-b93ebc53b62d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.646011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc7d13-cf52-4e31-9596-b93ebc53b62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.651002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc7d13-cf52-4e31-9596-b93ebc53b62d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.701517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:02.718006 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2991/5904] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:02 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:02.730965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171eccf-3e8d-402e-8888-b0c85140f190 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:02.754598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:02.756657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.757252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.757699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] PATH_INFO: `/v3/projects/2153dbc247a84246a5e1c0b752958919/users/162228bf8b464fa786f17413472e4935/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.782930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2153dbc247a84246a5e1c0b752958919, user_id=162228bf8b464fa786f17413472e4935, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:02.786282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:02.879808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2914/5905] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:02 2021] PUT /identity/v3/projects/2153dbc247a84246a5e1c0b752958919/users/162228bf8b464fa786f17413472e4935/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:02.892498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9db1-3a1e-4779-af15-7d1710972e49 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:02.892786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9db1-3a1e-4779-af15-7d1710972e49 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:02.893091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9db1-3a1e-4779-af15-7d1710972e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:02.939574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-261d9db1-3a1e-4779-af15-7d1710972e49 None None] MFA Rules not processed for user `162228bf8b464fa786f17413472e4935`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:02.943033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-261d9db1-3a1e-4779-af15-7d1710972e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:03.051898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2992/5906] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:02 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:03.054210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:03.142300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56189bde-278a-4bed-a5a8-2949a4ee0d5b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:03.149883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:03.154564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:03.154564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:03.154564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:03.154564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:03.159323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:03.274728 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2915/5907] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:03 2021] POST /identity/v3/projects => generated 389 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:03.279441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d9db1-3a1e-4779-af15-7d1710972e49 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:03.295290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d9db1-3a1e-4779-af15-7d1710972e49 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:03.399893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:03.401236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:03.401879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:03.402405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:03.404303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:03.406570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:03.531519 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2993/5908] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:03 2021] POST /identity/v3/users => generated 301 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:03.535217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:03.549759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e5b0-ce74-4541-9da5-afb69aadf562 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:03.555387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:03.556012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:03.556509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:03.556977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:03.557966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:03.559771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:03.575446 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2916/5909] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:03 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:03.579457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:03.590097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163ce77-0f59-49d2-84a5-37bf6faeb3a3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:03.596620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:03.597680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:03.598059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:03.599069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] PATH_INFO: `/v3/projects/ce19946cba974ae4afae85fba935404e/users/92a2a2ec123745efbe399b59756aa1a9/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:03.616490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce19946cba974ae4afae85fba935404e, user_id=92a2a2ec123745efbe399b59756aa1a9, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:03.621110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:03.788297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2994/5910] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:03 2021] PUT /identity/v3/projects/ce19946cba974ae4afae85fba935404e/users/92a2a2ec123745efbe399b59756aa1a9/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:03.792350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:03.805916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b35b9f-eec4-4b76-9bd2-274a5616cf72 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:03.922619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4d868-39fe-426a-8717-4209c1ce0528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:03.923808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4d868-39fe-426a-8717-4209c1ce0528 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:03.924327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4d868-39fe-426a-8717-4209c1ce0528 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:03.924840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4d868-39fe-426a-8717-4209c1ce0528 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:03.925869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4d868-39fe-426a-8717-4209c1ce0528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:03.927775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4d868-39fe-426a-8717-4209c1ce0528 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:03.966230 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2917/5911] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:03 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:03.971356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:03.989299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73795746-d0b6-4068-8ea4-963fd39c9e80 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:03.992049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:03.993133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:03.993522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:03.993899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] PATH_INFO: `/v3/projects/ce19946cba974ae4afae85fba935404e/users/92a2a2ec123745efbe399b59756aa1a9/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:03.999668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce19946cba974ae4afae85fba935404e, user_id=92a2a2ec123745efbe399b59756aa1a9, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:04.009359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:04.038038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2995/5912] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:03 2021] PUT /identity/v3/projects/ce19946cba974ae4afae85fba935404e/users/92a2a2ec123745efbe399b59756aa1a9/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:04.048549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e5d1-65ea-4daf-8ffe-37ab10a5c1e9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:04.048742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e5d1-65ea-4daf-8ffe-37ab10a5c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:04.049043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e5d1-65ea-4daf-8ffe-37ab10a5c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:04.116461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8828e5d1-65ea-4daf-8ffe-37ab10a5c1e9 None None] MFA Rules not processed for user `92a2a2ec123745efbe399b59756aa1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:04.121611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8828e5d1-65ea-4daf-8ffe-37ab10a5c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:04.268934 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2918/5913] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:04 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:04.274093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:04.276249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:04.433043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604ed70-c486-47d8-a292-339c23fbb70a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:04.448853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78673c1a-859f-4d9e-9833-61f200312e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:04.450025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673c1a-859f-4d9e-9833-61f200312e1f service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:04.452759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673c1a-859f-4d9e-9833-61f200312e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:04.452759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78673c1a-859f-4d9e-9833-61f200312e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:04.467180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78673c1a-859f-4d9e-9833-61f200312e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:04.479904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78673c1a-859f-4d9e-9833-61f200312e1f service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:04.501909 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2996/5914] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:04 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:04.903624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828e5d1-65ea-4daf-8ffe-37ab10a5c1e9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:04.903624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828e5d1-65ea-4daf-8ffe-37ab10a5c1e9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:04.903624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:04.903624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:04.911971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:04.911971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] PATH_INFO: `/v3/users/162228bf8b464fa786f17413472e4935` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:04.911971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162228bf8b464fa786f17413472e4935)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:04.911971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:04.914241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936ad7-6359-4feb-b1cf-6dbb6d3d1643 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:04.915396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936ad7-6359-4feb-b1cf-6dbb6d3d1643 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:04.915396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936ad7-6359-4feb-b1cf-6dbb6d3d1643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:04.971552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-09936ad7-6359-4feb-b1cf-6dbb6d3d1643 None None] MFA Rules not processed for user `87d768fb6277460588c4f47f8b0f31dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:04.974287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-09936ad7-6359-4feb-b1cf-6dbb6d3d1643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:05.084960 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2997/5915] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:04 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:05.276518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162228bf8b464fa786f17413472e4935'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:05.313591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162228bf8b464fa786f17413472e4935'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:05.345993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162228bf8b464fa786f17413472e4935'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:05.347045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162228bf8b464fa786f17413472e4935'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:05.347928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162228bf8b464fa786f17413472e4935'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:05.436099 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2919/5916] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:04 2021] DELETE /identity/v3/users/162228bf8b464fa786f17413472e4935 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:05.440589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:05.443380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:05.443974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:05.526950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:05.529319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:05.671193 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2998/5917] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:05.695449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:05.695449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:05.814633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732adbb-8a44-44b0-a11a-0edb4742b378 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:05.818997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:05.825933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:05.826599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:05.827057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:05.839237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:05.841012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:05.852617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2920/5918] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:28:07.074129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:07.076146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:07.089991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff488d-3a49-4b41-8003-f37baf3996cb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:07.095737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:07.096940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:07.097397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:07.097839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] PATH_INFO: `/v3/projects/2153dbc247a84246a5e1c0b752958919` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:07.100579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2153dbc247a84246a5e1c0b752958919)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:07.102747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:07.311768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2153dbc247a84246a5e1c0b752958919', 'request_id': 'req-279eae53-cfb3-4f37-82b5-71a7fc674b91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:07.426197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2153dbc247a84246a5e1c0b752958919', 'request_id': 'req-279eae53-cfb3-4f37-82b5-71a7fc674b91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:07.461914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2153dbc247a84246a5e1c0b752958919', 'request_id': 'req-279eae53-cfb3-4f37-82b5-71a7fc674b91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:07.543711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] The token cache is being invalidate because project 2153dbc247a84246a5e1c0b752958919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:07.544014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:07.562952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:07.567562 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 2999/5919] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:07 2021] DELETE /identity/v3/projects/2153dbc247a84246a5e1c0b752958919 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:07.572132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:07.585819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12522b38-44e2-4a02-9043-927f65bd83f0 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:07.720986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:07.721875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:07.722390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:07.722868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] PATH_INFO: `/v3/users/92a2a2ec123745efbe399b59756aa1a9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:07.724323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a2a2ec123745efbe399b59756aa1a9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:07.726684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:07.982678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a2a2ec123745efbe399b59756aa1a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:08.008233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a2a2ec123745efbe399b59756aa1a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:08.035342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a2a2ec123745efbe399b59756aa1a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:08.035342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a2a2ec123745efbe399b59756aa1a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:08.036109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a2a2ec123745efbe399b59756aa1a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:08.150347 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2921/5920] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:07 2021] DELETE /identity/v3/users/92a2a2ec123745efbe399b59756aa1a9 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:09.635357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:09.638395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:09.667474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eae53-cfb3-4f37-82b5-71a7fc674b91 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:09.782924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:09.784051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:09.784475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:09.785051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] PATH_INFO: `/v3/users/2d0410ac4e644b03b61cad1c2a1273e7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:09.786432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0410ac4e644b03b61cad1c2a1273e7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:09.789282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:09.830628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:09.832257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:09.849084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88798a-a22a-4e80-9a91-8334f275e049 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:09.857552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:09.858754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:09.859233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:09.859510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] PATH_INFO: `/v3/projects/ce19946cba974ae4afae85fba935404e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:09.861116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce19946cba974ae4afae85fba935404e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:09.863238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:10.097353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce19946cba974ae4afae85fba935404e', 'request_id': 'req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.100571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0410ac4e644b03b61cad1c2a1273e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.111578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce19946cba974ae4afae85fba935404e', 'request_id': 'req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.116954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0410ac4e644b03b61cad1c2a1273e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.173391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0410ac4e644b03b61cad1c2a1273e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.174166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0410ac4e644b03b61cad1c2a1273e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.215148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce19946cba974ae4afae85fba935404e', 'request_id': 'req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.236452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] The token cache is being invalidate because project ce19946cba974ae4afae85fba935404e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:10.240440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.243069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e256c18e-3e5c-407b-a8c4-b75e9d71d9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.247085 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2922/5921] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:09 2021] DELETE /identity/v3/projects/ce19946cba974ae4afae85fba935404e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:10.254812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748a42-eb3d-4bbd-b6d8-814f6704bbf0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:10.255103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748a42-eb3d-4bbd-b6d8-814f6704bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:10.255389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8748a42-eb3d-4bbd-b6d8-814f6704bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:10.305383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c322daab-849d-413a-899d-1a15a5cdb482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0410ac4e644b03b61cad1c2a1273e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:10.312711 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3000/5922] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:09 2021] DELETE /identity/v3/users/2d0410ac4e644b03b61cad1c2a1273e7 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:10.328566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d8748a42-eb3d-4bbd-b6d8-814f6704bbf0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:10.331756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d8748a42-eb3d-4bbd-b6d8-814f6704bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:10.500742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2923/5923] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:10.508624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11cca-2dfb-4e38-86d0-5cd4285c51f9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:10.509253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11cca-2dfb-4e38-86d0-5cd4285c51f9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:10.509762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f11cca-2dfb-4e38-86d0-5cd4285c51f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:10.553481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-14f11cca-2dfb-4e38-86d0-5cd4285c51f9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:10.569634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-14f11cca-2dfb-4e38-86d0-5cd4285c51f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:10.591121 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3001/5924] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:10.595324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748a42-eb3d-4bbd-b6d8-814f6704bbf0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:10.610979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8748a42-eb3d-4bbd-b6d8-814f6704bbf0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:10.627495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:10.628254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:10.629226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:10.629527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:10.630815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:10.631934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:10.634198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:10.670494 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2924/5925] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:28:10.675799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f11cca-2dfb-4e38-86d0-5cd4285c51f9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:10.688826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f11cca-2dfb-4e38-86d0-5cd4285c51f9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:10.707569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:10.708578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:10.709033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:10.709462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:10.710892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:10.715649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:10.866635 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3002/5926] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:10 2021] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:10.871005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:10.888012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da85acc-8f22-474c-a771-6cdd0f1530eb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:10.983867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:10.986549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:11.026746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:11.027947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.029057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.029609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:11.031010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:11.033415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:11.079221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665cf46-b8ea-4ba2-b199-1003cd9de5a8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:11.087241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:11.089333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.090016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.090496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] PATH_INFO: `/v3/projects/5b73d07b223d4a46b519eb55b7891ff6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:11.093915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b73d07b223d4a46b519eb55b7891ff6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:11.097436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:11.167499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2925/5927] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:10 2021] POST /identity/v3/users => generated 284 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:11.169363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:11.189126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b649-d455-4f79-a2b7-8c8489c90272 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:11.194707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:11.195397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.195682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.195984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:11.197238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:11.198944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:11.236511 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2926/5928] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:11.239966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:11.259023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350e39e-e27f-4a24-ad13-0b4643a30743 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:11.271155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:11.271841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.272216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.272499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:11.276908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:11.282200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:11.299739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b73d07b223d4a46b519eb55b7891ff6', 'request_id': 'req-bae5354d-e42c-486f-a961-c2cea4964d82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.310453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2927/5929] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:11.315061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:11.338910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb3722-fb3c-4f7c-a26e-b17cb7f280d7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:11.433701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838b71e-c1b2-457e-a5f8-61f58bb98fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:11.435355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838b71e-c1b2-457e-a5f8-61f58bb98fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.435622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838b71e-c1b2-457e-a5f8-61f58bb98fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.436812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838b71e-c1b2-457e-a5f8-61f58bb98fb0 admin admin] PATH_INFO: `/v3/projects/6d33281b0c4c402eacd641a45e81edd7/users/ebf61af4a7d6490ca760c131cfa5cf8e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:11.440777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b73d07b223d4a46b519eb55b7891ff6', 'request_id': 'req-bae5354d-e42c-486f-a961-c2cea4964d82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.447762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b73d07b223d4a46b519eb55b7891ff6', 'request_id': 'req-bae5354d-e42c-486f-a961-c2cea4964d82'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.473819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] The token cache is being invalidate because project 5b73d07b223d4a46b519eb55b7891ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:11.473819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.475080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.478761 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3003/5930] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:10 2021] DELETE /identity/v3/projects/5b73d07b223d4a46b519eb55b7891ff6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:11.481174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838b71e-c1b2-457e-a5f8-61f58bb98fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d33281b0c4c402eacd641a45e81edd7, user_id=ebf61af4a7d6490ca760c131cfa5cf8e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:11.484244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:11.485904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:11.490014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838b71e-c1b2-457e-a5f8-61f58bb98fb0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:11.511987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5354d-e42c-486f-a961-c2cea4964d82 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:11.518836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:11.520129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.520829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.521326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] PATH_INFO: `/v3/users/87d768fb6277460588c4f47f8b0f31dc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:11.523892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d768fb6277460588c4f47f8b0f31dc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:11.526299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:11.616773 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2928/5931] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:11 2021] PUT /identity/v3/projects/6d33281b0c4c402eacd641a45e81edd7/users/ebf61af4a7d6490ca760c131cfa5cf8e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:11.633749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.633830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.635251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:11.667701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] MFA Rules not processed for user `ebf61af4a7d6490ca760c131cfa5cf8e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:11.669685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:11.833447 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2929/5932] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:11 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:11.853699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:11.855276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:11.877057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d768fb6277460588c4f47f8b0f31dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.891164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d768fb6277460588c4f47f8b0f31dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.924210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d768fb6277460588c4f47f8b0f31dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.925223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d768fb6277460588c4f47f8b0f31dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:11.988917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708144bd-699f-404c-8aeb-4bdd57776eb5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:11.992985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62b9bb-9cab-4631-a937-34871e9a7a08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:11.993531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b9bb-9cab-4631-a937-34871e9a7a08 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:11.993814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b9bb-9cab-4631-a937-34871e9a7a08 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:11.998402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b9bb-9cab-4631-a937-34871e9a7a08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:12.013563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b9bb-9cab-4631-a937-34871e9a7a08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:12.015027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62b9bb-9cab-4631-a937-34871e9a7a08 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:12.020858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d768fb6277460588c4f47f8b0f31dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:12.033841 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3004/5933] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:11 2021] DELETE /identity/v3/users/87d768fb6277460588c4f47f8b0f31dc => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:12.037041 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2930/5934] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:11 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:28:12.644491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:12.655038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:12.863776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03c63a-8a31-46d0-8ff6-b980503d9041 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:12.873453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:12.876018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:12.876460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:12.876919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] PATH_INFO: `/v3/projects/750305cebc0f493c9d5a42bc8178f480` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:12.879047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] RBAC: Authorizing `identity:delete_project(project_id=750305cebc0f493c9d5a42bc8178f480)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:12.882198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:13.076789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750305cebc0f493c9d5a42bc8178f480', 'request_id': 'req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:13.213296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750305cebc0f493c9d5a42bc8178f480', 'request_id': 'req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:13.222038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750305cebc0f493c9d5a42bc8178f480', 'request_id': 'req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:13.243043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] The token cache is being invalidate because project 750305cebc0f493c9d5a42bc8178f480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:13.243555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:13.244661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd202db4-3a24-4fe0-82cd-3bb0abb3902a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:13.246673 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3005/5935] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:12 2021] DELETE /identity/v3/projects/750305cebc0f493c9d5a42bc8178f480 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:13.252942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635ff2-2fdb-4b87-8007-1dd6eb3195ec None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:13.253432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635ff2-2fdb-4b87-8007-1dd6eb3195ec None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:13.253742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635ff2-2fdb-4b87-8007-1dd6eb3195ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:13.297456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4d635ff2-2fdb-4b87-8007-1dd6eb3195ec None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:13.298992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d635ff2-2fdb-4b87-8007-1dd6eb3195ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:13.371537 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2931/5936] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:13.387401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb4670-ad8f-4970-961c-3063aa0663fa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:13.388614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb4670-ad8f-4970-961c-3063aa0663fa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:13.388936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb4670-ad8f-4970-961c-3063aa0663fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:13.431347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0ebb4670-ad8f-4970-961c-3063aa0663fa None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:13.434575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ebb4670-ad8f-4970-961c-3063aa0663fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:13.461385 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3006/5937] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:13.461565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635ff2-2fdb-4b87-8007-1dd6eb3195ec None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:13.475462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635ff2-2fdb-4b87-8007-1dd6eb3195ec None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:13.481601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:13.482668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:13.483134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:13.483488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:13.484297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:13.484847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:13.487579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:13.514638 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2932/5938] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:28:13.519118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb4670-ad8f-4970-961c-3063aa0663fa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:13.534884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb4670-ad8f-4970-961c-3063aa0663fa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:13.541833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:13.542521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:13.542803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:13.543077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:13.543818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:13.549431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:13.745232 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3007/5939] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:13 2021] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:13.749419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:13.776505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b576a7-fd0e-4a36-8b50-dfa9eaeeed55 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:13.931409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:13.932056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:13.932338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:13.932611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:13.933340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:13.936410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:14.055294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:14.056436 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2933/5940] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:13 2021] POST /identity/v3/users => generated 282 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:14.077446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1bf5b-379c-4fab-91da-4caa420bb453 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:14.089755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:14.090564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:14.091023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:14.091951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:14.092865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:14.094707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:14.176538 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3008/5941] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:14 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:14.180648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:14.192232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8e72-be59-4040-8207-752a85d2c12e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:14.204665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2961-9be6-41a9-861b-e6c71334a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:14.205398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2961-9be6-41a9-861b-e6c71334a041 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:14.205684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2961-9be6-41a9-861b-e6c71334a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:14.205967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2961-9be6-41a9-861b-e6c71334a041 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:14.206721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2961-9be6-41a9-861b-e6c71334a041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:14.211331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2961-9be6-41a9-861b-e6c71334a041 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:14.243044 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2934/5942] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:14 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:14.249875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:14.263927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17ca8-170f-435e-9359-6def7abc3407 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:14.281126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:14.282904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:14.283189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:14.284280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] PATH_INFO: `/v3/projects/01fe97247f8d425d80e1d145476201a0/users/cff6cb2ab4fc4993a8c9fca4b07a2522/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:14.321683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fe97247f8d425d80e1d145476201a0, user_id=cff6cb2ab4fc4993a8c9fca4b07a2522, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:14.337928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:14.443826 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3009/5943] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:14 2021] PUT /identity/v3/projects/01fe97247f8d425d80e1d145476201a0/users/cff6cb2ab4fc4993a8c9fca4b07a2522/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:14.454711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7f87-99eb-4d49-b1f6-96ae97a1cc37 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:14.456045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7f87-99eb-4d49-b1f6-96ae97a1cc37 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:14.456473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7f87-99eb-4d49-b1f6-96ae97a1cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:14.529676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-be3c7f87-99eb-4d49-b1f6-96ae97a1cc37 None None] MFA Rules not processed for user `cff6cb2ab4fc4993a8c9fca4b07a2522`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:14.531138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be3c7f87-99eb-4d49-b1f6-96ae97a1cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:14.650891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2935/5944] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:14 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:14.655941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:14.758889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b13a9-307b-4f0d-a121-81d19ed00dc8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:14.767395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:14.768563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:14.769045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:14.769495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:14.774347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:14.774347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:14.791494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:14.791784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:14.792062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:14.843750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] MFA Rules not processed for user `2e1d04230c7b45cab2d2fcb72fb218ad`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:14.845247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:14.861760 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3010/5945] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:14 2021] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:14.867085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:14.972913 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2936/5946] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:14 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:28:14.977752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3991c-d2b9-4fec-9ec7-5f9aae5392bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:14.983254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:14.984993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:14.993950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:14.994651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:14.998459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:14.998459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:14.998459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:15.002030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:15.088419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1136e5f-f191-448e-b4a2-a98b9bef1dea None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:15.098592 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3011/5947] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:14 2021] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:15.102110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:15.119306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bb34b-c7f3-4827-9ecb-305dd6d922ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:15.136681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:15.137571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:15.138601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:15.138887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:15.139776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:15.144045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:15.168249 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3012/5948] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:15 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:15.171701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:15.186667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0f73-8b97-4c13-804e-7c7ac0946f3b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:15.194698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:15.195677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:15.195861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:15.196180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:15.196549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:15.196651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:15.196850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:15.197182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] PATH_INFO: `/v3/projects/1f0921ffb9e647debd042a5f9215cd52/users/013c74d084d5467d938ef727a61db7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:15.199182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:15.225765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0921ffb9e647debd042a5f9215cd52, user_id=013c74d084d5467d938ef727a61db7dd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:15.229091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:15.324919 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3013/5949] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:15 2021] PUT /identity/v3/projects/1f0921ffb9e647debd042a5f9215cd52/users/013c74d084d5467d938ef727a61db7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:15.327773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:15.328865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:15.331814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:15.371511 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2937/5950] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:14 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:28:15.472185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebd081-af43-44b7-b08b-44aa26f47188 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:15.484591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cfa07-bd8f-4a49-bad6-bbded8ad2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:15.485365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cfa07-bd8f-4a49-bad6-bbded8ad2574 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:15.486258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cfa07-bd8f-4a49-bad6-bbded8ad2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:15.493056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cfa07-bd8f-4a49-bad6-bbded8ad2574 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:15.493056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cfa07-bd8f-4a49-bad6-bbded8ad2574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:15.493206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cfa07-bd8f-4a49-bad6-bbded8ad2574 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:15.520655 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3014/5951] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:15 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:15.523256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:15.543096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd591a8-810a-4ca5-a494-444cd3422c43 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:15.567503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:15.568430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:15.568710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:15.569012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] PATH_INFO: `/v3/projects/1f0921ffb9e647debd042a5f9215cd52/users/013c74d084d5467d938ef727a61db7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:15.580197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0921ffb9e647debd042a5f9215cd52, user_id=013c74d084d5467d938ef727a61db7dd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:15.582880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:15.633386 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2938/5952] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:15 2021] PUT /identity/v3/projects/1f0921ffb9e647debd042a5f9215cd52/users/013c74d084d5467d938ef727a61db7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:15.638528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c057b-4097-4afa-944f-62c3bf72af34 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:15.639882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c057b-4097-4afa-944f-62c3bf72af34 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:15.640599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c057b-4097-4afa-944f-62c3bf72af34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:15.730167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dc8c057b-4097-4afa-944f-62c3bf72af34 None None] MFA Rules not processed for user `013c74d084d5467d938ef727a61db7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:15.731928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dc8c057b-4097-4afa-944f-62c3bf72af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:15.885257 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3015/5953] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:15 2021] POST /identity/v3/auth/tokens => generated 3295 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:15.913153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:15.914910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:16.015695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a491e-4ab8-42bc-8b2c-7b51eea48aa0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:16.019503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:16.020254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:16.020651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:16.021024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:16.032256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:16.033811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:16.044338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2939/5954] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:15 2021] GET /identity/v3/auth/tokens => generated 3295 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:28:16.383961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c057b-4097-4afa-944f-62c3bf72af34 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:16.399312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c057b-4097-4afa-944f-62c3bf72af34 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:16.403082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864e7b1-018d-4e26-a444-a89bbd843d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:16.404204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864e7b1-018d-4e26-a444-a89bbd843d09 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:16.404658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864e7b1-018d-4e26-a444-a89bbd843d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:16.405072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864e7b1-018d-4e26-a444-a89bbd843d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:16.471993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864e7b1-018d-4e26-a444-a89bbd843d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:16.473668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864e7b1-018d-4e26-a444-a89bbd843d09 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:16.485837 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3016/5955] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:16 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:32.658212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:32.659797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:32.758355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f4e70-65b8-4add-a67c-5a6c52e73ead service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:32.764301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:32.765291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:32.765478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:32.765941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] PATH_INFO: `/v3/users/8d5535c04fab47d3b13e358932d3cea2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:32.767053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5535c04fab47d3b13e358932d3cea2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:32.769094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:32.977389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5535c04fab47d3b13e358932d3cea2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:32.984949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5535c04fab47d3b13e358932d3cea2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:32.997281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5535c04fab47d3b13e358932d3cea2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:32.998004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5535c04fab47d3b13e358932d3cea2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:32.998610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5535c04fab47d3b13e358932d3cea2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:33.099178 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2940/5956] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:32 2021] DELETE /identity/v3/users/8d5535c04fab47d3b13e358932d3cea2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:33.103567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:33.104047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:33.104120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:33.122858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:33.124061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:33.183879 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3017/5957] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:28:33.193744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:33.195205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:33.262357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d93ef-5b0d-48ca-911c-947df2209838 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:33.266195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62291691-f5bc-491a-b411-0e662200d110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:33.266841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62291691-f5bc-491a-b411-0e662200d110 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:33.267118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62291691-f5bc-491a-b411-0e662200d110 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:33.267387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62291691-f5bc-491a-b411-0e662200d110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:33.277132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62291691-f5bc-491a-b411-0e662200d110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:33.279073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62291691-f5bc-491a-b411-0e662200d110 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:33.288724 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2941/5958] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:28:33.630039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:33.631618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:33.649425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfd2dc-c320-4f81-b54e-3457c7c2494a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:33.657833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:33.660400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:33.660400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:33.660400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] PATH_INFO: `/v3/projects/e27ea19f90cf4e0c934675615d455854` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:33.660907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27ea19f90cf4e0c934675615d455854)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:33.662491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:33.797738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27ea19f90cf4e0c934675615d455854', 'request_id': 'req-c1a031c2-453c-44a1-9956-5e564718a4ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:33.901426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27ea19f90cf4e0c934675615d455854', 'request_id': 'req-c1a031c2-453c-44a1-9956-5e564718a4ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:33.909156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27ea19f90cf4e0c934675615d455854', 'request_id': 'req-c1a031c2-453c-44a1-9956-5e564718a4ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:33.923395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] The token cache is being invalidate because project e27ea19f90cf4e0c934675615d455854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:33.923968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:33.925047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a031c2-453c-44a1-9956-5e564718a4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:33.926776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3018/5959] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:33 2021] DELETE /identity/v3/projects/e27ea19f90cf4e0c934675615d455854 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:33.932853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d440-7139-460c-9866-66e951a533d4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:33.933376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d440-7139-460c-9866-66e951a533d4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:33.933376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d440-7139-460c-9866-66e951a533d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:33.967717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c092d440-7139-460c-9866-66e951a533d4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:33.968976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c092d440-7139-460c-9866-66e951a533d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:34.076935 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2942/5960] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:34.080532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696e5c-2970-4a0b-8cd5-26847f16f95c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.080818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696e5c-2970-4a0b-8cd5-26847f16f95c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.081251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696e5c-2970-4a0b-8cd5-26847f16f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.106762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-10696e5c-2970-4a0b-8cd5-26847f16f95c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:34.108716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-10696e5c-2970-4a0b-8cd5-26847f16f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:34.121569 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3019/5961] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:34.127294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092d440-7139-460c-9866-66e951a533d4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:34.141702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092d440-7139-460c-9866-66e951a533d4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:34.150580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:34.151662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.154999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.154999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.157593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:34.158213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:34.160314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:34.180645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2943/5962] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:28:34.184719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10696e5c-2970-4a0b-8cd5-26847f16f95c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:34.196900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10696e5c-2970-4a0b-8cd5-26847f16f95c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:34.210294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:34.211022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.211496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.211832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.212689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:34.216308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:34.367436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:34.367921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3020/5963] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:34 2021] POST /identity/v3/projects => generated 403 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:34.381652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f7517-3567-48cc-8f66-385fdc768579 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:34.445605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:34.446289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.446565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.446836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.447536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:34.449575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:34.537918 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2944/5964] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:34 2021] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:34.539460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:34.553392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fa74-2374-4929-a3f9-b188f22acd9f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:34.559817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:34.560707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.561305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.561730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.562918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:34.564998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:34.579148 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3021/5965] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:34 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:34.583281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:34.595235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29492fc1-2f0b-49cc-9f7d-54ea67cbe53d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:34.605903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a6902-d334-4458-933f-eca82a9a4b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:34.606871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6902-d334-4458-933f-eca82a9a4b5d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.607341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6902-d334-4458-933f-eca82a9a4b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.607686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a6902-d334-4458-933f-eca82a9a4b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.608667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a6902-d334-4458-933f-eca82a9a4b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:34.611178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a6902-d334-4458-933f-eca82a9a4b5d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:34.624705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2945/5966] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:34 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:34.629125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:34.643308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c702b8-7b56-4d33-a070-511523bfe24f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:34.655275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:34.656328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.656664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.656984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] PATH_INFO: `/v3/projects/f38fc294ddc048be9c1ff43557bc96a2/users/33d8ddbb641f4019991d184f13ab22c7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.685732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38fc294ddc048be9c1ff43557bc96a2, user_id=33d8ddbb641f4019991d184f13ab22c7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:34.689081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:34.815197 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3022/5967] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:34 2021] PUT /identity/v3/projects/f38fc294ddc048be9c1ff43557bc96a2/users/33d8ddbb641f4019991d184f13ab22c7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:34.825733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878c980-ea25-4acd-b208-e91a839184a1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:34.826022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878c980-ea25-4acd-b208-e91a839184a1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:34.826629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878c980-ea25-4acd-b208-e91a839184a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:34.854162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5878c980-ea25-4acd-b208-e91a839184a1 None None] MFA Rules not processed for user `33d8ddbb641f4019991d184f13ab22c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:34.855401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5878c980-ea25-4acd-b208-e91a839184a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:34.930297 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2946/5968] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:34 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:34.935179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:35.007692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846c081-7200-4b59-8194-7d24dc55f21a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:35.012778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:35.013561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.013842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.014114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.014841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:35.016808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:35.128983 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3023/5969] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:34 2021] POST /identity/v3/projects => generated 403 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:35.133008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878c980-ea25-4acd-b208-e91a839184a1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:35.144363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878c980-ea25-4acd-b208-e91a839184a1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:35.234704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:35.235539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.235918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.236391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.237321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:35.239552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:35.371999 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2947/5970] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:35 2021] POST /identity/v3/users => generated 308 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:28:35.374572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:35.386005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec5cec-d41d-4c04-897b-ab928b60875f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:35.391426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:35.392502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.393108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.393590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.394548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:35.396576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:35.413713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:35.414446 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3024/5971] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:35 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:35.428651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc28bc2-4ffa-4552-aa51-41b7de61882a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:35.434345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:35.438111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.438398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.441532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] PATH_INFO: `/v3/projects/64cf6a7f3efa4c23a62c634405ca8071/users/0af55f1dba3a4e6daa9322570c389567/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.459627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cf6a7f3efa4c23a62c634405ca8071, user_id=0af55f1dba3a4e6daa9322570c389567, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:35.462567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:35.532903 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2948/5972] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:35 2021] PUT /identity/v3/projects/64cf6a7f3efa4c23a62c634405ca8071/users/0af55f1dba3a4e6daa9322570c389567/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:35.537015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:35.547042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3597e2-9582-470e-97f7-e41cfffe0470 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:35.616323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966155c1-cd06-40f9-b63c-43155fcfee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:35.617172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966155c1-cd06-40f9-b63c-43155fcfee0e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.617458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966155c1-cd06-40f9-b63c-43155fcfee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.617785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966155c1-cd06-40f9-b63c-43155fcfee0e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.618682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966155c1-cd06-40f9-b63c-43155fcfee0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:35.621459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966155c1-cd06-40f9-b63c-43155fcfee0e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:35.633198 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3025/5973] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:35 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:35.637795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:35.649069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8200-6b31-4d61-858a-4c241fa35cdb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:35.669018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:35.669960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.670236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.670510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] PATH_INFO: `/v3/projects/64cf6a7f3efa4c23a62c634405ca8071/users/0af55f1dba3a4e6daa9322570c389567/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.673231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cf6a7f3efa4c23a62c634405ca8071, user_id=0af55f1dba3a4e6daa9322570c389567, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:35.679631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:35.693225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2949/5974] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:35 2021] PUT /identity/v3/projects/64cf6a7f3efa4c23a62c634405ca8071/users/0af55f1dba3a4e6daa9322570c389567/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:35.703880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed80a2-2983-4946-a7e9-be8b1b8dbeb5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.704266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed80a2-2983-4946-a7e9-be8b1b8dbeb5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.704634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed80a2-2983-4946-a7e9-be8b1b8dbeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.735612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-36ed80a2-2983-4946-a7e9-be8b1b8dbeb5 None None] MFA Rules not processed for user `0af55f1dba3a4e6daa9322570c389567`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:35.736856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-36ed80a2-2983-4946-a7e9-be8b1b8dbeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:35.837174 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3026/5975] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:35 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:35.851764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:35.853487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:35.931637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231a26-1ba0-4140-9e4e-92d67fea8fcf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:35.937391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb73f07-2fea-45a6-810f-75709462fa70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:35.938552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73f07-2fea-45a6-810f-75709462fa70 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:35.938981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73f07-2fea-45a6-810f-75709462fa70 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:35.939388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb73f07-2fea-45a6-810f-75709462fa70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:35.968482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73f07-2fea-45a6-810f-75709462fa70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:35.970783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb73f07-2fea-45a6-810f-75709462fa70 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:35.986956 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2950/5976] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:35 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:36.142714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed80a2-2983-4946-a7e9-be8b1b8dbeb5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:36.255832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed80a2-2983-4946-a7e9-be8b1b8dbeb5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:36.273572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:36.274703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:36.275129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:36.275566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] PATH_INFO: `/v3/users/33d8ddbb641f4019991d184f13ab22c7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:36.278887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d8ddbb641f4019991d184f13ab22c7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:36.281679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:36.530660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d8ddbb641f4019991d184f13ab22c7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:36.543617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d8ddbb641f4019991d184f13ab22c7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:36.565777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d8ddbb641f4019991d184f13ab22c7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:36.569412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d8ddbb641f4019991d184f13ab22c7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:36.664682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d8ddbb641f4019991d184f13ab22c7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:36.672576 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3027/5977] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:36 2021] DELETE /identity/v3/users/33d8ddbb641f4019991d184f13ab22c7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:36.677417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:36.677853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:36.677967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:36.699043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:36.700776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:36.810529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2951/5978] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:36.842230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:36.843853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:36.934592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f115a4d-05b5-4612-87f9-795039fd4da3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:36.939577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:36.941555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:36.941954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:36.942360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:36.968672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:36.970083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:36.983440 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3028/5979] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:38.003126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:38.004667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:38.022121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ca84-2630-4d2b-93f3-5a8e0bc78963 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:38.028403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:38.029309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:38.029588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:38.029859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] PATH_INFO: `/v3/projects/f38fc294ddc048be9c1ff43557bc96a2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:38.031075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38fc294ddc048be9c1ff43557bc96a2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:38.033597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:38.176406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38fc294ddc048be9c1ff43557bc96a2', 'request_id': 'req-b9972bd3-ed09-4478-9aa2-f1077d3a774d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.186701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38fc294ddc048be9c1ff43557bc96a2', 'request_id': 'req-b9972bd3-ed09-4478-9aa2-f1077d3a774d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.273568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38fc294ddc048be9c1ff43557bc96a2', 'request_id': 'req-b9972bd3-ed09-4478-9aa2-f1077d3a774d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.287371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] The token cache is being invalidate because project f38fc294ddc048be9c1ff43557bc96a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:38.287652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.290756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.294226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2952/5980] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:38 2021] DELETE /identity/v3/projects/f38fc294ddc048be9c1ff43557bc96a2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:38.301014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:38.311919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da758f9-d900-4068-b3bf-9dd67de386e6 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:38.389402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:38.391695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:38.391695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:38.391695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] PATH_INFO: `/v3/users/0af55f1dba3a4e6daa9322570c389567` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:38.392691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af55f1dba3a4e6daa9322570c389567)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:38.394674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:38.654135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af55f1dba3a4e6daa9322570c389567'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.665480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af55f1dba3a4e6daa9322570c389567'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.679808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af55f1dba3a4e6daa9322570c389567'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.680695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af55f1dba3a4e6daa9322570c389567'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.790347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af55f1dba3a4e6daa9322570c389567'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:38.797299 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3029/5981] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:38 2021] DELETE /identity/v3/users/0af55f1dba3a4e6daa9322570c389567 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:39.150418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:39.154769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:39.177519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9972bd3-ed09-4478-9aa2-f1077d3a774d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:39.269545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:39.271462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:39.273292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:39.274081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] PATH_INFO: `/v3/users/03c79cffce92412ca4dc094bf247e699` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:39.276277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c79cffce92412ca4dc094bf247e699)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:39.280401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:39.605839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:39.605839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:39.615549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928ad60-f7de-463e-97f7-f37bfe41417e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:39.621446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:39.622366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:39.622652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:39.623096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] PATH_INFO: `/v3/projects/64cf6a7f3efa4c23a62c634405ca8071` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:39.625165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64cf6a7f3efa4c23a62c634405ca8071)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:39.627331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:39.672214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c79cffce92412ca4dc094bf247e699'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.681711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c79cffce92412ca4dc094bf247e699'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.706576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c79cffce92412ca4dc094bf247e699'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.707371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c79cffce92412ca4dc094bf247e699'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.707957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a99e0ac5-7c14-4db8-b485-d24d1886e82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c79cffce92412ca4dc094bf247e699'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.755911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cf6a7f3efa4c23a62c634405ca8071', 'request_id': 'req-93868750-bafd-41bd-8cb8-8ac4fb28f44f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.827847 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2953/5982] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:39 2021] DELETE /identity/v3/users/03c79cffce92412ca4dc094bf247e699 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:39.832851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:39.833179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:39.833456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:39.864154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:39.865413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:39.911368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cf6a7f3efa4c23a62c634405ca8071', 'request_id': 'req-93868750-bafd-41bd-8cb8-8ac4fb28f44f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.923672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cf6a7f3efa4c23a62c634405ca8071', 'request_id': 'req-93868750-bafd-41bd-8cb8-8ac4fb28f44f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.944634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] The token cache is being invalidate because project 64cf6a7f3efa4c23a62c634405ca8071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:39.945116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.945879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-93868750-bafd-41bd-8cb8-8ac4fb28f44f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:39.947620 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3030/5983] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:39 2021] DELETE /identity/v3/projects/64cf6a7f3efa4c23a62c634405ca8071 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:39.956514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb995bb-0f6b-4922-a543-38b93ff9782e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:39.958443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb995bb-0f6b-4922-a543-38b93ff9782e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:39.960090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb995bb-0f6b-4922-a543-38b93ff9782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:39.974200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2954/5984] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:39.990867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dbb995bb-0f6b-4922-a543-38b93ff9782e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:39.992092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dbb995bb-0f6b-4922-a543-38b93ff9782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:39.993755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:39.996254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:40.020979 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3031/5985] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:40.030403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599778-5582-4dc2-83c3-0ed7c8cb756c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.030748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599778-5582-4dc2-83c3-0ed7c8cb756c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.031028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599778-5582-4dc2-83c3-0ed7c8cb756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.053005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2c599778-5582-4dc2-83c3-0ed7c8cb756c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:40.054734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2c599778-5582-4dc2-83c3-0ed7c8cb756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:40.077559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5dce0-14e7-45af-a6d6-3d034b55e6f6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:40.077877 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3032/5986] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:28:40.081489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599778-5582-4dc2-83c3-0ed7c8cb756c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:40.082010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:40.082668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.083012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.083257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.097040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599778-5582-4dc2-83c3-0ed7c8cb756c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:40.103365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:40.104390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.105560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.106095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.107230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:40.107752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:40.109903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:40.122482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:40.123962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:40.126224 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3033/5987] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:28:40.130853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:40.143881 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2955/5988] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:28:40.153843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3cf12-b23a-423c-8d78-6fcac09c1851 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:40.160796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:40.161865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.162650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.163326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.164203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:40.168213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:40.273983 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3034/5989] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:40 2021] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:40.279305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:40.291270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717af78-ec55-4dde-a4e2-025c0f7b5a7a service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:40.378140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:40.378933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.379361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.379729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.380560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:40.382620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:40.489992 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2956/5990] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:40 2021] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:28:40.494546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:40.510257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a038c0-070f-4de8-8156-724e5a8ce2bd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:40.543907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:40.544819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.545240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.545886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.547589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:40.549044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:40.563653 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3035/5991] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:40 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:40.569517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:40.580309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fc95c-cf11-431a-ad1f-020681cbf9eb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:40.591744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c072b-e0fa-44f4-8765-5c95cba858ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:40.592710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c072b-e0fa-44f4-8765-5c95cba858ea admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.594684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c072b-e0fa-44f4-8765-5c95cba858ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.604389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c072b-e0fa-44f4-8765-5c95cba858ea admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.604389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c072b-e0fa-44f4-8765-5c95cba858ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:40.604389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c072b-e0fa-44f4-8765-5c95cba858ea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:40.640094 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2957/5992] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:40 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:40.644712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:40.663481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a9633-ae39-4569-bd11-b31fdeaf9439 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:40.674607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:40.682759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.683424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.683898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] PATH_INFO: `/v3/projects/9b0e46e941e141b1812c1ac47ef9d798/users/fe9c046dd8a54b729c4ee31f741a5e13/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.735024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0e46e941e141b1812c1ac47ef9d798, user_id=fe9c046dd8a54b729c4ee31f741a5e13, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:40.736207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:40.849965 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3036/5993] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:40 2021] PUT /identity/v3/projects/9b0e46e941e141b1812c1ac47ef9d798/users/fe9c046dd8a54b729c4ee31f741a5e13/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:40.859883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:40.860084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:40.860288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:40.906766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] MFA Rules not processed for user `fe9c046dd8a54b729c4ee31f741a5e13`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:40.908049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:41.016164 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2958/5994] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:40 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:41.021132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:41.112161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:41.113596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:41.133503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b849-5680-49b1-a0a6-9f0256c78dab admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:41.143064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6600e-85c9-4fb5-a1c1-87eb814b185d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:41.150247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:41.153447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:41.157371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:41.157371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:41.157371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:41.157647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:41.157647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:41.157811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:41.159921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] PATH_INFO: `/v3/projects/f2ae4213c5284c2e83951c885ed24c07` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:41.160066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:41.161290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ae4213c5284c2e83951c885ed24c07)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:41.163454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:41.346818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ae4213c5284c2e83951c885ed24c07', 'request_id': 'req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:41.351513 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3037/5995] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:41 2021] POST /identity/v3/projects => generated 363 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:28:41.355978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:41.360155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ae4213c5284c2e83951c885ed24c07', 'request_id': 'req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:41.453811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ae4213c5284c2e83951c885ed24c07', 'request_id': 'req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:41.465846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee7140-633f-4253-a72d-1856e72dbb00 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:41.475415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:41.476121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:41.476409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:41.476691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:41.477828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:41.479276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] The token cache is being invalidate because project f2ae4213c5284c2e83951c885ed24c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:41.479568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:41.480518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:41.488216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:41.499091 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2959/5996] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:41 2021] DELETE /identity/v3/projects/f2ae4213c5284c2e83951c885ed24c07 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:41.508513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:41.519827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:41.596402 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3038/5997] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:41 2021] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:41.597572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:41.600019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:41.632104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d967367-aea2-4892-b3a9-ce1148c9a96a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:41.642489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:41.644420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:41.644937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:41.645988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:41.648581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:41.649084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:41.663632 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3039/5998] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:41 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:41.668503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:41.681723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6a915-ad77-4c72-99b5-cb8444e86fda admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:41.683655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5ed06-f718-4c4c-8b88-9497b7b9f454 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:41.688300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:41.689505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:41.689915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:41.690696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] PATH_INFO: `/v3/projects/6c9b8aa17dfd4cf8b2783399359c1e16/users/49b3e8774eaf44b1a11db90d2a2cc1bd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:41.701640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:41.702752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:41.709037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:41.709414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] PATH_INFO: `/v3/users/02dd8b1a0ddb48b5b5a78d378b689e30` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:41.713125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02dd8b1a0ddb48b5b5a78d378b689e30)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:41.716689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9b8aa17dfd4cf8b2783399359c1e16, user_id=49b3e8774eaf44b1a11db90d2a2cc1bd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:41.719565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:41.721587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:41.828360 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3040/5999] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:41 2021] PUT /identity/v3/projects/6c9b8aa17dfd4cf8b2783399359c1e16/users/49b3e8774eaf44b1a11db90d2a2cc1bd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:41.830745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:41.935721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e23f29-2702-4e76-a165-3a28ffd7b747 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:41.958204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:41.960586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:41.960953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:41.961188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:41.965145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:41.966800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:41.996377 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3041/6000] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:41 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:42.000859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:42.008036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02dd8b1a0ddb48b5b5a78d378b689e30'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:42.019721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0a5e-3eec-486e-af58-0a60b64d9a31 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:42.027524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02dd8b1a0ddb48b5b5a78d378b689e30'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:42.032406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902828f-b1c0-405e-a1a9-322929d91513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:42.033030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902828f-b1c0-405e-a1a9-322929d91513 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:42.033320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902828f-b1c0-405e-a1a9-322929d91513 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:42.033602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902828f-b1c0-405e-a1a9-322929d91513 admin admin] PATH_INFO: `/v3/projects/6c9b8aa17dfd4cf8b2783399359c1e16/users/49b3e8774eaf44b1a11db90d2a2cc1bd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:42.043019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902828f-b1c0-405e-a1a9-322929d91513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9b8aa17dfd4cf8b2783399359c1e16, user_id=49b3e8774eaf44b1a11db90d2a2cc1bd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:42.048070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902828f-b1c0-405e-a1a9-322929d91513 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:42.062399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02dd8b1a0ddb48b5b5a78d378b689e30'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:42.064621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02dd8b1a0ddb48b5b5a78d378b689e30'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:42.068104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02dd8b1a0ddb48b5b5a78d378b689e30'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:42.071542 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3042/6001] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:41 2021] PUT /identity/v3/projects/6c9b8aa17dfd4cf8b2783399359c1e16/users/49b3e8774eaf44b1a11db90d2a2cc1bd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:42.083010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:42.083318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:42.083596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:42.158710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] MFA Rules not processed for user `49b3e8774eaf44b1a11db90d2a2cc1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:42.182467 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2960/6002] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:41 2021] DELETE /identity/v3/users/02dd8b1a0ddb48b5b5a78d378b689e30 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:42.186626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:42.303015 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3043/6003] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:42 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:42.319511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:42.320790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:42.466036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0c60-1be7-4362-b131-4dc4295709e1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:42.477072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:42.477823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:42.478106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:42.478380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:42.500324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:42.501825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:42.531029 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2961/6004] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:42 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:42.794065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:42.796516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:43.012268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b7ca1-ff2e-4fc1-be5e-336c9cfce293 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:43.024382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:43.025481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.025923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.026205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] PATH_INFO: `/v3/projects/11dbaf75025641a583f8da351941d2bc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.029633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11dbaf75025641a583f8da351941d2bc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:43.031588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:43.089663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:43.092347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:43.118755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8103b-42b0-4d82-b9a8-7acaa729f294 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:43.128030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:43.129561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.129718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.130069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] PATH_INFO: `/v3/users/fe9c046dd8a54b729c4ee31f741a5e13` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.133719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9c046dd8a54b729c4ee31f741a5e13)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:43.137181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:43.209932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11dbaf75025641a583f8da351941d2bc', 'request_id': 'req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.291269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11dbaf75025641a583f8da351941d2bc', 'request_id': 'req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.302619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11dbaf75025641a583f8da351941d2bc', 'request_id': 'req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.341158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] The token cache is being invalidate because project 11dbaf75025641a583f8da351941d2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:43.344717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.347088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c6d0e99c-85d6-4e5b-a2ba-4e297f34fdf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.351687 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3044/6005] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:42 2021] DELETE /identity/v3/projects/11dbaf75025641a583f8da351941d2bc => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:43.354759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9c046dd8a54b729c4ee31f741a5e13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.356797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c2935-216f-4f1a-9dbc-7e03875aa748 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.357223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c2935-216f-4f1a-9dbc-7e03875aa748 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.358360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c2935-216f-4f1a-9dbc-7e03875aa748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.366166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9c046dd8a54b729c4ee31f741a5e13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.383664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9c046dd8a54b729c4ee31f741a5e13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.384675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9c046dd8a54b729c4ee31f741a5e13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.385548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be31f49a-658e-4a31-bcb0-7df04f8cb6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9c046dd8a54b729c4ee31f741a5e13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:43.392572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fb1c2935-216f-4f1a-9dbc-7e03875aa748 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:43.395069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb1c2935-216f-4f1a-9dbc-7e03875aa748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:43.477664 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3045/6006] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:43.486020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a228-28bc-4879-8f08-d45014bdecdb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.486538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a228-28bc-4879-8f08-d45014bdecdb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.487178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193a228-28bc-4879-8f08-d45014bdecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.510541 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2962/6007] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:43 2021] DELETE /identity/v3/users/fe9c046dd8a54b729c4ee31f741a5e13 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:43.514890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.515032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.515320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.538868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c193a228-28bc-4879-8f08-d45014bdecdb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:43.538868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c193a228-28bc-4879-8f08-d45014bdecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:43.562690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:43.568628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:43.734822 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2963/6008] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:43.753901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:43.755142 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3046/6009] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:28:43.755794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:43.756090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a228-28bc-4879-8f08-d45014bdecdb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:43.774862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193a228-28bc-4879-8f08-d45014bdecdb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:43.790935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:43.793097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.793097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.793097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.793645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:43.793960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:43.795569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:43.809356 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3047/6010] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:28:43.813285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:43.827279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5dc32-4af7-4178-a007-285cfed1692f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:43.838296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:43.839013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.839232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.839507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.840214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:43.842253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:43.869939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0df7e2-c0c9-40ed-af94-2be2a960b71d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:43.871877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:43.872537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:43.872992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:43.873270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:43.890748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:43.893040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:43.906270 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2964/6011] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:28:43.977375 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3048/6012] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:43 2021] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:43.978642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:43.996940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa776640-f229-49e4-bbcb-704b332f24f1 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:44.161181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:44.162026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:44.162410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:44.162804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:44.163638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:44.165680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:44.281673 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2965/6013] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:43 2021] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:44.286789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:44.299629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe31a-a6f0-442b-8ba5-9731b2c60922 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:44.305983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:44.312021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:44.312021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:44.312021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:44.312021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:44.312021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:44.324158 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3049/6014] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:44 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:44.328490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:44.344039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c53b9-a8b8-4bd0-b7e7-d02435cd0c01 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:44.369826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58111e6-8ae1-4c1b-bf4c-3ea2bdde3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:44.371080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58111e6-8ae1-4c1b-bf4c-3ea2bdde3317 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:44.371367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58111e6-8ae1-4c1b-bf4c-3ea2bdde3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:44.371645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58111e6-8ae1-4c1b-bf4c-3ea2bdde3317 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:44.372396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58111e6-8ae1-4c1b-bf4c-3ea2bdde3317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:44.374587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58111e6-8ae1-4c1b-bf4c-3ea2bdde3317 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:44.398195 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2966/6015] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:44 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:44.403605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:44.419218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073da3b-358e-40c2-94f0-cbff10b420bb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:44.422143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:44.423227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:44.423644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:44.423926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] PATH_INFO: `/v3/projects/ca0f447da8644bd4b4f678208438bd3a/users/5e3c811c67b241dea25112d1dd86394a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:44.440906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0f447da8644bd4b4f678208438bd3a, user_id=5e3c811c67b241dea25112d1dd86394a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:44.443759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:44.518191 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3050/6016] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:44 2021] PUT /identity/v3/projects/ca0f447da8644bd4b4f678208438bd3a/users/5e3c811c67b241dea25112d1dd86394a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:44.529534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:44.530039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:44.530111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:44.561031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] MFA Rules not processed for user `5e3c811c67b241dea25112d1dd86394a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:44.562347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:44.668784 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2967/6017] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:44 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:44.675314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:44.726282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:44.727730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:44.755500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4113d-650f-4b47-861b-d9624c378967 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:44.768145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:44.768145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:44.768145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:44.768145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:44.768545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:44.770247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:44.813363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81d71-43f2-402f-b075-8920388425d5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:44.818708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:44.819637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:44.819923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:44.820200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] PATH_INFO: `/v3/projects/9b0e46e941e141b1812c1ac47ef9d798` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:44.821480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0e46e941e141b1812c1ac47ef9d798)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:44.823478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:44.897138 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3051/6018] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:44 2021] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:44.899233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:45.020138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170690e-eba0-4d13-a50d-255ca685771d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:45.024702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0e46e941e141b1812c1ac47ef9d798', 'request_id': 'req-98cf5ad5-7818-431d-816c-67f4879bd99b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.034469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0e46e941e141b1812c1ac47ef9d798', 'request_id': 'req-98cf5ad5-7818-431d-816c-67f4879bd99b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.097305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:45.098282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.098719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.099338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.100528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:45.116090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0e46e941e141b1812c1ac47ef9d798', 'request_id': 'req-98cf5ad5-7818-431d-816c-67f4879bd99b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.120060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:45.134211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] The token cache is being invalidate because project 9b0e46e941e141b1812c1ac47ef9d798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:45.134566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.138570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.140466 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2968/6019] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:44 2021] DELETE /identity/v3/projects/9b0e46e941e141b1812c1ac47ef9d798 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:45.144464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:45.147900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:45.169324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf5ad5-7818-431d-816c-67f4879bd99b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:45.174766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:45.176003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.176349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.176692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] PATH_INFO: `/v3/users/49b3e8774eaf44b1a11db90d2a2cc1bd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.178294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b3e8774eaf44b1a11db90d2a2cc1bd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:45.180578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:45.238868 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3052/6020] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:44 2021] POST /identity/v3/users => generated 303 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:45.240058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:45.242212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:45.259572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c2d75-bed0-44f7-8ebe-315b8075c497 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:45.265766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:45.266502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.266865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.267205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.268002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:45.269817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:45.282581 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3053/6021] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:45 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:45.287233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:45.308441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a3bb-6d1f-4310-8751-c914aa1cf217 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:45.308918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:45.309809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.310093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.310371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] PATH_INFO: `/v3/projects/77a1d7c30135453f8bd518e1b025d3e4/users/13fecab968c14addb95e3780e1ceaecf/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.326422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a1d7c30135453f8bd518e1b025d3e4, user_id=13fecab968c14addb95e3780e1ceaecf, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:45.329131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:45.449303 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3054/6022] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:45 2021] PUT /identity/v3/projects/77a1d7c30135453f8bd518e1b025d3e4/users/13fecab968c14addb95e3780e1ceaecf/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:45.453539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:45.458461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b3e8774eaf44b1a11db90d2a2cc1bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.466766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b3e8774eaf44b1a11db90d2a2cc1bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.480855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b3e8774eaf44b1a11db90d2a2cc1bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.481695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b3e8774eaf44b1a11db90d2a2cc1bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.482287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-411c3a01-5df9-418f-a4eb-736dfcc044d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b3e8774eaf44b1a11db90d2a2cc1bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:45.529302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8ab41-eab9-4d12-86ef-e2bf7cbe6e48 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:45.535322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:45.535949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.536240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.536520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.537316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:45.539246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:45.555439 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3055/6023] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:45 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:45.560217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:45.562101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:45.597183 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2969/6024] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:45 2021] DELETE /identity/v3/users/49b3e8774eaf44b1a11db90d2a2cc1bd => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:45.601663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce32cd9-7b35-40bd-84f6-b527befe043d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:45.695665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:45.697657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.699471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.700101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] PATH_INFO: `/v3/projects/77a1d7c30135453f8bd518e1b025d3e4/users/13fecab968c14addb95e3780e1ceaecf/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.706125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a1d7c30135453f8bd518e1b025d3e4, user_id=13fecab968c14addb95e3780e1ceaecf, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:45.710166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:45.731577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3056/6025] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:45 2021] PUT /identity/v3/projects/77a1d7c30135453f8bd518e1b025d3e4/users/13fecab968c14addb95e3780e1ceaecf/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:45.743545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.744163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.744577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.792703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] MFA Rules not processed for user `13fecab968c14addb95e3780e1ceaecf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:45.792703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:45.872538 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2970/6026] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:45 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:28:45.889440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:45.891634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:45.962861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b6ad-ce2c-4d4c-85b1-4d95e70080fe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:45.967559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe48c5d-19c9-4062-90fb-29d6dab4cab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:45.968268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe48c5d-19c9-4062-90fb-29d6dab4cab3 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:45.968566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe48c5d-19c9-4062-90fb-29d6dab4cab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:45.968844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe48c5d-19c9-4062-90fb-29d6dab4cab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:45.979207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe48c5d-19c9-4062-90fb-29d6dab4cab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:45.981480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe48c5d-19c9-4062-90fb-29d6dab4cab3 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:45.992508 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3057/6027] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:45 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:46.242938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:46.244370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:46.346420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653027f-44db-4ee3-b063-867b96e6f7ec None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:46.355064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:46.355064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:46.355064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:46.355064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] PATH_INFO: `/v3/projects/6c9b8aa17dfd4cf8b2783399359c1e16` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:46.355864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9b8aa17dfd4cf8b2783399359c1e16)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:46.358550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:46.531767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9b8aa17dfd4cf8b2783399359c1e16', 'request_id': 'req-af88c40b-6771-4941-8a61-3636e5434579'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:46.538986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9b8aa17dfd4cf8b2783399359c1e16', 'request_id': 'req-af88c40b-6771-4941-8a61-3636e5434579'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:46.647960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9b8aa17dfd4cf8b2783399359c1e16', 'request_id': 'req-af88c40b-6771-4941-8a61-3636e5434579'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:46.666408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] The token cache is being invalidate because project 6c9b8aa17dfd4cf8b2783399359c1e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:46.666810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:46.668337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-af88c40b-6771-4941-8a61-3636e5434579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:46.670258 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2971/6028] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:46 2021] DELETE /identity/v3/projects/6c9b8aa17dfd4cf8b2783399359c1e16 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:46.676601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73dac-a69f-4e76-a2d0-ef17b0968a6c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:46.676935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73dac-a69f-4e76-a2d0-ef17b0968a6c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:46.677221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a73dac-a69f-4e76-a2d0-ef17b0968a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:46.708407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-67a73dac-a69f-4e76-a2d0-ef17b0968a6c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:46.709725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-67a73dac-a69f-4e76-a2d0-ef17b0968a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:46.799804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e1a04-86b0-4752-847a-f8d2d2349475 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:46.799804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e1a04-86b0-4752-847a-f8d2d2349475 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:46.799804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e1a04-86b0-4752-847a-f8d2d2349475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:46.801939 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3058/6029] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:46.819571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-273e1a04-86b0-4752-847a-f8d2d2349475 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:46.820790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-273e1a04-86b0-4752-847a-f8d2d2349475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:46.831972 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2972/6030] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:46.836120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a73dac-a69f-4e76-a2d0-ef17b0968a6c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:46.846559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a73dac-a69f-4e76-a2d0-ef17b0968a6c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:46.851481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:46.852169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:46.852446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:46.852715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:46.853493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:46.853784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:46.856061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:46.871928 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3059/6031] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:28:46.873116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e1a04-86b0-4752-847a-f8d2d2349475 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:46.882601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e1a04-86b0-4752-847a-f8d2d2349475 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:46.888127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:46.888919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:46.893725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:46.893725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:46.893725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:46.893725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:47.046891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2973/6032] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:46 2021] POST /identity/v3/projects => generated 355 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:47.050494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:47.076347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d210a2-2635-45d1-b2bc-82d44be130a1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:47.145089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:47.145819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:47.146039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:47.146481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:47.147185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:47.149123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:47.222196 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3060/6033] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:47 2021] POST /identity/v3/users => generated 278 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:47.226411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:47.238397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e931858-1c7a-448c-9af2-734b62f4bbe1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:47.244490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:47.245310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:47.246309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:47.246470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:47.247375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:47.249120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:47.264955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2974/6034] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:47 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:47.267313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:47.282658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a4f2f-03b0-4e02-9b6b-3efcc9b38e3d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:47.289214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec5f23-fd7a-4d50-abdf-e4fa00f7541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:47.290216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5f23-fd7a-4d50-abdf-e4fa00f7541a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:47.301168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5f23-fd7a-4d50-abdf-e4fa00f7541a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:47.301168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5f23-fd7a-4d50-abdf-e4fa00f7541a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:47.301168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec5f23-fd7a-4d50-abdf-e4fa00f7541a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:47.301168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec5f23-fd7a-4d50-abdf-e4fa00f7541a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:47.303946 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3061/6035] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:47 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:47.308351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:47.319827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8205b0-d89d-4e6e-ac9f-a432fef78626 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:47.325409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:47.326293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:47.326621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:47.326839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] PATH_INFO: `/v3/projects/8575c4332583463384501df8336e3599/users/359a08e577f445c3bc3a843845b9ec0c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:47.342049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8575c4332583463384501df8336e3599, user_id=359a08e577f445c3bc3a843845b9ec0c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:47.344659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:47.432330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2975/6036] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:47 2021] PUT /identity/v3/projects/8575c4332583463384501df8336e3599/users/359a08e577f445c3bc3a843845b9ec0c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:47.443080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe127761-36e5-4423-b58c-21a3623012a5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:47.443562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe127761-36e5-4423-b58c-21a3623012a5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:47.444026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe127761-36e5-4423-b58c-21a3623012a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:47.520425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fe127761-36e5-4423-b58c-21a3623012a5 None None] MFA Rules not processed for user `359a08e577f445c3bc3a843845b9ec0c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:47.524215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fe127761-36e5-4423-b58c-21a3623012a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:47.604291 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3062/6037] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:47 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:47.606615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:47.736800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00299d90-a7c9-4e64-8f2d-9fb1543cb48b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:47.742759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:47.743446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:47.743927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:47.744266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:47.745230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:47.747730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:47.864990 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2976/6038] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:47 2021] POST /identity/v3/projects => generated 357 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:47.869481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe127761-36e5-4423-b58c-21a3623012a5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:47.888563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe127761-36e5-4423-b58c-21a3623012a5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:47.974118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:47.975201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:47.975594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:47.975979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:47.976788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:47.978895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:48.083729 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3063/6039] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:47 2021] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:48.087998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:48.101029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fd07e-95c2-4a54-8e6c-6595d2100def admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:48.107965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:48.109262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:48.109785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:48.110348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:48.111390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:48.113758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:48.131113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2977/6040] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:48 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:28:48.132311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:48.144459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9cb6a-03f6-48eb-b7ef-93bbed02cac8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:48.155180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:48.155180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:48.155180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:48.155180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] PATH_INFO: `/v3/projects/426ef46fa2a54813ba775b7908a07181/users/1ea2d5032faa4944a2214a79bf59e5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:48.174105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426ef46fa2a54813ba775b7908a07181, user_id=1ea2d5032faa4944a2214a79bf59e5d2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:48.178485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:48.281532 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3064/6041] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:48 2021] PUT /identity/v3/projects/426ef46fa2a54813ba775b7908a07181/users/1ea2d5032faa4944a2214a79bf59e5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:48.285966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:48.296055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c4e57-ec36-4393-b38f-2f94ec82dc8a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:48.379999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab24e2-5dc9-4cf8-8ae5-8b548661b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:48.380839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab24e2-5dc9-4cf8-8ae5-8b548661b5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:48.384736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab24e2-5dc9-4cf8-8ae5-8b548661b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:48.384736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab24e2-5dc9-4cf8-8ae5-8b548661b5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:48.384736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab24e2-5dc9-4cf8-8ae5-8b548661b5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:48.384736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab24e2-5dc9-4cf8-8ae5-8b548661b5b5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:48.399755 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2978/6042] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:48 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:48.404686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:48.423869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822f0ea-9674-4516-87d8-640e1ffd5008 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:48.428785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:48.429840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:48.430890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:48.430890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] PATH_INFO: `/v3/projects/426ef46fa2a54813ba775b7908a07181/users/1ea2d5032faa4944a2214a79bf59e5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:48.432910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426ef46fa2a54813ba775b7908a07181, user_id=1ea2d5032faa4944a2214a79bf59e5d2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:48.435470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:48.449692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3065/6043] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:48 2021] PUT /identity/v3/projects/426ef46fa2a54813ba775b7908a07181/users/1ea2d5032faa4944a2214a79bf59e5d2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:48.467262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd766-338f-48b7-b13e-9e36376a9f8d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:48.467262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd766-338f-48b7-b13e-9e36376a9f8d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:48.467898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edd766-338f-48b7-b13e-9e36376a9f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:48.535653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-94edd766-338f-48b7-b13e-9e36376a9f8d None None] MFA Rules not processed for user `1ea2d5032faa4944a2214a79bf59e5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:48.537016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-94edd766-338f-48b7-b13e-9e36376a9f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:48.615192 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2979/6044] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:48 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:28:48.625708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:48.627440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:48.687315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a939f73-8d90-40c7-9e90-97c5eca17d75 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:48.691045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a33f31-08cc-405c-aa94-2132f2753856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:48.691688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a33f31-08cc-405c-aa94-2132f2753856 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:48.691968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a33f31-08cc-405c-aa94-2132f2753856 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:48.692300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a33f31-08cc-405c-aa94-2132f2753856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:48.701953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a33f31-08cc-405c-aa94-2132f2753856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:48.703373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a33f31-08cc-405c-aa94-2132f2753856 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:48.714920 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3066/6045] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:48 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:48.993609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edd766-338f-48b7-b13e-9e36376a9f8d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:49.002089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebb9fb-d7d5-485e-a3cb-2ac5ed6c1383 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:49.002696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebb9fb-d7d5-485e-a3cb-2ac5ed6c1383 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:49.004645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebb9fb-d7d5-485e-a3cb-2ac5ed6c1383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:49.025965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edd766-338f-48b7-b13e-9e36376a9f8d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:49.038323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-35ebb9fb-d7d5-485e-a3cb-2ac5ed6c1383 None None] MFA Rules not processed for user `0d9b0c5962544b66b24db53b7e9b8333`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:49.039778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-35ebb9fb-d7d5-485e-a3cb-2ac5ed6c1383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:49.044234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:49.045103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:49.045277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:49.045780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:49.140759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:49.142495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:49.144670 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3067/6046] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:28:49.155556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605eff-4b58-479b-b1f5-644e15b561b8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:49.155848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605eff-4b58-479b-b1f5-644e15b561b8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:49.156128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605eff-4b58-479b-b1f5-644e15b561b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:49.159753 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2980/6047] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:48 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:49.176391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-91605eff-4b58-479b-b1f5-644e15b561b8 None None] MFA Rules not processed for user `0d9b0c5962544b66b24db53b7e9b8333`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:49.177651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91605eff-4b58-479b-b1f5-644e15b561b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:49.190897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3068/6048] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:49 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:49.535566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:49.537112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:49.630961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3506ed6-826d-4cab-b7cc-dad8f3a1179b service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:49.637153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:49.638337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:49.639901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:49.644003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] PATH_INFO: `/v3/users/5e3c811c67b241dea25112d1dd86394a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:49.644003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3c811c67b241dea25112d1dd86394a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:49.647564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:49.928552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3c811c67b241dea25112d1dd86394a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:49.945667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3c811c67b241dea25112d1dd86394a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:49.969808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3c811c67b241dea25112d1dd86394a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:49.971487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3c811c67b241dea25112d1dd86394a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:49.972363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3c811c67b241dea25112d1dd86394a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:50.068764 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2981/6049] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:49 2021] DELETE /identity/v3/users/5e3c811c67b241dea25112d1dd86394a => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:50.072810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:50.073430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:50.074158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:50.097215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:50.099626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:50.172781 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3069/6050] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:50.187532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:50.189106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:50.264587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2237a-bb8b-4265-918c-8df473f300fd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:50.268357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:50.269043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:50.269515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:50.269952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:50.282704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:50.284202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:50.296567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2982/6051] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:51.161146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:51.163304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:51.192412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaa1e7-07fc-44fd-9436-88e1881edf80 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:51.218406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:51.225099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:51.225099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:51.225099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] PATH_INFO: `/v3/projects/ca0f447da8644bd4b4f678208438bd3a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:51.225099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0f447da8644bd4b4f678208438bd3a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:51.227300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:51.381845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0f447da8644bd4b4f678208438bd3a', 'request_id': 'req-e1e84641-2fe9-42e2-a23d-2b9661979f54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:51.535222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0f447da8644bd4b4f678208438bd3a', 'request_id': 'req-e1e84641-2fe9-42e2-a23d-2b9661979f54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:51.542537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0f447da8644bd4b4f678208438bd3a', 'request_id': 'req-e1e84641-2fe9-42e2-a23d-2b9661979f54'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:51.555404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] The token cache is being invalidate because project ca0f447da8644bd4b4f678208438bd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:51.555610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:51.556443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:51.566841 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3070/6052] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:51 2021] DELETE /identity/v3/projects/ca0f447da8644bd4b4f678208438bd3a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:51.569320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:51.596215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78c28e-fb86-4509-9e2c-3d6fc232ecfb service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:51.696757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:51.697762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:51.698746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:51.699078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] PATH_INFO: `/v3/users/13fecab968c14addb95e3780e1ceaecf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:51.700539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fecab968c14addb95e3780e1ceaecf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:51.702585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:51.979223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fecab968c14addb95e3780e1ceaecf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:51.987449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fecab968c14addb95e3780e1ceaecf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.002635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fecab968c14addb95e3780e1ceaecf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.003439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fecab968c14addb95e3780e1ceaecf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.004134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f7aa536-cb9b-4145-9fab-bbeb35d4ae64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fecab968c14addb95e3780e1ceaecf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.101401 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2983/6053] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:28:51 2021] DELETE /identity/v3/users/13fecab968c14addb95e3780e1ceaecf => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:52.407903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:52.409556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:52.439533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84641-2fe9-42e2-a23d-2b9661979f54 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:52.522384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:52.522384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:52.522601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:52.523297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] PATH_INFO: `/v3/projects/77a1d7c30135453f8bd518e1b025d3e4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:52.524914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a1d7c30135453f8bd518e1b025d3e4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:52.528741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:52.717424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a1d7c30135453f8bd518e1b025d3e4', 'request_id': 'req-aeb59ec2-a32d-4925-80d1-c6b07b93780e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.883983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a1d7c30135453f8bd518e1b025d3e4', 'request_id': 'req-aeb59ec2-a32d-4925-80d1-c6b07b93780e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.895105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a1d7c30135453f8bd518e1b025d3e4', 'request_id': 'req-aeb59ec2-a32d-4925-80d1-c6b07b93780e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.907047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] The token cache is being invalidate because project 77a1d7c30135453f8bd518e1b025d3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:28:52.911069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.911069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aeb59ec2-a32d-4925-80d1-c6b07b93780e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:28:52.911069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3071/6054] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:28:52 2021] DELETE /identity/v3/projects/77a1d7c30135453f8bd518e1b025d3e4 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:28:52.915520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557f89a-6899-4018-9e99-d58450c1b27a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:52.915996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557f89a-6899-4018-9e99-d58450c1b27a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:52.916332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557f89a-6899-4018-9e99-d58450c1b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:52.953117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5557f89a-6899-4018-9e99-d58450c1b27a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:52.954595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5557f89a-6899-4018-9e99-d58450c1b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:53.027884 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2984/6055] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:53.035464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe192-1da8-4987-afa7-808cf7a556cd None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.042662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe192-1da8-4987-afa7-808cf7a556cd None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.042662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe192-1da8-4987-afa7-808cf7a556cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.058751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-02abe192-1da8-4987-afa7-808cf7a556cd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:53.060423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-02abe192-1da8-4987-afa7-808cf7a556cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:53.069171 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3072/6056] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:53.073581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557f89a-6899-4018-9e99-d58450c1b27a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:53.089080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557f89a-6899-4018-9e99-d58450c1b27a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:53.094229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:53.094759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.095202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.098132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.098132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:28:53.098132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:53.098608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:53.117878 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2985/6057] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:28:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:28:53.123288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe192-1da8-4987-afa7-808cf7a556cd None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:53.134811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe192-1da8-4987-afa7-808cf7a556cd None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:53.141911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:53.152136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.152136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.152136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.152136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:53.152136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:53.324337 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3073/6058] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:28:53 2021] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:53.328507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:53.339251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90bbf3-407c-4529-b968-ea584f938859 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:53.395625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:53.396299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.396583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.396860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.397582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:53.399496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:53.513599 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2986/6059] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:28:53 2021] POST /identity/v3/users => generated 282 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:28:53.517630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:53.529578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d20ca-d0ce-45da-a7e9-d85d79184189 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:53.534379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:53.535048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.536298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.536298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.536461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:53.538103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:53.548812 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3074/6060] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:53.552904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:53.566120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a43c19-2b7d-4237-b99b-11d481d6304d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:53.571096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df6196-bbdc-430f-b8f2-e3f9907399da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:53.571858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df6196-bbdc-430f-b8f2-e3f9907399da admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.572215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df6196-bbdc-430f-b8f2-e3f9907399da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.572692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df6196-bbdc-430f-b8f2-e3f9907399da admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.574289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df6196-bbdc-430f-b8f2-e3f9907399da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:53.577287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df6196-bbdc-430f-b8f2-e3f9907399da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:53.593682 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2987/6061] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:28:53 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:28:53.597597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:53.618335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899df03-19ac-400c-a5b8-99054860e7af admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:53.628547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:53.629517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.629806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.630094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] PATH_INFO: `/v3/projects/a80fe923d39349348137639eb937eac1/users/42a8bf90ae324660abd7fa59d8d27e95/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.648633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80fe923d39349348137639eb937eac1, user_id=42a8bf90ae324660abd7fa59d8d27e95, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:53.653219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:53.726612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3075/6062] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:28:53 2021] PUT /identity/v3/projects/a80fe923d39349348137639eb937eac1/users/42a8bf90ae324660abd7fa59d8d27e95/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:28:53.735633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.736039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.736455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.765149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] MFA Rules not processed for user `42a8bf90ae324660abd7fa59d8d27e95`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:28:53.766274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:53.835370 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2988/6063] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:28:53 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:28:53.846464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:53.850894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:53.969181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515e82-1160-4e62-b179-3a7403a4ae19 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:53.974503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:53.975401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:53.976148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:53.976148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:53.988395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:53.989839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:54.000045 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3076/6064] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:53 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:28:55.621712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:28:55.624059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:55.640419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62959f98-21f3-4c34-a1d2-51a99383d8df None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:28:55.644631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac334b9-c314-4933-8ef7-cca2dae53436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:28:55.645936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac334b9-c314-4933-8ef7-cca2dae53436 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:28:55.646218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac334b9-c314-4933-8ef7-cca2dae53436 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:28:55.646500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac334b9-c314-4933-8ef7-cca2dae53436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:28:55.648497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fac334b9-c314-4933-8ef7-cca2dae53436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:28:55.686714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac334b9-c314-4933-8ef7-cca2dae53436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:28:55.688753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac334b9-c314-4933-8ef7-cca2dae53436 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:28:55.701146 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2989/6065] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:28:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:29:01.195942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:01.198255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:01.274046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5662-7ec0-4e9d-a7f0-429adcf1a9fb service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:01.279714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:01.280732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:01.281093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:01.281655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] PATH_INFO: `/v3/users/3ede6f3f62de4cb0bf9c54f76856078f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:01.283499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ede6f3f62de4cb0bf9c54f76856078f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:01.285835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:01.463584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ede6f3f62de4cb0bf9c54f76856078f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:01.470609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ede6f3f62de4cb0bf9c54f76856078f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:01.483178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ede6f3f62de4cb0bf9c54f76856078f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:01.484039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ede6f3f62de4cb0bf9c54f76856078f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:01.601826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ede6f3f62de4cb0bf9c54f76856078f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:01.601826 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3077/6066] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:01 2021] DELETE /identity/v3/users/3ede6f3f62de4cb0bf9c54f76856078f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:01.604584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:01.607017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:01.607017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:01.629028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:01.630423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:01.702027 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2990/6067] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:01.712333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:01.714461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:01.774722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e7e07-334e-4205-9662-2cc16679179c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:01.779016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e1c20-9db8-432c-8d6f-39de5ad7e6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:01.779772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e1c20-9db8-432c-8d6f-39de5ad7e6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:01.780104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e1c20-9db8-432c-8d6f-39de5ad7e6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:01.780405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e1c20-9db8-432c-8d6f-39de5ad7e6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:01.790458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e1c20-9db8-432c-8d6f-39de5ad7e6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:01.791963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e1c20-9db8-432c-8d6f-39de5ad7e6d5 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:01.802087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3078/6068] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:02.325374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:02.325374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:02.325374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0e9a-992b-4fe3-8e41-b2ffa29126c7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:02.327711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:02.327711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:02.327711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:02.327711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] PATH_INFO: `/v3/projects/70fdeb50a23f42c4bedba3950b7fce5c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:02.328510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fdeb50a23f42c4bedba3950b7fce5c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:02.328510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:02.453319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fdeb50a23f42c4bedba3950b7fce5c', 'request_id': 'req-a262a483-d3e2-43c7-a876-c099ee61fcde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:02.462731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fdeb50a23f42c4bedba3950b7fce5c', 'request_id': 'req-a262a483-d3e2-43c7-a876-c099ee61fcde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:02.540596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fdeb50a23f42c4bedba3950b7fce5c', 'request_id': 'req-a262a483-d3e2-43c7-a876-c099ee61fcde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:02.554791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] The token cache is being invalidate because project 70fdeb50a23f42c4bedba3950b7fce5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:02.555371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:02.556488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a262a483-d3e2-43c7-a876-c099ee61fcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:02.558999 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2991/6069] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:02 2021] DELETE /identity/v3/projects/70fdeb50a23f42c4bedba3950b7fce5c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:02.564515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b619-cd57-4fe3-8561-4fb6adb5c22a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:02.565482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b619-cd57-4fe3-8561-4fb6adb5c22a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:02.565829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b619-cd57-4fe3-8561-4fb6adb5c22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:02.586539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2488b619-cd57-4fe3-8561-4fb6adb5c22a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:02.587972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2488b619-cd57-4fe3-8561-4fb6adb5c22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:02.686931 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3079/6070] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:02.701063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d2f12-51ab-4b79-98d2-6909167c82d8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:02.701531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d2f12-51ab-4b79-98d2-6909167c82d8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:02.701608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d2f12-51ab-4b79-98d2-6909167c82d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:02.731535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e29d2f12-51ab-4b79-98d2-6909167c82d8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:02.732761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e29d2f12-51ab-4b79-98d2-6909167c82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:02.762314 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2992/6071] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:02.764435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488b619-cd57-4fe3-8561-4fb6adb5c22a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:02.776866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488b619-cd57-4fe3-8561-4fb6adb5c22a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:02.784555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:02.785469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:02.785848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:02.786236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:02.787069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:02.787510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:02.789281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:02.813289 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3080/6072] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:29:02.815359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d2f12-51ab-4b79-98d2-6909167c82d8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:02.843056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d2f12-51ab-4b79-98d2-6909167c82d8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:02.850915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:02.851818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:02.852435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:02.853172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:02.855001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:02.857784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:03.024204 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2993/6073] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:02 2021] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:03.029576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:03.040058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5afae-0b55-42d1-abf0-099490b47805 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:03.097757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:03.098440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:03.098789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:03.098992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:03.099827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:03.101793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:03.238845 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3081/6074] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:03 2021] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:03.242795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:03.264635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d1452-50a4-49bb-88ea-7338077db86e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:03.270516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:03.271437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:03.271895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:03.272566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:03.273507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:03.279381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:03.292081 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2994/6075] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:03.296121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:03.314232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9799-69bd-48e7-a9b2-138b18e95407 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:03.319440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a71e43-ec5d-430e-b5cc-d58b8a58a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:03.320347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71e43-ec5d-430e-b5cc-d58b8a58a1ce admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:03.320678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71e43-ec5d-430e-b5cc-d58b8a58a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:03.321308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a71e43-ec5d-430e-b5cc-d58b8a58a1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:03.322478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71e43-ec5d-430e-b5cc-d58b8a58a1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:03.325762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a71e43-ec5d-430e-b5cc-d58b8a58a1ce admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:03.338846 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3082/6076] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:03.343103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:03.355546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc277-03b6-4b25-9b39-b4766f77e921 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:03.360475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:03.361430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:03.369269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:03.369269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] PATH_INFO: `/v3/projects/630b7b4e23714a47b3012c008ec639f8/users/7355bee9864946e1bd475d5dada82b1f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:03.380964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=630b7b4e23714a47b3012c008ec639f8, user_id=7355bee9864946e1bd475d5dada82b1f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:03.383662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:03.459257 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2995/6077] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:03 2021] PUT /identity/v3/projects/630b7b4e23714a47b3012c008ec639f8/users/7355bee9864946e1bd475d5dada82b1f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:03.471825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:03.476983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:03.477291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:03.555422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] MFA Rules not processed for user `7355bee9864946e1bd475d5dada82b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:03.557822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:03.652102 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3083/6078] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:03 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:03.724110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:03.730979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:03.876707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c4b-6d67-4cd5-a57f-e38d0592a59b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:03.886411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:03.887285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:03.887642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:03.887995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:03.900318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:03.902611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:03.924013 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2996/6079] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:03 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:04.949882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:04.955134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:05.221235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b917c-709e-42e5-a3b5-bcfd391fd591 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:05.237962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22459de5-8e24-44a1-9036-a11b6ad823da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:05.241077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22459de5-8e24-44a1-9036-a11b6ad823da service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:05.241077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22459de5-8e24-44a1-9036-a11b6ad823da service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:05.241077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22459de5-8e24-44a1-9036-a11b6ad823da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:05.247934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-22459de5-8e24-44a1-9036-a11b6ad823da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:05.271155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22459de5-8e24-44a1-9036-a11b6ad823da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:05.273211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22459de5-8e24-44a1-9036-a11b6ad823da service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:05.293454 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3084/6080] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:07.284466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:07.286835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:07.404491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b6513-7068-43ca-ba9b-eb30496ef773 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:07.410162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:07.411311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:07.411833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:07.412250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] PATH_INFO: `/v3/users/cff6cb2ab4fc4993a8c9fca4b07a2522` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:07.414174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff6cb2ab4fc4993a8c9fca4b07a2522)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:07.417351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:07.674715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff6cb2ab4fc4993a8c9fca4b07a2522'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:07.689347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff6cb2ab4fc4993a8c9fca4b07a2522'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:07.716599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff6cb2ab4fc4993a8c9fca4b07a2522'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:07.717401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff6cb2ab4fc4993a8c9fca4b07a2522'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:07.718547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff6cb2ab4fc4993a8c9fca4b07a2522'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:07.906658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2997/6081] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:07 2021] DELETE /identity/v3/users/cff6cb2ab4fc4993a8c9fca4b07a2522 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:07.911912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:07.912801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:07.913257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:07.943253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:07.950023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:08.032415 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3085/6082] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:08.076421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:08.079743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:08.267923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170bf5d-49da-4c6d-a0a9-9a541a5df6f5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:08.273432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:08.274454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:08.274950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:08.291489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:08.320425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:08.330850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:08.340682 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2998/6083] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:09.155872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:09.157297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:09.169630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffbb3d-8752-412e-9819-a2f03adf2835 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:09.180072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:09.182582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:09.185225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:09.185225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] PATH_INFO: `/v3/projects/01fe97247f8d425d80e1d145476201a0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:09.185225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fe97247f8d425d80e1d145476201a0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:09.187148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:09.357452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fe97247f8d425d80e1d145476201a0', 'request_id': 'req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:09.449654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fe97247f8d425d80e1d145476201a0', 'request_id': 'req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:09.472125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fe97247f8d425d80e1d145476201a0', 'request_id': 'req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:09.554760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] The token cache is being invalidate because project 01fe97247f8d425d80e1d145476201a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:09.554760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:09.557577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:09.560744 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3086/6084] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:09 2021] DELETE /identity/v3/projects/01fe97247f8d425d80e1d145476201a0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:09.565856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:09.581065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e05145-d5c8-4279-ab82-e370d04d3798 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:09.698206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:09.699112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:09.699489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:09.699776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] PATH_INFO: `/v3/users/013c74d084d5467d938ef727a61db7dd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:09.704671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=013c74d084d5467d938ef727a61db7dd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:09.710335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:10.089062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013c74d084d5467d938ef727a61db7dd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:10.104946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013c74d084d5467d938ef727a61db7dd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:10.123381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013c74d084d5467d938ef727a61db7dd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:10.124368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013c74d084d5467d938ef727a61db7dd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:10.125260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d3955802-7428-4267-995c-8028c857c1ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013c74d084d5467d938ef727a61db7dd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:10.281284 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 2999/6085] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:09 2021] DELETE /identity/v3/users/013c74d084d5467d938ef727a61db7dd => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:11.418623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:11.420062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:11.441602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2eb61-23ba-4b8e-b7b4-0d5550917d93 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:11.554493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:11.558877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:11.558877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:11.558877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] PATH_INFO: `/v3/projects/1f0921ffb9e647debd042a5f9215cd52` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:11.560264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0921ffb9e647debd042a5f9215cd52)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:11.564128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:11.780282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0921ffb9e647debd042a5f9215cd52', 'request_id': 'req-0e999cae-91e1-4689-82ba-0c6eff18d703'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:11.918059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0921ffb9e647debd042a5f9215cd52', 'request_id': 'req-0e999cae-91e1-4689-82ba-0c6eff18d703'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:11.928580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0921ffb9e647debd042a5f9215cd52', 'request_id': 'req-0e999cae-91e1-4689-82ba-0c6eff18d703'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:11.968508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] The token cache is being invalidate because project 1f0921ffb9e647debd042a5f9215cd52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:11.968508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:11.968508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e999cae-91e1-4689-82ba-0c6eff18d703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:11.970068 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3087/6086] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:11 2021] DELETE /identity/v3/projects/1f0921ffb9e647debd042a5f9215cd52 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:11.975880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349c03-9d95-4dcd-ad60-77ee83e04be8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:11.976396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349c03-9d95-4dcd-ad60-77ee83e04be8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:11.976493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349c03-9d95-4dcd-ad60-77ee83e04be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.015178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-68349c03-9d95-4dcd-ad60-77ee83e04be8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:12.019134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68349c03-9d95-4dcd-ad60-77ee83e04be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:12.122556 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3000/6087] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:29:12.130495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff6414-292a-4676-961f-0777aa247635 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:12.130902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff6414-292a-4676-961f-0777aa247635 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:12.131065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff6414-292a-4676-961f-0777aa247635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.173962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-88ff6414-292a-4676-961f-0777aa247635 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:12.176856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-88ff6414-292a-4676-961f-0777aa247635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:12.194813 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3088/6088] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:29:12.198896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68349c03-9d95-4dcd-ad60-77ee83e04be8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:12.217571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68349c03-9d95-4dcd-ad60-77ee83e04be8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:12.225210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:12.226132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:12.226616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:12.226970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.227623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:12.228142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:12.231948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:12.256241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff6414-292a-4676-961f-0777aa247635 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:12.273338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3001/6089] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:29:12.278589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff6414-292a-4676-961f-0777aa247635 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:12.283954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:12.285362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:12.286136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:12.286518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.287594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:12.290911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:12.404688 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3089/6090] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:12 2021] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:12.408902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:12.419674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff0d38-7c23-4686-9437-148be07ddfb1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:12.558162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:12.559887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:12.560391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:12.560822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.561871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:12.564237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:12.686558 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3002/6091] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:12 2021] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:12.690390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:12.706623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035a9dd-fdae-409f-912f-f72832cdb102 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:12.721437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:12.722503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:12.723902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:12.724325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.728276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:12.737153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:12.762910 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3090/6092] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:29:12.766770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:12.831308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c327a9-c281-4ac5-a90b-c3ce1a4d6a40 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:12.846768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835ac3-c677-44a2-b0b1-1089fe9c380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:12.847470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835ac3-c677-44a2-b0b1-1089fe9c380b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:12.847752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835ac3-c677-44a2-b0b1-1089fe9c380b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:12.848025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835ac3-c677-44a2-b0b1-1089fe9c380b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.848774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835ac3-c677-44a2-b0b1-1089fe9c380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:12.855870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835ac3-c677-44a2-b0b1-1089fe9c380b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:12.882617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:12.895142 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3003/6093] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:12.896723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d74125-2c12-4a2c-afc6-f6c12b615a9d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:12.921804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:12.922715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:12.922995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:12.923270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] PATH_INFO: `/v3/projects/48b6042ddacd4ebf8dd697acae2f2146/users/6c3515d9c8db41e6a371ed1afe0e2149/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:12.977290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b6042ddacd4ebf8dd697acae2f2146, user_id=6c3515d9c8db41e6a371ed1afe0e2149, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:12.981022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:13.105681 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3091/6094] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:12 2021] PUT /identity/v3/projects/48b6042ddacd4ebf8dd697acae2f2146/users/6c3515d9c8db41e6a371ed1afe0e2149/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:29:13.115986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fb157-2efa-4834-8e4a-98aa85e83fde None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:13.116468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fb157-2efa-4834-8e4a-98aa85e83fde None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:13.116687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fb157-2efa-4834-8e4a-98aa85e83fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:13.173877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-798fb157-2efa-4834-8e4a-98aa85e83fde None None] MFA Rules not processed for user `6c3515d9c8db41e6a371ed1afe0e2149`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:13.175150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-798fb157-2efa-4834-8e4a-98aa85e83fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:13.264084 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3004/6095] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:13 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:13.268500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:13.399863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155037cd-8160-4cad-940c-6e012dafb78b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:13.405336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:13.410061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:13.410061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:13.410061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:13.410061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:13.410061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:13.545403 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3092/6096] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:13 2021] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:13.546632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fb157-2efa-4834-8e4a-98aa85e83fde None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:13.559346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fb157-2efa-4834-8e4a-98aa85e83fde None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:13.731647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:13.732456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:13.732608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:13.732960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:13.733676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:13.735799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:13.867164 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3005/6097] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:13 2021] POST /identity/v3/users => generated 296 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:13.871985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:13.887067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9d4d2-9fd9-4982-81b8-45d46ecd4309 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:13.897938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:13.898623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:13.898905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:13.899175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:13.900864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:13.909092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:13.923767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3093/6098] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:13 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:13.927953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:13.949874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cefc0-4fdf-40a9-a898-78c10a7d612b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:13.965189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:13.966587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:13.967261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:13.967545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] PATH_INFO: `/v3/projects/45953b275c2f4bc6ac750580315935a4/users/484c4fcce120401ba5e0dac36c37a2ac/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:14.045494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45953b275c2f4bc6ac750580315935a4, user_id=484c4fcce120401ba5e0dac36c37a2ac, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:14.053493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:14.161801 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3006/6099] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:13 2021] PUT /identity/v3/projects/45953b275c2f4bc6ac750580315935a4/users/484c4fcce120401ba5e0dac36c37a2ac/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:14.167725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:14.185558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b667f25-55e8-486b-b31b-cd5878124195 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:14.270137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd805-a43b-4fcc-982a-562aed6dd414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:14.270940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd805-a43b-4fcc-982a-562aed6dd414 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:14.271224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd805-a43b-4fcc-982a-562aed6dd414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:14.271672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd805-a43b-4fcc-982a-562aed6dd414 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:14.272582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bd805-a43b-4fcc-982a-562aed6dd414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:14.275478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bd805-a43b-4fcc-982a-562aed6dd414 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:14.293398 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3094/6100] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:14 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:14.298075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:14.311731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5572f-e561-44d9-8b82-6e6a0f8c0b09 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:14.320174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:14.321581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:14.322688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:14.323171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] PATH_INFO: `/v3/projects/45953b275c2f4bc6ac750580315935a4/users/484c4fcce120401ba5e0dac36c37a2ac/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:14.326310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=45953b275c2f4bc6ac750580315935a4, user_id=484c4fcce120401ba5e0dac36c37a2ac, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:14.330441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:14.347352 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3007/6101] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:14 2021] PUT /identity/v3/projects/45953b275c2f4bc6ac750580315935a4/users/484c4fcce120401ba5e0dac36c37a2ac/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:29:14.358350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7fac6-9dfd-4c12-9e80-6cbd81aa9d93 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:14.359082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7fac6-9dfd-4c12-9e80-6cbd81aa9d93 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:14.359444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7fac6-9dfd-4c12-9e80-6cbd81aa9d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:14.414256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6cd7fac6-9dfd-4c12-9e80-6cbd81aa9d93 None None] MFA Rules not processed for user `484c4fcce120401ba5e0dac36c37a2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:14.419080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6cd7fac6-9dfd-4c12-9e80-6cbd81aa9d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:14.574108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3095/6102] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:14 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:14.594415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:14.594415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:14.717499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79bbc-8aef-4e97-946d-aa547078e4df admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:14.721361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:14.722094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:14.722611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:14.723071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:14.735965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:14.738711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:14.768330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3008/6103] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:14 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:15.895646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7fac6-9dfd-4c12-9e80-6cbd81aa9d93 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:15.916535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7fac6-9dfd-4c12-9e80-6cbd81aa9d93 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:15.922817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '484c4fcce120401ba5e0dac36c37a2ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45953b275c2f4bc6ac750580315935a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:15.923499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:15.924031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:15.924255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:15.925047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:15.925343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:15.927024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:15.940575 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3096/6104] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:29:15.945815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:15.961693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a7efa-db0b-44bf-a954-7d3713651f88 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:15.996433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '484c4fcce120401ba5e0dac36c37a2ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45953b275c2f4bc6ac750580315935a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:15.997433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:15.999149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:15.999615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:16.007088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:16.015910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:16.250317 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3009/6105] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:15 2021] POST /identity/v3/projects => generated 353 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:16.255084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:16.272740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f9ee8-0a8c-4019-9b9b-6d2e2c4d0766 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:16.390322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '484c4fcce120401ba5e0dac36c37a2ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45953b275c2f4bc6ac750580315935a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:16.393188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:16.393584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:16.393998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:16.395669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:16.396088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:16.398178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:16.414600 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3097/6106] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:29:16.460928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:16.483872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603afef-d117-45cc-8da6-ca617e1bc2c0 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:16.489683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '484c4fcce120401ba5e0dac36c37a2ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45953b275c2f4bc6ac750580315935a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:16.490766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:16.491673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:16.492139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] PATH_INFO: `/v3/projects/243755ae5d8745d2beae437997d00b21` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:16.494445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=243755ae5d8745d2beae437997d00b21)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:16.496834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:16.668357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243755ae5d8745d2beae437997d00b21', 'request_id': 'req-dfc57a78-ea4a-43c7-8eaf-336723fc7367'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:16.675447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243755ae5d8745d2beae437997d00b21', 'request_id': 'req-dfc57a78-ea4a-43c7-8eaf-336723fc7367'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:16.826231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243755ae5d8745d2beae437997d00b21', 'request_id': 'req-dfc57a78-ea4a-43c7-8eaf-336723fc7367'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:16.840440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] The token cache is being invalidate because project 243755ae5d8745d2beae437997d00b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:16.841101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:16.841915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dfc57a78-ea4a-43c7-8eaf-336723fc7367 tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:16.843988 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3010/6107] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:16 2021] DELETE /identity/v3/projects/243755ae5d8745d2beae437997d00b21 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:17.668708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:17.675848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:17.781795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e63df-198f-4e2d-b2c2-a88594a3d29c tempest-VolumeQuotaClassesTest-193428579 tempest-VolumeQuotaClassesTest-193428579-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:17.849397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:17.850285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:17.850568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:17.850848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] PATH_INFO: `/v3/users/6c3515d9c8db41e6a371ed1afe0e2149` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:17.852226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3515d9c8db41e6a371ed1afe0e2149)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:17.855903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:18.193999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3515d9c8db41e6a371ed1afe0e2149'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:18.205753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3515d9c8db41e6a371ed1afe0e2149'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:18.222478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3515d9c8db41e6a371ed1afe0e2149'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:18.224440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3515d9c8db41e6a371ed1afe0e2149'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:18.283888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3515d9c8db41e6a371ed1afe0e2149'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:18.300487 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3098/6108] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:17 2021] DELETE /identity/v3/users/6c3515d9c8db41e6a371ed1afe0e2149 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:18.302286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:18.302740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:18.302845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:18.338239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:18.342830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:18.443605 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3011/6109] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:18.454607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:18.456182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:18.534246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860ba08-2ebe-4650-b87b-cd0c1110b375 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:18.538535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:18.539201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:18.539479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:18.539755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:18.553248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:18.557581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:18.573221 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3099/6110] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:19.313832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:19.315407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:19.336168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f8b8-d034-4295-aaff-4770e8a0d1e4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:19.349863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:19.351208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:19.351721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:19.352329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] PATH_INFO: `/v3/projects/48b6042ddacd4ebf8dd697acae2f2146` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:19.356416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b6042ddacd4ebf8dd697acae2f2146)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:19.358620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:19.532109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b6042ddacd4ebf8dd697acae2f2146', 'request_id': 'req-83f0365f-a45b-40bc-9142-0bf53c0763cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:19.541151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b6042ddacd4ebf8dd697acae2f2146', 'request_id': 'req-83f0365f-a45b-40bc-9142-0bf53c0763cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:19.614879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b6042ddacd4ebf8dd697acae2f2146', 'request_id': 'req-83f0365f-a45b-40bc-9142-0bf53c0763cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:19.630675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] The token cache is being invalidate because project 48b6042ddacd4ebf8dd697acae2f2146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:19.631193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:19.632016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:19.635056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3012/6111] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:19 2021] DELETE /identity/v3/projects/48b6042ddacd4ebf8dd697acae2f2146 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:19.638756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:19.663358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d76ca-15b4-4f0d-9661-408a61f93b4a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:19.841036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:19.841036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:19.841036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:19.841566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] PATH_INFO: `/v3/users/484c4fcce120401ba5e0dac36c37a2ac` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:19.856539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484c4fcce120401ba5e0dac36c37a2ac)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:19.859745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:20.143521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484c4fcce120401ba5e0dac36c37a2ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:20.156237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484c4fcce120401ba5e0dac36c37a2ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:20.169579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484c4fcce120401ba5e0dac36c37a2ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:20.170376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484c4fcce120401ba5e0dac36c37a2ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:20.271736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-240fb906-a7b2-4994-ae2c-5d20e94e8db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484c4fcce120401ba5e0dac36c37a2ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:20.283993 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3100/6112] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:19 2021] DELETE /identity/v3/users/484c4fcce120401ba5e0dac36c37a2ac => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:21.135381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:21.136942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:21.156103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0365f-a45b-40bc-9142-0bf53c0763cf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:21.302443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:21.304649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:21.307891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:21.308524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] PATH_INFO: `/v3/projects/45953b275c2f4bc6ac750580315935a4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:21.313436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45953b275c2f4bc6ac750580315935a4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:21.317041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:21.527299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45953b275c2f4bc6ac750580315935a4', 'request_id': 'req-53a1487b-b706-45ba-bf46-54fc5a46bbb0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:21.542514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45953b275c2f4bc6ac750580315935a4', 'request_id': 'req-53a1487b-b706-45ba-bf46-54fc5a46bbb0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:21.614504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45953b275c2f4bc6ac750580315935a4', 'request_id': 'req-53a1487b-b706-45ba-bf46-54fc5a46bbb0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:21.629504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] The token cache is being invalidate because project 45953b275c2f4bc6ac750580315935a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:21.629791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:21.633379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-53a1487b-b706-45ba-bf46-54fc5a46bbb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:21.651564 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3013/6113] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:21 2021] DELETE /identity/v3/projects/45953b275c2f4bc6ac750580315935a4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:21.653432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226138-80f8-4bfa-b5fb-4caaf6558f06 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:21.653877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226138-80f8-4bfa-b5fb-4caaf6558f06 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:21.654019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226138-80f8-4bfa-b5fb-4caaf6558f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:21.690085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6b226138-80f8-4bfa-b5fb-4caaf6558f06 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:21.696079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b226138-80f8-4bfa-b5fb-4caaf6558f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:21.839338 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3101/6114] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:21.847815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a898add-a910-44e8-b30c-506a827f44bf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:21.848133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a898add-a910-44e8-b30c-506a827f44bf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:21.848419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a898add-a910-44e8-b30c-506a827f44bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:21.870643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3a898add-a910-44e8-b30c-506a827f44bf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:21.872009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a898add-a910-44e8-b30c-506a827f44bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:21.885103 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3014/6115] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:21.886567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226138-80f8-4bfa-b5fb-4caaf6558f06 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:21.898314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226138-80f8-4bfa-b5fb-4caaf6558f06 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:21.904708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:21.905641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:21.906058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:21.906468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:21.907357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:21.907764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:21.909592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:21.923195 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3102/6116] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:29:21.927701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a898add-a910-44e8-b30c-506a827f44bf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:21.937848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a898add-a910-44e8-b30c-506a827f44bf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:21.942678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:21.949109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:21.949109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:21.949109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:21.949109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:21.949109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:22.077830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3015/6117] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:21 2021] POST /identity/v3/projects => generated 407 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:22.082140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:22.100819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970609-05ae-43db-ae34-42e2da36f07c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:22.208154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:22.210435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:22.211358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:22.212676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:22.212676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:22.214860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:22.310453 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3103/6118] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:22 2021] POST /identity/v3/users => generated 304 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:22.314598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:22.331118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f492-5ddf-466c-8594-1ad503b82e27 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:22.338559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:22.339638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:22.340154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:22.340654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:22.341981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:22.344832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:22.363175 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3016/6119] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:22 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:29:22.365584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:22.378042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53f6fb-1ad5-40e6-9d47-e3107445857c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:22.384983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f32171-44e1-401b-b130-a90ac4a7959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:22.386123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32171-44e1-401b-b130-a90ac4a7959d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:22.386123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32171-44e1-401b-b130-a90ac4a7959d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:22.386399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f32171-44e1-401b-b130-a90ac4a7959d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:22.387223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f32171-44e1-401b-b130-a90ac4a7959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:22.388856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f32171-44e1-401b-b130-a90ac4a7959d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:22.404808 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3104/6120] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:22 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:22.407968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:22.421949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142807b-4a8f-4c04-a677-f12d38ebf733 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:22.427215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:22.428105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:22.428385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:22.428661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] PATH_INFO: `/v3/projects/5a699909695048b89c32adc2939a97f8/users/3717a4bd457f409eb3350766e001093b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:22.445237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a699909695048b89c32adc2939a97f8, user_id=3717a4bd457f409eb3350766e001093b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:22.448447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:22.534811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3017/6121] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:22 2021] PUT /identity/v3/projects/5a699909695048b89c32adc2939a97f8/users/3717a4bd457f409eb3350766e001093b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:29:22.536759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc73a8-018b-4c75-8b6a-096def4576de None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:22.537311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc73a8-018b-4c75-8b6a-096def4576de None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:22.537658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc73a8-018b-4c75-8b6a-096def4576de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:22.570241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7cfc73a8-018b-4c75-8b6a-096def4576de None None] MFA Rules not processed for user `3717a4bd457f409eb3350766e001093b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:22.571545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7cfc73a8-018b-4c75-8b6a-096def4576de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:22.658401 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3105/6122] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:22 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:22.663574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:22.762150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a053d-faf7-4c10-93f0-eb26247635a2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:22.769145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:22.769931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:22.770631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:22.770907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:22.772369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:22.774911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:22.936508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3018/6123] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:22 2021] POST /identity/v3/projects => generated 409 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:22.940443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc73a8-018b-4c75-8b6a-096def4576de None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:22.952200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc73a8-018b-4c75-8b6a-096def4576de None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:23.076784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:23.077543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:23.077823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:23.078239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:23.078959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:23.082183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:23.202408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3106/6124] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:22 2021] POST /identity/v3/users => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:23.208317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:23.223272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dccd5c-3f13-433e-847c-e3eab55f0626 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:23.233360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:23.234231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:23.234645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:23.235183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:23.236129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:23.238068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:23.251232 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3019/6125] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:23 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:23.255361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:23.269886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53444c-0e13-4260-86f3-6401d47958aa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:23.277141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:23.278286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:23.278667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:23.279112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] PATH_INFO: `/v3/projects/df0f296c829f494694914b7dd3973f9b/users/3cc602b7167646be8ab037990eb53bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:23.297494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0f296c829f494694914b7dd3973f9b, user_id=3cc602b7167646be8ab037990eb53bb6, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:23.300446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:23.398707 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3107/6126] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:23 2021] PUT /identity/v3/projects/df0f296c829f494694914b7dd3973f9b/users/3cc602b7167646be8ab037990eb53bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:29:23.403480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:23.416424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a4d0-8f0e-4ef1-89bc-0ac253ef2084 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:23.488274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe598807-2a65-4b31-bdc0-09efc7816fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:23.489009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598807-2a65-4b31-bdc0-09efc7816fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:23.489291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598807-2a65-4b31-bdc0-09efc7816fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:23.489728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598807-2a65-4b31-bdc0-09efc7816fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:23.490678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe598807-2a65-4b31-bdc0-09efc7816fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:23.492353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe598807-2a65-4b31-bdc0-09efc7816fd5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:23.504597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3020/6127] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:23 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:29:23.509081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:23.519918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf01f-4e73-4d19-b03e-8da06fdab666 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:23.525452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:23.526331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:23.526602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:23.527051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] PATH_INFO: `/v3/projects/df0f296c829f494694914b7dd3973f9b/users/3cc602b7167646be8ab037990eb53bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:23.529099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0f296c829f494694914b7dd3973f9b, user_id=3cc602b7167646be8ab037990eb53bb6, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:23.542162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:23.545015 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3108/6128] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:23 2021] PUT /identity/v3/projects/df0f296c829f494694914b7dd3973f9b/users/3cc602b7167646be8ab037990eb53bb6/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:29:23.555578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:23.555954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:23.556242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:23.586267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] MFA Rules not processed for user `3cc602b7167646be8ab037990eb53bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:23.588050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:23.664222 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3021/6129] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:23 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:23.675502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:23.677881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:23.758845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae4dbf-976b-4801-9e88-0d2e12232a86 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:23.764360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b46e1-e136-4253-88a3-6c3546271e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:23.765187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b46e1-e136-4253-88a3-6c3546271e96 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:23.765578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b46e1-e136-4253-88a3-6c3546271e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:23.766064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b46e1-e136-4253-88a3-6c3546271e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:23.776717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b46e1-e136-4253-88a3-6c3546271e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:23.778279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b46e1-e136-4253-88a3-6c3546271e96 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:23.798240 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3109/6130] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:23 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:24.292635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:24.294179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:24.315557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:24.316640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:24.316974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:24.415055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85d5f-001b-4ddc-bde5-fc5ec06160f0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:24.422241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:24.423339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:24.423857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:24.424400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] PATH_INFO: `/v3/users/7355bee9864946e1bd475d5dada82b1f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:24.425899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7355bee9864946e1bd475d5dada82b1f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:24.428054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:24.474458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:24.475985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:24.599985 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3110/6131] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:29:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:29:24.601360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:24.603235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:24.630377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a100613-6a88-48a5-9bd9-0a51bd3901a0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:24.637082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:24.638129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:24.638773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:24.639344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:24.700418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7355bee9864946e1bd475d5dada82b1f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:24.711281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7355bee9864946e1bd475d5dada82b1f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:24.726834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:24.732242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:24.734493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7355bee9864946e1bd475d5dada82b1f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:24.735849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7355bee9864946e1bd475d5dada82b1f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:24.736743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-262185fd-a54c-47da-b815-7257c59b5d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7355bee9864946e1bd475d5dada82b1f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:24.739701 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3111/6132] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:24 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:24.813432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:24.817079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:24.843544 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3022/6133] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:24 2021] DELETE /identity/v3/users/7355bee9864946e1bd475d5dada82b1f => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:24.849972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:24.852457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:24.855163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:24.891191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:24.895339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:25.007389 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3023/6134] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:25.015754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003504-285d-48d8-a7d2-235f62352a6c service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:25.021819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:25.025993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:25.130565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674be94c-d2f7-4c20-bc84-aa57299db5a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:25.131240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674be94c-d2f7-4c20-bc84-aa57299db5a2 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:25.131520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674be94c-d2f7-4c20-bc84-aa57299db5a2 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:25.131812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674be94c-d2f7-4c20-bc84-aa57299db5a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:25.135089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-674be94c-d2f7-4c20-bc84-aa57299db5a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:25.138365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186cee-b1ea-4d44-8cc4-462db9c34de2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:25.143681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:25.145088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:25.146234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:25.146234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:25.157601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:25.159404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:25.185689 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3024/6135] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:29:25.213498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674be94c-d2f7-4c20-bc84-aa57299db5a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:25.215151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674be94c-d2f7-4c20-bc84-aa57299db5a2 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:25.233597 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3112/6136] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:29:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:29:25.669980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:25.670547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:25.716442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e774-4bd1-4a12-85ad-8dea2597af6c service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:25.735086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:25.736273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:25.736711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:25.737438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] PATH_INFO: `/v3/projects/630b7b4e23714a47b3012c008ec639f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:25.739075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630b7b4e23714a47b3012c008ec639f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:25.742510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:25.939135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630b7b4e23714a47b3012c008ec639f8', 'request_id': 'req-cc0cb658-1eb1-475e-94ff-15b8da623ac4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:25.947761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630b7b4e23714a47b3012c008ec639f8', 'request_id': 'req-cc0cb658-1eb1-475e-94ff-15b8da623ac4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:26.145635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630b7b4e23714a47b3012c008ec639f8', 'request_id': 'req-cc0cb658-1eb1-475e-94ff-15b8da623ac4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:26.166581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] The token cache is being invalidate because project 630b7b4e23714a47b3012c008ec639f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:26.166581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:26.168094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cc0cb658-1eb1-475e-94ff-15b8da623ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:26.170872 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3025/6137] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:25 2021] DELETE /identity/v3/projects/630b7b4e23714a47b3012c008ec639f8 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:26.176619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:26.177853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:26.178735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:26.214306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:26.215834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:26.361264 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3113/6138] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:26.372276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9679c-bc9b-41b7-a94b-118cd685433f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:26.372623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9679c-bc9b-41b7-a94b-118cd685433f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:26.372838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9679c-bc9b-41b7-a94b-118cd685433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:26.485184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bbe9679c-bc9b-41b7-a94b-118cd685433f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:26.496985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:26.496985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:26.498728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bbe9679c-bc9b-41b7-a94b-118cd685433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:26.514237 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3026/6139] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:26.531145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9679c-bc9b-41b7-a94b-118cd685433f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:26.592472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9679c-bc9b-41b7-a94b-118cd685433f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:26.622382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:26.626689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:26.626689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:26.626689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:26.628182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:26.629208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:26.637243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:26.705887 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3027/6140] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:29:26.709379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:26.723590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63efc2-fe20-4ff5-acec-98334310d8e7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:26.733484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a3da5-2291-4f9c-acf8-4b36bafcd851 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:26.741709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:26.744217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:26.747514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:26.747514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:26.747514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:26.747514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:26.752425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:26.755832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:26.756355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:26.761713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:26.761713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:26.829762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:26.831535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:26.872923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3114/6141] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:26.888669 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3028/6142] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:26 2021] POST /identity/v3/projects => generated 359 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:26.892695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:26.916566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500b306-c29a-4d63-9405-17c2d234d279 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:27.040444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:27.041333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:27.041947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:27.042309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:27.043192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:27.047952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:27.194993 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3115/6143] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:26 2021] POST /identity/v3/users => generated 280 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:27.197726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:27.210537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba4ab-ddca-4ed0-9cac-c0043b2c3fe5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:27.217101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:27.218111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:27.218543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:27.219018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:27.219903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:27.222074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:27.238711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3029/6144] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:27 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:27.239375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:27.251188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eaf7a-3ff5-4c03-b87b-585bd35a34fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:27.256833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8641d8d-1ffb-4ee8-9cfd-b32758760c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:27.257552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8641d8d-1ffb-4ee8-9cfd-b32758760c7b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:27.257833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8641d8d-1ffb-4ee8-9cfd-b32758760c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:27.258109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8641d8d-1ffb-4ee8-9cfd-b32758760c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:27.259401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8641d8d-1ffb-4ee8-9cfd-b32758760c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:27.261110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8641d8d-1ffb-4ee8-9cfd-b32758760c7b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:27.277447 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3116/6145] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:27.278832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:27.293277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b9ed7-ad8d-4145-99ca-7066f8ace515 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:27.312778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:27.313959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:27.314234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:27.314506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] PATH_INFO: `/v3/projects/2b4b670b5aa1407f8675179d6279efab/users/5717d2674648434bbca845f2ce91516b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:27.339372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4b670b5aa1407f8675179d6279efab, user_id=5717d2674648434bbca845f2ce91516b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:27.344146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:27.454162 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3030/6146] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:27 2021] PUT /identity/v3/projects/2b4b670b5aa1407f8675179d6279efab/users/5717d2674648434bbca845f2ce91516b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:27.459747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:27.460049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:27.460323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:27.513030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] MFA Rules not processed for user `5717d2674648434bbca845f2ce91516b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:27.514220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:27.698983 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3117/6147] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:27 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:27.718340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:27.721763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:27.831408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f0372-d391-4340-a3d0-65f85fbdb34c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:27.848085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b0ada-dd05-417e-bbdc-a555a80ba4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:27.848085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0ada-dd05-417e-bbdc-a555a80ba4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:27.848085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0ada-dd05-417e-bbdc-a555a80ba4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:27.854753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0ada-dd05-417e-bbdc-a555a80ba4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:27.883793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b0ada-dd05-417e-bbdc-a555a80ba4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:27.888318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b0ada-dd05-417e-bbdc-a555a80ba4e7 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:27.942517 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3031/6148] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:27 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:43.675990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:43.686191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:43.913128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2ce54-c446-4b68-a6eb-f161ec49951b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:43.936984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:43.937898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:43.938180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:43.938452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] PATH_INFO: `/v3/users/359a08e577f445c3bc3a843845b9ec0c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:43.940691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359a08e577f445c3bc3a843845b9ec0c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:43.942597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:44.237338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359a08e577f445c3bc3a843845b9ec0c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:44.270590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359a08e577f445c3bc3a843845b9ec0c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:44.315255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359a08e577f445c3bc3a843845b9ec0c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:44.316296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359a08e577f445c3bc3a843845b9ec0c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:44.425296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359a08e577f445c3bc3a843845b9ec0c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:44.442594 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3118/6149] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:43 2021] DELETE /identity/v3/users/359a08e577f445c3bc3a843845b9ec0c => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:44.447646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:44.448740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:44.449218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:44.482947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:44.486890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:44.629122 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3032/6150] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:44.865882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:44.865882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:44.865882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22891f4-9cb6-4ce1-8de7-8141f307b434 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:44.866884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:44.866884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:44.866884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:44.866884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:44.867299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:44.867299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:44.867299 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3119/6151] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:46.260675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:46.262996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:46.285067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b93a8-acca-4875-b89d-f2fa240b2e5a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:46.315537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:46.316525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:46.317465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:46.317842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] PATH_INFO: `/v3/projects/8575c4332583463384501df8336e3599` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:46.319163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8575c4332583463384501df8336e3599)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:46.322321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:46.595478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8575c4332583463384501df8336e3599', 'request_id': 'req-935985b8-aca8-498b-8290-0e5f81090a79'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:46.601733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8575c4332583463384501df8336e3599', 'request_id': 'req-935985b8-aca8-498b-8290-0e5f81090a79'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:46.751916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8575c4332583463384501df8336e3599', 'request_id': 'req-935985b8-aca8-498b-8290-0e5f81090a79'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:46.771205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] The token cache is being invalidate because project 8575c4332583463384501df8336e3599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:46.771790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:46.813640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:46.813640 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3033/6152] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:46 2021] DELETE /identity/v3/projects/8575c4332583463384501df8336e3599 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:46.824641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:46.843596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212ac34-4a95-43cf-9f46-ac5b65085227 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:46.989339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:46.990670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:46.991340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:46.991787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] PATH_INFO: `/v3/users/1ea2d5032faa4944a2214a79bf59e5d2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:46.995141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea2d5032faa4944a2214a79bf59e5d2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:46.997593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:47.284222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea2d5032faa4944a2214a79bf59e5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:47.304408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea2d5032faa4944a2214a79bf59e5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:47.327447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea2d5032faa4944a2214a79bf59e5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:47.328249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea2d5032faa4944a2214a79bf59e5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:47.436377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a91ba0d5-1823-45d2-8b55-1a0fcaae37bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea2d5032faa4944a2214a79bf59e5d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:47.451682 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3120/6153] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:46 2021] DELETE /identity/v3/users/1ea2d5032faa4944a2214a79bf59e5d2 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:48.433418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:48.435395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:48.454528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935985b8-aca8-498b-8290-0e5f81090a79 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:48.544093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:48.545503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:48.545897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:48.546282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] PATH_INFO: `/v3/projects/426ef46fa2a54813ba775b7908a07181` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:48.547885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426ef46fa2a54813ba775b7908a07181)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:48.550017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:48.674617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426ef46fa2a54813ba775b7908a07181', 'request_id': 'req-e4b46353-76a4-4bfc-8a57-5553b3f690a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:48.681541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426ef46fa2a54813ba775b7908a07181', 'request_id': 'req-e4b46353-76a4-4bfc-8a57-5553b3f690a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:48.771401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426ef46fa2a54813ba775b7908a07181', 'request_id': 'req-e4b46353-76a4-4bfc-8a57-5553b3f690a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:48.786532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] The token cache is being invalidate because project 426ef46fa2a54813ba775b7908a07181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:48.786828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:48.787752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4b46353-76a4-4bfc-8a57-5553b3f690a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:48.789622 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3034/6154] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:48 2021] DELETE /identity/v3/projects/426ef46fa2a54813ba775b7908a07181 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:48.795805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380650a-1251-4eb1-99fa-5d31b7857256 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:48.796350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380650a-1251-4eb1-99fa-5d31b7857256 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:48.796350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380650a-1251-4eb1-99fa-5d31b7857256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:48.817859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2380650a-1251-4eb1-99fa-5d31b7857256 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:48.819096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2380650a-1251-4eb1-99fa-5d31b7857256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:48.891642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3121/6155] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:48.893863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666862-a420-4ccd-98d6-407bcf565ca2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:48.894252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666862-a420-4ccd-98d6-407bcf565ca2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:48.894595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666862-a420-4ccd-98d6-407bcf565ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:48.917363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6a666862-a420-4ccd-98d6-407bcf565ca2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:48.918812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6a666862-a420-4ccd-98d6-407bcf565ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:48.931868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3035/6156] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:29:48.933094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380650a-1251-4eb1-99fa-5d31b7857256 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:48.945949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380650a-1251-4eb1-99fa-5d31b7857256 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:48.951822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:48.952770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:48.955904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:48.955904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:48.955904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:48.955904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:48.957133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:48.981188 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3122/6157] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:29:48.982612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a666862-a420-4ccd-98d6-407bcf565ca2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:48.992157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a666862-a420-4ccd-98d6-407bcf565ca2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:48.997050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:48.997726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:48.998063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:48.998318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:48.999020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:49.001064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:49.112314 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3036/6158] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:48 2021] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:49.116438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.127192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b26af-862f-4d74-809c-3d0a6366d967 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:49.202127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:49.202807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.203259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.203690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.204405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:49.206649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:49.308818 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3123/6159] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:49 2021] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:49.312717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.325108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036b84b-48d3-4887-9887-e912edcc8167 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:49.332489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:49.333224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.333523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.333846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.335084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:49.336917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:49.354153 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3037/6160] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:49 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:49.361581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.371852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a505fc1-b8f9-4049-8c69-b6c0f1f452c6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:49.376629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:49.377514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.377791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.378065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.378792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:49.380382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:49.391612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3124/6161] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:49.395644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.406449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99918511-89d5-4152-bec9-2ad6b5e0337e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:49.411088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a25c02-2b63-4fff-b94b-3e1afee83251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:49.411991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a25c02-2b63-4fff-b94b-3e1afee83251 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.412243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a25c02-2b63-4fff-b94b-3e1afee83251 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.412542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a25c02-2b63-4fff-b94b-3e1afee83251 admin admin] PATH_INFO: `/v3/projects/13413b6e22ac4d319f142d01c6f58fbb/users/2ce1d9a465f54f46af59b1089007008c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.429769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a25c02-2b63-4fff-b94b-3e1afee83251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13413b6e22ac4d319f142d01c6f58fbb, user_id=2ce1d9a465f54f46af59b1089007008c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:49.432552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a25c02-2b63-4fff-b94b-3e1afee83251 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:49.442389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.444208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:49.457573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd4f2-21f1-484e-ac07-9aa5acf2084c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:49.462894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:49.463753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.464030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.464930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] PATH_INFO: `/v3/users/ebf61af4a7d6490ca760c131cfa5cf8e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.465571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf61af4a7d6490ca760c131cfa5cf8e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:49.467469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:49.507643 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3038/6162] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:49 2021] PUT /identity/v3/projects/13413b6e22ac4d319f142d01c6f58fbb/users/2ce1d9a465f54f46af59b1089007008c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:29:49.511976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b815f-d748-40ab-97da-ad8282a73424 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.512252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b815f-d748-40ab-97da-ad8282a73424 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.512567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b815f-d748-40ab-97da-ad8282a73424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.547107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a79b815f-d748-40ab-97da-ad8282a73424 None None] MFA Rules not processed for user `2ce1d9a465f54f46af59b1089007008c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:49.548506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a79b815f-d748-40ab-97da-ad8282a73424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:49.618590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3039/6163] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:29:49.623006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b815f-d748-40ab-97da-ad8282a73424 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.668380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf61af4a7d6490ca760c131cfa5cf8e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:49.675399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf61af4a7d6490ca760c131cfa5cf8e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:49.688598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf61af4a7d6490ca760c131cfa5cf8e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:49.689413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf61af4a7d6490ca760c131cfa5cf8e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:49.691963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b815f-d748-40ab-97da-ad8282a73424 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:49.698040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:49.698704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.702296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.702296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.702296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:49.702296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:49.806787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8cad917-b20d-400c-a4e2-1c5c9eaf32d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf61af4a7d6490ca760c131cfa5cf8e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:49.813279 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3125/6164] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:49 2021] DELETE /identity/v3/users/ebf61af4a7d6490ca760c131cfa5cf8e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:29:49.817682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:49.817971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:49.818251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:49.836371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:49.838025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:49.899627 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3126/6165] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:29:49.904831 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3040/6166] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:49 2021] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:49.908620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.910341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:49.923231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bf0da-df96-4e9b-85b4-32bc833fb6df None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:49.950799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:49.964859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:50.047764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:50.050644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.051165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.051623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.055598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:50.055598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:50.066840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24055b-bc2e-4012-8e85-eef4f0684099 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:50.072806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:50.086813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.086813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.086813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.097726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:50.099349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:50.119357 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3041/6167] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:50.227757 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3127/6168] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:49 2021] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:29:50.228984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:50.247902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523360-a634-4cb9-ac93-f11a6353ec55 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:50.268434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:50.269434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.269778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.277319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.277319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:50.277319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:50.297197 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3042/6169] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:50 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:50.298474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:50.311401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf357c-39c6-43cb-a081-e3aebe03ecfb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:50.317666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:50.318716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.319080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.325966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] PATH_INFO: `/v3/projects/29500fa7f2f34192bb55987623afabf2/users/c833baac62ad4020936455852e507eca/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.348922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=29500fa7f2f34192bb55987623afabf2, user_id=c833baac62ad4020936455852e507eca, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:50.353230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:50.488391 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3128/6170] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:50 2021] PUT /identity/v3/projects/29500fa7f2f34192bb55987623afabf2/users/c833baac62ad4020936455852e507eca/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:50.492140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:50.502862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff64c-c0e3-498d-b85e-5ec4e435db2f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:50.570754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff4bd-3e0e-4c14-bf25-70518686db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:50.571718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff4bd-3e0e-4c14-bf25-70518686db15 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.572093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff4bd-3e0e-4c14-bf25-70518686db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.572442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff4bd-3e0e-4c14-bf25-70518686db15 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.573354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff4bd-3e0e-4c14-bf25-70518686db15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:50.575439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff4bd-3e0e-4c14-bf25-70518686db15 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:50.591666 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3043/6171] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:50 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:50.595731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:50.608422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3979-5186-489a-a040-56e556cebacc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:50.617861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:50.618982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.619265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.619542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] PATH_INFO: `/v3/projects/29500fa7f2f34192bb55987623afabf2/users/c833baac62ad4020936455852e507eca/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.623208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29500fa7f2f34192bb55987623afabf2, user_id=c833baac62ad4020936455852e507eca, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:50.626319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:50.660189 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3129/6172] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:50 2021] PUT /identity/v3/projects/29500fa7f2f34192bb55987623afabf2/users/c833baac62ad4020936455852e507eca/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:50.661794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.667976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.667976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.696504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] MFA Rules not processed for user `c833baac62ad4020936455852e507eca`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:50.698298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:50.805571 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3044/6173] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:50 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:29:50.816769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:50.820292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:50.947339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbc1ab-dd94-4d05-8d68-16a9f5271a6e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:50.953187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b9a51-1e58-4364-88c2-5ebf826473a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:50.953187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9a51-1e58-4364-88c2-5ebf826473a5 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:50.953187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9a51-1e58-4364-88c2-5ebf826473a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:50.953187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9a51-1e58-4364-88c2-5ebf826473a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:50.955196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-445b9a51-1e58-4364-88c2-5ebf826473a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:51.040113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b9a51-1e58-4364-88c2-5ebf826473a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:51.042214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b9a51-1e58-4364-88c2-5ebf826473a5 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:51.058148 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3130/6174] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:50 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:51.570151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:51.572045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:51.760649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee713b82-4f2c-4483-babd-7d4f19900641 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:51.774734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:51.775683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:51.777860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:51.778396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] PATH_INFO: `/v3/projects/6d33281b0c4c402eacd641a45e81edd7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:51.780395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d33281b0c4c402eacd641a45e81edd7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:51.784700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:51.952021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d33281b0c4c402eacd641a45e81edd7', 'request_id': 'req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:51.962360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d33281b0c4c402eacd641a45e81edd7', 'request_id': 'req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:52.031912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d33281b0c4c402eacd641a45e81edd7', 'request_id': 'req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:52.063821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] The token cache is being invalidate because project 6d33281b0c4c402eacd641a45e81edd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:52.064018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:52.064701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a8e8cb42-8404-4c49-b19e-c9eb9158dcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:52.075748 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3045/6175] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:51 2021] DELETE /identity/v3/projects/6d33281b0c4c402eacd641a45e81edd7 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:52.090515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcfa2d-4a61-4a1a-981c-5d61c6447526 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.090515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcfa2d-4a61-4a1a-981c-5d61c6447526 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.090515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcfa2d-4a61-4a1a-981c-5d61c6447526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.126670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c8dcfa2d-4a61-4a1a-981c-5d61c6447526 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:52.128082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8dcfa2d-4a61-4a1a-981c-5d61c6447526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:52.239127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3131/6176] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:52.246900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546421a6-b990-4723-a8b8-6df00d399e48 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.247424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546421a6-b990-4723-a8b8-6df00d399e48 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.247850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546421a6-b990-4723-a8b8-6df00d399e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.272209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-546421a6-b990-4723-a8b8-6df00d399e48 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:52.274374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-546421a6-b990-4723-a8b8-6df00d399e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:52.284128 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3046/6177] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:52.289271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcfa2d-4a61-4a1a-981c-5d61c6447526 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:52.302860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcfa2d-4a61-4a1a-981c-5d61c6447526 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:52.310445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:52.311736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.312340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.312772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.314276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:52.314785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:52.317455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:52.333864 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3132/6178] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:29:52.341827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546421a6-b990-4723-a8b8-6df00d399e48 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:52.349829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546421a6-b990-4723-a8b8-6df00d399e48 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:52.356021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:52.357800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.358092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.358370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.359509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:52.361600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:52.544065 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3047/6179] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:52 2021] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:52.548363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:52.559846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b95f57-d59d-467d-8abd-db1cb45a4a32 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:52.647765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:52.649506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.649914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.650303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.651184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:52.659512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:52.763192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3133/6180] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:52 2021] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:52.765748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:52.778513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2a0dc-8410-4030-81f2-9ec5d14435cd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:52.789385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:52.790479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.791586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.792115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.793836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:52.796762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:52.814968 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3048/6181] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:52 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:52.818907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:52.835449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8510-afdd-46f5-8512-965d47fc99aa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:52.845220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b29b4-04ee-4614-a95d-b21ab57b4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:52.846445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b29b4-04ee-4614-a95d-b21ab57b4ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.846954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b29b4-04ee-4614-a95d-b21ab57b4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.847384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b29b4-04ee-4614-a95d-b21ab57b4ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.849343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b29b4-04ee-4614-a95d-b21ab57b4ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:52.851894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b29b4-04ee-4614-a95d-b21ab57b4ab4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:52.875095 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3134/6182] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:52 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:52.879112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:52.903729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d1f4d-cdb1-4fa5-9d48-1e23e98f3a3c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:52.910554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:52.912751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:52.913278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:52.914058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] PATH_INFO: `/v3/projects/534717b7b07e491c88ee84580be26ed9/users/eb5b68737dff4ebf8b444e58310c0964/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:52.936858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534717b7b07e491c88ee84580be26ed9, user_id=eb5b68737dff4ebf8b444e58310c0964, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:52.941207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:53.076266 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3049/6183] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:52 2021] PUT /identity/v3/projects/534717b7b07e491c88ee84580be26ed9/users/eb5b68737dff4ebf8b444e58310c0964/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:53.197433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d9234-6c86-4775-b1eb-2889a3e2ac5c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:53.198349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d9234-6c86-4775-b1eb-2889a3e2ac5c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:53.198349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d9234-6c86-4775-b1eb-2889a3e2ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:53.253838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e38d9234-6c86-4775-b1eb-2889a3e2ac5c None None] MFA Rules not processed for user `eb5b68737dff4ebf8b444e58310c0964`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:53.255905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e38d9234-6c86-4775-b1eb-2889a3e2ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:53.438150 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3135/6184] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:53 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:53.439111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:53.440818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:53.540205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afce34-9dba-41b5-92bb-5d90e8d882f7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:53.548524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:53.550029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:53.550685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:53.551166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:53.563494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:53.566270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:53.586837 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3050/6185] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:53 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:53.624966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d9234-6c86-4775-b1eb-2889a3e2ac5c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:53.728224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d9234-6c86-4775-b1eb-2889a3e2ac5c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:53.734088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:53.735768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:53.736377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:53.736697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] PATH_INFO: `/v3/users/eb5b68737dff4ebf8b444e58310c0964` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:53.738314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5b68737dff4ebf8b444e58310c0964)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:53.740806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:53.842535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:53.844318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.006870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0fbb6-1430-42fe-8caa-7689e7b69f66 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:54.016945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:54.018011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:54.018802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:54.019699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:54.024458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.047938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:54.049520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5b68737dff4ebf8b444e58310c0964'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:54.051809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:54.101457 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3051/6186] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:54.101595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5b68737dff4ebf8b444e58310c0964'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:54.105867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:54.110255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.155312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5b68737dff4ebf8b444e58310c0964'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:54.160933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5b68737dff4ebf8b444e58310c0964'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:54.260360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b39f47-6e92-4707-8bff-14356080a47f service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:54.274617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:54.275458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:54.275838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:54.276268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:54.278735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.281652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0371dbd-1c53-46ad-a9b8-ae43e6cf6c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5b68737dff4ebf8b444e58310c0964'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:54.293892 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3136/6187] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:29:53 2021] DELETE /identity/v3/users/eb5b68737dff4ebf8b444e58310c0964 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:54.295560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:54.295998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:54.297153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:54.323291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:54.324931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:54.341905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:54.345115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.358116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3052/6188] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:54.430128 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3137/6189] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:54.457599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:54.459225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.591801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50c5d-0743-447f-aecb-7c4be854e82f service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:54.642719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:54.644425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.725914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:54.729973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:54.731309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:54.731700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:54.753634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:54.755311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:54.773121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def698-0ee0-4021-bdbf-85377cc17eeb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:54.778246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2430e-0809-40d6-bbf3-4e9fa8497287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:54.778720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2430e-0809-40d6-bbf3-4e9fa8497287 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:54.779065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2430e-0809-40d6-bbf3-4e9fa8497287 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:54.779424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2430e-0809-40d6-bbf3-4e9fa8497287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:54.782360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c3a2430e-0809-40d6-bbf3-4e9fa8497287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:54.790056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3053/6190] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:29:54.797525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2430e-0809-40d6-bbf3-4e9fa8497287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:54.800053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2430e-0809-40d6-bbf3-4e9fa8497287 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:54.815883 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3138/6191] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:29:55.830810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:55.832541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:55.847663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae89f-bc81-4287-b492-704b0246344a service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:55.858336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:55.859374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:55.859760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:55.860138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] PATH_INFO: `/v3/projects/534717b7b07e491c88ee84580be26ed9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:55.862556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=534717b7b07e491c88ee84580be26ed9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:55.864673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:56.013747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534717b7b07e491c88ee84580be26ed9', 'request_id': 'req-91c5fcee-6902-462c-b87f-325811245eef'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:56.021710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534717b7b07e491c88ee84580be26ed9', 'request_id': 'req-91c5fcee-6902-462c-b87f-325811245eef'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:56.121579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534717b7b07e491c88ee84580be26ed9', 'request_id': 'req-91c5fcee-6902-462c-b87f-325811245eef'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:56.140021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] The token cache is being invalidate because project 534717b7b07e491c88ee84580be26ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:29:56.140320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:56.146777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-91c5fcee-6902-462c-b87f-325811245eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:29:56.151567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3054/6192] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:29:55 2021] DELETE /identity/v3/projects/534717b7b07e491c88ee84580be26ed9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:56.166963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94b83-7789-40d1-a135-1606124b60ec None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.168317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94b83-7789-40d1-a135-1606124b60ec None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.169001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94b83-7789-40d1-a135-1606124b60ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.193183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-12e94b83-7789-40d1-a135-1606124b60ec None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:56.196013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-12e94b83-7789-40d1-a135-1606124b60ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:56.299825 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3139/6193] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:56.308836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65cb5-6663-4c46-baff-86a0156612ed None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.309364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65cb5-6663-4c46-baff-86a0156612ed None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.309642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65cb5-6663-4c46-baff-86a0156612ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.348680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cfc65cb5-6663-4c46-baff-86a0156612ed None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:56.350379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cfc65cb5-6663-4c46-baff-86a0156612ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:56.373974 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3055/6194] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:56.378716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e94b83-7789-40d1-a135-1606124b60ec None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:56.400728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e94b83-7789-40d1-a135-1606124b60ec None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:56.415099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:56.416635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.417185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.417776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.418626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:29:56.419037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:56.421043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:56.451761 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3140/6195] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:29:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:29:56.453047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65cb5-6663-4c46-baff-86a0156612ed None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:56.469660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65cb5-6663-4c46-baff-86a0156612ed None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:56.478721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:56.479449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.479735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.480018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.480868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:56.483623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:56.602095 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3056/6196] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:29:56 2021] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:56.605975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:56.620303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e5abe-41bd-448a-b43e-1d8f8fc36106 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:56.722979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:56.723822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.724207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.724639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.725520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:56.728517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:56.830831 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3141/6197] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:29:56 2021] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:29:56.834869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:56.847416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e861-e7f2-473e-8bda-feee046eec87 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:56.854988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:56.855670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.855962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.856242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.857158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:56.859301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:56.874597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3057/6198] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:56 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:56.878764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:56.893549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba011d-615f-49c5-9e3d-0394323099bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:56.896557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902653dc-1185-49ab-85ff-e609e9fa6b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:56.898136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902653dc-1185-49ab-85ff-e609e9fa6b24 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.898136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902653dc-1185-49ab-85ff-e609e9fa6b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.898136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902653dc-1185-49ab-85ff-e609e9fa6b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.899224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902653dc-1185-49ab-85ff-e609e9fa6b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:56.900711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902653dc-1185-49ab-85ff-e609e9fa6b24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:56.914872 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3142/6199] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:29:56 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:29:56.919172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:56.936791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b917c-0ff9-41db-a3d5-59f073628cd5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:56.945863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:56.947074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:56.952379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:56.956709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] PATH_INFO: `/v3/projects/da0b810d510e4022906978eed80e7346/users/f3183f288efa402aa0d44bbe35b35d2a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:56.981845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0b810d510e4022906978eed80e7346, user_id=f3183f288efa402aa0d44bbe35b35d2a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:56.984824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:57.089293 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3058/6200] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:29:56 2021] PUT /identity/v3/projects/da0b810d510e4022906978eed80e7346/users/f3183f288efa402aa0d44bbe35b35d2a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:29:57.100902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca3f7-0263-458c-89f3-43ba3bf3c755 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:57.101491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca3f7-0263-458c-89f3-43ba3bf3c755 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:57.102064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ca3f7-0263-458c-89f3-43ba3bf3c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:57.166611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f94ca3f7-0263-458c-89f3-43ba3bf3c755 None None] MFA Rules not processed for user `f3183f288efa402aa0d44bbe35b35d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:29:57.168704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f94ca3f7-0263-458c-89f3-43ba3bf3c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:57.363032 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3143/6201] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:29:57 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:29:57.381055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:29:57.382986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:29:57.532249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9e95-c260-4d23-a23d-66e4572e6bdd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:29:57.544737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:29:57.545518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:29:57.545803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:29:57.546093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:29:57.567845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:29:57.571305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:29:57.590201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3059/6202] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:29:57 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:00.162346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ca3f7-0263-458c-89f3-43ba3bf3c755 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:00.179594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ca3f7-0263-458c-89f3-43ba3bf3c755 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:00.182817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:00.183529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:00.183863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:00.184149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:00.186316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:00.277772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:00.281129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:00.294936 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3144/6203] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:00 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:00.902041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:00.904737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:01.050982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58b64b-619a-44bb-923c-f117f2df527f service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:01.059952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ebd5c-06b3-4abc-a606-932fdd890dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:01.061261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebd5c-06b3-4abc-a606-932fdd890dbd service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:01.061747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebd5c-06b3-4abc-a606-932fdd890dbd service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:01.062135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebd5c-06b3-4abc-a606-932fdd890dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:01.064732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f40ebd5c-06b3-4abc-a606-932fdd890dbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:01.242736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebd5c-06b3-4abc-a606-932fdd890dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:01.247909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebd5c-06b3-4abc-a606-932fdd890dbd service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:01.280462 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3060/6204] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:00 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:01.345641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:01.347182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:01.494878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1346-78df-45b5-be04-9f65e4c49ab4 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:01.505639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:01.506612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:01.509134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:01.509524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] PATH_INFO: `/v3/users/3717a4bd457f409eb3350766e001093b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:01.518580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3717a4bd457f409eb3350766e001093b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:01.518580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:01.881746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:01.882307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:01.891444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:01.903804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3717a4bd457f409eb3350766e001093b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:01.918204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:01.930815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:01.931055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3717a4bd457f409eb3350766e001093b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:01.972214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3717a4bd457f409eb3350766e001093b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:01.975524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3717a4bd457f409eb3350766e001093b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:02.042653 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3061/6205] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:30:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:02.057127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:02.059290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:02.061941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dd7a3efb-5c9d-4505-9f64-68e4ae80424d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3717a4bd457f409eb3350766e001093b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:02.077324 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3145/6206] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:01 2021] DELETE /identity/v3/users/3717a4bd457f409eb3350766e001093b => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:02.082101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:02.082406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:02.082727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:02.128911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:02.134182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:02.253122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391b46e-3632-46c8-ac9d-f8f6b44d981e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:02.353971 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3146/6207] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:02.382620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:02.383496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:02.383993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:02.385073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:02.388449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:02.414910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:02.416379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:02.479884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:02.481996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:02.518229 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3062/6208] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:30:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:30:02.611179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc8a5-f6cc-417b-bd51-259daa5d5e9f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:02.621364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:02.622331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:02.622618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:02.622907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:02.642236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:02.646591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:02.677233 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3147/6209] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:30:04.574553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:04.578379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:04.810542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9ca07-8448-4abe-abaa-537098f5cd31 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:04.832236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:04.836347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:04.836347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:04.836347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:04.843544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:04.893989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:04.895796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:04.939542 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3063/6210] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:05.904180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:05.923898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:05.938109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce166-dabc-4d56-a42f-bef76f4a88de service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:05.953943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:05.954836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:05.955137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:05.955359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] PATH_INFO: `/v3/projects/5a699909695048b89c32adc2939a97f8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:05.958788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a699909695048b89c32adc2939a97f8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:05.960773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:06.099495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a699909695048b89c32adc2939a97f8', 'request_id': 'req-1855f91b-a100-4493-bd2e-7cf388d246d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.201557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a699909695048b89c32adc2939a97f8', 'request_id': 'req-1855f91b-a100-4493-bd2e-7cf388d246d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.214118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a699909695048b89c32adc2939a97f8', 'request_id': 'req-1855f91b-a100-4493-bd2e-7cf388d246d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.243047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] The token cache is being invalidate because project 5a699909695048b89c32adc2939a97f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:06.243575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.256479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.263605 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3148/6211] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:05 2021] DELETE /identity/v3/projects/5a699909695048b89c32adc2939a97f8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:06.267604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:06.283181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa023a51-e9e9-4e16-a775-4db3372de46b service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:06.513158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:06.514312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:06.517058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:06.517390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] PATH_INFO: `/v3/users/3cc602b7167646be8ab037990eb53bb6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:06.518760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc602b7167646be8ab037990eb53bb6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:06.539613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:06.853256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc602b7167646be8ab037990eb53bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.866899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc602b7167646be8ab037990eb53bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.896201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc602b7167646be8ab037990eb53bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.900805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc602b7167646be8ab037990eb53bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:06.903720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-18e7d5f3-db2d-456b-bfc0-bedfa7035cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc602b7167646be8ab037990eb53bb6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:07.071744 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3064/6212] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:06 2021] DELETE /identity/v3/users/3cc602b7167646be8ab037990eb53bb6 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:30:10.364040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:10.374124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:10.393726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855f91b-a100-4493-bd2e-7cf388d246d8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:10.597868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:10.599547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:10.602053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:10.602687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] PATH_INFO: `/v3/projects/df0f296c829f494694914b7dd3973f9b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:10.604897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0f296c829f494694914b7dd3973f9b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:10.611529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:10.875424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0f296c829f494694914b7dd3973f9b', 'request_id': 'req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:10.986687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0f296c829f494694914b7dd3973f9b', 'request_id': 'req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:10.992941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0f296c829f494694914b7dd3973f9b', 'request_id': 'req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:11.011588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] The token cache is being invalidate because project df0f296c829f494694914b7dd3973f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:11.015540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:11.015540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1c866b5c-04c3-464b-8feb-6e60d15e3ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:11.016728 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3149/6213] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:10 2021] DELETE /identity/v3/projects/df0f296c829f494694914b7dd3973f9b => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:11.023164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34105ba8-13ec-479b-a9d8-5cff1073f070 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:11.023646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34105ba8-13ec-479b-a9d8-5cff1073f070 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:11.023773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34105ba8-13ec-479b-a9d8-5cff1073f070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:11.092825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-34105ba8-13ec-479b-a9d8-5cff1073f070 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:11.095887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-34105ba8-13ec-479b-a9d8-5cff1073f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:11.337035 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3065/6214] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:11.339416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60ab3-67b4-4026-bf96-5de56b11dee6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:11.342969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60ab3-67b4-4026-bf96-5de56b11dee6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:11.343845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60ab3-67b4-4026-bf96-5de56b11dee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:11.409322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fdc60ab3-67b4-4026-bf96-5de56b11dee6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:11.414943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fdc60ab3-67b4-4026-bf96-5de56b11dee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:11.450104 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3150/6215] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:30:11.454551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34105ba8-13ec-479b-a9d8-5cff1073f070 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:11.475149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34105ba8-13ec-479b-a9d8-5cff1073f070 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:11.497100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:11.505497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:11.513083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:11.514951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:11.520746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:11.520746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:11.520746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:11.556537 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3066/6216] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:11.589923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc60ab3-67b4-4026-bf96-5de56b11dee6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:11.589923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc60ab3-67b4-4026-bf96-5de56b11dee6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:11.589923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:11.589923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:11.590500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:11.590500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:11.590500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:11.590500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:11.691637 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3151/6217] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:11 2021] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:11.695938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:11.717616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe15bf-3db1-425b-8cf8-8f0817b1cab2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:11.817192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:11.818269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:11.820204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:11.820715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:11.821929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:11.825534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:11.987843 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3067/6218] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:11 2021] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:11.989610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:12.024417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61f0a7-ad3a-4023-93d1-abe7c59f6224 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:12.035692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:12.036702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:12.037225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:12.038646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:12.039755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:12.042091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:12.076041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:12.094036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3152/6219] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:11 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:12.117512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017c816-b1d3-491b-b776-380f5e8001a7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:12.123964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbdb37-ebb8-4755-8010-190ceea3f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:12.125261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdb37-ebb8-4755-8010-190ceea3f761 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:12.125803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdb37-ebb8-4755-8010-190ceea3f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:12.126312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdb37-ebb8-4755-8010-190ceea3f761 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:12.127377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbdb37-ebb8-4755-8010-190ceea3f761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:12.132972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbdb37-ebb8-4755-8010-190ceea3f761 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:12.155326 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3068/6220] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:12 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:12.156010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:12.173532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2336e-563b-4a46-822a-f03e625e5dd9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:12.179465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:12.180384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:12.180668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:12.180998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] PATH_INFO: `/v3/projects/3ed7adc4401942fb9b231240f1d89feb/users/ceabeb375f8a45a6a40f08410b3b957d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:12.222549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed7adc4401942fb9b231240f1d89feb, user_id=ceabeb375f8a45a6a40f08410b3b957d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:12.226029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:12.345229 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3153/6221] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:12 2021] PUT /identity/v3/projects/3ed7adc4401942fb9b231240f1d89feb/users/ceabeb375f8a45a6a40f08410b3b957d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:30:12.443773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:12.454896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:12.454896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:12.519887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] MFA Rules not processed for user `ceabeb375f8a45a6a40f08410b3b957d`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:12.523654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:12.683647 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3069/6222] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:12.695198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:12.698344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:12.916308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dddcf1-06b5-4149-b614-cd61f3739e70 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:12.940511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:12.940511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:12.940511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:12.940511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:12.959372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:12.963544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:12.980944 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3154/6223] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:12 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:30:17.922632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:17.924392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:18.050230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c33a7-6a78-4d46-8eb9-8cc3e78ac884 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:18.057573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1df5d-dabb-42c9-8998-3f99f92e77b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:18.058691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1df5d-dabb-42c9-8998-3f99f92e77b3 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:18.059379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1df5d-dabb-42c9-8998-3f99f92e77b3 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:18.059866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1df5d-dabb-42c9-8998-3f99f92e77b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:18.062450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-74e1df5d-dabb-42c9-8998-3f99f92e77b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:18.081682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1df5d-dabb-42c9-8998-3f99f92e77b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:18.083385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1df5d-dabb-42c9-8998-3f99f92e77b3 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:18.134221 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3070/6224] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:21.246837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:21.248380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:21.322638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6b5a-710c-4f5c-9b62-5fa6858f51e9 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:21.330826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:21.330826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:21.330826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:21.330826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] PATH_INFO: `/v3/users/f3183f288efa402aa0d44bbe35b35d2a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:21.331954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3183f288efa402aa0d44bbe35b35d2a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:21.334738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:21.534323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3183f288efa402aa0d44bbe35b35d2a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:21.542282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3183f288efa402aa0d44bbe35b35d2a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:21.555110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3183f288efa402aa0d44bbe35b35d2a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:21.555916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3183f288efa402aa0d44bbe35b35d2a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:21.668441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3183f288efa402aa0d44bbe35b35d2a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:21.672480 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3155/6225] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:21 2021] DELETE /identity/v3/users/f3183f288efa402aa0d44bbe35b35d2a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:21.677151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be67f-93ef-463b-b833-1b111975f68a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:21.677661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be67f-93ef-463b-b833-1b111975f68a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:21.677742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145be67f-93ef-463b-b833-1b111975f68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:21.703136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-145be67f-93ef-463b-b833-1b111975f68a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:21.704580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-145be67f-93ef-463b-b833-1b111975f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:21.795132 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3071/6226] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:21.807742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:21.809493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:21.898806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ad1b1-8c41-4259-9b40-88cd5a0d1e9d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:21.903867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27371779-7ddd-44ae-a90c-ae26d017170a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:21.905017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27371779-7ddd-44ae-a90c-ae26d017170a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:21.905488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27371779-7ddd-44ae-a90c-ae26d017170a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:21.905917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27371779-7ddd-44ae-a90c-ae26d017170a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:21.918559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27371779-7ddd-44ae-a90c-ae26d017170a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:21.921957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27371779-7ddd-44ae-a90c-ae26d017170a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:21.936722 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3156/6227] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:22.559586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be67f-93ef-463b-b833-1b111975f68a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:22.559586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-145be67f-93ef-463b-b833-1b111975f68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:22.571912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145be67f-93ef-463b-b833-1b111975f68a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:22.580602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:22.580602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:22.580602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:22.580602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] PATH_INFO: `/v3/projects/da0b810d510e4022906978eed80e7346` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:22.582399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0b810d510e4022906978eed80e7346)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:22.585692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:22.760687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0b810d510e4022906978eed80e7346', 'request_id': 'req-58ad7da9-7d83-43e1-9740-cb2b434f1667'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:22.769099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0b810d510e4022906978eed80e7346', 'request_id': 'req-58ad7da9-7d83-43e1-9740-cb2b434f1667'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:22.885200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0b810d510e4022906978eed80e7346', 'request_id': 'req-58ad7da9-7d83-43e1-9740-cb2b434f1667'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:22.949114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] The token cache is being invalidate because project da0b810d510e4022906978eed80e7346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:22.950316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:22.952209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-58ad7da9-7d83-43e1-9740-cb2b434f1667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:22.956212 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3072/6228] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:22 2021] DELETE /identity/v3/projects/da0b810d510e4022906978eed80e7346 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:22.967607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e413b-9c29-425b-b403-eb71c6c918a6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:22.968010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e413b-9c29-425b-b403-eb71c6c918a6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:22.968163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e413b-9c29-425b-b403-eb71c6c918a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.000810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f57e413b-9c29-425b-b403-eb71c6c918a6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:23.002309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f57e413b-9c29-425b-b403-eb71c6c918a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:23.114155 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3157/6229] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:23.123287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454754a-317d-4118-be1f-08f2a8fbd7ec None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.123740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454754a-317d-4118-be1f-08f2a8fbd7ec None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.124182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454754a-317d-4118-be1f-08f2a8fbd7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.149671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1454754a-317d-4118-be1f-08f2a8fbd7ec None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:23.152568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1454754a-317d-4118-be1f-08f2a8fbd7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:23.166564 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3073/6230] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:23.170522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e413b-9c29-425b-b403-eb71c6c918a6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:23.181502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e413b-9c29-425b-b403-eb71c6c918a6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:23.196508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:23.197558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.198432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.198893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.199704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:23.200015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:23.201693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:23.215393 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3158/6231] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:23.220128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454754a-317d-4118-be1f-08f2a8fbd7ec None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:23.235607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454754a-317d-4118-be1f-08f2a8fbd7ec None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:23.244108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:23.245737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.252754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.252754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.252754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:23.252754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:23.335216 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3074/6232] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:23 2021] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:30:23.343777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:23.360029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c6ef2-00d2-41e8-9b12-a71447c0e8ac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:23.445894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:23.446639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.447026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.447406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.448304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:23.450364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:23.549120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3159/6233] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:23 2021] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:23.553464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:23.574276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83263b1-61be-49b8-9c0f-c540f27f3b44 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:23.579932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:23.581117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.581636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.582108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.582933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:23.585176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:23.601393 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3075/6234] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:23.605807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:23.623501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b42849-728a-4280-a7f7-cd6debe379f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:23.630829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342b925-847b-4982-9c22-d530e71e63a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:23.632596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342b925-847b-4982-9c22-d530e71e63a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.632596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342b925-847b-4982-9c22-d530e71e63a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.632825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342b925-847b-4982-9c22-d530e71e63a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.633563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342b925-847b-4982-9c22-d530e71e63a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:23.635175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342b925-847b-4982-9c22-d530e71e63a7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:23.646227 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3160/6235] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:23.650626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:23.660898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460a83e-a46d-4e78-b634-3cecfff8b18f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:23.666085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:23.666977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.667263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.667538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] PATH_INFO: `/v3/projects/eba48d8aa66b4f2686392acc0daf1e2b/users/267c85e8911a47048f4fca10a717db01/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.683441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba48d8aa66b4f2686392acc0daf1e2b, user_id=267c85e8911a47048f4fca10a717db01, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:23.686557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:23.828367 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3076/6236] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:23 2021] PUT /identity/v3/projects/eba48d8aa66b4f2686392acc0daf1e2b/users/267c85e8911a47048f4fca10a717db01/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:30:23.839604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0520f6-59b4-4746-91ff-fc5c41014827 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:23.840006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0520f6-59b4-4746-91ff-fc5c41014827 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:23.840366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0520f6-59b4-4746-91ff-fc5c41014827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:23.872128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4a0520f6-59b4-4746-91ff-fc5c41014827 None None] MFA Rules not processed for user `267c85e8911a47048f4fca10a717db01`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:23.874368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4a0520f6-59b4-4746-91ff-fc5c41014827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:23.967098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3161/6237] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:23 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:23.971735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:24.069526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e67320-bf4e-4074-8fe6-ceb6d9e3ef4c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:24.076489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:24.078330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:24.078741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:24.079019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:24.079870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:24.082804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:24.181992 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3077/6238] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:23 2021] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:30:24.186308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0520f6-59b4-4746-91ff-fc5c41014827 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:24.211547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0520f6-59b4-4746-91ff-fc5c41014827 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:24.352140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:24.352513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:24.352893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:24.353191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:24.359103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:24.372215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:24.477675 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3162/6239] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:24 2021] POST /identity/v3/users => generated 300 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:24.481541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:24.496306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf59e3-2d15-42a5-8f61-c65c4cc93e91 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:24.502205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cab738-e79b-427b-9e18-9e87b12371e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:24.503461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cab738-e79b-427b-9e18-9e87b12371e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:24.503890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cab738-e79b-427b-9e18-9e87b12371e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:24.504311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cab738-e79b-427b-9e18-9e87b12371e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:24.506209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cab738-e79b-427b-9e18-9e87b12371e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:24.508410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cab738-e79b-427b-9e18-9e87b12371e3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:24.523940 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3078/6240] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:24 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:24.527769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:24.559899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94a6b-fd5a-43ce-9916-a58e1d1642e7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:24.573639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:24.579624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:24.580683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:24.580998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] PATH_INFO: `/v3/projects/fbd29ca239784dd5bc26cf0c1beef1bb/users/e6d62fa7a9034261b32b929d6d1e8178/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:24.628056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd29ca239784dd5bc26cf0c1beef1bb, user_id=e6d62fa7a9034261b32b929d6d1e8178, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:24.633115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:24.789726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3163/6241] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:24 2021] PUT /identity/v3/projects/fbd29ca239784dd5bc26cf0c1beef1bb/users/e6d62fa7a9034261b32b929d6d1e8178/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:24.801734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a0554-8898-4714-98b1-25fa4620f1f4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:24.802052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a0554-8898-4714-98b1-25fa4620f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:24.802331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a0554-8898-4714-98b1-25fa4620f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:24.870070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f93a0554-8898-4714-98b1-25fa4620f1f4 None None] MFA Rules not processed for user `e6d62fa7a9034261b32b929d6d1e8178`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:24.872912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f93a0554-8898-4714-98b1-25fa4620f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:25.003334 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3079/6242] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:24 2021] POST /identity/v3/auth/tokens => generated 3259 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:25.064527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:25.071038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:25.145476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752283a2-0364-40dc-826c-5315b0f7a68f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:25.145849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752283a2-0364-40dc-826c-5315b0f7a68f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:25.146202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752283a2-0364-40dc-826c-5315b0f7a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:25.183300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-752283a2-0364-40dc-826c-5315b0f7a68f None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:25.184545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-752283a2-0364-40dc-826c-5315b0f7a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:25.284300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69973-eb62-4904-b9ba-229b84144fe4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:25.305368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:25.306033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:25.308687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:25.309188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:25.316802 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3080/6243] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:30:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:30:25.346518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752283a2-0364-40dc-826c-5315b0f7a68f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:25.358129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:25.359764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:25.367214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752283a2-0364-40dc-826c-5315b0f7a68f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:25.382717 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3164/6244] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:30:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:30:25.386633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540907b8-42e7-41dc-b6b5-6df1b7bfad8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:25.387767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540907b8-42e7-41dc-b6b5-6df1b7bfad8c service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:25.388245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540907b8-42e7-41dc-b6b5-6df1b7bfad8c service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:25.389928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540907b8-42e7-41dc-b6b5-6df1b7bfad8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:25.413342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540907b8-42e7-41dc-b6b5-6df1b7bfad8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:25.418613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540907b8-42e7-41dc-b6b5-6df1b7bfad8c service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:25.431943 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3081/6245] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:30:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:30:29.194433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:29.303359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e522a3-3911-4887-b030-21b62f8933a6 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:29.308173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:29.309143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:29.309647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:29.309994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] PATH_INFO: `/v3/users/267c85e8911a47048f4fca10a717db01` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:29.312013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=267c85e8911a47048f4fca10a717db01)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:29.314244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:29.494187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267c85e8911a47048f4fca10a717db01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:29.503041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267c85e8911a47048f4fca10a717db01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:29.518485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267c85e8911a47048f4fca10a717db01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:29.519234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267c85e8911a47048f4fca10a717db01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:29.636209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267c85e8911a47048f4fca10a717db01'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:29.653574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3165/6246] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:29 2021] DELETE /identity/v3/users/267c85e8911a47048f4fca10a717db01 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:29.659209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:29.659688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:29.659820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:29.680262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:29.681990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:29.746617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3082/6247] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:29.761849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:29.763408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:29.833340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785ebf-aa43-431d-9d1f-200efe8b44fe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:29.838729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:29.839458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:29.840472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:29.840472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:29.853900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:29.855406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:29.868590 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3166/6248] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:31.089171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:31.091225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:31.105691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ccf6b-daf7-41f4-b299-77efbf2455e8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:31.112317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:31.112317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:31.112909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:31.113387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] PATH_INFO: `/v3/projects/eba48d8aa66b4f2686392acc0daf1e2b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:31.115956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba48d8aa66b4f2686392acc0daf1e2b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:31.118158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:31.253644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba48d8aa66b4f2686392acc0daf1e2b', 'request_id': 'req-881a1220-3605-48d0-b057-0c730990be12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.264401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba48d8aa66b4f2686392acc0daf1e2b', 'request_id': 'req-881a1220-3605-48d0-b057-0c730990be12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.325915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba48d8aa66b4f2686392acc0daf1e2b', 'request_id': 'req-881a1220-3605-48d0-b057-0c730990be12'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.343805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] The token cache is being invalidate because project eba48d8aa66b4f2686392acc0daf1e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:31.343961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.346319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.349743 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3083/6249] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:31 2021] DELETE /identity/v3/projects/eba48d8aa66b4f2686392acc0daf1e2b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:31.354198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:31.370484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6446be-14fb-4262-9df5-79697644ca40 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:31.483850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:31.485227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:31.486567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:31.486962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] PATH_INFO: `/v3/users/e6d62fa7a9034261b32b929d6d1e8178` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:31.490972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d62fa7a9034261b32b929d6d1e8178)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:31.493789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:31.874072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d62fa7a9034261b32b929d6d1e8178'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.882145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d62fa7a9034261b32b929d6d1e8178'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.900220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d62fa7a9034261b32b929d6d1e8178'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:31.901559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d62fa7a9034261b32b929d6d1e8178'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:32.078717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6f46611c-ac57-43e1-95c3-1c59a503e65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d62fa7a9034261b32b929d6d1e8178'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:32.089052 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3167/6250] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:31 2021] DELETE /identity/v3/users/e6d62fa7a9034261b32b929d6d1e8178 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:33.111200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:33.113660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:33.143067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a1220-3605-48d0-b057-0c730990be12 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:33.284077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:33.291942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:33.292454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:33.293170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] PATH_INFO: `/v3/projects/fbd29ca239784dd5bc26cf0c1beef1bb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:33.295719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd29ca239784dd5bc26cf0c1beef1bb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:33.298419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:33.465124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd29ca239784dd5bc26cf0c1beef1bb', 'request_id': 'req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:33.473612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd29ca239784dd5bc26cf0c1beef1bb', 'request_id': 'req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:33.602643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd29ca239784dd5bc26cf0c1beef1bb', 'request_id': 'req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:33.622822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] The token cache is being invalidate because project fbd29ca239784dd5bc26cf0c1beef1bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:33.623395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:33.629594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a85e5e0-9ad2-4f64-a3fc-a1164dabf5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:33.635198 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3084/6251] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:33 2021] DELETE /identity/v3/projects/fbd29ca239784dd5bc26cf0c1beef1bb => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:33.643167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503b65-fdf7-4466-8d41-c7d48b68171b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:33.643167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503b65-fdf7-4466-8d41-c7d48b68171b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:33.643167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503b65-fdf7-4466-8d41-c7d48b68171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:33.676550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-46503b65-fdf7-4466-8d41-c7d48b68171b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:33.682114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-46503b65-fdf7-4466-8d41-c7d48b68171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:33.805246 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3168/6252] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:33.817118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f39ac-2f8e-4f20-8fe1-11979a34adef None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:33.817755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f39ac-2f8e-4f20-8fe1-11979a34adef None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:33.820050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f39ac-2f8e-4f20-8fe1-11979a34adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:33.857270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-db8f39ac-2f8e-4f20-8fe1-11979a34adef None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:33.858843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-db8f39ac-2f8e-4f20-8fe1-11979a34adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:33.869149 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3085/6253] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:33.873597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503b65-fdf7-4466-8d41-c7d48b68171b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:33.886589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503b65-fdf7-4466-8d41-c7d48b68171b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:33.893490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:33.901295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:33.901816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:33.902312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:33.903374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:33.903911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:33.906149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:33.923825 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3169/6254] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:30:33.925678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f39ac-2f8e-4f20-8fe1-11979a34adef None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:33.935339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f39ac-2f8e-4f20-8fe1-11979a34adef None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:33.940949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:33.941990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:33.942271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:33.942545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:33.943250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:33.945410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:34.070438 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3086/6255] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:33 2021] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:30:34.074691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:34.086570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8734d6-a240-4ad0-aea3-648d402fbb8e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:34.200664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:34.235358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:34.235824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:34.236111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:34.237717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:34.238990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:34.346239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3170/6256] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:34 2021] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:30:34.347958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:34.360663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0a53-81a2-4842-be90-eb4a2098a0c0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:34.368803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:34.369526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:34.370158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:34.370591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:34.371650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:34.373663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:34.390354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3087/6257] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:34.394498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:34.408363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631032-7763-4d91-8521-bb77c98e616e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:34.422093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c230fa-8dae-4488-95ff-0de40d4c6a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:34.422093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c230fa-8dae-4488-95ff-0de40d4c6a46 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:34.422434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c230fa-8dae-4488-95ff-0de40d4c6a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:34.422434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c230fa-8dae-4488-95ff-0de40d4c6a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:34.423351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c230fa-8dae-4488-95ff-0de40d4c6a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:34.425377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c230fa-8dae-4488-95ff-0de40d4c6a46 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:34.460079 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3171/6258] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:34 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:34.464328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:34.477172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822bb7-54a5-44ab-8782-97ce88eca8a8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:34.483092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:34.485883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:34.486362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:34.486805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] PATH_INFO: `/v3/projects/bb99b704ca5d4a59a8c04ff015c24dae/users/7943496bf92e4467af3ee9c4a68f4937/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:34.511588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb99b704ca5d4a59a8c04ff015c24dae, user_id=7943496bf92e4467af3ee9c4a68f4937, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:34.514718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:34.585903 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3088/6259] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:34 2021] PUT /identity/v3/projects/bb99b704ca5d4a59a8c04ff015c24dae/users/7943496bf92e4467af3ee9c4a68f4937/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:34.591165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:34.591456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:34.591734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:34.610608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:34.611880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:34.709704 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3172/6260] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:30:34.721975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:34.729188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:34.810722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0916-34ba-4bfa-b0bf-8b94ad64b366 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:34.823411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e8fb0-d6e6-484e-a9d9-2c29514a19d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:34.824403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8fb0-d6e6-484e-a9d9-2c29514a19d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:34.825096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8fb0-d6e6-484e-a9d9-2c29514a19d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:34.826706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8fb0-d6e6-484e-a9d9-2c29514a19d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:34.841787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e8fb0-d6e6-484e-a9d9-2c29514a19d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:34.843900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e8fb0-d6e6-484e-a9d9-2c29514a19d9 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:34.859613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3089/6261] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:41.773015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:41.774519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:41.786634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953d551-d2af-41cc-99ef-efae02b56620 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:41.792483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:41.793578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:41.793910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:41.794410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] PATH_INFO: `/v3/users/ceabeb375f8a45a6a40f08410b3b957d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:41.795800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceabeb375f8a45a6a40f08410b3b957d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:41.798756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:42.140361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceabeb375f8a45a6a40f08410b3b957d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:42.155612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceabeb375f8a45a6a40f08410b3b957d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:42.185095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceabeb375f8a45a6a40f08410b3b957d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:42.186171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceabeb375f8a45a6a40f08410b3b957d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:42.273735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceabeb375f8a45a6a40f08410b3b957d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:42.281255 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3173/6262] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:41 2021] DELETE /identity/v3/users/ceabeb375f8a45a6a40f08410b3b957d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:42.285761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:42.286203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:42.287034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:42.322100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:42.326273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:42.428437 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3090/6263] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:42.463962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:42.466201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:42.608209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4091-9fef-4813-87c6-3e8000aea6a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:42.621171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45ec14-e09a-4ae3-86b3-0b7bca2cfd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:42.621856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ec14-e09a-4ae3-86b3-0b7bca2cfd4e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:42.626771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ec14-e09a-4ae3-86b3-0b7bca2cfd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:42.626771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45ec14-e09a-4ae3-86b3-0b7bca2cfd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:42.644158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45ec14-e09a-4ae3-86b3-0b7bca2cfd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:42.646725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45ec14-e09a-4ae3-86b3-0b7bca2cfd4e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:42.659118 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3174/6264] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:44.122260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:44.123817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:44.148373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5da7d-200e-4873-8fd3-096c5f24276f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:44.155783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:44.157454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:44.158064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:44.158575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] PATH_INFO: `/v3/projects/3ed7adc4401942fb9b231240f1d89feb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:44.160729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed7adc4401942fb9b231240f1d89feb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:44.165147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:44.383561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed7adc4401942fb9b231240f1d89feb', 'request_id': 'req-b44907a7-bc29-4ddd-a093-d44329aab30d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:44.394876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed7adc4401942fb9b231240f1d89feb', 'request_id': 'req-b44907a7-bc29-4ddd-a093-d44329aab30d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:44.466564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed7adc4401942fb9b231240f1d89feb', 'request_id': 'req-b44907a7-bc29-4ddd-a093-d44329aab30d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:44.484008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] The token cache is being invalidate because project 3ed7adc4401942fb9b231240f1d89feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:44.484749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:44.485285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b44907a7-bc29-4ddd-a093-d44329aab30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:44.493788 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3091/6265] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:44 2021] DELETE /identity/v3/projects/3ed7adc4401942fb9b231240f1d89feb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:44.498767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94679e-95c7-4650-8136-4ddb48f017e6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:44.506988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94679e-95c7-4650-8136-4ddb48f017e6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:44.506988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94679e-95c7-4650-8136-4ddb48f017e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:44.563930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ff94679e-95c7-4650-8136-4ddb48f017e6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:44.570396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ff94679e-95c7-4650-8136-4ddb48f017e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:44.745667 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3175/6266] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:44.748065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930d0df-f4bc-4c86-8ee9-0fea52b6498c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:44.748619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930d0df-f4bc-4c86-8ee9-0fea52b6498c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:44.749156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930d0df-f4bc-4c86-8ee9-0fea52b6498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:44.781800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9930d0df-f4bc-4c86-8ee9-0fea52b6498c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:44.783814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9930d0df-f4bc-4c86-8ee9-0fea52b6498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:44.795330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3092/6267] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:44.801486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94679e-95c7-4650-8136-4ddb48f017e6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:44.846198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94679e-95c7-4650-8136-4ddb48f017e6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:44.865431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:44.866286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:44.866577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:44.866853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:44.867594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:44.867924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:44.869596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:44.905747 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3176/6268] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:44.916220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930d0df-f4bc-4c86-8ee9-0fea52b6498c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:44.929871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930d0df-f4bc-4c86-8ee9-0fea52b6498c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:44.935969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:44.937205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:44.938163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:44.938719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:44.940043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:44.943268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:45.045480 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3093/6269] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:44 2021] POST /identity/v3/projects => generated 359 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:45.049257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:45.061487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5c15f-54c0-4995-abcc-1240e97f843d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:45.190322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:45.191011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:45.191295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:45.191569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:45.193330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:45.198093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:45.362152 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3177/6270] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:45 2021] POST /identity/v3/users => generated 280 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:30:45.363447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:45.389024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d68f-33ff-4976-b2c2-c26a483844cc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:45.400967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:45.401873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:45.402325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:45.404319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:45.405212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:45.407794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:45.448247 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3094/6271] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:45.449583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:45.465556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba6b2-be18-4f40-8897-d1899a4c07ff admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:45.470479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec457a-ee6e-4a39-b483-45a976bdbc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:45.471359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec457a-ee6e-4a39-b483-45a976bdbc85 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:45.471711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec457a-ee6e-4a39-b483-45a976bdbc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:45.472087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec457a-ee6e-4a39-b483-45a976bdbc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:45.473129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec457a-ee6e-4a39-b483-45a976bdbc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:45.476397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec457a-ee6e-4a39-b483-45a976bdbc85 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:45.493943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3178/6272] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:45.495114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:45.511045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889964-73a7-4768-b790-ba16c93852db admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:45.517935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:45.519276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:45.519819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:45.520329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] PATH_INFO: `/v3/projects/6d0cbd460ab04073955f033f41540b9b/users/90d5f54671f94286a95621d48c10375e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:45.563442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0cbd460ab04073955f033f41540b9b, user_id=90d5f54671f94286a95621d48c10375e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:45.568948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:45.659138 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3095/6273] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:45 2021] PUT /identity/v3/projects/6d0cbd460ab04073955f033f41540b9b/users/90d5f54671f94286a95621d48c10375e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:45.675168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede94b-43d7-4c39-aecb-7b6af61b48ef None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:45.675620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede94b-43d7-4c39-aecb-7b6af61b48ef None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:45.675743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede94b-43d7-4c39-aecb-7b6af61b48ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:45.714194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a5ede94b-43d7-4c39-aecb-7b6af61b48ef None None] MFA Rules not processed for user `90d5f54671f94286a95621d48c10375e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:45.715840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5ede94b-43d7-4c39-aecb-7b6af61b48ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:45.847146 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3179/6274] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:45 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:45.878322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:45.881946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:46.044632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b530f-dfae-4a38-926f-6c9fadcd20f8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:46.057161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e08bc-edc5-4e3c-b385-857295fed34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:46.058402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e08bc-edc5-4e3c-b385-857295fed34f service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:46.060912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e08bc-edc5-4e3c-b385-857295fed34f service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:46.060912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e08bc-edc5-4e3c-b385-857295fed34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:46.078915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e08bc-edc5-4e3c-b385-857295fed34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:46.080396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e08bc-edc5-4e3c-b385-857295fed34f service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:46.096193 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3096/6275] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:45 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:46.119580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede94b-43d7-4c39-aecb-7b6af61b48ef None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:46.227408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede94b-43d7-4c39-aecb-7b6af61b48ef None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:46.233145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:46.234027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:46.234307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:46.237775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] PATH_INFO: `/v3/users/90d5f54671f94286a95621d48c10375e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:46.237775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d5f54671f94286a95621d48c10375e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:46.238002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:46.600681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:46.601710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:46.602452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:46.768637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] MFA Rules not processed for user `7943496bf92e4467af3ee9c4a68f4937`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:46.768637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:46.768637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3097/6276] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:46 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:30:46.768637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:46.768637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:46.769710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fd45a-6858-4399-b179-0945a733e217 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:46.775526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:46.776386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:46.776781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:46.777403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:46.778175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:46.780218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:47.015034 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3098/6277] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:46 2021] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:30:47.016295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:47.032090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d5f54671f94286a95621d48c10375e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:47.073582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d5f54671f94286a95621d48c10375e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:47.082056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b66f0-b245-42dc-a13e-d805b80b7fe5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:47.101677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:47.103828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:47.104099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:47.104377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:47.112206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:47.112206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:47.113396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d5f54671f94286a95621d48c10375e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:47.115769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d5f54671f94286a95621d48c10375e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:47.125713 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3099/6278] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:47.130258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:47.143021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afcd83-15f9-4b95-9254-4dedef6493de admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:47.149554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed8f30-1692-4f13-86a9-cd587880a247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:47.150805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed8f30-1692-4f13-86a9-cd587880a247 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:47.151120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed8f30-1692-4f13-86a9-cd587880a247 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:47.151448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed8f30-1692-4f13-86a9-cd587880a247 admin admin] PATH_INFO: `/v3/system/users/f085dfbc06b44670a4457b0e562f01b7/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:47.168393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed8f30-1692-4f13-86a9-cd587880a247 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f085dfbc06b44670a4457b0e562f01b7, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:47.170194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed8f30-1692-4f13-86a9-cd587880a247 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:47.232766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c95eeec3-85d2-408f-a444-bda547da1682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d5f54671f94286a95621d48c10375e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:47.240973 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3180/6279] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:46 2021] DELETE /identity/v3/users/90d5f54671f94286a95621d48c10375e => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:47.245911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:47.246195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:47.246543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:47.249830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3100/6280] 10.222.0.32 () {60 vars in 1377 bytes} [Sat Dec 25 21:30:47 2021] PUT /identity/v3/system/users/f085dfbc06b44670a4457b0e562f01b7/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:30:47.264989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02cbc-e9a4-4187-bad4-7860161a052c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:47.265275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02cbc-e9a4-4187-bad4-7860161a052c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:47.265725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02cbc-e9a4-4187-bad4-7860161a052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:47.297317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:47.302880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:47.349281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f6c02cbc-e9a4-4187-bad4-7860161a052c None None] MFA Rules not processed for user `f085dfbc06b44670a4457b0e562f01b7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:47.349777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f6c02cbc-e9a4-4187-bad4-7860161a052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:47.406376 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3181/6281] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:30:47.416259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:47.417947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:47.485121 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3101/6282] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:47 2021] POST /identity/v3/auth/tokens => generated 2404 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Dec 25 21:30:47.491186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02cbc-e9a4-4187-bad4-7860161a052c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:47.544947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c8942-e4f9-4bf4-a9ef-f5d17a63df8c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:47.553613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:47.554279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:47.554566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:47.554868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:47.575593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:47.578841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:47.592826 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3182/6283] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:30:47.631743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02cbc-e9a4-4187-bad4-7860161a052c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:47.675278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f085dfbc06b44670a4457b0e562f01b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:47.675736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:47.676028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:47.676311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:47.677112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:47.679097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:47.700655 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3102/6284] 10.222.0.32 () {58 vars in 1109 bytes} [Sat Dec 25 21:30:47 2021] GET /identity/v3/services => generated 2191 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:47.702741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:48.001716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a270fb-915f-4dd7-a10e-ac0a789cf94d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:48.121731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f085dfbc06b44670a4457b0e562f01b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:48.122471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:48.122713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:48.123188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] PATH_INFO: `/v3/limits` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:48.130282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:48.131946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:48.183614 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Dec 25 21:30:48.187385 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3183/6285] 10.222.0.32 () {60 vars in 1125 bytes} [Sat Dec 25 21:30:47 2021] POST /identity/v3/limits => generated 124 bytes in 485 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:30:48.192906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:48.404919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10587427-f663-4eb8-bb8e-c6c0fe1c933d None tempest-ImageQuotaTest-972885260-system-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:48.469310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:48.472170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:48.515642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e09ef-4dc8-45b4-8693-5cd35524d043 None tempest-ImageQuotaTest-972885260-system-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:48.522305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f085dfbc06b44670a4457b0e562f01b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:48.524446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:48.526626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:48.527630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:48.531000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:48.534606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:48.535665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:48.547399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:48.547942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:48.550234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] PATH_INFO: `/v3/projects/6d0cbd460ab04073955f033f41540b9b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:48.554015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0cbd460ab04073955f033f41540b9b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:48.556226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:48.573277 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3103/6286] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:30:48 2021] GET /identity/v3/registered_limits => generated 129 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:48.575410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:48.714288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84fb09-b9c1-4082-85e5-2c0843569891 None tempest-ImageQuotaTest-972885260-system-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:48.771546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0cbd460ab04073955f033f41540b9b', 'request_id': 'req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:48.775783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaff0d-bf00-4b96-8800-d7f5560bf7b5 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f085dfbc06b44670a4457b0e562f01b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:48.777006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaff0d-bf00-4b96-8800-d7f5560bf7b5 None tempest-ImageQuotaTest-972885260-system-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:48.777788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaff0d-bf00-4b96-8800-d7f5560bf7b5 None tempest-ImageQuotaTest-972885260-system-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:48.778308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaff0d-bf00-4b96-8800-d7f5560bf7b5 None tempest-ImageQuotaTest-972885260-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:48.779070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaff0d-bf00-4b96-8800-d7f5560bf7b5 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:48.780164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaff0d-bf00-4b96-8800-d7f5560bf7b5 None tempest-ImageQuotaTest-972885260-system-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:48.785645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3104/6287] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:30:48 2021] GET /identity/v3/registered_limits => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:48.923080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0cbd460ab04073955f033f41540b9b', 'request_id': 'req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:48.941170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0cbd460ab04073955f033f41540b9b', 'request_id': 'req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:48.966787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] The token cache is being invalidate because project 6d0cbd460ab04073955f033f41540b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:48.967206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:48.969153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-027b95c8-b38b-48b9-b5a8-ec2d9850a7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:48.976236 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3184/6288] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:48 2021] DELETE /identity/v3/projects/6d0cbd460ab04073955f033f41540b9b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:48.978124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dfbd2-4be4-41be-944b-8de20b398c21 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:48.978517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dfbd2-4be4-41be-944b-8de20b398c21 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:48.978964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dfbd2-4be4-41be-944b-8de20b398c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.005619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7e1dfbd2-4be4-41be-944b-8de20b398c21 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:49.008848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e1dfbd2-4be4-41be-944b-8de20b398c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:49.151892 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3105/6289] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:49.153873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b009-9188-4604-8ccf-0e0d0b8fb642 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.154327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b009-9188-4604-8ccf-0e0d0b8fb642 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.154656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b009-9188-4604-8ccf-0e0d0b8fb642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.189509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-86f8b009-9188-4604-8ccf-0e0d0b8fb642 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:49.189509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-86f8b009-9188-4604-8ccf-0e0d0b8fb642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:49.218782 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3185/6290] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:49.220417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dfbd2-4be4-41be-944b-8de20b398c21 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:49.234458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dfbd2-4be4-41be-944b-8de20b398c21 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:49.243469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:49.244266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.244783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.245172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.246157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:49.246621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:49.249686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:49.269819 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3106/6291] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:49.271562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8b009-9188-4604-8ccf-0e0d0b8fb642 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:49.288102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8b009-9188-4604-8ccf-0e0d0b8fb642 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:49.300419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:49.300419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.300419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.300419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.301392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:49.307281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:49.390342 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3186/6292] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:49 2021] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:49.391544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:49.411746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299c00-f94a-4549-ac04-62a5ed5704fb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:49.540074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:49.540952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.541242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.541520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.542232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:49.544179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:49.647837 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3107/6293] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:49 2021] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:49.651778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:49.674520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043aad-87c3-4fa6-a3a9-8d944af02444 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:49.683369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:49.684118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.686494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.686494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.686494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:49.687081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:49.713900 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3187/6294] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:49 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:49.715792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:49.727616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a808-696d-4a64-8f96-5d224cbaff2c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:49.733116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46503a40-97b9-4cf6-8dc1-5fb91f974f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:49.733910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503a40-97b9-4cf6-8dc1-5fb91f974f2d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.734323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503a40-97b9-4cf6-8dc1-5fb91f974f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.734726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46503a40-97b9-4cf6-8dc1-5fb91f974f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.735587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46503a40-97b9-4cf6-8dc1-5fb91f974f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:49.738224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46503a40-97b9-4cf6-8dc1-5fb91f974f2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:49.753708 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3108/6295] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:49 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:49.754921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:49.766832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b348-b889-4731-93d1-13e8d49e9428 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:49.779425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:49.780336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.780685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.781002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] PATH_INFO: `/v3/projects/d8f250b16290406fa59b0ad0129cee20/users/51b86762a6184cb29595cdcf520b4851/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.802446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f250b16290406fa59b0ad0129cee20, user_id=51b86762a6184cb29595cdcf520b4851, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:49.805319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:49.910073 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3188/6296] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:49 2021] PUT /identity/v3/projects/d8f250b16290406fa59b0ad0129cee20/users/51b86762a6184cb29595cdcf520b4851/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:49.921399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:49.922620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:49.922978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:49.980607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] MFA Rules not processed for user `51b86762a6184cb29595cdcf520b4851`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:49.982039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:50.131089 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3109/6297] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:50.140093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:50.140987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:50.356119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648307d-ec75-4a5e-a664-a81039b063bf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:50.370233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4967167-87cb-43b8-9829-b46ddfec121c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:50.370233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4967167-87cb-43b8-9829-b46ddfec121c service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:50.370233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4967167-87cb-43b8-9829-b46ddfec121c service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:50.370233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4967167-87cb-43b8-9829-b46ddfec121c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:50.406473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4967167-87cb-43b8-9829-b46ddfec121c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:50.410456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4967167-87cb-43b8-9829-b46ddfec121c service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:50.443419 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3189/6298] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:50 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:52.677608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:52.679084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:52.789560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14c58c-e816-4c9c-9d31-308c63d83b6d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:52.794914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:52.796072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:52.796678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:52.810726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] PATH_INFO: `/v3/users/42a8bf90ae324660abd7fa59d8d27e95` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:52.814726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a8bf90ae324660abd7fa59d8d27e95)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:52.817561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:53.135995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a8bf90ae324660abd7fa59d8d27e95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:53.147118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a8bf90ae324660abd7fa59d8d27e95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:53.163355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a8bf90ae324660abd7fa59d8d27e95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:53.164381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a8bf90ae324660abd7fa59d8d27e95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:53.165024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a8bf90ae324660abd7fa59d8d27e95'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:53.269026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3110/6299] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:52 2021] DELETE /identity/v3/users/42a8bf90ae324660abd7fa59d8d27e95 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:53.272447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:53.273453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:53.274028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:53.303220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:53.304607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:53.500184 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3190/6300] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:53.519601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:53.522094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:53.687391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01263e2-d738-4951-aa22-d0f64a11defc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:53.695688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424faca-117c-4ef4-914e-059e6e62f314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:53.699455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424faca-117c-4ef4-914e-059e6e62f314 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:53.699455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424faca-117c-4ef4-914e-059e6e62f314 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:53.699455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424faca-117c-4ef4-914e-059e6e62f314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:53.717047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424faca-117c-4ef4-914e-059e6e62f314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:53.718142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424faca-117c-4ef4-914e-059e6e62f314 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:53.735086 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3111/6301] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:54.425034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:54.427869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:54.455716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae592863-b74f-4089-b124-ac54e78c1b69 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:54.465655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:54.466903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:54.467355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:54.467638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] PATH_INFO: `/v3/projects/a80fe923d39349348137639eb937eac1` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:54.469431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80fe923d39349348137639eb937eac1)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:54.471395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:54.757601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80fe923d39349348137639eb937eac1', 'request_id': 'req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:54.912568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80fe923d39349348137639eb937eac1', 'request_id': 'req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:54.928491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80fe923d39349348137639eb937eac1', 'request_id': 'req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:54.940577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] The token cache is being invalidate because project a80fe923d39349348137639eb937eac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:54.949047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:54.949047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-116072d4-ce5f-44c4-8aaa-4342ba6e9a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:54.949047 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3191/6302] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:54 2021] DELETE /identity/v3/projects/a80fe923d39349348137639eb937eac1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:54.951198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694e954-a799-42ae-84f2-84f8343765c9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:54.951992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694e954-a799-42ae-84f2-84f8343765c9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:54.952438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694e954-a799-42ae-84f2-84f8343765c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:54.982556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1694e954-a799-42ae-84f2-84f8343765c9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:54.983817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1694e954-a799-42ae-84f2-84f8343765c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:55.053668 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3112/6303] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:55.063485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe23d9-9cbe-4630-bbaf-072be6ec17e7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.063985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe23d9-9cbe-4630-bbaf-072be6ec17e7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.064458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe23d9-9cbe-4630-bbaf-072be6ec17e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.089958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-14fe23d9-9cbe-4630-bbaf-072be6ec17e7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:55.091576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-14fe23d9-9cbe-4630-bbaf-072be6ec17e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:55.111544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694e954-a799-42ae-84f2-84f8343765c9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:55.116785 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3192/6304] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:55.135980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694e954-a799-42ae-84f2-84f8343765c9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:55.161828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:55.162513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.163167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.163709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.164466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:55.164776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:55.166426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:55.219035 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3113/6305] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:55.225590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe23d9-9cbe-4630-bbaf-072be6ec17e7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:55.243418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe23d9-9cbe-4630-bbaf-072be6ec17e7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:55.259129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:55.259909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.273265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.274499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.275311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:55.279961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:55.425376 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3193/6306] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:55 2021] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:55.431022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:55.444823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483e3c-0d87-4794-a4e2-998cf7ad244b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:55.514752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:55.515420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.515698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.516187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.516709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:55.518703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:55.550192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:55.552046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:55.575449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a73b5e-f282-4e2e-84cd-6dbf817191a1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:55.585594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:55.586807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.597603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.597603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] PATH_INFO: `/v3/users/7943496bf92e4467af3ee9c4a68f4937` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.597603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7943496bf92e4467af3ee9c4a68f4937)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:55.597932 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3114/6307] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:55 2021] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:30:55.597932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:55.598119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:55.616696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14304b51-84eb-48a5-8596-6da2608a07bb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:55.637497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:55.638301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.639090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.639860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.640738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:55.642632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:55.659125 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3115/6308] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:55 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:55.663594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:55.680517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811596f4-dae2-45ca-9fa4-e8bf47b72437 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:55.686004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:55.687362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.687836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.688548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.689671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:55.691501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:55.709278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3116/6309] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:55 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:55.712444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:55.727621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637b08c-44ad-44e4-bc8c-292a05049951 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:55.731391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198826f7-7663-4f7b-b06d-c3eca0c0e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:55.732499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198826f7-7663-4f7b-b06d-c3eca0c0e653 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.732782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198826f7-7663-4f7b-b06d-c3eca0c0e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.733086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198826f7-7663-4f7b-b06d-c3eca0c0e653 admin admin] PATH_INFO: `/v3/projects/c0d0e3600dcf4248a0b8b2f426a7b538/users/3675c1599f3544aabd161d1917154edf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.751775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198826f7-7663-4f7b-b06d-c3eca0c0e653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d0e3600dcf4248a0b8b2f426a7b538, user_id=3675c1599f3544aabd161d1917154edf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:55.755569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198826f7-7663-4f7b-b06d-c3eca0c0e653 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:55.817376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7943496bf92e4467af3ee9c4a68f4937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:55.830961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7943496bf92e4467af3ee9c4a68f4937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:55.841201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7943496bf92e4467af3ee9c4a68f4937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:55.841941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7943496bf92e4467af3ee9c4a68f4937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:55.884006 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3117/6310] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:55 2021] PUT /identity/v3/projects/c0d0e3600dcf4248a0b8b2f426a7b538/users/3675c1599f3544aabd161d1917154edf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:55.894223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:55.894507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:55.895480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:55.925182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] MFA Rules not processed for user `3675c1599f3544aabd161d1917154edf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:55.926540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:56.025409 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3118/6311] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:55 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:56.033625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:56.035232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:56.050643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7943496bf92e4467af3ee9c4a68f4937'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:56.059912 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3194/6312] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:55 2021] DELETE /identity/v3/users/7943496bf92e4467af3ee9c4a68f4937 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:30:56.151998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17702-67a0-4c6a-b324-18cf4d929918 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:56.285050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:56.286921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:56.287210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:56.287486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:56.291068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:56.420582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:56.423049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:56.435956 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3119/6313] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:56 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:56.452358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:56.453864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:56.534156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ab10b-69c6-41c6-98cf-63d0664a014e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:56.540663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:56.542093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:56.542629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:56.543101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] PATH_INFO: `/v3/users/3675c1599f3544aabd161d1917154edf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:56.545054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3675c1599f3544aabd161d1917154edf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:56.547366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:56.752505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3675c1599f3544aabd161d1917154edf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:56.761362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3675c1599f3544aabd161d1917154edf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:56.777999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:56.779481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:56.783798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3675c1599f3544aabd161d1917154edf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:56.784684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3675c1599f3544aabd161d1917154edf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:56.813901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704f97-a9ed-4c08-b0fc-61905a1aa93b service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:56.815514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:56.816497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:56.818973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:56.819395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] PATH_INFO: `/v3/projects/bb99b704ca5d4a59a8c04ff015c24dae` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:56.821712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb99b704ca5d4a59a8c04ff015c24dae)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:56.825129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:56.866605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a75050b5-ddf4-4856-9f81-9c2d6b7247d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3675c1599f3544aabd161d1917154edf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:56.882109 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3195/6314] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:56 2021] DELETE /identity/v3/users/3675c1599f3544aabd161d1917154edf => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:56.886407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:56.886668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:56.886901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:56.929613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:56.929613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:56.977654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb99b704ca5d4a59a8c04ff015c24dae', 'request_id': 'req-6376eb8a-5ebb-4b84-9f81-6135216670c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:56.984210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb99b704ca5d4a59a8c04ff015c24dae', 'request_id': 'req-6376eb8a-5ebb-4b84-9f81-6135216670c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.072102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb99b704ca5d4a59a8c04ff015c24dae', 'request_id': 'req-6376eb8a-5ebb-4b84-9f81-6135216670c1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.073604 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3196/6315] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:30:57.084587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:57.087372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:57.095179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] The token cache is being invalidate because project bb99b704ca5d4a59a8c04ff015c24dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:57.095780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.096812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.099665 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3120/6316] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:56 2021] DELETE /identity/v3/projects/bb99b704ca5d4a59a8c04ff015c24dae => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:30:57.107995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:57.110651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:57.206234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d6d5-be7a-43f0-9a8c-c2361630b05a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:57.213087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376eb8a-5ebb-4b84-9f81-6135216670c1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:57.230879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:57.231832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:57.232118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:57.232397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] PATH_INFO: `/v3/users/f085dfbc06b44670a4457b0e562f01b7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:57.234200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f085dfbc06b44670a4457b0e562f01b7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:57.236288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:57.286872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:57.287510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:57.287797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:57.288076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:57.290329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:57.304183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:57.305771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:57.317442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3197/6317] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:30:57.480185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f085dfbc06b44670a4457b0e562f01b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.489225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f085dfbc06b44670a4457b0e562f01b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.507097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f085dfbc06b44670a4457b0e562f01b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.507946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f085dfbc06b44670a4457b0e562f01b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.508698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f085dfbc06b44670a4457b0e562f01b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:57.625183 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3121/6318] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:30:57 2021] DELETE /identity/v3/users/f085dfbc06b44670a4457b0e562f01b7 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:57.891245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:57.892727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:57.906651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9899db6-0571-4632-be53-28fa8d7c461e service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:58.060679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:58.061794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.062235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.062603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] PATH_INFO: `/v3/projects/c0d0e3600dcf4248a0b8b2f426a7b538` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.064249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d0e3600dcf4248a0b8b2f426a7b538)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:58.066499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:58.303335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d0e3600dcf4248a0b8b2f426a7b538', 'request_id': 'req-01a3445b-f01e-4ca5-b802-36a370aa0d6f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:58.376842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:58.378369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:58.391927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d0e3600dcf4248a0b8b2f426a7b538', 'request_id': 'req-01a3445b-f01e-4ca5-b802-36a370aa0d6f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:58.402894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d0e3600dcf4248a0b8b2f426a7b538', 'request_id': 'req-01a3445b-f01e-4ca5-b802-36a370aa0d6f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:58.403513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2710-415f-4b38-92ec-085400bcf26e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:58.420919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] The token cache is being invalidate because project c0d0e3600dcf4248a0b8b2f426a7b538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:30:58.421454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:58.422294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01a3445b-f01e-4ca5-b802-36a370aa0d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:30:58.424793 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3198/6319] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:30:57 2021] DELETE /identity/v3/projects/c0d0e3600dcf4248a0b8b2f426a7b538 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:58.430360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e94c-9f88-4c15-a390-d02ffb7c1b05 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.430765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e94c-9f88-4c15-a390-d02ffb7c1b05 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.431518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e94c-9f88-4c15-a390-d02ffb7c1b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.461896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1777e94c-9f88-4c15-a390-d02ffb7c1b05 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:58.464370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1777e94c-9f88-4c15-a390-d02ffb7c1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:58.511293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301218ce-1c2a-4f9e-93b0-09bc73fcad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:58.512408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301218ce-1c2a-4f9e-93b0-09bc73fcad2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.512949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301218ce-1c2a-4f9e-93b0-09bc73fcad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.513670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301218ce-1c2a-4f9e-93b0-09bc73fcad2c admin admin] PATH_INFO: `/v3/projects/None` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.527043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301218ce-1c2a-4f9e-93b0-09bc73fcad2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:58.529277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301218ce-1c2a-4f9e-93b0-09bc73fcad2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:58.549602 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-301218ce-1c2a-4f9e-93b0-09bc73fcad2c admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Dec 25 21:30:58.552613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3122/6320] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:30:58 2021] DELETE /identity/v3/projects/None => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 25 21:30:58.560797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb13f8-e643-4af6-ba0e-3b5f7ddb5589 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.564647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb13f8-e643-4af6-ba0e-3b5f7ddb5589 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.566068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb13f8-e643-4af6-ba0e-3b5f7ddb5589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.602758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-65eb13f8-e643-4af6-ba0e-3b5f7ddb5589 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:58.604184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-65eb13f8-e643-4af6-ba0e-3b5f7ddb5589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:58.635176 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3199/6321] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:58.645210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b338-f5a2-4808-8eac-ba8fa6dc1bff None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.646471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b338-f5a2-4808-8eac-ba8fa6dc1bff None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.646770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70b338-f5a2-4808-8eac-ba8fa6dc1bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.651280 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3123/6322] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:58.664345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d432e-f4c4-4ef2-93bc-286fc6dad972 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.664946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d432e-f4c4-4ef2-93bc-286fc6dad972 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.665380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d432e-f4c4-4ef2-93bc-286fc6dad972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.690567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bf7d432e-f4c4-4ef2-93bc-286fc6dad972 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:58.692727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bf7d432e-f4c4-4ef2-93bc-286fc6dad972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:58.702172 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3124/6323] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:30:58.707832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dc70b338-f5a2-4808-8eac-ba8fa6dc1bff None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:58.708274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d432e-f4c4-4ef2-93bc-286fc6dad972 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:58.710284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dc70b338-f5a2-4808-8eac-ba8fa6dc1bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:58.725497 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3200/6324] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:58.726900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b338-f5a2-4808-8eac-ba8fa6dc1bff None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:58.731023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d432e-f4c4-4ef2-93bc-286fc6dad972 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:58.739656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:58.740691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.741153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.741548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.742682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:58.743110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:58.745429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:58.762539 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3125/6325] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:58.765791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70b338-f5a2-4808-8eac-ba8fa6dc1bff None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:58.770010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:58.778367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:58.779311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.779768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.780220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.781158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:30:58.783437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:58.787640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:58.797439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9b620-388b-4c7a-86ff-98a6b17e914a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:58.805182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:58.806543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.806975 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3201/6326] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:30:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:30:58.807148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.807564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.808436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:58.810873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:58.812542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:58.841316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba3124-4422-418c-83c6-64bde3775824 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:58.847308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:58.848788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:58.851992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:58.851992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:58.852422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:58.854328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:58.978057 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3126/6327] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:58 2021] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:58.986769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.016595 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3202/6328] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:30:58 2021] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:59.018943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.090609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fddf31-9fb1-47a6-b41d-84582e1f1bb5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.135012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b5890-b4f2-4866-8486-88af7322e3f8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.143582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.145923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.146185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.146458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.147300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.149312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.168323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.169420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.170193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.170673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.172652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.175183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.235594 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3203/6329] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:59 2021] POST /identity/v3/users => generated 281 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:59.240424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.257955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96151ae8-256e-4202-bed4-4fbb3964fec2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.264334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.265308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.266377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.266735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.267705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.269448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.282676 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3204/6330] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:59 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:59.288357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.304225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3127/6331] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:30:58 2021] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:30:59.306407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084430de-90f6-4bee-872f-9f821513c9fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.308917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.317620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.319077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.320225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.320522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.321404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.323269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.325761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd37e-711f-4dc7-b79b-8e185fb8bddf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.342951 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3205/6332] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:59 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:59.343625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.344400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.344683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.345295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.345724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.347312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.350094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.365775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d97bf-f537-410f-a3aa-b7dd15cfd87f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.370924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3128/6333] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:59 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:30:59.375574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.376570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e40a83-6cf1-4cb4-a235-3019385ac17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.377490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40a83-6cf1-4cb4-a235-3019385ac17c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.377760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40a83-6cf1-4cb4-a235-3019385ac17c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.378031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e40a83-6cf1-4cb4-a235-3019385ac17c admin admin] PATH_INFO: `/v3/projects/0e7617b28f94425bbcf599d545e4f87e/users/43721dc50da84b93afb8046c4582b6ff/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.397731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b82b8f-6bac-479a-8ff6-ead3282e4097 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.408230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.408893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.414155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.414155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.414478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e40a83-6cf1-4cb4-a235-3019385ac17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7617b28f94425bbcf599d545e4f87e, user_id=43721dc50da84b93afb8046c4582b6ff, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.414569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.417012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.418979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e40a83-6cf1-4cb4-a235-3019385ac17c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.432457 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3129/6334] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:30:59 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:30:59.436229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.449098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c4e99-51b5-4003-b53d-0712779445d7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.479699 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3206/6335] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:59 2021] PUT /identity/v3/projects/0e7617b28f94425bbcf599d545e4f87e/users/43721dc50da84b93afb8046c4582b6ff/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:30:59.480636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f3d81-df7f-4590-9798-98e90920f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.489066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3d81-df7f-4590-9798-98e90920f838 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.489066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3d81-df7f-4590-9798-98e90920f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.489066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3d81-df7f-4590-9798-98e90920f838 admin admin] PATH_INFO: `/v3/projects/c77dc74a46d64a67991d82bf12adb1dc/users/171c198b6b734cd698b3c1eaf76a0234/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.497021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.497021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.497021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.534966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f3d81-df7f-4590-9798-98e90920f838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77dc74a46d64a67991d82bf12adb1dc, user_id=171c198b6b734cd698b3c1eaf76a0234, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.539462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f3d81-df7f-4590-9798-98e90920f838 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.565550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] MFA Rules not processed for user `43721dc50da84b93afb8046c4582b6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:59.579614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:59.644530 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3130/6336] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:30:59 2021] PUT /identity/v3/projects/c77dc74a46d64a67991d82bf12adb1dc/users/171c198b6b734cd698b3c1eaf76a0234/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:30:59.651192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919669-16bc-42e7-a8c4-6b934a7b3ff4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.651774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919669-16bc-42e7-a8c4-6b934a7b3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.652218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0919669-16bc-42e7-a8c4-6b934a7b3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.698436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c0919669-16bc-42e7-a8c4-6b934a7b3ff4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:30:59.704548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c0919669-16bc-42e7-a8c4-6b934a7b3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:59.713686 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3207/6337] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:59 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:59.733490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.736932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:30:59.820403 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3131/6338] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:30:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:30:59.832399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0919669-16bc-42e7-a8c4-6b934a7b3ff4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:30:59.845184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b48ec-55ee-4969-9d74-caeab0722575 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.911971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0919669-16bc-42e7-a8c4-6b934a7b3ff4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:30:59.915950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.916712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.916950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.917207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.923540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb77b35-f0a9-424c-8c15-cccaaa39caaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:30:59.926332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77b35-f0a9-424c-8c15-cccaaa39caaf service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:30:59.926332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77b35-f0a9-424c-8c15-cccaaa39caaf service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:30:59.926332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77b35-f0a9-424c-8c15-cccaaa39caaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:30:59.927864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:30:59.929638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:30:59.942511 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3132/6339] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:31:00.002870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb77b35-f0a9-424c-8c15-cccaaa39caaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:00.004941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb77b35-f0a9-424c-8c15-cccaaa39caaf service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:00.016189 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3208/6340] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:30:59 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:03.742862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:03.746954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:03.773839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3cf4-bec7-48a8-8033-870bd43cf613 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:03.788430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:03.789369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:03.789654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:03.789934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] PATH_INFO: `/v3/users/2ce1d9a465f54f46af59b1089007008c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:03.791686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce1d9a465f54f46af59b1089007008c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:03.793723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:04.070395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce1d9a465f54f46af59b1089007008c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:04.107007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce1d9a465f54f46af59b1089007008c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:04.115514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce1d9a465f54f46af59b1089007008c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:04.116656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce1d9a465f54f46af59b1089007008c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:04.116972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce1d9a465f54f46af59b1089007008c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:04.212474 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3133/6341] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:03 2021] DELETE /identity/v3/users/2ce1d9a465f54f46af59b1089007008c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:04.217445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:04.218298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:04.218732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:04.271165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:04.272618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:04.431962 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3209/6342] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:04.576418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:04.578510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:04.755535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555474a2-7c81-4cb9-a227-36acf7c4401c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:04.777734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:04.778424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:04.778717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:04.778995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:04.799286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:04.801372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:04.818798 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3134/6343] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:31:06.681943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:06.684393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:06.705414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27abbe-a1cf-40ea-9f8e-73e3be6f16af None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:06.717508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:06.718814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:06.719341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:06.719829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] PATH_INFO: `/v3/projects/13413b6e22ac4d319f142d01c6f58fbb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:06.731612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13413b6e22ac4d319f142d01c6f58fbb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:06.739377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:07.022376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13413b6e22ac4d319f142d01c6f58fbb', 'request_id': 'req-26ff8f5b-9f37-4101-906c-1620cfb7e22d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.146875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13413b6e22ac4d319f142d01c6f58fbb', 'request_id': 'req-26ff8f5b-9f37-4101-906c-1620cfb7e22d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.167819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13413b6e22ac4d319f142d01c6f58fbb', 'request_id': 'req-26ff8f5b-9f37-4101-906c-1620cfb7e22d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.235200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] The token cache is being invalidate because project 13413b6e22ac4d319f142d01c6f58fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:07.237402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.242465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.251136 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3210/6344] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:06 2021] DELETE /identity/v3/projects/13413b6e22ac4d319f142d01c6f58fbb => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:07.255427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:07.276210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300bbee-f778-4583-9010-1e6617d911bf service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:07.414307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:07.415459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:07.415895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:07.416321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] PATH_INFO: `/v3/users/c833baac62ad4020936455852e507eca` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:07.417959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c833baac62ad4020936455852e507eca)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:07.420166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:07.707909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c833baac62ad4020936455852e507eca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.742012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c833baac62ad4020936455852e507eca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.780575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c833baac62ad4020936455852e507eca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.784263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c833baac62ad4020936455852e507eca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.786834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c833baac62ad4020936455852e507eca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:07.880133 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3135/6345] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:07 2021] DELETE /identity/v3/users/c833baac62ad4020936455852e507eca => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:09.477383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:09.480091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:09.493713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:09.495851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:09.622414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd8400-e1b3-430f-82e3-382250196887 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:09.637402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff8f5b-9f37-4101-906c-1620cfb7e22d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:09.645414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:09.646295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:09.646819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:09.647882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] PATH_INFO: `/v3/projects/29500fa7f2f34192bb55987623afabf2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:09.649513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29500fa7f2f34192bb55987623afabf2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:09.652187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:09.720362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769ad3-1ca9-43a7-9201-7b3ceab1f442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:09.721057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769ad3-1ca9-43a7-9201-7b3ceab1f442 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:09.721522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769ad3-1ca9-43a7-9201-7b3ceab1f442 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:09.721957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769ad3-1ca9-43a7-9201-7b3ceab1f442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:09.725151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1c769ad3-1ca9-43a7-9201-7b3ceab1f442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:09.745949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769ad3-1ca9-43a7-9201-7b3ceab1f442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:09.748042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769ad3-1ca9-43a7-9201-7b3ceab1f442 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:09.768998 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3211/6346] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:09.814936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29500fa7f2f34192bb55987623afabf2', 'request_id': 'req-7d41e132-9ebd-4c73-8220-7a191fe47f54'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:09.826394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29500fa7f2f34192bb55987623afabf2', 'request_id': 'req-7d41e132-9ebd-4c73-8220-7a191fe47f54'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:09.889896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29500fa7f2f34192bb55987623afabf2', 'request_id': 'req-7d41e132-9ebd-4c73-8220-7a191fe47f54'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:09.941075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] The token cache is being invalidate because project 29500fa7f2f34192bb55987623afabf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:09.941758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:09.943479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7d41e132-9ebd-4c73-8220-7a191fe47f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:09.954353 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3136/6347] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:09 2021] DELETE /identity/v3/projects/29500fa7f2f34192bb55987623afabf2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:31:09.961695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8a4c-18b9-47b1-998e-27b99f12586f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:09.962213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8a4c-18b9-47b1-998e-27b99f12586f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:09.962697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee8a4c-18b9-47b1-998e-27b99f12586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:10.004093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-adee8a4c-18b9-47b1-998e-27b99f12586f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:10.005826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-adee8a4c-18b9-47b1-998e-27b99f12586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:10.110305 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3212/6348] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:10.118426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668972b-348a-4840-b18e-e22cbc78adad None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:10.118961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668972b-348a-4840-b18e-e22cbc78adad None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:10.119523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668972b-348a-4840-b18e-e22cbc78adad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:10.150464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0668972b-348a-4840-b18e-e22cbc78adad None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:10.152352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0668972b-348a-4840-b18e-e22cbc78adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:10.172528 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3137/6349] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:10.176914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee8a4c-18b9-47b1-998e-27b99f12586f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:10.194476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee8a4c-18b9-47b1-998e-27b99f12586f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:10.203185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:10.204641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:10.205053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:10.205427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:10.206557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:10.207613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:10.210343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:10.242371 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3213/6350] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:31:10.243393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668972b-348a-4840-b18e-e22cbc78adad None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:10.261874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668972b-348a-4840-b18e-e22cbc78adad None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:10.272303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:10.274025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:10.274709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:10.275244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:10.282254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:10.288076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:10.452929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3138/6351] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:10 2021] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:10.456249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:10.514863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb6fd1-5fd7-41b9-b0c5-b2edf8a46642 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:10.749447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:10.751667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:10.752276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:10.752758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:10.754084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:10.763088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:10.917771 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3214/6352] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:10 2021] POST /identity/v3/users => generated 293 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:10.922821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:10.939469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bdaec-dd24-4e5e-9a17-a7404d0ec35c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:10.954348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:10.955494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:10.955927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:10.956355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:10.958439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:10.960244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:10.987483 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3139/6353] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:10 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:10.991128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:11.012643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d144e2-0ff1-4efb-8e29-eddcfa041820 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:11.020753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eb4ef-9fb0-40fe-91eb-556eaee56741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:11.022267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb4ef-9fb0-40fe-91eb-556eaee56741 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:11.023153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb4ef-9fb0-40fe-91eb-556eaee56741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:11.024021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eb4ef-9fb0-40fe-91eb-556eaee56741 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:11.026999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eb4ef-9fb0-40fe-91eb-556eaee56741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:11.028837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52eb4ef-9fb0-40fe-91eb-556eaee56741 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:11.048173 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3215/6354] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:10 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:31:11.049936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:11.070967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824ca32-6545-4a63-b6da-2f13b0f92f41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:11.079578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:11.080982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:11.081278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:11.081693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] PATH_INFO: `/v3/projects/6711625167a8423786a2f4e0ccd4c2de/users/d437861f5af24458a875bb112ef77ff5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:11.109545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6711625167a8423786a2f4e0ccd4c2de, user_id=d437861f5af24458a875bb112ef77ff5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:11.114298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:11.230629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016a67-22d3-4aeb-bc4c-1f3933d66bcc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:11.231320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016a67-22d3-4aeb-bc4c-1f3933d66bcc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:11.231806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016a67-22d3-4aeb-bc4c-1f3933d66bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:11.233560 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3140/6355] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:11 2021] PUT /identity/v3/projects/6711625167a8423786a2f4e0ccd4c2de/users/d437861f5af24458a875bb112ef77ff5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:31:11.267159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9b016a67-22d3-4aeb-bc4c-1f3933d66bcc None None] MFA Rules not processed for user `d437861f5af24458a875bb112ef77ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:11.268789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9b016a67-22d3-4aeb-bc4c-1f3933d66bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:11.383529 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3216/6356] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:11 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:11.390609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:11.393695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:11.474557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1021-3b35-44b8-a04f-aab5338bdce9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:11.480590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387adbeb-3df6-4d9b-bff2-831d0ade524a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:11.481623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adbeb-3df6-4d9b-bff2-831d0ade524a service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:11.482016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adbeb-3df6-4d9b-bff2-831d0ade524a service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:11.482296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387adbeb-3df6-4d9b-bff2-831d0ade524a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:11.499335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387adbeb-3df6-4d9b-bff2-831d0ade524a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:11.501307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387adbeb-3df6-4d9b-bff2-831d0ade524a service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:11.528128 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3141/6357] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:11 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:11.541983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016a67-22d3-4aeb-bc4c-1f3933d66bcc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:11.691299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016a67-22d3-4aeb-bc4c-1f3933d66bcc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:11.705882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:11.707698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:11.708173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:11.709299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] PATH_INFO: `/v3/users/d437861f5af24458a875bb112ef77ff5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:11.710781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d437861f5af24458a875bb112ef77ff5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:11.713162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:12.042604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd437861f5af24458a875bb112ef77ff5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:12.072102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd437861f5af24458a875bb112ef77ff5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:12.101206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd437861f5af24458a875bb112ef77ff5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:12.102357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd437861f5af24458a875bb112ef77ff5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:12.157587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd437861f5af24458a875bb112ef77ff5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:12.166318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3217/6358] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:11 2021] DELETE /identity/v3/users/d437861f5af24458a875bb112ef77ff5 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:12.171342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe282-c6d2-4aee-8e89-c618637faf25 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:12.172168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe282-c6d2-4aee-8e89-c618637faf25 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:12.172665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe282-c6d2-4aee-8e89-c618637faf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:12.210324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fcafe282-c6d2-4aee-8e89-c618637faf25 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:12.211962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fcafe282-c6d2-4aee-8e89-c618637faf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:12.361857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3142/6359] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:12.381331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:12.383031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:12.531149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea1968-b3e8-4684-9eb2-dfb00f41463b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:12.536796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:12.537712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:12.538212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:12.538819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:12.549456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:12.551915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:12.564709 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3218/6360] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:12.709889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ce1-ae89-4253-a52a-8cdcec160c74 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:12.710229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ce1-ae89-4253-a52a-8cdcec160c74 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:12.710514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ce1-ae89-4253-a52a-8cdcec160c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:12.804007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-45fc9ce1-ae89-4253-a52a-8cdcec160c74 None None] MFA Rules not processed for user `171c198b6b734cd698b3c1eaf76a0234`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:12.805829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-45fc9ce1-ae89-4253-a52a-8cdcec160c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:13.015692 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3143/6361] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:12 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:13.021459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:13.022978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:13.044625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4cd2d-5303-4c4c-9994-383e2af2b80a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:13.050591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:13.051823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:13.052315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:13.052790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:13.053842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:13.062718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:13.265500 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3219/6362] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:13 2021] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:13.269619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc9ce1-ae89-4253-a52a-8cdcec160c74 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:13.296862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc9ce1-ae89-4253-a52a-8cdcec160c74 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:13.446986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:13.447688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:13.447974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:13.448251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:13.448990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:13.450928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:13.540585 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3144/6363] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:13 2021] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:13.541096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:13.553487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1480b20-695e-4972-babc-623e275a68ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:13.560775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:13.563777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:13.563777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:13.563777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:13.563777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:13.570857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:13.586718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3220/6364] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:13 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:13.592067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:13.609763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36877199-cf8e-40f8-b311-0b6b4b793673 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:13.619896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:13.625459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:13.626391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:13.627012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] PATH_INFO: `/v3/projects/682ce12dc98b4f82b95ff686c0e788d8/users/3f7bfbe1464a4466b395dbc35592d7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:13.668930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682ce12dc98b4f82b95ff686c0e788d8, user_id=3f7bfbe1464a4466b395dbc35592d7dd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:13.671674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:13.766632 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3145/6365] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:13 2021] PUT /identity/v3/projects/682ce12dc98b4f82b95ff686c0e788d8/users/3f7bfbe1464a4466b395dbc35592d7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:13.771609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:13.788822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f9600-0552-44c5-80e7-82142def27a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:13.913961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:13.916070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:13.916070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:13.916535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:13.920536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:13.922891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:13.963577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3221/6366] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:13 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:13.970071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:13.981739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778868e0-03ea-4e3e-9d24-a9d1d73406c2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:13.987882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3071d-295f-4844-b77b-1dc770c1f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:13.988949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3071d-295f-4844-b77b-1dc770c1f3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:13.989342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3071d-295f-4844-b77b-1dc770c1f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:13.989714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3071d-295f-4844-b77b-1dc770c1f3f2 admin admin] PATH_INFO: `/v3/projects/682ce12dc98b4f82b95ff686c0e788d8/users/3f7bfbe1464a4466b395dbc35592d7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:13.992107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3071d-295f-4844-b77b-1dc770c1f3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682ce12dc98b4f82b95ff686c0e788d8, user_id=3f7bfbe1464a4466b395dbc35592d7dd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:13.996421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3071d-295f-4844-b77b-1dc770c1f3f2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:14.013731 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3146/6367] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:13 2021] PUT /identity/v3/projects/682ce12dc98b4f82b95ff686c0e788d8/users/3f7bfbe1464a4466b395dbc35592d7dd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:14.068346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:14.070701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:14.099604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7302-cdb2-4aea-8b9f-be556a912262 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:14.243144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:14.245061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:14.245647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:14.246494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] PATH_INFO: `/v3/projects/6711625167a8423786a2f4e0ccd4c2de` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:14.249837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6711625167a8423786a2f4e0ccd4c2de)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:14.250637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:14.454023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6711625167a8423786a2f4e0ccd4c2de', 'request_id': 'req-5db0f2f6-1023-474a-8f11-841bfe812a53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:14.533928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6711625167a8423786a2f4e0ccd4c2de', 'request_id': 'req-5db0f2f6-1023-474a-8f11-841bfe812a53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:14.543237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6711625167a8423786a2f4e0ccd4c2de', 'request_id': 'req-5db0f2f6-1023-474a-8f11-841bfe812a53'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:14.578018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] The token cache is being invalidate because project 6711625167a8423786a2f4e0ccd4c2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:14.579392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:14.582792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5db0f2f6-1023-474a-8f11-841bfe812a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:14.585386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3222/6368] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:14 2021] DELETE /identity/v3/projects/6711625167a8423786a2f4e0ccd4c2de => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:14.591750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d7ac-d975-4deb-92ab-d350ca5898a1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:14.592589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d7ac-d975-4deb-92ab-d350ca5898a1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:14.593137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28d7ac-d975-4deb-92ab-d350ca5898a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:14.635991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7b28d7ac-d975-4deb-92ab-d350ca5898a1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:14.637253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7b28d7ac-d975-4deb-92ab-d350ca5898a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:14.784613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3147/6369] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:14.794092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ee86-798d-42b1-bd48-df142a579e76 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:14.794612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ee86-798d-42b1-bd48-df142a579e76 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:14.795053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ee86-798d-42b1-bd48-df142a579e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:14.837371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9543ee86-798d-42b1-bd48-df142a579e76 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:14.841649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9543ee86-798d-42b1-bd48-df142a579e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:14.885437 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3223/6370] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:14.889292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d7ac-d975-4deb-92ab-d350ca5898a1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:14.907763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28d7ac-d975-4deb-92ab-d350ca5898a1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:14.915464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:14.918749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:14.918749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:14.918749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:14.963924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:14.965408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:14.974090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:15.007567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3148/6371] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:31:15.011257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ee86-798d-42b1-bd48-df142a579e76 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:15.044271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ee86-798d-42b1-bd48-df142a579e76 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:15.063840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:15.065605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:15.065605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:15.065605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:15.066041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:15.069437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:15.225340 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3224/6372] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:15 2021] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:31:15.229823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:15.254715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd4d7d-4524-43bb-b560-d2f1d332eac7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:15.401770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:15.402545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:15.402827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:15.403100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:15.404375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:15.405811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:15.552506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:15.553242 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3149/6373] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:15 2021] POST /identity/v3/users => generated 287 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:15.563971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976be0a-5998-4e3a-ac1c-53cf1fee00fe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:15.576618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:15.577636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:15.578144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:15.579141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:15.580196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:15.582077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:15.601907 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3225/6374] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:15 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:15.605656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:15.639614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f26a8-8175-4988-8781-f54ab6465fdd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:15.653113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e775de2-1542-4899-9b75-d5e617ad919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:15.654355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e775de2-1542-4899-9b75-d5e617ad919d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:15.654986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e775de2-1542-4899-9b75-d5e617ad919d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:15.655473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e775de2-1542-4899-9b75-d5e617ad919d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:15.657322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e775de2-1542-4899-9b75-d5e617ad919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:15.671978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e775de2-1542-4899-9b75-d5e617ad919d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:15.698952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:15.701211 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3150/6375] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:15 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:15.715534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01279004-bac8-4958-a847-66aab87886a4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:15.732928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:15.733976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:15.734455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:15.734906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] PATH_INFO: `/v3/projects/8ece5e5ef72d4614b89456ee37fe94f3/users/0af5c61e37b747608ee6af2f8f75f412/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:15.758041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ece5e5ef72d4614b89456ee37fe94f3, user_id=0af5c61e37b747608ee6af2f8f75f412, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:15.762008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:15.884415 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3226/6376] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:15 2021] PUT /identity/v3/projects/8ece5e5ef72d4614b89456ee37fe94f3/users/0af5c61e37b747608ee6af2f8f75f412/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:15.889888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328199-e388-4112-9214-9dd8b8bf10e7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:15.890178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328199-e388-4112-9214-9dd8b8bf10e7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:15.890459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328199-e388-4112-9214-9dd8b8bf10e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:15.922496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-18328199-e388-4112-9214-9dd8b8bf10e7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:15.925712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-18328199-e388-4112-9214-9dd8b8bf10e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:16.056212 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3151/6377] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:16.079664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:16.083059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:16.222484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72347a21-0e49-4abe-920a-99eda680dc18 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:16.232167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9392b-f6d1-4106-85b6-f1fc49ef3899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:16.234974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9392b-f6d1-4106-85b6-f1fc49ef3899 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:16.236124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9392b-f6d1-4106-85b6-f1fc49ef3899 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:16.236433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9392b-f6d1-4106-85b6-f1fc49ef3899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:16.260038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9392b-f6d1-4106-85b6-f1fc49ef3899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:16.263781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9392b-f6d1-4106-85b6-f1fc49ef3899 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:16.280853 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3227/6378] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:18.011843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:18.012378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:18.012378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:18.058041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] MFA Rules not processed for user `517838d2d4a942bfa8b332c767c60904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:18.059287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:18.225250 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3152/6379] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:18 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:19.292260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:19.292260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:19.292260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:19.350029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] MFA Rules not processed for user `0af5c61e37b747608ee6af2f8f75f412`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:19.351804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:19.501245 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3228/6380] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:19.507438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:19.509066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:19.717112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cd787-85fa-4c81-8309-19cba1c15e98 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:19.728004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea02a-b992-480a-b4cc-d6ab0d824f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:19.728842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea02a-b992-480a-b4cc-d6ab0d824f61 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:19.729256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea02a-b992-480a-b4cc-d6ab0d824f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:19.729629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea02a-b992-480a-b4cc-d6ab0d824f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:19.755682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ea02a-b992-480a-b4cc-d6ab0d824f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:19.755839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ea02a-b992-480a-b4cc-d6ab0d824f61 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:19.781553 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3153/6381] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:19.950263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:19.951812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:19.979942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ac512-a66d-4a5d-87f8-3a36d2bbdd02 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:19.988582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:19.989414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:19.989802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:19.990152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:20.010258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:20.051662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:20.059101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:20.093019 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3229/6382] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:19 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:23.006101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa622-4be5-41b6-9d4b-97a553ff4185 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:23.007177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa622-4be5-41b6-9d4b-97a553ff4185 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:23.007899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa622-4be5-41b6-9d4b-97a553ff4185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:23.031645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-86caa622-4be5-41b6-9d4b-97a553ff4185 None None] MFA Rules not processed for user `0af5c61e37b747608ee6af2f8f75f412`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:23.034893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-86caa622-4be5-41b6-9d4b-97a553ff4185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:23.045172 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3154/6383] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:26.241814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:26.244082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:26.270915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae0d8b-c02b-47dc-9813-80ee207d246a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:26.284690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:26.285857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:26.286802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:26.287368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] PATH_INFO: `/v3/users/51b86762a6184cb29595cdcf520b4851` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:26.309328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b86762a6184cb29595cdcf520b4851)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:26.311619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:26.574545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b86762a6184cb29595cdcf520b4851'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:26.604980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b86762a6184cb29595cdcf520b4851'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:26.651027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b86762a6184cb29595cdcf520b4851'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:26.653695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b86762a6184cb29595cdcf520b4851'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:26.772769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b86762a6184cb29595cdcf520b4851'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:26.788934 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3230/6384] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:26 2021] DELETE /identity/v3/users/51b86762a6184cb29595cdcf520b4851 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:26.793826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:26.794309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:26.794925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:26.846084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:26.847430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:27.001884 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3155/6385] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:27.037518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:27.039272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:27.139236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546351f2-372e-4dba-a89e-47142790e5b0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:27.144771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942817-cf2c-45c3-aac7-046c5416439d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:27.163313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942817-cf2c-45c3-aac7-046c5416439d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:27.165407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942817-cf2c-45c3-aac7-046c5416439d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:27.165849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942817-cf2c-45c3-aac7-046c5416439d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:27.199893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6942817-cf2c-45c3-aac7-046c5416439d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:27.201611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6942817-cf2c-45c3-aac7-046c5416439d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:27.214114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3231/6386] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:28.741094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:28.742607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:28.760764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e68c2b-b9a6-4b1b-b231-40c7eaf155a1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:28.773878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:28.774793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:28.775074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:28.775350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] PATH_INFO: `/v3/projects/d8f250b16290406fa59b0ad0129cee20` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:28.781856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f250b16290406fa59b0ad0129cee20)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:28.784415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:29.014674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f250b16290406fa59b0ad0129cee20', 'request_id': 'req-05a1f9b1-2147-4a67-8824-053945ac7ad6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:29.019021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f250b16290406fa59b0ad0129cee20', 'request_id': 'req-05a1f9b1-2147-4a67-8824-053945ac7ad6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:29.139593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f250b16290406fa59b0ad0129cee20', 'request_id': 'req-05a1f9b1-2147-4a67-8824-053945ac7ad6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:29.157767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] The token cache is being invalidate because project d8f250b16290406fa59b0ad0129cee20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:29.158208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:29.159108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-05a1f9b1-2147-4a67-8824-053945ac7ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:29.165200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3156/6387] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:28 2021] DELETE /identity/v3/projects/d8f250b16290406fa59b0ad0129cee20 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:29.170817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e349cd-4f8d-4be8-be4f-6af440f0a0e6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:29.171300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e349cd-4f8d-4be8-be4f-6af440f0a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:29.171624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e349cd-4f8d-4be8-be4f-6af440f0a0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:29.211210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f1e349cd-4f8d-4be8-be4f-6af440f0a0e6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:29.212479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f1e349cd-4f8d-4be8-be4f-6af440f0a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:29.407215 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3232/6388] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:29.415259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb07fc-0cd7-4457-98a2-33df83edcd1d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:29.416715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb07fc-0cd7-4457-98a2-33df83edcd1d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:29.417239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb07fc-0cd7-4457-98a2-33df83edcd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:29.442611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c2eb07fc-0cd7-4457-98a2-33df83edcd1d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:29.444851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c2eb07fc-0cd7-4457-98a2-33df83edcd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:29.459465 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3157/6389] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:29.461247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e349cd-4f8d-4be8-be4f-6af440f0a0e6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:29.476116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e349cd-4f8d-4be8-be4f-6af440f0a0e6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:29.485171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:29.485581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:29.486114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:29.486671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:29.487950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:29.489038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:29.492140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:29.514580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3233/6390] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:31:29.517780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb07fc-0cd7-4457-98a2-33df83edcd1d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:29.531311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb07fc-0cd7-4457-98a2-33df83edcd1d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:29.542131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:29.543838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:29.544288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:29.544718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:29.545632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:29.547791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:29.667035 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3158/6391] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:29 2021] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:29.673760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:29.685357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2222-56fe-4757-b13f-b9f22032a741 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:29.813227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:29.814216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:29.814652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:29.815168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:29.816024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:29.818344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:29.941279 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3234/6392] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:29 2021] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:29.946000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:29.962495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866757-7baa-4483-a7d7-87a0ac266784 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:29.967196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:29.968003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:29.968317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:29.968594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:29.972173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:29.977034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:30.000385 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3159/6393] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:29 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:30.005821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:30.021726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f920fa-fcad-4790-8dff-0f56d5441321 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:30.037181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f00a61-ade9-4eb9-9992-3e3abc89b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:30.037958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00a61-ade9-4eb9-9992-3e3abc89b221 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:30.038238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00a61-ade9-4eb9-9992-3e3abc89b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:30.038624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00a61-ade9-4eb9-9992-3e3abc89b221 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:30.039880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f00a61-ade9-4eb9-9992-3e3abc89b221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:30.041812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f00a61-ade9-4eb9-9992-3e3abc89b221 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:30.076926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3235/6394] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:30 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:30.081675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:30.093874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796c449-3163-44cd-a32a-8cc8f870135c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:30.098915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:30.100018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:30.100454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:30.100923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] PATH_INFO: `/v3/projects/1b4189d0115b4d849f8f9bce9deef49f/users/c2b731b2ca634360afda4cfc55acc81f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:30.123924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4189d0115b4d849f8f9bce9deef49f, user_id=c2b731b2ca634360afda4cfc55acc81f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:30.127169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:30.229583 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3160/6395] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:30 2021] PUT /identity/v3/projects/1b4189d0115b4d849f8f9bce9deef49f/users/c2b731b2ca634360afda4cfc55acc81f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:31:30.240438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6798-0da1-44b3-8fb1-00e907f480af None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:30.241321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6798-0da1-44b3-8fb1-00e907f480af None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:30.241753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6798-0da1-44b3-8fb1-00e907f480af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:30.293864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-90ce6798-0da1-44b3-8fb1-00e907f480af None None] MFA Rules not processed for user `c2b731b2ca634360afda4cfc55acc81f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:30.295080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-90ce6798-0da1-44b3-8fb1-00e907f480af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:30.407449 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3236/6396] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:30 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:30.413830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:30.415724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:30.515807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbab4d-17a3-4167-9e88-56dafe7ae41d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:30.522932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:30.524191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:30.524728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:30.525237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:30.538126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:30.542831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:30.558237 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3161/6397] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:30 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:33.123900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b73acb-6ff1-4f0c-aef8-c7ede828bc2b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:33.124439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b73acb-6ff1-4f0c-aef8-c7ede828bc2b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:33.124765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b73acb-6ff1-4f0c-aef8-c7ede828bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:33.169942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f5b73acb-6ff1-4f0c-aef8-c7ede828bc2b None None] MFA Rules not processed for user `3f7bfbe1464a4466b395dbc35592d7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:33.178112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f5b73acb-6ff1-4f0c-aef8-c7ede828bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:33.360153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3237/6398] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:33 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:33.374397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:33.377154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:33.543361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af0da4-6c61-47d8-b1f4-2f8e5dd2fc9c service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:33.546897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:33.553098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:33.553098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:33.556915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:33.557651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:33.558099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:33.558564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:33.561137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:33.597312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] MFA Rules not processed for user `c2b731b2ca634360afda4cfc55acc81f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:33.602215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:33.635546 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3238/6399] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:31:33.759366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:33.762232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:33.816842 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3162/6400] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:33 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:37.497704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:37.499425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:37.663251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd6db3-e2b7-4c64-a5f0-59f643c765ec None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:37.682597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:37.683705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:37.683986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:37.684257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] PATH_INFO: `/v3/users/a85842dabc3d4a219d28c154e36c293c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:37.685581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85842dabc3d4a219d28c154e36c293c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:37.687734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:37.913404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85842dabc3d4a219d28c154e36c293c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:37.924079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85842dabc3d4a219d28c154e36c293c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:37.939001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85842dabc3d4a219d28c154e36c293c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:37.940076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85842dabc3d4a219d28c154e36c293c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:38.026031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85842dabc3d4a219d28c154e36c293c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:38.045307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3239/6401] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:37 2021] DELETE /identity/v3/users/a85842dabc3d4a219d28c154e36c293c => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:38.580741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:38.605408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765538-4474-4d60-931d-916d6e6c2c3b service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:38.657153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:38.658687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:38.730886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:38.734049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:38.734336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:38.737793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] PATH_INFO: `/v3/projects/d4571ece0fa3450b83fde221178518c8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:38.742560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4571ece0fa3450b83fde221178518c8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:38.748255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:38.787682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7595-9a87-4fc9-a0d3-14661efef4fd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:38.800299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:38.801258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:38.801540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:38.801819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] PATH_INFO: `/v3/users/43721dc50da84b93afb8046c4582b6ff` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:38.804234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43721dc50da84b93afb8046c4582b6ff)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:38.806619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:38.941488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4571ece0fa3450b83fde221178518c8', 'request_id': 'req-a068293a-977b-4361-a082-e8d8844bd13c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:38.962495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4571ece0fa3450b83fde221178518c8', 'request_id': 'req-a068293a-977b-4361-a082-e8d8844bd13c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.076120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43721dc50da84b93afb8046c4582b6ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.090479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43721dc50da84b93afb8046c4582b6ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.106069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4571ece0fa3450b83fde221178518c8', 'request_id': 'req-a068293a-977b-4361-a082-e8d8844bd13c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.113216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43721dc50da84b93afb8046c4582b6ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.114708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43721dc50da84b93afb8046c4582b6ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.122290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] The token cache is being invalidate because project d4571ece0fa3450b83fde221178518c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:39.122796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.123615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.127089 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3163/6402] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:38 2021] DELETE /identity/v3/projects/d4571ece0fa3450b83fde221178518c8 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:39.130929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:39.132465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:39.184842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8dff7c9-46c1-4f3d-a6b5-304dac112c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43721dc50da84b93afb8046c4582b6ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.192387 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3240/6403] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:38 2021] DELETE /identity/v3/users/43721dc50da84b93afb8046c4582b6ff => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:31:39.196802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:39.197266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:39.197693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:39.242046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:39.243566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:39.247074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068293a-977b-4361-a082-e8d8844bd13c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:39.360775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:39.360775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:39.361329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:39.361709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] PATH_INFO: `/v3/users/f12553f5c64c42579f99a0f2229dffa8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:39.378906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12553f5c64c42579f99a0f2229dffa8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:39.381233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:39.390151 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3241/6404] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:39.402383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:39.404606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:39.467684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9df1b5-5a13-4790-81ff-77b80097cae2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:39.472051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:39.472599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:39.472897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:39.473183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:39.482614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:39.484037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:39.497863 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3242/6405] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:39.637470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12553f5c64c42579f99a0f2229dffa8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.647478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12553f5c64c42579f99a0f2229dffa8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.662779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12553f5c64c42579f99a0f2229dffa8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.664483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12553f5c64c42579f99a0f2229dffa8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.665323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12553f5c64c42579f99a0f2229dffa8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:39.737050 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3164/6406] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:39 2021] DELETE /identity/v3/users/f12553f5c64c42579f99a0f2229dffa8 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:31:40.176387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:40.180634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:40.241462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc291612-db5d-49c6-8013-b90c0a1007eb service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:40.282802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:40.284972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:40.384486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:40.385395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:40.385678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:40.385949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] PATH_INFO: `/v3/projects/0e7617b28f94425bbcf599d545e4f87e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:40.390151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7617b28f94425bbcf599d545e4f87e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:40.395499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:40.442259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01208a8-ad35-47bd-a0db-9deeace97455 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:40.449862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:40.450992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:40.451712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:40.452236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] PATH_INFO: `/v3/projects/498aad80bbd44b6e8fc8fd1b6ed08a4b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:40.478478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498aad80bbd44b6e8fc8fd1b6ed08a4b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:40.484822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:40.569200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7617b28f94425bbcf599d545e4f87e', 'request_id': 'req-9cca1c08-06bb-4580-9643-f497b9bdacf6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.664731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7617b28f94425bbcf599d545e4f87e', 'request_id': 'req-9cca1c08-06bb-4580-9643-f497b9bdacf6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.674792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7617b28f94425bbcf599d545e4f87e', 'request_id': 'req-9cca1c08-06bb-4580-9643-f497b9bdacf6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.683794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498aad80bbd44b6e8fc8fd1b6ed08a4b', 'request_id': 'req-d8914afc-b4dc-48e2-a5f3-4729e67be685'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.704208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] The token cache is being invalidate because project 0e7617b28f94425bbcf599d545e4f87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:40.704509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.708642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498aad80bbd44b6e8fc8fd1b6ed08a4b', 'request_id': 'req-d8914afc-b4dc-48e2-a5f3-4729e67be685'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.712142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9cca1c08-06bb-4580-9643-f497b9bdacf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.715765 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3243/6407] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:40 2021] DELETE /identity/v3/projects/0e7617b28f94425bbcf599d545e4f87e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:40.723979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d068-e4c9-46c1-ad31-eff29fcd315e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:40.724271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d068-e4c9-46c1-ad31-eff29fcd315e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:40.724946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d068-e4c9-46c1-ad31-eff29fcd315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:40.770980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2825d068-e4c9-46c1-ad31-eff29fcd315e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:40.772243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2825d068-e4c9-46c1-ad31-eff29fcd315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:40.848453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498aad80bbd44b6e8fc8fd1b6ed08a4b', 'request_id': 'req-d8914afc-b4dc-48e2-a5f3-4729e67be685'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.872816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] The token cache is being invalidate because project 498aad80bbd44b6e8fc8fd1b6ed08a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:40.875340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.875340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d8914afc-b4dc-48e2-a5f3-4729e67be685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:40.882971 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3165/6408] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:40 2021] DELETE /identity/v3/projects/498aad80bbd44b6e8fc8fd1b6ed08a4b => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:40.898981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e9c5-9506-4859-9a77-02c6040c316d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:40.899257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e9c5-9506-4859-9a77-02c6040c316d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:40.899572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413e9c5-9506-4859-9a77-02c6040c316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:40.933952 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3244/6409] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:40.933952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70d2b-4834-4db9-9673-aff761b33439 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:40.933952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70d2b-4834-4db9-9673-aff761b33439 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:40.933952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70d2b-4834-4db9-9673-aff761b33439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:40.946137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8413e9c5-9506-4859-9a77-02c6040c316d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:40.949540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8413e9c5-9506-4859-9a77-02c6040c316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:40.980111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3166/6410] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:40.980816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ebd70d2b-4834-4db9-9673-aff761b33439 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:40.981667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70653-60da-4940-b60c-c7a9dea024a7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:40.981960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70653-60da-4940-b60c-c7a9dea024a7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:40.982993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70653-60da-4940-b60c-c7a9dea024a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:40.986471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ebd70d2b-4834-4db9-9673-aff761b33439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:41.014892 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3245/6411] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:41.020929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70d2b-4834-4db9-9673-aff761b33439 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.025041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-08d70653-60da-4940-b60c-c7a9dea024a7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:41.028894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08d70653-60da-4940-b60c-c7a9dea024a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:41.039534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70d2b-4834-4db9-9673-aff761b33439 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.050929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3167/6412] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:41.054980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70653-60da-4940-b60c-c7a9dea024a7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.056232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.056976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.057212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.057503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.058220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:41.058525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.060327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.076020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70653-60da-4940-b60c-c7a9dea024a7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.089086 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3246/6413] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:31:41.094189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.098658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.099458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.100793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.101100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.101884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:41.104030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.112725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.117643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cc68-7e2d-49cd-aba5-3c3fe4a674bc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.135223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.135906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.136189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.137129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.137859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.139953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.152574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3168/6414] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:31:41.161618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.187453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad83400-afc0-4a68-9d6b-d897d9c9db3f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.204398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.208229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.208585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.208894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.209645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.214027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.300209 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3247/6415] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:41 2021] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:41.301834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.397300 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3169/6416] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:41 2021] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:41.400630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.439268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9fdb7-e0e6-4256-8da8-e351e348e0d0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.512536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf54bb-c751-466c-9033-6e9abcc142b5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.523399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.524277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.524649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.525057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.527416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.529783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.566840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.568030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.568511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.568999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.570539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.572659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.675367 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3170/6417] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:41 2021] POST /identity/v3/users => generated 296 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:41.682208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.699376 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3248/6418] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:41 2021] POST /identity/v3/users => generated 288 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:41.700869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.715533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ac097-a917-41c3-9a49-4686538d4435 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.717032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eeb1ce-2de5-4081-9a54-d7b06811f7dc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.723897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.725704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.727870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.727870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.727870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.735670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.735893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.740577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.742495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.742836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.745851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.752299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.762165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3249/6419] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:41.763870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.786760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ff5bb-563f-402c-aeb6-23fba60b9a3f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.795578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.796794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.797346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.797816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.798757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.800595 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3171/6420] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:41.802189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.813339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.822846 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3250/6421] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:41.824624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.838105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9223ae-9634-42e3-b773-f075b9260960 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.839196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ed9fb-1765-4ba1-94fd-b5c5d912cf0c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.848778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d7369-141f-44fb-a4fe-44965c3eb931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.851106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7369-141f-44fb-a4fe-44965c3eb931 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.851999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.853095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.857778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7369-141f-44fb-a4fe-44965c3eb931 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.857778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d7369-141f-44fb-a4fe-44965c3eb931 admin admin] PATH_INFO: `/v3/projects/8162958349d74f9cbd6c53f5a7a5c87b/users/d437dc2c7a1c4f8d9b2057a47bab64b4/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.858012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.858012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.859878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.862894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.893110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d7369-141f-44fb-a4fe-44965c3eb931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8162958349d74f9cbd6c53f5a7a5c87b, user_id=d437dc2c7a1c4f8d9b2057a47bab64b4, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.896532 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3172/6422] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:41 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:41.900809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:41.904586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d7369-141f-44fb-a4fe-44965c3eb931 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:41.915867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29333e-bb77-4f51-83fe-75b021e2a23e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:41.926703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92be271-5585-4487-9ac4-3e5ed0a65a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:41.928141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92be271-5585-4487-9ac4-3e5ed0a65a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:41.928816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92be271-5585-4487-9ac4-3e5ed0a65a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:41.929129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92be271-5585-4487-9ac4-3e5ed0a65a7b admin admin] PATH_INFO: `/v3/projects/d3625a8207df4cb0a4da19210ca5c80c/users/54abf7f90439451081ee3b38676b6b65/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:41.950745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92be271-5585-4487-9ac4-3e5ed0a65a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3625a8207df4cb0a4da19210ca5c80c, user_id=54abf7f90439451081ee3b38676b6b65, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:41.953464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92be271-5585-4487-9ac4-3e5ed0a65a7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:42.038008 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3251/6423] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:41 2021] PUT /identity/v3/projects/8162958349d74f9cbd6c53f5a7a5c87b/users/d437dc2c7a1c4f8d9b2057a47bab64b4/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:42.052697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:42.053212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:42.053677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:42.090754 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3173/6424] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:41 2021] PUT /identity/v3/projects/d3625a8207df4cb0a4da19210ca5c80c/users/54abf7f90439451081ee3b38676b6b65/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:42.097407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:42.097881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:42.098384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:42.132393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:42.132635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] MFA Rules not processed for user `d437dc2c7a1c4f8d9b2057a47bab64b4`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:42.133829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:42.133979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:42.301354 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3252/6425] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:42 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:31:42.310855 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3174/6426] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:42.314932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:42.316503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:42.334192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:42.336500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:42.450580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc2521-0e87-4b6b-aa34-b0d6cd9e1e27 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:42.459904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4faa9-cb91-40a7-9bbd-fe6b36c360ff None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:42.463229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:42.465181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:42.465463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:42.467666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:42.474194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a43cf-1f80-4b94-8119-5dcd6d465bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:42.476203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a43cf-1f80-4b94-8119-5dcd6d465bbe service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:42.476887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a43cf-1f80-4b94-8119-5dcd6d465bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:42.482112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a43cf-1f80-4b94-8119-5dcd6d465bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:42.494094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:42.501276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:42.507881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a43cf-1f80-4b94-8119-5dcd6d465bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:42.510786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a43cf-1f80-4b94-8119-5dcd6d465bbe service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:42.530936 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3253/6427] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:42 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:42.539469 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3175/6428] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:31:44.067520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:44.079615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92232-3309-48cd-9732-7a4111d01a4d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:44.085932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:44.086891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:44.087247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:44.087592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] PATH_INFO: `/v3/users/d437dc2c7a1c4f8d9b2057a47bab64b4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:44.089141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d437dc2c7a1c4f8d9b2057a47bab64b4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:44.091308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:44.287208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd437dc2c7a1c4f8d9b2057a47bab64b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:44.297193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd437dc2c7a1c4f8d9b2057a47bab64b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:44.310832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd437dc2c7a1c4f8d9b2057a47bab64b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:44.311595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd437dc2c7a1c4f8d9b2057a47bab64b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:44.407641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd437dc2c7a1c4f8d9b2057a47bab64b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:44.417168 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3254/6429] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:44 2021] DELETE /identity/v3/users/d437dc2c7a1c4f8d9b2057a47bab64b4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:44.422241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca374-4917-4c74-90ab-3597fabb1eaf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:44.422747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca374-4917-4c74-90ab-3597fabb1eaf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:44.422868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ca374-4917-4c74-90ab-3597fabb1eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:44.441230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-949ca374-4917-4c74-90ab-3597fabb1eaf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:44.442751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-949ca374-4917-4c74-90ab-3597fabb1eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:44.502906 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3176/6430] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:44.514246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:44.515691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:44.599695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d2472-d569-46f7-9f51-9c2bc3837fe7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:44.606299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d471-1914-4e64-b3f6-7cf7d4789aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:44.607227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d471-1914-4e64-b3f6-7cf7d4789aea service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:44.607505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d471-1914-4e64-b3f6-7cf7d4789aea service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:44.607941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d471-1914-4e64-b3f6-7cf7d4789aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:44.620688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d471-1914-4e64-b3f6-7cf7d4789aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:44.622373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d471-1914-4e64-b3f6-7cf7d4789aea service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:44.633208 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3255/6431] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:31:45.199531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:45.199825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:45.200107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:45.232214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] MFA Rules not processed for user `54abf7f90439451081ee3b38676b6b65`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:45.234162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:45.365054 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3177/6432] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:45 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:45.374210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:45.374754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:45.375395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:45.413348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:45.414900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:45.425679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] MFA Rules not processed for user `54abf7f90439451081ee3b38676b6b65`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:45.427571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:45.437981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fe18-139e-4e93-ac2f-434649b52fa0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:45.454854 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3256/6433] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:45 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:45.469420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:45.470014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:45.470109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:45.470109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:45.470109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] PATH_INFO: `/v3/projects/8162958349d74f9cbd6c53f5a7a5c87b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:45.470890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:45.471018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8162958349d74f9cbd6c53f5a7a5c87b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:45.471018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:45.686059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8162958349d74f9cbd6c53f5a7a5c87b', 'request_id': 'req-36d8ee32-af1c-4917-965f-c3407b8fa858'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:45.700286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8162958349d74f9cbd6c53f5a7a5c87b', 'request_id': 'req-36d8ee32-af1c-4917-965f-c3407b8fa858'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:45.753657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862ac5-1762-4932-9252-0c25a616db3c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:45.768011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8162958349d74f9cbd6c53f5a7a5c87b', 'request_id': 'req-36d8ee32-af1c-4917-965f-c3407b8fa858'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:45.784747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] The token cache is being invalidate because project 8162958349d74f9cbd6c53f5a7a5c87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:45.785355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:45.787298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-36d8ee32-af1c-4917-965f-c3407b8fa858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:45.794857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3178/6434] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:45 2021] DELETE /identity/v3/projects/8162958349d74f9cbd6c53f5a7a5c87b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:45.802310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781be71-89d3-479c-a8c7-b56312ce69be None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:45.802686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781be71-89d3-479c-a8c7-b56312ce69be None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:45.803024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781be71-89d3-479c-a8c7-b56312ce69be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:45.841852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d781be71-89d3-479c-a8c7-b56312ce69be None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:45.843904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:45.844561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:45.844844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:45.845203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:45.846280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d781be71-89d3-479c-a8c7-b56312ce69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:45.847822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:45.929240 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3179/6435] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:31:45.933607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a75711-39b2-48f4-a576-457500f70596 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:45.933892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a75711-39b2-48f4-a576-457500f70596 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:45.934166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a75711-39b2-48f4-a576-457500f70596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:45.951988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:45.954538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:45.987362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-08a75711-39b2-48f4-a576-457500f70596 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:45.989260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08a75711-39b2-48f4-a576-457500f70596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:45.989998 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3257/6436] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:45 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:46.027186 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3180/6437] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:46.029406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:46.056418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe59ef-470d-41c4-b2f5-66dc4b86f32a service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:46.065717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:46.066399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.066791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.067561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.068111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:46.068504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:46.070272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:46.101950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a75711-39b2-48f4-a576-457500f70596 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:46.113841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a75711-39b2-48f4-a576-457500f70596 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:46.114890 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3258/6438] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:31:46.119376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:46.120056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.120625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.120940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.121652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:46.123669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:46.202973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:46.223425 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3181/6439] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:46 2021] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:46.226735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9101-3517-4971-b47d-4e094dada5d6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:46.367546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:46.368256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.368594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.369086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.369792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:46.371724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:46.434917 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3259/6440] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:46 2021] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:46.439653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:46.462374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa2a9-1e99-49e0-9bfe-32878d1a0d68 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:46.468050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:46.468826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.469199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.469540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.470385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:46.472046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:46.483345 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3182/6441] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:31:46.487747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:46.499241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9becb-a8b2-4ea8-88ce-ef615644b383 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:46.505182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f42b26-5568-49b4-8682-cf471c28dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:46.506339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42b26-5568-49b4-8682-cf471c28dd98 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.507076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42b26-5568-49b4-8682-cf471c28dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.507427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42b26-5568-49b4-8682-cf471c28dd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.508243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f42b26-5568-49b4-8682-cf471c28dd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:46.509952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f42b26-5568-49b4-8682-cf471c28dd98 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:46.531362 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3260/6442] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:46.541793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:46.554382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987210-b548-4f35-9440-a41ef144e507 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:46.561234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:46.562308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.562684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.563055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] PATH_INFO: `/v3/projects/20a4eb20436c4a588550b002c8421152/users/a82f804f19334441ba0982c3a1ee43ec/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.587596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a4eb20436c4a588550b002c8421152, user_id=a82f804f19334441ba0982c3a1ee43ec, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:46.592263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:46.693319 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3183/6443] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:46 2021] PUT /identity/v3/projects/20a4eb20436c4a588550b002c8421152/users/a82f804f19334441ba0982c3a1ee43ec/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:46.703932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62f7c-83c0-46c9-a213-cc0f6c9bb877 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.708277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62f7c-83c0-46c9-a213-cc0f6c9bb877 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.708277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af62f7c-83c0-46c9-a213-cc0f6c9bb877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.770609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4af62f7c-83c0-46c9-a213-cc0f6c9bb877 None None] MFA Rules not processed for user `a82f804f19334441ba0982c3a1ee43ec`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:46.773017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4af62f7c-83c0-46c9-a213-cc0f6c9bb877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:46.860337 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3261/6444] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:46 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:46.881169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:46.883290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:46.956286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5af8-4907-4a36-8b3d-c739cfedfd5b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:46.968274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc36d33-374f-4f82-812a-f7b57185e895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:46.969236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc36d33-374f-4f82-812a-f7b57185e895 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:46.969717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc36d33-374f-4f82-812a-f7b57185e895 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:46.969989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc36d33-374f-4f82-812a-f7b57185e895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:46.980868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc36d33-374f-4f82-812a-f7b57185e895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:46.982857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc36d33-374f-4f82-812a-f7b57185e895 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:46.995551 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3184/6445] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:46 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:47.011211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62f7c-83c0-46c9-a213-cc0f6c9bb877 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:47.083460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af62f7c-83c0-46c9-a213-cc0f6c9bb877 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:47.088231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:47.089259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:47.089539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:47.089813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] PATH_INFO: `/v3/users/a82f804f19334441ba0982c3a1ee43ec` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:47.091053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82f804f19334441ba0982c3a1ee43ec)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:47.093133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:47.367108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82f804f19334441ba0982c3a1ee43ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:47.402611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82f804f19334441ba0982c3a1ee43ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:47.460712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82f804f19334441ba0982c3a1ee43ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:47.463513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82f804f19334441ba0982c3a1ee43ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:47.567910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82f804f19334441ba0982c3a1ee43ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:47.576210 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3262/6446] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:47 2021] DELETE /identity/v3/users/a82f804f19334441ba0982c3a1ee43ec => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:47.581339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ae1f-7b82-4ccb-86a1-fd989000a6b3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:47.582932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ae1f-7b82-4ccb-86a1-fd989000a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:47.583355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ae1f-7b82-4ccb-86a1-fd989000a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:47.630381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d307ae1f-7b82-4ccb-86a1-fd989000a6b3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:47.630381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d307ae1f-7b82-4ccb-86a1-fd989000a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:47.718512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3185/6447] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:47.725952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:47.727742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:47.835517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce75b-c136-4ce0-b753-2e1ef9dc9a80 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:47.848485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:47.849398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:47.849820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:47.850295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:47.867792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:47.869438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:47.891766 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3263/6448] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:48.460102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dbbe8-95e6-4449-9d7e-a0a8342de259 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:48.461830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dbbe8-95e6-4449-9d7e-a0a8342de259 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:48.461830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dbbe8-95e6-4449-9d7e-a0a8342de259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:48.486171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-669dbbe8-95e6-4449-9d7e-a0a8342de259 None None] MFA Rules not processed for user `171c198b6b734cd698b3c1eaf76a0234`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:48.488303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-669dbbe8-95e6-4449-9d7e-a0a8342de259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:48.657144 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3186/6449] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:48 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:48.995833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:48.997367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:49.069397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49154fda-4350-43e7-9bb6-b16e2804a8d9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:49.070176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:49.070862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:49.070989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:49.071264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] PATH_INFO: `/v3/projects/20a4eb20436c4a588550b002c8421152` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:49.076099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a4eb20436c4a588550b002c8421152)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:49.078132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:49.279922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a4eb20436c4a588550b002c8421152', 'request_id': 'req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:49.363173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a4eb20436c4a588550b002c8421152', 'request_id': 'req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:49.382317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a4eb20436c4a588550b002c8421152', 'request_id': 'req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:49.405327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] The token cache is being invalidate because project 20a4eb20436c4a588550b002c8421152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:49.405696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:49.406456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5cf1eae-d91d-4418-ac3c-f877efb8cc12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:49.408187 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3264/6450] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:48 2021] DELETE /identity/v3/projects/20a4eb20436c4a588550b002c8421152 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:49.416669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11092-1220-4878-b804-ea4535f55fab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:49.418178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11092-1220-4878-b804-ea4535f55fab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:49.418673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca11092-1220-4878-b804-ea4535f55fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:49.461052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0ca11092-1220-4878-b804-ea4535f55fab None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:49.461052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0ca11092-1220-4878-b804-ea4535f55fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:49.534278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3187/6451] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:49.543785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d704-b666-474b-819f-79ff9b4f0cab None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:49.544276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d704-b666-474b-819f-79ff9b4f0cab None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:49.544604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d704-b666-474b-819f-79ff9b4f0cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:49.587841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-70b9d704-b666-474b-819f-79ff9b4f0cab None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:49.592278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-70b9d704-b666-474b-819f-79ff9b4f0cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:49.603140 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3265/6452] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:49.607273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11092-1220-4878-b804-ea4535f55fab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:49.619771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca11092-1220-4878-b804-ea4535f55fab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:49.626842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:49.627880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:49.628527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:49.629002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:49.634076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:49.634076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:49.634076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:49.652099 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3188/6453] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:31:49.657125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9d704-b666-474b-819f-79ff9b4f0cab None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:49.668726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9d704-b666-474b-819f-79ff9b4f0cab None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:49.681230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:49.681911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:49.682379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:49.682852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:49.684109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:49.686745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:49.734602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:49.736402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:49.821344 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3266/6454] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:49 2021] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:31:49.822198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee2ff-eb9f-4a66-8597-a7283d9b8f43 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:49.825816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:49.895706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:49.896912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:49.896912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:49.897120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:49.906813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:49.926430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:49.928193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:49.946684 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3189/6455] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:31:49.976722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9078888-7826-42e4-9c1e-d458c51385a9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:50.013440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:50.014172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:50.014660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:50.015132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:50.016071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:50.018659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:50.105902 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3267/6456] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:49 2021] POST /identity/v3/users => generated 284 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:50.110442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:50.135549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc5e9f-afcb-4f7e-a46a-0c4a0a339e0a service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:50.166339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:50.167812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:50.168096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:50.168393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:50.169210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:50.171673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:50.184001 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3190/6457] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:50 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:50.186995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:50.198688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4475829-6b63-4a7e-837c-ffd9f9472f97 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:50.206956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dccfb2-94c7-40c4-83d8-6bb3815450d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:50.207641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccfb2-94c7-40c4-83d8-6bb3815450d9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:50.208148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccfb2-94c7-40c4-83d8-6bb3815450d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:50.208421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccfb2-94c7-40c4-83d8-6bb3815450d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:50.209187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccfb2-94c7-40c4-83d8-6bb3815450d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:50.211982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccfb2-94c7-40c4-83d8-6bb3815450d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:50.225401 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3268/6458] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:50 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:50.226546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:50.241850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4c888-83f7-41ea-90d6-adfdb7f1b8bb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:50.247919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:50.249127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:50.249487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:50.249953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] PATH_INFO: `/v3/projects/ed197c5baf3c48e6a12fd9ff053dff10/users/533e0f997248410b8a86adec8d647c67/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:50.274267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed197c5baf3c48e6a12fd9ff053dff10, user_id=533e0f997248410b8a86adec8d647c67, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:50.277839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:50.416911 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3191/6459] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:50 2021] PUT /identity/v3/projects/ed197c5baf3c48e6a12fd9ff053dff10/users/533e0f997248410b8a86adec8d647c67/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:50.427473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f1db-0ac8-476a-be3e-fa6389c25d25 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:50.428042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f1db-0ac8-476a-be3e-fa6389c25d25 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:50.428432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f1db-0ac8-476a-be3e-fa6389c25d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:50.469616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7ff5f1db-0ac8-476a-be3e-fa6389c25d25 None None] MFA Rules not processed for user `533e0f997248410b8a86adec8d647c67`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:50.470769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7ff5f1db-0ac8-476a-be3e-fa6389c25d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:50.568927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3269/6460] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:50 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:31:50.572802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:50.674857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775723e0-5a2c-4fc3-8983-285b2bb7b086 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:50.681885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:50.682730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:50.683122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:50.683501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:50.684452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:50.686898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:50.798936 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3192/6461] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:50 2021] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:50.803354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5f1db-0ac8-476a-be3e-fa6389c25d25 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:50.816066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5f1db-0ac8-476a-be3e-fa6389c25d25 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:50.896369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:50.897196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:50.897620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:50.898061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:50.898835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:50.901314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:51.000094 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3270/6462] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:50 2021] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:51.002899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:51.021256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459da83-22f1-481b-9614-1d307b58c506 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:51.033607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:51.034384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:51.034740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:51.035916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:51.036985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:51.046679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:51.079799 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3193/6463] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:51 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:51.083630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:51.119004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3527868-de17-4d37-9d71-7b7350bcbee4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:51.130057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:51.131466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:51.132507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:51.132788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] PATH_INFO: `/v3/projects/e847b0d887694ae0854f8496a7f984e6/users/b6f00cf4c0474f78a75d54bbff07e2ee/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:51.176975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e847b0d887694ae0854f8496a7f984e6, user_id=b6f00cf4c0474f78a75d54bbff07e2ee, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:51.180071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:51.321636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:51.323897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3271/6464] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:51 2021] PUT /identity/v3/projects/e847b0d887694ae0854f8496a7f984e6/users/b6f00cf4c0474f78a75d54bbff07e2ee/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:51.338106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed640d-8703-4a37-ab2e-b83ca5b1ef58 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:51.406569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2f5b3-aa80-4325-be17-e2ee866bb58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:51.407268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f5b3-aa80-4325-be17-e2ee866bb58d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:51.407602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f5b3-aa80-4325-be17-e2ee866bb58d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:51.407879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2f5b3-aa80-4325-be17-e2ee866bb58d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:51.408709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2f5b3-aa80-4325-be17-e2ee866bb58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:51.410235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2f5b3-aa80-4325-be17-e2ee866bb58d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:51.423843 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3194/6465] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:51 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:51.427917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:51.444748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb762ba-ad40-4d69-ab4b-ac6dbc2f979b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:51.456257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:51.456257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:51.456257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:51.456257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] PATH_INFO: `/v3/projects/e847b0d887694ae0854f8496a7f984e6/users/b6f00cf4c0474f78a75d54bbff07e2ee/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:51.458318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e847b0d887694ae0854f8496a7f984e6, user_id=b6f00cf4c0474f78a75d54bbff07e2ee, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:51.461162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:51.475130 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3272/6466] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:51 2021] PUT /identity/v3/projects/e847b0d887694ae0854f8496a7f984e6/users/b6f00cf4c0474f78a75d54bbff07e2ee/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:51.486501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:51.491128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:51.491128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:51.546473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] MFA Rules not processed for user `b6f00cf4c0474f78a75d54bbff07e2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:51.546473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:51.652019 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3195/6467] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:51 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:51.664039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:51.667865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:51.739827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89fa7d-1ff3-43bc-8844-b1b0b9f01ba0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:51.748053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:51.749137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:51.749488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:51.749941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:51.765289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:51.768024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:51.781243 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3273/6468] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:51 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:52.054470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:52.056017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:52.149191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:52.162771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2abda-a353-4eb4-b323-b3e0b5ba06ab service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:52.170071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b821f57-8cfc-4e0e-aeb7-54a9c4b986f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:52.172049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b821f57-8cfc-4e0e-aeb7-54a9c4b986f0 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:52.172542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b821f57-8cfc-4e0e-aeb7-54a9c4b986f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:52.173960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b821f57-8cfc-4e0e-aeb7-54a9c4b986f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:52.200020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a23816-59b1-40a2-b7b2-84890dbc5190 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:52.215737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:52.217781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:52.218906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:52.221461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] PATH_INFO: `/v3/users/5717d2674648434bbca845f2ce91516b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:52.223855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5717d2674648434bbca845f2ce91516b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:52.225896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:52.275080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b821f57-8cfc-4e0e-aeb7-54a9c4b986f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:52.276794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b821f57-8cfc-4e0e-aeb7-54a9c4b986f0 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:52.288165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3274/6469] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:52 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:52.530058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5717d2674648434bbca845f2ce91516b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:52.547120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5717d2674648434bbca845f2ce91516b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:52.563304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5717d2674648434bbca845f2ce91516b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:52.565449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5717d2674648434bbca845f2ce91516b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:52.569296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5717d2674648434bbca845f2ce91516b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:52.727572 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3196/6470] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:31:52 2021] DELETE /identity/v3/users/5717d2674648434bbca845f2ce91516b => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:52.732405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3697a4-614c-4930-a320-16a30751bd9f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:52.732700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3697a4-614c-4930-a320-16a30751bd9f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:52.732997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3697a4-614c-4930-a320-16a30751bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:52.752545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-af3697a4-614c-4930-a320-16a30751bd9f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:52.753785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-af3697a4-614c-4930-a320-16a30751bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:52.810228 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3275/6471] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:52.822892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:52.824301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:52.899526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09844f-2eb7-40ef-8307-c771dd7f3a44 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:52.903404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:52.904055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:52.904339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:52.904618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:52.915625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:52.917129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:52.927643 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3197/6472] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:53.388841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05149c11-4099-4ee6-b5c2-0ef4722d6c3e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:53.389351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05149c11-4099-4ee6-b5c2-0ef4722d6c3e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:53.389467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05149c11-4099-4ee6-b5c2-0ef4722d6c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:53.414954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-05149c11-4099-4ee6-b5c2-0ef4722d6c3e None None] MFA Rules not processed for user `0af5c61e37b747608ee6af2f8f75f412`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:53.417153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-05149c11-4099-4ee6-b5c2-0ef4722d6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:53.497011 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3276/6473] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:53.631598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:53.634504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:53.669392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614e755-ec2f-46e9-b298-47faf7ae6587 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:53.678621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:53.680726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:53.681134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:53.681513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] PATH_INFO: `/v3/projects/2b4b670b5aa1407f8675179d6279efab` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:53.682888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4b670b5aa1407f8675179d6279efab)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:53.685053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:53.803472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4b670b5aa1407f8675179d6279efab', 'request_id': 'req-9a5ea453-5809-4b34-9ae8-b6b5efefc151'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:53.810806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4b670b5aa1407f8675179d6279efab', 'request_id': 'req-9a5ea453-5809-4b34-9ae8-b6b5efefc151'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:53.961648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4b670b5aa1407f8675179d6279efab', 'request_id': 'req-9a5ea453-5809-4b34-9ae8-b6b5efefc151'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:53.974312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] The token cache is being invalidate because project 2b4b670b5aa1407f8675179d6279efab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:31:53.974599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:53.975441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a5ea453-5809-4b34-9ae8-b6b5efefc151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:31:53.977381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3198/6474] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:31:53 2021] DELETE /identity/v3/projects/2b4b670b5aa1407f8675179d6279efab => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:53.982958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67934f9-d1ce-416d-b067-bedbbb4669ae None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:53.987268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67934f9-d1ce-416d-b067-bedbbb4669ae None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:53.987268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67934f9-d1ce-416d-b067-bedbbb4669ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.004233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d67934f9-d1ce-416d-b067-bedbbb4669ae None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:54.005409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d67934f9-d1ce-416d-b067-bedbbb4669ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:54.073051 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3277/6475] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:54.082076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19f73-2aea-4dac-99df-c0b26d2642c5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.082373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19f73-2aea-4dac-99df-c0b26d2642c5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.082656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f19f73-2aea-4dac-99df-c0b26d2642c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.103944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-63f19f73-2aea-4dac-99df-c0b26d2642c5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:54.105194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63f19f73-2aea-4dac-99df-c0b26d2642c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:54.115487 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3199/6476] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:54.124524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67934f9-d1ce-416d-b067-bedbbb4669ae None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:54.129972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67934f9-d1ce-416d-b067-bedbbb4669ae None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:54.134818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:54.135460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.135747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.136029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.136844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:31:54.137275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:54.138879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:54.152687 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3278/6477] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:31:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:31:54.159572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f19f73-2aea-4dac-99df-c0b26d2642c5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:54.168912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f19f73-2aea-4dac-99df-c0b26d2642c5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:54.176199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:54.177361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.184348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.184348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.184348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:54.184348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:54.243025 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3200/6478] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:31:54 2021] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:31:54.247464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:54.259834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d8e91-f521-41a7-879f-c8ef3a4f14a6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:54.324814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:54.325523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.325802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.326078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.334529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:54.336617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:54.488222 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3279/6479] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:31:54 2021] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:31:54.490377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:54.510901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d07f85-11bf-4e1a-9b59-e1c8943933a5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:54.525653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:54.525653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.525653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.525966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.526426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:54.528023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:54.541701 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3201/6480] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:54 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:54.546054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:54.558046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed542caf-16d1-4725-a7e0-cab17ebbf860 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:54.563313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a50b9-1268-4796-8e23-d47bc36f78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:54.564025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a50b9-1268-4796-8e23-d47bc36f78c2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.564307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a50b9-1268-4796-8e23-d47bc36f78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.564722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a50b9-1268-4796-8e23-d47bc36f78c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.565550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a50b9-1268-4796-8e23-d47bc36f78c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:54.567150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a50b9-1268-4796-8e23-d47bc36f78c2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:54.577855 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3280/6481] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:31:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:31:54.583319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:54.602674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eec58-ccb2-4368-916e-632a5f03f094 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:54.607843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:54.608741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.609081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.609353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] PATH_INFO: `/v3/projects/2df0d563ffbd46f29137fd7713ff19ea/users/77f17a14f1b64ee0857d6857531fe8dc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.628968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df0d563ffbd46f29137fd7713ff19ea, user_id=77f17a14f1b64ee0857d6857531fe8dc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:54.631807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:54.705391 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3202/6482] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:31:54 2021] PUT /identity/v3/projects/2df0d563ffbd46f29137fd7713ff19ea/users/77f17a14f1b64ee0857d6857531fe8dc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:31:54.715755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16e55-a767-4fab-a116-8b70e24bf438 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.716043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16e55-a767-4fab-a116-8b70e24bf438 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.716324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d16e55-a767-4fab-a116-8b70e24bf438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.743615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a2d16e55-a767-4fab-a116-8b70e24bf438 None None] MFA Rules not processed for user `77f17a14f1b64ee0857d6857531fe8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:54.744992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a2d16e55-a767-4fab-a116-8b70e24bf438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:54.818140 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3281/6483] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:31:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:54.828682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:54.831142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:54.902640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc709d18-5b30-4d7c-9510-891c1ebce181 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:54.908151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:54.909153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:54.909433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:54.914195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:54.919697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:54.921174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:54.930587 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3203/6484] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:31:54 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:31:57.728971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53756-6a1f-4323-9c84-b918bcb363ef None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:57.729441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53756-6a1f-4323-9c84-b918bcb363ef None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:57.729730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53756-6a1f-4323-9c84-b918bcb363ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:57.757324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-40c53756-6a1f-4323-9c84-b918bcb363ef None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:57.760229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-40c53756-6a1f-4323-9c84-b918bcb363ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:57.839026 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3282/6485] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:31:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:58.058053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:58.059602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:58.195390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b07c8-7528-4862-b775-153c17250f47 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:58.202159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:58.202847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:58.203071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:58.203507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:58.222527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:58.225433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:58.239172 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3204/6486] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:31:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:31:59.628228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f787-b9e6-40b3-9fa5-fb4d86bc836c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:59.629739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f787-b9e6-40b3-9fa5-fb4d86bc836c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:59.630307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f787-b9e6-40b3-9fa5-fb4d86bc836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:59.660862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-62c2f787-b9e6-40b3-9fa5-fb4d86bc836c None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:31:59.663782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-62c2f787-b9e6-40b3-9fa5-fb4d86bc836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:31:59.687676 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3283/6487] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:31:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:31:59.702755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:31:59.716666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1890b-0da2-4bec-9533-89507c5419ba service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:31:59.723021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:31:59.723702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:31:59.724014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:31:59.724290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:31:59.734112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:31:59.736346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:31:59.749196 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3205/6488] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:31:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:00.674568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:00.675085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:00.675305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:00.699991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:00.701512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:00.715145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3284/6489] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:32:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:00.725246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:00.748645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f67ba-72df-4d43-a30e-8a854fad88d3 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:00.755666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e3b0-a286-4873-9460-9051fbb1b205 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:00.756329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e3b0-a286-4873-9460-9051fbb1b205 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:00.756802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e3b0-a286-4873-9460-9051fbb1b205 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:00.757781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e3b0-a286-4873-9460-9051fbb1b205 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:00.767800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911e3b0-a286-4873-9460-9051fbb1b205 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:00.769725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911e3b0-a286-4873-9460-9051fbb1b205 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:00.779614 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3206/6490] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:32:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:01.303032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:01.303032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:01.446698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d5cd1-121a-405a-828b-ace69e93c74a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:01.453602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:01.454618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:01.455343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:01.455867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:01.458234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:01.544165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:01.544667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:01.545171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:01.568395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:01.572361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:01.588273 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3285/6491] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:01 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:32:01.594057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:01.597417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:01.629890 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3207/6492] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:32:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:01.648947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:01.677168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312b08-08c6-440d-b92f-146f0b1199e2 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:01.690517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:01.691397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:01.691865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:01.692575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:01.745574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:01.752734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:01.771493 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3286/6493] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:32:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:08.257466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:08.262137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:08.303012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8785b-185f-4791-8bad-0bc39eaf474e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:08.318060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:08.318953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:08.319398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:08.320799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:08.325140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:08.378123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:08.379298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:08.421186 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3208/6494] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:10.457503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:10.462816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:10.597624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796464-759d-4ae9-a171-95d5c254ff12 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:10.607092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:10.607983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:10.608437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:10.609174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] PATH_INFO: `/v3/users/533e0f997248410b8a86adec8d647c67` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:10.612397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] RBAC: Authorizing `identity:delete_user(user_id=533e0f997248410b8a86adec8d647c67)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:10.615122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:10.791315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:10.814299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f26e85-e70c-4a2d-a614-a5356113578f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:10.820657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e0158-ab1f-472f-9cba-a97240cdf69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:10.821349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e0158-ab1f-472f-9cba-a97240cdf69a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:10.821834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e0158-ab1f-472f-9cba-a97240cdf69a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:10.822109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e0158-ab1f-472f-9cba-a97240cdf69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:10.824225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e4e0158-ab1f-472f-9cba-a97240cdf69a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:10.842166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e0158-ab1f-472f-9cba-a97240cdf69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:10.844057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e0158-ab1f-472f-9cba-a97240cdf69a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:10.861596 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3209/6495] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:10.973025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533e0f997248410b8a86adec8d647c67'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:10.986844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533e0f997248410b8a86adec8d647c67'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:11.012746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533e0f997248410b8a86adec8d647c67'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:11.013758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533e0f997248410b8a86adec8d647c67'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:11.097976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533e0f997248410b8a86adec8d647c67'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:11.106574 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3287/6496] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:10 2021] DELETE /identity/v3/users/533e0f997248410b8a86adec8d647c67 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:11.111733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:11.112333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:11.112766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:11.134895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:11.136811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:11.207914 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3210/6497] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:11.218789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:11.220842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:11.286178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140afcbe-d9ca-4b49-95d8-50edd1fe025b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:11.289998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:11.290655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:11.290943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:11.292800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:11.305738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:11.310808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:11.323469 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3288/6498] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:12.209912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:12.211981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:12.226096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffdecc-455b-4b78-9851-5bf276c94e87 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:12.233020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:12.234211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:12.235765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:12.236362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] PATH_INFO: `/v3/projects/ed197c5baf3c48e6a12fd9ff053dff10` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:12.241192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed197c5baf3c48e6a12fd9ff053dff10)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:12.241192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:12.376208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed197c5baf3c48e6a12fd9ff053dff10', 'request_id': 'req-425fe1dc-87e2-466e-830d-7355920ac461'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.384580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed197c5baf3c48e6a12fd9ff053dff10', 'request_id': 'req-425fe1dc-87e2-466e-830d-7355920ac461'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.513941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed197c5baf3c48e6a12fd9ff053dff10', 'request_id': 'req-425fe1dc-87e2-466e-830d-7355920ac461'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.542032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] The token cache is being invalidate because project ed197c5baf3c48e6a12fd9ff053dff10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:12.542408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.544148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.546905 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3211/6499] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:12 2021] DELETE /identity/v3/projects/ed197c5baf3c48e6a12fd9ff053dff10 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:12.551782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:12.564779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd27b2-fefe-4543-a162-9809d8de206d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:12.639985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:12.641691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:12.641973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:12.642248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] PATH_INFO: `/v3/users/b6f00cf4c0474f78a75d54bbff07e2ee` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:12.643973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f00cf4c0474f78a75d54bbff07e2ee)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:12.646353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:12.893135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f00cf4c0474f78a75d54bbff07e2ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.903947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f00cf4c0474f78a75d54bbff07e2ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.919854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f00cf4c0474f78a75d54bbff07e2ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:12.921616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f00cf4c0474f78a75d54bbff07e2ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:13.110196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f00cf4c0474f78a75d54bbff07e2ee'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:13.131069 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3289/6500] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:12 2021] DELETE /identity/v3/users/b6f00cf4c0474f78a75d54bbff07e2ee => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:13.917195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:13.919157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:13.942521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fe1dc-87e2-466e-830d-7355920ac461 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.009516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.010497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.010886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.011278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] PATH_INFO: `/v3/projects/e847b0d887694ae0854f8496a7f984e6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.012758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e847b0d887694ae0854f8496a7f984e6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.014793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.134317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e847b0d887694ae0854f8496a7f984e6', 'request_id': 'req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.144112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e847b0d887694ae0854f8496a7f984e6', 'request_id': 'req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.211835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.213323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:14.227788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1cb-0943-4f8d-8bda-40939c6b5a24 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.229238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e847b0d887694ae0854f8496a7f984e6', 'request_id': 'req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.248083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] The token cache is being invalidate because project e847b0d887694ae0854f8496a7f984e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:14.248731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.249817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0ce3e02f-f304-4d8a-9c01-e1cd7e970fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.253089 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3212/6501] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:13 2021] DELETE /identity/v3/projects/e847b0d887694ae0854f8496a7f984e6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:14.258690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4b840-cd28-4895-86bb-ccfa80140e79 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.259069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4b840-cd28-4895-86bb-ccfa80140e79 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.259295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4b840-cd28-4895-86bb-ccfa80140e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.281868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a3e4b840-cd28-4895-86bb-ccfa80140e79 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:14.283327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3e4b840-cd28-4895-86bb-ccfa80140e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:14.299761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.301191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.301764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.302285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] PATH_INFO: `/v3/users/c2b731b2ca634360afda4cfc55acc81f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.304378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b731b2ca634360afda4cfc55acc81f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.306664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.352777 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3213/6502] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:14.360756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775e41-e91e-42a2-8cd9-e3854dd16833 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.361074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775e41-e91e-42a2-8cd9-e3854dd16833 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.361346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d775e41-e91e-42a2-8cd9-e3854dd16833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.379550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3d775e41-e91e-42a2-8cd9-e3854dd16833 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:14.380749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3d775e41-e91e-42a2-8cd9-e3854dd16833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:14.388757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3214/6503] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:14.393392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775e41-e91e-42a2-8cd9-e3854dd16833 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.402783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d775e41-e91e-42a2-8cd9-e3854dd16833 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.407599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.408276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.408555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.408831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.409587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:32:14.409891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.411571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.423830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3215/6504] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:32:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:32:14.427780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.439348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7e67c-ba11-4deb-9207-69fb25d12c21 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.444347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.445031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.445320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.445623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.446346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.448238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.540954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b731b2ca634360afda4cfc55acc81f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.545758 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3216/6505] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:14 2021] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:32:14.549812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b731b2ca634360afda4cfc55acc81f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.550337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.564362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b731b2ca634360afda4cfc55acc81f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.565596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b731b2ca634360afda4cfc55acc81f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.616072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba5ad4-b415-47f8-aaac-2ca874fe9b30 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.621057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.621727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.622057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.622289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.622982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.624971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.641512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8ad9e65c-7e79-4a53-ba7c-278f8175af56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b731b2ca634360afda4cfc55acc81f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:14.648304 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3290/6506] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:14 2021] DELETE /identity/v3/users/c2b731b2ca634360afda4cfc55acc81f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:32:14.652957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.653320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.653603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.673483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:14.675233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:14.704670 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3217/6507] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:14 2021] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:32:14.704670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.707070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:14.733609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799100b8-ddd6-447b-8d02-1244fef0a495 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.824465 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3291/6508] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:14.827195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.828130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.828999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.829277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.830019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.831760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.838533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.839985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:14.844314 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3218/6509] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:14 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:32:14.861555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.876538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d665d0e-8159-4227-ae5d-3f4ff6a589aa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.893935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.894617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.894894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.895201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.895938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.897871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.911592 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3219/6510] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:14 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:32:14.916188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:14.927608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351114bd-4bb9-419f-b05d-334a884ac3de admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.937074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f3a57-c61e-4446-b449-e399e05770bf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:14.937913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.940250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.940733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.941020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb35f2-ea54-44f0-af46-ca39f60f876d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:14.941437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] PATH_INFO: `/v3/projects/71418288426545dea311f347bd0cbfdb/users/f2237f90a5db4203805e0a7f287f0964/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.941797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb35f2-ea54-44f0-af46-ca39f60f876d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:14.942145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb35f2-ea54-44f0-af46-ca39f60f876d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:14.942584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb35f2-ea54-44f0-af46-ca39f60f876d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:14.961987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71418288426545dea311f347bd0cbfdb, user_id=f2237f90a5db4203805e0a7f287f0964, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.965674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.984080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb35f2-ea54-44f0-af46-ca39f60f876d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:14.986436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb35f2-ea54-44f0-af46-ca39f60f876d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:14.997301 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3292/6511] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:32:15.068479 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3220/6512] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:14 2021] PUT /identity/v3/projects/71418288426545dea311f347bd0cbfdb/users/f2237f90a5db4203805e0a7f287f0964/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:15.070376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:15.070669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:15.070944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:15.090816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:15.092491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:15.199923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3293/6513] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:15.257780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:15.335554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be886966-7d44-4924-9a74-84a676d0f8a6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:15.340792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c47f6-16f5-484f-815a-b6876259e0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:15.341548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c47f6-16f5-484f-815a-b6876259e0ae service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:15.342268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c47f6-16f5-484f-815a-b6876259e0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:15.342605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c47f6-16f5-484f-815a-b6876259e0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:15.353279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c47f6-16f5-484f-815a-b6876259e0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:15.355701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c47f6-16f5-484f-815a-b6876259e0ae service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:15.371523 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3221/6514] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:15.637476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:15.638935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:15.652426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd9577-9cac-4349-974d-65b994d5eb5b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:15.663855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:15.664753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:15.665064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:15.665523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] PATH_INFO: `/v3/projects/1b4189d0115b4d849f8f9bce9deef49f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:15.667007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4189d0115b4d849f8f9bce9deef49f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:15.669152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:15.808906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4189d0115b4d849f8f9bce9deef49f', 'request_id': 'req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:15.921400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4189d0115b4d849f8f9bce9deef49f', 'request_id': 'req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:15.928746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4189d0115b4d849f8f9bce9deef49f', 'request_id': 'req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:15.950138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] The token cache is being invalidate because project 1b4189d0115b4d849f8f9bce9deef49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:15.950683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:15.952314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:15.973898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3294/6515] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:15 2021] DELETE /identity/v3/projects/1b4189d0115b4d849f8f9bce9deef49f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:18.405849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82688df7-cb1c-499d-a4c0-8622cb2e3b33 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:18.406947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82688df7-cb1c-499d-a4c0-8622cb2e3b33 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:18.407054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82688df7-cb1c-499d-a4c0-8622cb2e3b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:18.444116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-82688df7-cb1c-499d-a4c0-8622cb2e3b33 None None] MFA Rules not processed for user `f2237f90a5db4203805e0a7f287f0964`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:18.445541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-82688df7-cb1c-499d-a4c0-8622cb2e3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:18.550508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3222/6516] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:18.552379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:18.554137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:18.638462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7161d1-cba5-4fd1-8ef9-7837c89e8578 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:18.644598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:18.645342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:18.645625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:18.645904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:18.646622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:18.648754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:18.757810 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3295/6517] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:18 2021] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:18.762160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82688df7-cb1c-499d-a4c0-8622cb2e3b33 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:18.775001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82688df7-cb1c-499d-a4c0-8622cb2e3b33 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:18.832095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:18.832777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:18.833100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:18.833382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:18.834123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:18.836088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:18.958597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3223/6518] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:18 2021] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:18.959770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:18.973087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f982c-871b-47fa-8e60-00f303628a1f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:18.978647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:18.979550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:18.980112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:18.980539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:18.981712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:18.983473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:18.997237 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3296/6519] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:18 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:19.001747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:19.015447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef71fd-bb78-428d-9d56-87e76025b1ed admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:19.035049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:19.035877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:19.036279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:19.036733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] PATH_INFO: `/v3/projects/065784da9c2c4ec791d79f36c0ffb7e9/users/dd61f1d8c49940b992308e416fdb2c6e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:19.056346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065784da9c2c4ec791d79f36c0ffb7e9, user_id=dd61f1d8c49940b992308e416fdb2c6e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:19.059042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:19.156189 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3224/6520] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:19 2021] PUT /identity/v3/projects/065784da9c2c4ec791d79f36c0ffb7e9/users/dd61f1d8c49940b992308e416fdb2c6e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:32:19.158046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:19.175047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d66c5-c014-46c4-b62c-868af3643656 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:19.251758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:19.252563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:19.253376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:19.253775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:19.254600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:19.257042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:19.272612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3297/6521] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:19 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:19.276117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:19.291103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e067577-43c8-4f67-ade3-c43b13f7b727 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:19.297767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad6002-cf3c-4754-9ee0-c4dd4866983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:19.299020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad6002-cf3c-4754-9ee0-c4dd4866983d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:19.299020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad6002-cf3c-4754-9ee0-c4dd4866983d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:19.299242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad6002-cf3c-4754-9ee0-c4dd4866983d admin admin] PATH_INFO: `/v3/projects/065784da9c2c4ec791d79f36c0ffb7e9/users/dd61f1d8c49940b992308e416fdb2c6e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:19.301531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad6002-cf3c-4754-9ee0-c4dd4866983d admin admin] RBAC: Authorizing `identity:create_grant(project_id=065784da9c2c4ec791d79f36c0ffb7e9, user_id=dd61f1d8c49940b992308e416fdb2c6e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:19.304917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad6002-cf3c-4754-9ee0-c4dd4866983d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:19.349002 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3225/6522] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:19 2021] PUT /identity/v3/projects/065784da9c2c4ec791d79f36c0ffb7e9/users/dd61f1d8c49940b992308e416fdb2c6e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:21.131162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:21.132896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:21.146708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b6f1-65e7-4700-ab58-9569a7ad5b24 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:21.220406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:21.221323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:21.221735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:21.222026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] PATH_INFO: `/v3/users/77f17a14f1b64ee0857d6857531fe8dc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:21.223296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f17a14f1b64ee0857d6857531fe8dc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:21.225247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:21.457982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f17a14f1b64ee0857d6857531fe8dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:21.464536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f17a14f1b64ee0857d6857531fe8dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:21.477214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f17a14f1b64ee0857d6857531fe8dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:21.477975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f17a14f1b64ee0857d6857531fe8dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:21.595163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9b94c30f-9963-481d-be39-bcece634e5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f17a14f1b64ee0857d6857531fe8dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:21.601747 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3298/6523] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:21 2021] DELETE /identity/v3/users/77f17a14f1b64ee0857d6857531fe8dc => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:21.606304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:21.606821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:21.606937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:21.625603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:21.626820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:21.653352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b250d-c3b9-4d63-a79f-3b9f011de10e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:21.653683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b250d-c3b9-4d63-a79f-3b9f011de10e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:21.653968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b250d-c3b9-4d63-a79f-3b9f011de10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:21.702906 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3226/6524] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:21.710299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4b0b250d-c3b9-4d63-a79f-3b9f011de10e None None] MFA Rules not processed for user `dd61f1d8c49940b992308e416fdb2c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:21.711584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4b0b250d-c3b9-4d63-a79f-3b9f011de10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:21.713426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:21.714954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:21.789141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811defe5-7be2-4635-86dd-5a69caf43116 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:21.791100 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3299/6525] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:21 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:21.793043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:21.798935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:21.799229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:21.799567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:21.802877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b715-c452-449d-8587-5be377edadbc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:21.803250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b715-c452-449d-8587-5be377edadbc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:21.803942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b715-c452-449d-8587-5be377edadbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:21.812104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:21.814911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:21.826978 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3227/6526] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:32:21.830465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-95c5b715-c452-449d-8587-5be377edadbc None None] MFA Rules not processed for user `f2237f90a5db4203805e0a7f287f0964`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:21.831810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-95c5b715-c452-449d-8587-5be377edadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:21.909124 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3300/6527] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:21 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:21.923790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:21.926268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:22.066551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8763b3-8d87-4163-82c5-82f378abec90 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:22.075076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca5792-0291-4b02-abec-27a433de9088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:22.075743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5792-0291-4b02-abec-27a433de9088 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:22.083217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5792-0291-4b02-abec-27a433de9088 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:22.083217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5792-0291-4b02-abec-27a433de9088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:22.083217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-03ca5792-0291-4b02-abec-27a433de9088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:22.092291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca5792-0291-4b02-abec-27a433de9088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:22.094669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca5792-0291-4b02-abec-27a433de9088 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:22.104405 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3228/6528] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:21 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:22.147656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5b715-c452-449d-8587-5be377edadbc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:22.153185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-95c5b715-c452-449d-8587-5be377edadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:22.180429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5b715-c452-449d-8587-5be377edadbc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:22.187818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:22.187818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:22.187818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:22.187818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] PATH_INFO: `/v3/projects/2df0d563ffbd46f29137fd7713ff19ea` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:22.189933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df0d563ffbd46f29137fd7713ff19ea)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:22.191845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:22.298594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df0d563ffbd46f29137fd7713ff19ea', 'request_id': 'req-d84fb5ba-e339-4c04-ba9b-2881ac42e741'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:22.377605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df0d563ffbd46f29137fd7713ff19ea', 'request_id': 'req-d84fb5ba-e339-4c04-ba9b-2881ac42e741'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:22.384487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df0d563ffbd46f29137fd7713ff19ea', 'request_id': 'req-d84fb5ba-e339-4c04-ba9b-2881ac42e741'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:22.395655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] The token cache is being invalidate because project 2df0d563ffbd46f29137fd7713ff19ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:22.395940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:22.396584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d84fb5ba-e339-4c04-ba9b-2881ac42e741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:22.398649 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3301/6529] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:22 2021] DELETE /identity/v3/projects/2df0d563ffbd46f29137fd7713ff19ea => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:22.404625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93731bb7-c409-4296-9aa9-729e897bc0f9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:22.404936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93731bb7-c409-4296-9aa9-729e897bc0f9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:22.405537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93731bb7-c409-4296-9aa9-729e897bc0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:22.426542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-93731bb7-c409-4296-9aa9-729e897bc0f9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:22.427908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93731bb7-c409-4296-9aa9-729e897bc0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:22.501025 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3229/6530] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:22.508668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f213f-4552-4272-8703-881249bb2fa3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:22.508994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f213f-4552-4272-8703-881249bb2fa3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:22.509529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f213f-4552-4272-8703-881249bb2fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:22.533983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-478f213f-4552-4272-8703-881249bb2fa3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:22.534606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-478f213f-4552-4272-8703-881249bb2fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:22.548496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3302/6531] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:22.554557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93731bb7-c409-4296-9aa9-729e897bc0f9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:22.565096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93731bb7-c409-4296-9aa9-729e897bc0f9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:22.572791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:22.573592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:22.573955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:22.575117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:22.575863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:32:22.576172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:22.578021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:22.596039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3230/6532] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:32:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:32:22.597512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f213f-4552-4272-8703-881249bb2fa3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:22.607205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f213f-4552-4272-8703-881249bb2fa3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:22.612851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:22.614389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:22.614389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:22.614389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:22.614903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:22.617003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:22.747930 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3303/6533] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:22 2021] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:32:22.753868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:22.766142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680f51c-ddc7-4fe9-9794-e2d6dc4725a7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:22.839612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:22.840361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:22.840641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:22.840953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:22.841647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:22.843639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:22.987313 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3231/6534] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:22 2021] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:22.988531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:23.002088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638c5f-1c01-4944-9abb-df3813da7591 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:23.006858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:23.013647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:23.013647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:23.013647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:23.013647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:23.013647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:23.022571 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3304/6535] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:22 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:23.026652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:23.038463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e5ba-df7c-4da8-9454-fd5a5c881bfa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:23.043819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605745-3807-45ff-a379-b496c15ce229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:23.044530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605745-3807-45ff-a379-b496c15ce229 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:23.044816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605745-3807-45ff-a379-b496c15ce229 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:23.045297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605745-3807-45ff-a379-b496c15ce229 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:23.045988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605745-3807-45ff-a379-b496c15ce229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:23.047620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605745-3807-45ff-a379-b496c15ce229 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:23.058904 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3232/6536] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:23.065921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:23.076416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056fcaf-561c-459f-b720-2142580c00a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:23.082190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:23.083408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:23.083747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:23.084088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] PATH_INFO: `/v3/projects/ba455203ac7140c28ff472a7bbf7c17e/users/bd32767601194a32ad1f808cad1e591e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:23.100833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba455203ac7140c28ff472a7bbf7c17e, user_id=bd32767601194a32ad1f808cad1e591e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:23.103618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:23.226233 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3305/6537] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:23 2021] PUT /identity/v3/projects/ba455203ac7140c28ff472a7bbf7c17e/users/bd32767601194a32ad1f808cad1e591e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:23.302864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:23.303085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:23.303334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:23.335246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] MFA Rules not processed for user `bd32767601194a32ad1f808cad1e591e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:23.336477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:23.418434 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3233/6538] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:23 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:23.427650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:23.430082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:23.493783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea6ba1-d221-4f9d-b799-43e2d969dac1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:23.498619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:23.499190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:23.499414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:23.499741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:23.509396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:23.510823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:23.522189 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3306/6539] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:23 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:23.606087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:23.611467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:23.721004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e269d4-3d67-41fc-8676-1f857bcf4ce3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:23.727168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215be12-e82f-4086-937f-f77af0b45df1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:23.727935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215be12-e82f-4086-937f-f77af0b45df1 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:23.728219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215be12-e82f-4086-937f-f77af0b45df1 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:23.728495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215be12-e82f-4086-937f-f77af0b45df1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:23.731037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e215be12-e82f-4086-937f-f77af0b45df1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:23.747267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215be12-e82f-4086-937f-f77af0b45df1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:23.748861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215be12-e82f-4086-937f-f77af0b45df1 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:23.762041 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3234/6540] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:27.230427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:27.232663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:27.439671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894ab5-3d46-4fb4-a410-bbbab9a74e29 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:27.445822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:27.447171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:27.448411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:27.449061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] PATH_INFO: `/v3/users/54abf7f90439451081ee3b38676b6b65` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:27.451509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54abf7f90439451081ee3b38676b6b65)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:27.454875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:27.814743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54abf7f90439451081ee3b38676b6b65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:27.834742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54abf7f90439451081ee3b38676b6b65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:27.859589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54abf7f90439451081ee3b38676b6b65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:27.863102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54abf7f90439451081ee3b38676b6b65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:28.016433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54abf7f90439451081ee3b38676b6b65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:28.024176 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3307/6541] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:27 2021] DELETE /identity/v3/users/54abf7f90439451081ee3b38676b6b65 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:28.152638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:28.153173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:28.153466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:28.176312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:28.177795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:28.239043 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3235/6542] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:32:28 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:28.252641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:28.254692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:28.306364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:28.307864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:28.342874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56c693-b341-47d2-8f73-72a75dc35139 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:28.350717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc253f2-15d9-460d-92ba-b5759095e2ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:28.351377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc253f2-15d9-460d-92ba-b5759095e2ba service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:28.351657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc253f2-15d9-460d-92ba-b5759095e2ba service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:28.351931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc253f2-15d9-460d-92ba-b5759095e2ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:28.361892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc253f2-15d9-460d-92ba-b5759095e2ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:28.363806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc253f2-15d9-460d-92ba-b5759095e2ba service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:28.373408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3308/6543] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:32:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:28.397435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a012e-77d6-43e2-b654-ff15e6513bab None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:28.402149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:28.403007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:28.403289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:28.403562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] PATH_INFO: `/v3/projects/d3625a8207df4cb0a4da19210ca5c80c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:28.404830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3625a8207df4cb0a4da19210ca5c80c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:28.406819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:28.627023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3625a8207df4cb0a4da19210ca5c80c', 'request_id': 'req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:28.644645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3625a8207df4cb0a4da19210ca5c80c', 'request_id': 'req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:28.726011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3625a8207df4cb0a4da19210ca5c80c', 'request_id': 'req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:28.744198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] The token cache is being invalidate because project d3625a8207df4cb0a4da19210ca5c80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:28.744727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:28.747039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48081c55-ba26-4d0d-8aa7-bccf93fdbc5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:28.751118 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3236/6544] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:28 2021] DELETE /identity/v3/projects/d3625a8207df4cb0a4da19210ca5c80c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:32:28.758870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76921a5-fce1-4f34-99dd-7131b6226d08 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:28.758870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76921a5-fce1-4f34-99dd-7131b6226d08 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:28.758870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76921a5-fce1-4f34-99dd-7131b6226d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:28.794620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b76921a5-fce1-4f34-99dd-7131b6226d08 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:28.796755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b76921a5-fce1-4f34-99dd-7131b6226d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:28.926964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3309/6545] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:28.935004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea15e-c40b-4c59-bbb0-5e85846ba542 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:28.935320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea15e-c40b-4c59-bbb0-5e85846ba542 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:28.936016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ea15e-c40b-4c59-bbb0-5e85846ba542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:28.980624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f61ea15e-c40b-4c59-bbb0-5e85846ba542 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:28.988210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f61ea15e-c40b-4c59-bbb0-5e85846ba542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:29.032905 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3237/6546] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:29.037263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76921a5-fce1-4f34-99dd-7131b6226d08 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:29.049580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76921a5-fce1-4f34-99dd-7131b6226d08 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:29.061739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:29.062976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:29.063255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:29.063528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:29.064262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:32:29.064620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:29.068214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:29.122785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ea15e-c40b-4c59-bbb0-5e85846ba542 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:29.136405 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3310/6547] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:32:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:32:29.139376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ea15e-c40b-4c59-bbb0-5e85846ba542 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:29.151783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:29.151783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:29.151783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:29.151783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:29.152361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:29.154127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:29.270073 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3238/6548] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:29 2021] POST /identity/v3/projects => generated 397 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:29.274421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:29.291320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f62a70-fca1-4558-b3d1-162ab59e8daa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:29.402784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:29.404894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:29.406440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:29.406699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:29.409477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:29.412037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:29.532053 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3311/6549] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:29 2021] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:32:29.536043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:29.555275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb460830-0241-4005-b90f-330b4a5f23e6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:29.569183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:29.569830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:29.570375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:29.570834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:29.571732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:29.573906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:29.604131 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3239/6550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:29.608175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:29.620337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded5379-92dd-48d2-9311-0ee3f5d5ca82 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:29.634448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83574d2-5b11-4f61-8031-1731f91a789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:29.635134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83574d2-5b11-4f61-8031-1731f91a789d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:29.635435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83574d2-5b11-4f61-8031-1731f91a789d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:29.636425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83574d2-5b11-4f61-8031-1731f91a789d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:29.636425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83574d2-5b11-4f61-8031-1731f91a789d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:29.648155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83574d2-5b11-4f61-8031-1731f91a789d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:29.672436 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3312/6551] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:29.674667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:29.687789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0af8a-e4e0-4382-8174-9667bfe17aa7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:29.697536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f6db8-8953-4cea-9ee1-27199e154174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:29.700961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6db8-8953-4cea-9ee1-27199e154174 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:29.701288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6db8-8953-4cea-9ee1-27199e154174 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:29.703809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f6db8-8953-4cea-9ee1-27199e154174 admin admin] PATH_INFO: `/v3/projects/ce5e124ac56542edb7381b92b9fe6b47/users/a1f63c41bae14445a47126b7e35c0485/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:29.750676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6db8-8953-4cea-9ee1-27199e154174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5e124ac56542edb7381b92b9fe6b47, user_id=a1f63c41bae14445a47126b7e35c0485, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:29.758222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f6db8-8953-4cea-9ee1-27199e154174 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:29.871575 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3240/6552] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:29 2021] PUT /identity/v3/projects/ce5e124ac56542edb7381b92b9fe6b47/users/a1f63c41bae14445a47126b7e35c0485/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:29.883008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:29.883577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:29.884033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:29.941610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] MFA Rules not processed for user `a1f63c41bae14445a47126b7e35c0485`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:29.945495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:30.135315 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3313/6553] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:30.139280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b555e9-4905-4a2d-bcd9-73ea38ee012a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:30.139641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b555e9-4905-4a2d-bcd9-73ea38ee012a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:30.140599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b555e9-4905-4a2d-bcd9-73ea38ee012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:30.191621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a4b555e9-4905-4a2d-bcd9-73ea38ee012a None None] MFA Rules not processed for user `a1f63c41bae14445a47126b7e35c0485`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:30.193888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a4b555e9-4905-4a2d-bcd9-73ea38ee012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:30.210372 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3241/6554] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:30.289167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:30.293240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:30.445093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8df900-424f-4c96-91c3-a91a81f5d86f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:30.445430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b7bf1-3d1b-4a00-a645-124e1b6553c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:30.447081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7bf1-3d1b-4a00-a645-124e1b6553c4 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:30.447770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7bf1-3d1b-4a00-a645-124e1b6553c4 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:30.448130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b7bf1-3d1b-4a00-a645-124e1b6553c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:30.458760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7bf1-3d1b-4a00-a645-124e1b6553c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:30.460329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b7bf1-3d1b-4a00-a645-124e1b6553c4 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:30.473465 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3314/6555] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:30.497052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174c3a-8a3e-44d6-8b6f-0271282b456e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:30.497335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174c3a-8a3e-44d6-8b6f-0271282b456e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:30.497790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174c3a-8a3e-44d6-8b6f-0271282b456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:30.525531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ce174c3a-8a3e-44d6-8b6f-0271282b456e None None] MFA Rules not processed for user `a1f63c41bae14445a47126b7e35c0485`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:30.527806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce174c3a-8a3e-44d6-8b6f-0271282b456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:30.543142 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3242/6556] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:30.573315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65718-58eb-4cee-aff1-0cc813930b5c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:30.573607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65718-58eb-4cee-aff1-0cc813930b5c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:30.573889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65718-58eb-4cee-aff1-0cc813930b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:30.601939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6ca65718-58eb-4cee-aff1-0cc813930b5c None None] MFA Rules not processed for user `a1f63c41bae14445a47126b7e35c0485`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:30.607698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6ca65718-58eb-4cee-aff1-0cc813930b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:30.626525 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3315/6557] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:30.649564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50378-80d0-4250-8266-ec4ddce536e7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:30.650823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50378-80d0-4250-8266-ec4ddce536e7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:30.650823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae50378-80d0-4250-8266-ec4ddce536e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:30.680412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5ae50378-80d0-4250-8266-ec4ddce536e7 None None] MFA Rules not processed for user `a1f63c41bae14445a47126b7e35c0485`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:30.684259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5ae50378-80d0-4250-8266-ec4ddce536e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:30.699200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3243/6558] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:30.727772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8ebd-c119-48ba-8c7a-28cd6a55745e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:30.728088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8ebd-c119-48ba-8c7a-28cd6a55745e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:30.728370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8ebd-c119-48ba-8c7a-28cd6a55745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:30.749075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-eadc8ebd-c119-48ba-8c7a-28cd6a55745e None None] MFA Rules not processed for user `a1f63c41bae14445a47126b7e35c0485`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:30.750896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eadc8ebd-c119-48ba-8c7a-28cd6a55745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:30.777762 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3316/6559] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:30 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:30.804860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae50378-80d0-4250-8266-ec4ddce536e7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:30.926186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae50378-80d0-4250-8266-ec4ddce536e7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:30.933050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:30.934400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:30.934924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:30.935440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] PATH_INFO: `/v3/users/a1f63c41bae14445a47126b7e35c0485` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:30.938552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f63c41bae14445a47126b7e35c0485)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:30.941365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:31.236708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f63c41bae14445a47126b7e35c0485'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:31.244543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f63c41bae14445a47126b7e35c0485'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:31.256070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f63c41bae14445a47126b7e35c0485'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:31.256777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f63c41bae14445a47126b7e35c0485'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:31.258002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f63c41bae14445a47126b7e35c0485'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:31.334390 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3244/6560] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:30 2021] DELETE /identity/v3/users/a1f63c41bae14445a47126b7e35c0485 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:31.335833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:31.336322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:31.336322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:31.376627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:31.382008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:31.489095 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3317/6561] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:31.500396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:31.506809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:31.597732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d317b2-92c3-4004-bcfc-d74c18869dc4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:31.602536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7d017-0569-4549-94cc-7038d6c0b2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:31.603632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7d017-0569-4549-94cc-7038d6c0b2ef service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:31.604073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7d017-0569-4549-94cc-7038d6c0b2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:31.604578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7d017-0569-4549-94cc-7038d6c0b2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:31.618578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7d017-0569-4549-94cc-7038d6c0b2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:31.620569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7d017-0569-4549-94cc-7038d6c0b2ef service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:31.632959 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3245/6562] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:32.302561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:32.304060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:32.334090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e42c6-62bd-4ebd-9756-f19e073062b8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:32.347710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:32.347710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:32.347710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:32.347710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] PATH_INFO: `/v3/projects/ce5e124ac56542edb7381b92b9fe6b47` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:32.348544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5e124ac56542edb7381b92b9fe6b47)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:32.348544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:32.500559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5e124ac56542edb7381b92b9fe6b47', 'request_id': 'req-ed949ceb-b889-4482-8cdd-e4943193ee09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:32.595660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5e124ac56542edb7381b92b9fe6b47', 'request_id': 'req-ed949ceb-b889-4482-8cdd-e4943193ee09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:32.604807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5e124ac56542edb7381b92b9fe6b47', 'request_id': 'req-ed949ceb-b889-4482-8cdd-e4943193ee09'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:32.618028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] The token cache is being invalidate because project ce5e124ac56542edb7381b92b9fe6b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:32.618323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:32.619307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ed949ceb-b889-4482-8cdd-e4943193ee09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:32.620967 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3318/6563] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:32 2021] DELETE /identity/v3/projects/ce5e124ac56542edb7381b92b9fe6b47 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:32.628716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852cb7f-88cb-4e9d-aab2-eaf46bcaefc3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:32.629670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852cb7f-88cb-4e9d-aab2-eaf46bcaefc3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:32.629949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852cb7f-88cb-4e9d-aab2-eaf46bcaefc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:32.653260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c852cb7f-88cb-4e9d-aab2-eaf46bcaefc3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:32.655106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c852cb7f-88cb-4e9d-aab2-eaf46bcaefc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:32.731856 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3246/6564] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:32.747266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221bfc7-54c2-43cc-b9ad-e95cfb9b354b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:32.747784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221bfc7-54c2-43cc-b9ad-e95cfb9b354b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:32.747784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221bfc7-54c2-43cc-b9ad-e95cfb9b354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:32.772842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c221bfc7-54c2-43cc-b9ad-e95cfb9b354b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:32.774557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c221bfc7-54c2-43cc-b9ad-e95cfb9b354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:32.783505 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3319/6565] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:32.787611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852cb7f-88cb-4e9d-aab2-eaf46bcaefc3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:32.798400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852cb7f-88cb-4e9d-aab2-eaf46bcaefc3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:32.804395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:32.805385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:32.805782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:32.810328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:32.810328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:32:32.810328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:32.810328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:32.824478 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3247/6566] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:32:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:32:32.830083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221bfc7-54c2-43cc-b9ad-e95cfb9b354b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:32.840732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221bfc7-54c2-43cc-b9ad-e95cfb9b354b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:32.845289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:32.845997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:32.846309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:32.846587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:32.847234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:32.849138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:33.085918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3320/6567] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:32 2021] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:33.087553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:33.098052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755f46c-046d-4622-b7ae-13f0ce9eb90e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:33.155157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:33.155892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:33.156176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:33.156457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:33.157183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:33.159162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:33.288983 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3248/6568] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:33 2021] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:33.293058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:33.309276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104959e-21f2-429f-8f5f-ce595eeacce8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:33.319953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:33.320791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:33.321204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:33.321901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:33.323342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:33.326524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:33.341686 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3321/6569] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:33 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:33.351589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:33.364814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd25ec0-9502-4d98-9347-77692107556b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:33.371183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163085f-217e-478c-806b-0107ec7b78b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:33.372487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163085f-217e-478c-806b-0107ec7b78b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:33.373365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163085f-217e-478c-806b-0107ec7b78b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:33.376698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163085f-217e-478c-806b-0107ec7b78b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:33.377980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163085f-217e-478c-806b-0107ec7b78b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:33.380348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163085f-217e-478c-806b-0107ec7b78b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:33.394922 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3249/6570] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:33 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:33.400707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:33.412628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75773ec-91c0-409f-b0de-5b76f512f302 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:33.426386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:33.428742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:33.428742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:33.428742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] PATH_INFO: `/v3/projects/fd4a43ad54d448798e4a36160a2a6476/users/0f04cf22c6134aa3ac22cc1d3ae153e7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:33.456491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4a43ad54d448798e4a36160a2a6476, user_id=0f04cf22c6134aa3ac22cc1d3ae153e7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:33.463319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:33.580970 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3322/6571] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:33 2021] PUT /identity/v3/projects/fd4a43ad54d448798e4a36160a2a6476/users/0f04cf22c6134aa3ac22cc1d3ae153e7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:33.585922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855740a-4195-4d45-a5b7-cc337cc11a2e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:33.586621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855740a-4195-4d45-a5b7-cc337cc11a2e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:33.587347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855740a-4195-4d45-a5b7-cc337cc11a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:33.634391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b855740a-4195-4d45-a5b7-cc337cc11a2e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:33.635963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b855740a-4195-4d45-a5b7-cc337cc11a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:33.709349 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3250/6572] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:33.721020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:33.723477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:33.802434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d96457-ad3d-469f-8b5c-343aeeb5b0b2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:33.806636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:33.807772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:33.808057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:33.808339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:33.819410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:33.823227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:33.855462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3323/6573] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:35.730793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44054e0c-f269-4cca-b817-3656e37369de None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:35.733250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44054e0c-f269-4cca-b817-3656e37369de None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:35.733250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44054e0c-f269-4cca-b817-3656e37369de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:35.809200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-44054e0c-f269-4cca-b817-3656e37369de None None] MFA Rules not processed for user `0f04cf22c6134aa3ac22cc1d3ae153e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:35.815234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44054e0c-f269-4cca-b817-3656e37369de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:36.011440 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3251/6574] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:36.026359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:36.028770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:36.216318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44054e0c-f269-4cca-b817-3656e37369de None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:36.218658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44054e0c-f269-4cca-b817-3656e37369de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:36.226534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f4881-b083-4d27-b2ee-6d62459602a7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:36.242398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38afbe6-a71f-4e91-b790-40c9d69b191a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:36.243540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38afbe6-a71f-4e91-b790-40c9d69b191a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:36.244169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38afbe6-a71f-4e91-b790-40c9d69b191a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:36.244511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38afbe6-a71f-4e91-b790-40c9d69b191a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:36.255567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44054e0c-f269-4cca-b817-3656e37369de None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:36.266746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:36.268912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:36.268912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:36.268912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] PATH_INFO: `/v3/users/bd32767601194a32ad1f808cad1e591e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:36.269470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38afbe6-a71f-4e91-b790-40c9d69b191a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:36.272151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd32767601194a32ad1f808cad1e591e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:36.273506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38afbe6-a71f-4e91-b790-40c9d69b191a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:36.274504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:36.297443 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3324/6575] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:36 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:36.494839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd32767601194a32ad1f808cad1e591e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:36.516270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd32767601194a32ad1f808cad1e591e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:36.550663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd32767601194a32ad1f808cad1e591e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:36.552695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd32767601194a32ad1f808cad1e591e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:36.555050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd32767601194a32ad1f808cad1e591e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:36.681850 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3252/6576] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:36 2021] DELETE /identity/v3/users/bd32767601194a32ad1f808cad1e591e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:36.686951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:36.687764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:36.688292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:36.710043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:36.715175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:36.970943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3325/6577] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:36.988126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:36.990711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:37.103206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe8c2-ab5a-4322-ab08-0589173dd468 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:37.107915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a2ff2-0903-40cf-9866-eb92cd248c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:37.108911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2ff2-0903-40cf-9866-eb92cd248c94 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:37.110435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2ff2-0903-40cf-9866-eb92cd248c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:37.111017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a2ff2-0903-40cf-9866-eb92cd248c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:37.122976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2ff2-0903-40cf-9866-eb92cd248c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:37.124515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a2ff2-0903-40cf-9866-eb92cd248c94 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:37.137277 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3253/6578] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:37.522310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:37.523771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:37.550676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eddf0-6960-4a08-ad99-a9179d5e0843 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:37.557139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:37.557905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:37.558186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:37.558462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] PATH_INFO: `/v3/projects/ba455203ac7140c28ff472a7bbf7c17e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:37.559913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba455203ac7140c28ff472a7bbf7c17e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:37.561969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:37.680049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba455203ac7140c28ff472a7bbf7c17e', 'request_id': 'req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:37.804072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba455203ac7140c28ff472a7bbf7c17e', 'request_id': 'req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:37.821930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba455203ac7140c28ff472a7bbf7c17e', 'request_id': 'req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:37.852797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] The token cache is being invalidate because project ba455203ac7140c28ff472a7bbf7c17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:37.852797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:37.854002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-43430b8b-8c1f-4501-9f6a-59dbb83b02ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:37.856740 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3326/6579] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:37 2021] DELETE /identity/v3/projects/ba455203ac7140c28ff472a7bbf7c17e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:37.863798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4acb-91ab-4792-b66b-cf85c352c9c4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:37.864304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4acb-91ab-4792-b66b-cf85c352c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:37.864834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4acb-91ab-4792-b66b-cf85c352c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:37.888604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6d4d4acb-91ab-4792-b66b-cf85c352c9c4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:37.890513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d4d4acb-91ab-4792-b66b-cf85c352c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:38.001507 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3254/6580] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:38.009195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c5bd-564b-4567-b6ab-6982f5cf6aa2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.009935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c5bd-564b-4567-b6ab-6982f5cf6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.010501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c5bd-564b-4567-b6ab-6982f5cf6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.042900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d121c5bd-564b-4567-b6ab-6982f5cf6aa2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:38.044403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d121c5bd-564b-4567-b6ab-6982f5cf6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:38.054399 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3327/6581] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:38.058877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4acb-91ab-4792-b66b-cf85c352c9c4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:38.079920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4acb-91ab-4792-b66b-cf85c352c9c4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:38.085442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:38.086335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.087258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.087706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.089197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:32:38.089869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:38.093101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:38.123481 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3255/6582] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:32:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:32:38.131172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121c5bd-564b-4567-b6ab-6982f5cf6aa2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:38.147058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121c5bd-564b-4567-b6ab-6982f5cf6aa2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:38.153392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62555e5a-c5a3-4301-b616-adee81d46771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:38.165350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555e5a-c5a3-4301-b616-adee81d46771 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.165815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555e5a-c5a3-4301-b616-adee81d46771 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.166944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555e5a-c5a3-4301-b616-adee81d46771 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.167949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555e5a-c5a3-4301-b616-adee81d46771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:38.170525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62555e5a-c5a3-4301-b616-adee81d46771 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:38.326766 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3328/6583] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:38 2021] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:38.332540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:38.354100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e705937-9350-47e3-b847-3d978f4924f3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:38.486482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:38.487284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.487577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.487854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.488558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:38.492389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:38.631051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bde9b-cae9-474a-ba87-6088f66eb8a2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.631623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bde9b-cae9-474a-ba87-6088f66eb8a2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.631623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bde9b-cae9-474a-ba87-6088f66eb8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.647925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3256/6584] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:38 2021] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:38.654226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:38.667766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9a6bde9b-cae9-474a-ba87-6088f66eb8a2 None None] MFA Rules not processed for user `0f04cf22c6134aa3ac22cc1d3ae153e7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:38.669668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9a6bde9b-cae9-474a-ba87-6088f66eb8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:38.672480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f112-6fad-45c4-9cff-aec02b412a70 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:38.680757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:38.682661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.683820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.684326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.686050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:38.689745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:38.704544 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3257/6585] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:38 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:38.710475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:38.732154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48760d57-a8f1-4577-83a9-a304304fb56f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:38.739996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eb95d-3f32-4fce-aa3b-832e016f3dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:38.741633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eb95d-3f32-4fce-aa3b-832e016f3dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.742331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eb95d-3f32-4fce-aa3b-832e016f3dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.742938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eb95d-3f32-4fce-aa3b-832e016f3dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.744075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eb95d-3f32-4fce-aa3b-832e016f3dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:38.746219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eb95d-3f32-4fce-aa3b-832e016f3dc6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:38.748361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3329/6586] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:38 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:38.763031 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3258/6587] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:38 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:38.768223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bde9b-cae9-474a-ba87-6088f66eb8a2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:38.790820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bde9b-cae9-474a-ba87-6088f66eb8a2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:38.798320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:38.800813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.801131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.801981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] PATH_INFO: `/v3/projects/758f44503e1c41dc9aecca962e0c75f6/users/3a838ec078394a5cba918617920febff/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.822436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758f44503e1c41dc9aecca962e0c75f6, user_id=3a838ec078394a5cba918617920febff, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:38.825185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:38.927074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3330/6588] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:38 2021] PUT /identity/v3/projects/758f44503e1c41dc9aecca962e0c75f6/users/3a838ec078394a5cba918617920febff/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:38.939064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a2c4-2680-43fc-9b27-5becd872de6d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:38.939362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a2c4-2680-43fc-9b27-5becd872de6d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:38.939643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a2c4-2680-43fc-9b27-5becd872de6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:38.990567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6ee1a2c4-2680-43fc-9b27-5becd872de6d None None] MFA Rules not processed for user `3a838ec078394a5cba918617920febff`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:38.992559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6ee1a2c4-2680-43fc-9b27-5becd872de6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:39.090170 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3259/6589] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:38 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:39.094579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:39.230610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6849-1683-4d2c-8a5c-1edff5392d40 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:39.246405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:39.250916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:39.250916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:39.252093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:39.254380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:39.258225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:39.379063 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3331/6590] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:39 2021] POST /identity/v3/projects => generated 371 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:39.380285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1a2c4-2680-43fc-9b27-5becd872de6d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:39.396616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1a2c4-2680-43fc-9b27-5becd872de6d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:39.526220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:39.527334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:39.527833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:39.528297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:39.529303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:39.533381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:39.850520 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3260/6591] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:39 2021] POST /identity/v3/users => generated 292 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:32:39.853210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:39.868422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14473231-6419-4169-9a10-4b86af8b5fa9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:39.875020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:39.876403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:39.877079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:39.877597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:39.880122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:39.882100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:39.902192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:39.914356 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3332/6592] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:39 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:39.923170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cb6f7-b1f7-4330-826f-8b0d62c2f78a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:39.937569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:39.943354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:39.943354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:39.943354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] PATH_INFO: `/v3/projects/30c46ac2ae5b47ed9025da4c12ac0d41/users/52233d3e7d064c6e9ba87283f4a0eb7b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:39.988689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c46ac2ae5b47ed9025da4c12ac0d41, user_id=52233d3e7d064c6e9ba87283f4a0eb7b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:39.991631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:40.095300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:40.096068 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3261/6593] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:39 2021] PUT /identity/v3/projects/30c46ac2ae5b47ed9025da4c12ac0d41/users/52233d3e7d064c6e9ba87283f4a0eb7b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:40.107979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcde40-21de-439e-805f-d3d24ab5b806 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:40.227905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206a224-d1af-4dbd-9eaa-e4d482602669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:40.230371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a224-d1af-4dbd-9eaa-e4d482602669 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:40.233385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a224-d1af-4dbd-9eaa-e4d482602669 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:40.239055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a224-d1af-4dbd-9eaa-e4d482602669 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:40.239055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206a224-d1af-4dbd-9eaa-e4d482602669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:40.239055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206a224-d1af-4dbd-9eaa-e4d482602669 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:40.259414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3333/6594] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:32:40 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:32:40.265519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:40.281144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1ad4f-8a2c-4239-937e-fb068e58cf1c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:40.290154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:40.291814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:40.292272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:40.292721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] PATH_INFO: `/v3/projects/30c46ac2ae5b47ed9025da4c12ac0d41/users/52233d3e7d064c6e9ba87283f4a0eb7b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:40.295120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c46ac2ae5b47ed9025da4c12ac0d41, user_id=52233d3e7d064c6e9ba87283f4a0eb7b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:40.298119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:40.318612 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3262/6595] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:32:40 2021] PUT /identity/v3/projects/30c46ac2ae5b47ed9025da4c12ac0d41/users/52233d3e7d064c6e9ba87283f4a0eb7b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:40.327658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68ee4c-9a9c-4ed6-8408-61820dff69fe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:40.327950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68ee4c-9a9c-4ed6-8408-61820dff69fe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:40.328227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68ee4c-9a9c-4ed6-8408-61820dff69fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:40.358835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-eb68ee4c-9a9c-4ed6-8408-61820dff69fe None None] MFA Rules not processed for user `52233d3e7d064c6e9ba87283f4a0eb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:40.360346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eb68ee4c-9a9c-4ed6-8408-61820dff69fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:40.473012 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3334/6596] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:40 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:32:40.479998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:40.482190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:40.555160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313e0d4-505d-4595-9e29-5c657bd2b592 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:40.560687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:40.561614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:40.562094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:40.562658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:40.583290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:40.586582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:40.606424 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3263/6597] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:40 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:40.897975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68ee4c-9a9c-4ed6-8408-61820dff69fe None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:40.915664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68ee4c-9a9c-4ed6-8408-61820dff69fe None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:40.921013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:40.922009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:40.922392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:40.922754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:41.073236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:41.075265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:41.101630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3335/6598] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:40 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:32:42.551219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:42.571059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af862a1b-eed3-4474-a88f-e25e681ced57 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:42.584849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:42.584849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:42.584849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:42.584849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:42.589935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:42.714110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:42.716689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:42.732708 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3264/6599] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:42 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:58.486085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:58.487931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:58.614482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d679b8-05bf-46cb-8005-020c99556de1 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:58.629945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:58.632061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:58.632355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:58.632638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] PATH_INFO: `/v3/users/0f04cf22c6134aa3ac22cc1d3ae153e7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:58.634940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f04cf22c6134aa3ac22cc1d3ae153e7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:58.639041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:58.887335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f04cf22c6134aa3ac22cc1d3ae153e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:58.895103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f04cf22c6134aa3ac22cc1d3ae153e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:58.907829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f04cf22c6134aa3ac22cc1d3ae153e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:58.908620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f04cf22c6134aa3ac22cc1d3ae153e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:58.993404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f04cf22c6134aa3ac22cc1d3ae153e7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:58.999896 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3336/6600] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:32:58 2021] DELETE /identity/v3/users/0f04cf22c6134aa3ac22cc1d3ae153e7 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:32:59.324385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:59.336274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a752858-2228-4366-9963-0b6f51563f30 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:59.407885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:59.408724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:59.409041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:59.409320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] PATH_INFO: `/v3/projects/fd4a43ad54d448798e4a36160a2a6476` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:59.410523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4a43ad54d448798e4a36160a2a6476)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:59.412425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:59.487272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:59.488689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:59.513994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4a43ad54d448798e4a36160a2a6476', 'request_id': 'req-4586793a-b8fc-44ff-b4e5-edaa87f5d022'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:59.520562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4a43ad54d448798e4a36160a2a6476', 'request_id': 'req-4586793a-b8fc-44ff-b4e5-edaa87f5d022'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:59.551989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa31a5-7397-4e09-9cce-c994a1c8d658 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:59.576348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4a43ad54d448798e4a36160a2a6476', 'request_id': 'req-4586793a-b8fc-44ff-b4e5-edaa87f5d022'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:59.588636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] The token cache is being invalidate because project fd4a43ad54d448798e4a36160a2a6476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:32:59.589046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:59.589775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4586793a-b8fc-44ff-b4e5-edaa87f5d022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:32:59.592285 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3265/6601] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:32:59 2021] DELETE /identity/v3/projects/fd4a43ad54d448798e4a36160a2a6476 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:32:59.598999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac957c8-cd7c-41c1-9f16-59fad519f2e9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:59.599477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac957c8-cd7c-41c1-9f16-59fad519f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:59.599763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac957c8-cd7c-41c1-9f16-59fad519f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:59.602172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464eca5-4e85-48d9-80a6-9d082e6c76d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:59.602832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464eca5-4e85-48d9-80a6-9d082e6c76d9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:59.603110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464eca5-4e85-48d9-80a6-9d082e6c76d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:59.603561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464eca5-4e85-48d9-80a6-9d082e6c76d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:59.606078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c464eca5-4e85-48d9-80a6-9d082e6c76d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:59.620002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464eca5-4e85-48d9-80a6-9d082e6c76d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:59.620858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4ac957c8-cd7c-41c1-9f16-59fad519f2e9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:59.621781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464eca5-4e85-48d9-80a6-9d082e6c76d9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:59.622244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4ac957c8-cd7c-41c1-9f16-59fad519f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:59.633928 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3337/6602] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:32:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:32:59.684732 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3266/6603] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:59.692628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d934-dec9-40e7-8e89-3ee00d63a459 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:59.692950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d934-dec9-40e7-8e89-3ee00d63a459 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:59.693226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d934-dec9-40e7-8e89-3ee00d63a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:59.713570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e1b4d934-dec9-40e7-8e89-3ee00d63a459 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:32:59.714942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e1b4d934-dec9-40e7-8e89-3ee00d63a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:32:59.723550 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3338/6604] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:32:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:32:59.727836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac957c8-cd7c-41c1-9f16-59fad519f2e9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:59.738274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac957c8-cd7c-41c1-9f16-59fad519f2e9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:59.743055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:59.743710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:59.743990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:59.744293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:59.745049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:32:59.745358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:59.746957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:59.762287 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3267/6605] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:32:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:32:59.763482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4d934-dec9-40e7-8e89-3ee00d63a459 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:59.773847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4d934-dec9-40e7-8e89-3ee00d63a459 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:59.792522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:59.792522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:59.792522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:59.792522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:59.793026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:59.793026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:32:59.887432 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3339/6606] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:32:59 2021] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:32:59.891566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:32:59.902353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70de1-9606-4a72-8e44-e5b66a1ff917 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:32:59.964639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e8f53-c1de-4fa1-a2f4-d8b2d3e2684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:32:59.965370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8f53-c1de-4fa1-a2f4-d8b2d3e2684d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:32:59.965658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8f53-c1de-4fa1-a2f4-d8b2d3e2684d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:32:59.967169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8f53-c1de-4fa1-a2f4-d8b2d3e2684d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:32:59.967169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e8f53-c1de-4fa1-a2f4-d8b2d3e2684d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:32:59.969004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e8f53-c1de-4fa1-a2f4-d8b2d3e2684d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:00.067267 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3268/6607] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:32:59 2021] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:00.068568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:00.083838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619048c-b042-47b6-82db-d380ade13ec2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:00.089211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:00.090142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:00.090427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:00.090703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:00.091552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:00.093041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:00.102537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:00.103391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:00.103854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:00.104934 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3340/6608] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:00 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:00.109027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:00.126938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfb77d-8045-4231-a44c-a5e8d1832508 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:00.133736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:00.134778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:00.135217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:00.135710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:00.136708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:00.138942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:00.142050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:00.143667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:00.159292 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3341/6609] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:00 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:00.163442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:00.175971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73244ce9-28ee-495d-8ae6-03c1652c8ba3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:00.182679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a373cbd-f944-4a32-bac7-45a4f2aeb166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:00.183576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373cbd-f944-4a32-bac7-45a4f2aeb166 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:00.184476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373cbd-f944-4a32-bac7-45a4f2aeb166 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:00.184781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373cbd-f944-4a32-bac7-45a4f2aeb166 admin admin] PATH_INFO: `/v3/projects/ac1acf7a8cbb44ce80756e3508b9b392/users/57b60038227d40fabb353ef15c464cc2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:00.207189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a373cbd-f944-4a32-bac7-45a4f2aeb166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1acf7a8cbb44ce80756e3508b9b392, user_id=57b60038227d40fabb353ef15c464cc2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:00.210743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a373cbd-f944-4a32-bac7-45a4f2aeb166 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:00.214004 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3269/6610] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:33:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:00.235430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:00.236233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:00.298791 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3342/6611] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:00 2021] PUT /identity/v3/projects/ac1acf7a8cbb44ce80756e3508b9b392/users/57b60038227d40fabb353ef15c464cc2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:00.301828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:00.302403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:00.302781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:00.335793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:00.337051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:00.349331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7dcbb-ebdf-48c0-84d4-f7d81b7cf1b1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:00.413669 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3343/6612] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:00.422322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dba4a2-9108-418e-939a-c01ccecf3507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:00.423193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba4a2-9108-418e-939a-c01ccecf3507 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:00.423493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba4a2-9108-418e-939a-c01ccecf3507 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:00.423772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba4a2-9108-418e-939a-c01ccecf3507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:00.425682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:00.427653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:00.485027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dba4a2-9108-418e-939a-c01ccecf3507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:00.486694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dba4a2-9108-418e-939a-c01ccecf3507 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:00.492852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f95eb7-ba09-424b-9f05-0dd7c7727ae9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:00.496681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f8834-969e-4836-b6f3-6ff778f71953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:00.497355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f8834-969e-4836-b6f3-6ff778f71953 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:00.497656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f8834-969e-4836-b6f3-6ff778f71953 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:00.498081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f8834-969e-4836-b6f3-6ff778f71953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:00.498235 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3270/6613] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:33:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:33:00.509447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f8834-969e-4836-b6f3-6ff778f71953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:00.510943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f8834-969e-4836-b6f3-6ff778f71953 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:00.522691 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3344/6614] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:33:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:33:01.965070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:01.965646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:01.965880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:01.992659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] MFA Rules not processed for user `57b60038227d40fabb353ef15c464cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:01.993830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:02.060380 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3271/6615] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:02.072421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484f23-50c0-4401-a5e8-c19d939efee9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:02.072963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484f23-50c0-4401-a5e8-c19d939efee9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:02.073106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484f23-50c0-4401-a5e8-c19d939efee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:02.094864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-11484f23-50c0-4401-a5e8-c19d939efee9 None None] MFA Rules not processed for user `57b60038227d40fabb353ef15c464cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:02.096108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-11484f23-50c0-4401-a5e8-c19d939efee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:02.103633 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3345/6616] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:02 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:02.115897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:02.117308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:02.203553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f0309-e1fb-4d49-af8e-4fb180710968 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:02.209748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:02.210391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:02.210700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:02.210970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:02.218807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:02.220380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:02.229549 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3272/6617] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:33:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:33:02.496054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67380d21-19fe-4b00-ab7a-ef66912e6ad2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:02.496342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67380d21-19fe-4b00-ab7a-ef66912e6ad2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:02.496633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67380d21-19fe-4b00-ab7a-ef66912e6ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:02.514482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-67380d21-19fe-4b00-ab7a-ef66912e6ad2 None None] MFA Rules not processed for user `171c198b6b734cd698b3c1eaf76a0234`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:02.515861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-67380d21-19fe-4b00-ab7a-ef66912e6ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:02.582473 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3346/6618] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:02 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:11.898555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:11.900082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:11.915117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fbafb-948c-4cf7-8ffb-99bf30347a64 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:11.920152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:11.921347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:11.921658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:11.921997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] PATH_INFO: `/v3/users/0af5c61e37b747608ee6af2f8f75f412` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:11.923298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af5c61e37b747608ee6af2f8f75f412)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:11.925348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:12.194221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af5c61e37b747608ee6af2f8f75f412'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.204681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af5c61e37b747608ee6af2f8f75f412'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.217663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af5c61e37b747608ee6af2f8f75f412'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.218540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af5c61e37b747608ee6af2f8f75f412'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.219860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-751e4adb-dd17-4bae-a4a6-6599f0f4a3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af5c61e37b747608ee6af2f8f75f412'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.290827 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3273/6619] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:11 2021] DELETE /identity/v3/users/0af5c61e37b747608ee6af2f8f75f412 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:12.572910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67380d21-19fe-4b00-ab7a-ef66912e6ad2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:12.595370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67380d21-19fe-4b00-ab7a-ef66912e6ad2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:12.654197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:12.655028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:12.655297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:12.655569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] PATH_INFO: `/v3/projects/8ece5e5ef72d4614b89456ee37fe94f3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:12.656761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ece5e5ef72d4614b89456ee37fe94f3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:12.658737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:12.792417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ece5e5ef72d4614b89456ee37fe94f3', 'request_id': 'req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.882213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ece5e5ef72d4614b89456ee37fe94f3', 'request_id': 'req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.888809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ece5e5ef72d4614b89456ee37fe94f3', 'request_id': 'req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.899226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] The token cache is being invalidate because project 8ece5e5ef72d4614b89456ee37fe94f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:12.899516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.900223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da5c2939-e07e-4ff4-81fb-1a870e2c2bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:12.901776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3347/6620] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:12 2021] DELETE /identity/v3/projects/8ece5e5ef72d4614b89456ee37fe94f3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:12.907709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e56630-8329-4b78-96fa-633894454c53 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:12.908180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e56630-8329-4b78-96fa-633894454c53 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:12.908308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e56630-8329-4b78-96fa-633894454c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:12.926680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-00e56630-8329-4b78-96fa-633894454c53 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:12.928025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-00e56630-8329-4b78-96fa-633894454c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:12.989788 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3274/6621] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:12.997400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8984c3-d8e0-4026-a7f1-ac247663f8b2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:12.997786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8984c3-d8e0-4026-a7f1-ac247663f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:12.998074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8984c3-d8e0-4026-a7f1-ac247663f8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.018060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2d8984c3-d8e0-4026-a7f1-ac247663f8b2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:13.019268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2d8984c3-d8e0-4026-a7f1-ac247663f8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:13.027647 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3348/6622] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:33:13.031807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e56630-8329-4b78-96fa-633894454c53 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:13.041426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e56630-8329-4b78-96fa-633894454c53 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:13.046548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:13.047742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.048019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.048461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.049235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:13.049540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:13.051251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:13.063954 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3275/6623] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:33:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:13.068016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8984c3-d8e0-4026-a7f1-ac247663f8b2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:13.077221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8984c3-d8e0-4026-a7f1-ac247663f8b2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:13.082246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:13.082898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.083180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.083456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.084142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:13.086081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:13.189683 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3349/6624] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:13 2021] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:13.193773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:13.203953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e8443-daa5-4344-9183-66337ae83365 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:13.262207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:13.262882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.263164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.263482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.264246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:13.266452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:13.351880 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3276/6625] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:13 2021] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:13.355480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:13.367916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccf049-1e2f-4feb-b81c-a03f72c0aa7d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:13.372847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:13.373599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.373951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.374311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.375105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:13.376846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:13.391253 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3350/6626] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:33:13.392558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:13.402767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995c5e9-bc34-4edf-b41a-8b6733d3372c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:13.407875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84bf23-1fdb-4b84-95ec-4ddf7ed602dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:13.408521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bf23-1fdb-4b84-95ec-4ddf7ed602dd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.408791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bf23-1fdb-4b84-95ec-4ddf7ed602dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.409162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bf23-1fdb-4b84-95ec-4ddf7ed602dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.415227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84bf23-1fdb-4b84-95ec-4ddf7ed602dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:13.415227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84bf23-1fdb-4b84-95ec-4ddf7ed602dd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:13.421403 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3277/6627] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:13.426040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:13.435853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ce6c8-0f12-4f1b-ab46-4cc9b736794a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:13.445093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:13.445093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.445093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.445093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] PATH_INFO: `/v3/projects/45b0c92954754ea791ec111677972332/users/4a10d60f8b244da881d219d6fdc011f5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.461683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b0c92954754ea791ec111677972332, user_id=4a10d60f8b244da881d219d6fdc011f5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:13.464717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:13.528830 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3351/6628] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:13 2021] PUT /identity/v3/projects/45b0c92954754ea791ec111677972332/users/4a10d60f8b244da881d219d6fdc011f5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:13.540042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.540331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.540613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.573412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] MFA Rules not processed for user `4a10d60f8b244da881d219d6fdc011f5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:13.578550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:13.644588 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3278/6629] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:13 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:13.654888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:13.657621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:13.733428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efa927-aa16-41b6-b778-b872dff2032f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:13.737768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9ab5b-7b87-4970-8084-bb366518a185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:13.738416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ab5b-7b87-4970-8084-bb366518a185 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:13.738698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ab5b-7b87-4970-8084-bb366518a185 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:13.739022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ab5b-7b87-4970-8084-bb366518a185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:13.748244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9ab5b-7b87-4970-8084-bb366518a185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:13.749724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9ab5b-7b87-4970-8084-bb366518a185 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:13.758714 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3352/6630] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:33:13 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:33:16.148830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:16.150546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:16.227922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49e2ea-4231-4fa0-98a1-a00d3699dad6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:16.233841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01f5ec-6338-40aa-8e13-6272d2c4efb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:16.235101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f5ec-6338-40aa-8e13-6272d2c4efb8 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:16.235377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f5ec-6338-40aa-8e13-6272d2c4efb8 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:16.235647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f5ec-6338-40aa-8e13-6272d2c4efb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:16.237412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7d01f5ec-6338-40aa-8e13-6272d2c4efb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:16.293791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01f5ec-6338-40aa-8e13-6272d2c4efb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:16.295322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01f5ec-6338-40aa-8e13-6272d2c4efb8 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:16.305329 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3279/6631] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:33:16 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:33:17.413181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607578a-30b0-4e60-98d4-eaeecf379f4d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:17.414293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607578a-30b0-4e60-98d4-eaeecf379f4d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:17.414787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607578a-30b0-4e60-98d4-eaeecf379f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:17.438509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6607578a-30b0-4e60-98d4-eaeecf379f4d None None] MFA Rules not processed for user `57b60038227d40fabb353ef15c464cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:17.440454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6607578a-30b0-4e60-98d4-eaeecf379f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:17.501499 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3353/6632] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:17.618674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44443-c984-4567-9b29-614893f60402 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:17.619349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44443-c984-4567-9b29-614893f60402 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:17.619953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44443-c984-4567-9b29-614893f60402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:17.638030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cfd44443-c984-4567-9b29-614893f60402 None None] MFA Rules not processed for user `57b60038227d40fabb353ef15c464cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:17.639243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cfd44443-c984-4567-9b29-614893f60402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:17.647486 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3280/6633] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:33:17.673324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80dbe5-14d7-45d5-8368-62f1d8113a98 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:17.673324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80dbe5-14d7-45d5-8368-62f1d8113a98 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:17.673324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80dbe5-14d7-45d5-8368-62f1d8113a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:17.690356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6e80dbe5-14d7-45d5-8368-62f1d8113a98 None None] MFA Rules not processed for user `57b60038227d40fabb353ef15c464cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:17.691550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e80dbe5-14d7-45d5-8368-62f1d8113a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:17.698793 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3354/6634] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:17.720764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3d6c-88e4-4cfe-98a9-08b3a267ae05 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:17.721105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3d6c-88e4-4cfe-98a9-08b3a267ae05 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:17.721389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3d6c-88e4-4cfe-98a9-08b3a267ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:17.739336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-858d3d6c-88e4-4cfe-98a9-08b3a267ae05 None None] MFA Rules not processed for user `57b60038227d40fabb353ef15c464cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:17.740546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-858d3d6c-88e4-4cfe-98a9-08b3a267ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:17.747758 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3281/6635] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:33:17.771345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:17.771636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:17.771918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:17.789402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] MFA Rules not processed for user `57b60038227d40fabb353ef15c464cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:17.790596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:17.797688 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3355/6636] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:21.759661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:21.760191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:21.760319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:21.779830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:21.781599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:21.845562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3282/6637] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:33:21 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:21.859975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:21.862243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:21.940360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1751e33-ec2c-4ff1-90b5-be84abf05877 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:21.945280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:21.950944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:21.950944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:21.950944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:21.958252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:21.960115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:21.969943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3356/6638] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:33:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:33:22.474880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:22.476044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:22.563475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefc2c7-b18c-4ad2-b66d-6a0c4457db54 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:22.568198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:22.569107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:22.569397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:22.569674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] PATH_INFO: `/v3/users/57b60038227d40fabb353ef15c464cc2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:22.571011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b60038227d40fabb353ef15c464cc2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:22.573088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:22.840994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b60038227d40fabb353ef15c464cc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:22.848292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b60038227d40fabb353ef15c464cc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:22.860762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b60038227d40fabb353ef15c464cc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:22.861515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b60038227d40fabb353ef15c464cc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:22.862137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-43619b8b-c516-4ef8-b62c-56588f461055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b60038227d40fabb353ef15c464cc2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:22.970416 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3283/6639] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:22 2021] DELETE /identity/v3/users/57b60038227d40fabb353ef15c464cc2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:23.221055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:23.233571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d2d-03c9-423a-a906-89efc3eff586 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:23.301101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:23.301967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:23.302312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:23.302594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] PATH_INFO: `/v3/projects/ac1acf7a8cbb44ce80756e3508b9b392` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:23.303842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1acf7a8cbb44ce80756e3508b9b392)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:23.306151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:23.579478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1acf7a8cbb44ce80756e3508b9b392', 'request_id': 'req-b2c98736-cce5-4751-984f-88278335b7f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:23.684204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1acf7a8cbb44ce80756e3508b9b392', 'request_id': 'req-b2c98736-cce5-4751-984f-88278335b7f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:23.691580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1acf7a8cbb44ce80756e3508b9b392', 'request_id': 'req-b2c98736-cce5-4751-984f-88278335b7f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:23.702410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] The token cache is being invalidate because project ac1acf7a8cbb44ce80756e3508b9b392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:23.702410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:23.703032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b2c98736-cce5-4751-984f-88278335b7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:23.705172 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3357/6640] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:23 2021] DELETE /identity/v3/projects/ac1acf7a8cbb44ce80756e3508b9b392 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:23.716069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe9d8-fc39-443a-803d-677f31fa0a55 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:23.718154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe9d8-fc39-443a-803d-677f31fa0a55 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:23.718154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe9d8-fc39-443a-803d-677f31fa0a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:23.734584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e25fe9d8-fc39-443a-803d-677f31fa0a55 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:23.735787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e25fe9d8-fc39-443a-803d-677f31fa0a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:23.794720 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3284/6641] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:33:23.803289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698fac-a51d-44c3-8f6c-fe1da328db14 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:23.803583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698fac-a51d-44c3-8f6c-fe1da328db14 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:23.803866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da698fac-a51d-44c3-8f6c-fe1da328db14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:23.822709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-da698fac-a51d-44c3-8f6c-fe1da328db14 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:23.823918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-da698fac-a51d-44c3-8f6c-fe1da328db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:23.832593 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3358/6642] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:23.836829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fe9d8-fc39-443a-803d-677f31fa0a55 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:23.846963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fe9d8-fc39-443a-803d-677f31fa0a55 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:23.851701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:23.852345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:23.852621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:23.852927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:23.853655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:23.853964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:23.855550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:23.867402 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3285/6643] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:33:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:23.871851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698fac-a51d-44c3-8f6c-fe1da328db14 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:23.882078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da698fac-a51d-44c3-8f6c-fe1da328db14 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:23.887146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:23.887807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:23.888392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:23.888618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:23.889612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:23.892124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:24.001145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3359/6644] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:23 2021] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:24.005179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:24.016425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48de85-5e2c-47cc-8018-eb42f5670890 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:24.073694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:24.074359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:24.074980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:24.075262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:24.075957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:24.080669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:24.185626 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3286/6645] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:24 2021] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:24.189821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:24.200372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b6e5d-84aa-4de7-a7ad-d34c0fc9f321 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:24.205658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:24.206303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:24.206609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:24.206884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:24.207601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:24.209363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:24.222099 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3360/6646] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:24.226229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:24.236476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f1730-5373-4086-9fc1-588b9fd3c17e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:24.241208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fee8b-7fe9-430e-94ab-4bd1dde60611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:24.241878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fee8b-7fe9-430e-94ab-4bd1dde60611 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:24.242143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fee8b-7fe9-430e-94ab-4bd1dde60611 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:24.242449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fee8b-7fe9-430e-94ab-4bd1dde60611 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:24.243180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fee8b-7fe9-430e-94ab-4bd1dde60611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:24.244762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fee8b-7fe9-430e-94ab-4bd1dde60611 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:24.255056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3287/6647] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:24.263596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:24.275086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28da85b-a01a-4547-a1bb-70bce1632ad8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:24.279992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:24.281044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:24.281925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:24.282204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] PATH_INFO: `/v3/projects/715cc52a40844250b389066803a644e4/users/7382f57666f34fb3946b8f29b3dd94ee/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:24.297422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715cc52a40844250b389066803a644e4, user_id=7382f57666f34fb3946b8f29b3dd94ee, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:24.300144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:24.385342 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3361/6648] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:24 2021] PUT /identity/v3/projects/715cc52a40844250b389066803a644e4/users/7382f57666f34fb3946b8f29b3dd94ee/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:24.397000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec2536-b50b-4359-a99c-959499b44a0d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:24.397290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec2536-b50b-4359-a99c-959499b44a0d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:24.397567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec2536-b50b-4359-a99c-959499b44a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:24.423825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-52ec2536-b50b-4359-a99c-959499b44a0d None None] MFA Rules not processed for user `7382f57666f34fb3946b8f29b3dd94ee`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:24.425100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-52ec2536-b50b-4359-a99c-959499b44a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:24.498226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3288/6649] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:24 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:24.503733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:24.567529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9b59-bc3d-4071-aef8-8c849db9a980 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:24.572441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:24.573190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:24.573468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:24.573740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:24.574425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:24.576357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:24.689507 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3362/6650] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:24 2021] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:24.693584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec2536-b50b-4359-a99c-959499b44a0d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:24.704761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec2536-b50b-4359-a99c-959499b44a0d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:24.766059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:24.766738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:24.767022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:24.767298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:24.768089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:24.770042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:24.994278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3289/6651] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:24 2021] POST /identity/v3/users => generated 308 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:24.995406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:25.016158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2d1c5-453f-42a1-b4a9-34e3e242b72b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:25.021298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:25.021977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.022432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.023075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.023820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:25.025526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:25.039157 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3363/6652] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:24 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:25.043661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:25.054834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adebc1-62ea-4d50-9526-1cfbd5007204 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:25.060589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:25.064031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.064031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.064031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] PATH_INFO: `/v3/projects/54dc0c0ff76d4d13a0c4eae2284595d3/users/8ddee8e8f1584ba9b38097322bc93c6f/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.089746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dc0c0ff76d4d13a0c4eae2284595d3, user_id=8ddee8e8f1584ba9b38097322bc93c6f, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:25.094457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:25.174842 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3290/6653] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:25 2021] PUT /identity/v3/projects/54dc0c0ff76d4d13a0c4eae2284595d3/users/8ddee8e8f1584ba9b38097322bc93c6f/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:25.176290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:25.188565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f52c9-fc38-4bcb-9735-f8ec178ede9e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:25.243860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caefe7-57ec-473a-aafd-7218dd2d4c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:25.244523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caefe7-57ec-473a-aafd-7218dd2d4c74 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.244789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caefe7-57ec-473a-aafd-7218dd2d4c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.245096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caefe7-57ec-473a-aafd-7218dd2d4c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.245819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caefe7-57ec-473a-aafd-7218dd2d4c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:25.247427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caefe7-57ec-473a-aafd-7218dd2d4c74 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:25.256967 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3364/6654] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:25 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:25.261244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:25.271977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d8c62-8512-4250-82bd-9a9ac7914ec3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:25.276850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:25.278060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.278343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.278613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] PATH_INFO: `/v3/projects/54dc0c0ff76d4d13a0c4eae2284595d3/users/8ddee8e8f1584ba9b38097322bc93c6f/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.280613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dc0c0ff76d4d13a0c4eae2284595d3, user_id=8ddee8e8f1584ba9b38097322bc93c6f, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:25.284147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:25.294428 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3291/6655] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:25 2021] PUT /identity/v3/projects/54dc0c0ff76d4d13a0c4eae2284595d3/users/8ddee8e8f1584ba9b38097322bc93c6f/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:25.305440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f540-9a6e-4749-beb6-a7c27aa585eb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.305735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f540-9a6e-4749-beb6-a7c27aa585eb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.306019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f540-9a6e-4749-beb6-a7c27aa585eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.333549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8cc7f540-9a6e-4749-beb6-a7c27aa585eb None None] MFA Rules not processed for user `8ddee8e8f1584ba9b38097322bc93c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:25.334750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8cc7f540-9a6e-4749-beb6-a7c27aa585eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:25.402712 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3365/6656] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:25 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:25.408722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:25.420104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73b48e-81ed-4d97-b9f8-db2772d8640d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:25.425397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ddee8e8f1584ba9b38097322bc93c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54dc0c0ff76d4d13a0c4eae2284595d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:25.427137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.427137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.427137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.427417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:25.428928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:25.499859 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3292/6657] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:33:25 2021] POST /identity/v3/roles => generated 240 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:25.504026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7f540-9a6e-4749-beb6-a7c27aa585eb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:25.513311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7f540-9a6e-4749-beb6-a7c27aa585eb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:25.520664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f55f0-ec97-4a12-aed9-a0121127f507 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ddee8e8f1584ba9b38097322bc93c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54dc0c0ff76d4d13a0c4eae2284595d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:25.520664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f55f0-ec97-4a12-aed9-a0121127f507 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.520664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f55f0-ec97-4a12-aed9-a0121127f507 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.521043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f55f0-ec97-4a12-aed9-a0121127f507 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] PATH_INFO: `/v3/projects/715cc52a40844250b389066803a644e4/users/7382f57666f34fb3946b8f29b3dd94ee/roles/e06a5d688e5547919d13d7f31c89987c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.522709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f55f0-ec97-4a12-aed9-a0121127f507 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: Authorizing `identity:create_grant(project_id=715cc52a40844250b389066803a644e4, user_id=7382f57666f34fb3946b8f29b3dd94ee, role_id=e06a5d688e5547919d13d7f31c89987c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:25.525417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f55f0-ec97-4a12-aed9-a0121127f507 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:25.602896 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3366/6658] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:25 2021] PUT /identity/v3/projects/715cc52a40844250b389066803a644e4/users/7382f57666f34fb3946b8f29b3dd94ee/roles/e06a5d688e5547919d13d7f31c89987c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:25.607183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:25.680400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938cdc7-081f-434f-b779-84aa4a875d29 tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:25.695706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38dadb-0f32-43b4-b87a-799c398d87d3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.695995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38dadb-0f32-43b4-b87a-799c398d87d3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.696274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38dadb-0f32-43b4-b87a-799c398d87d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.723408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fe38dadb-0f32-43b4-b87a-799c398d87d3 None None] MFA Rules not processed for user `171c198b6b734cd698b3c1eaf76a0234`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:25.724232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fe38dadb-0f32-43b4-b87a-799c398d87d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:25.742227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7382f57666f34fb3946b8f29b3dd94ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715cc52a40844250b389066803a644e4', 'project_domain_id': 'default', 'roles': ['tempest-test_role-2133288116', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:25.743264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.743552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.743836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] PATH_INFO: `/v3/users/7382f57666f34fb3946b8f29b3dd94ee/application_credentials` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.744583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] RBAC: Authorizing `identity:create_application_credential(user_id=7382f57666f34fb3946b8f29b3dd94ee)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:25.745776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:25.781508 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3367/6659] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:25.944233 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3293/6660] 10.222.0.32 () {60 vars in 1314 bytes} [Sat Dec 25 21:33:25 2021] POST /identity/v3/users/7382f57666f34fb3946b8f29b3dd94ee/application_credentials => generated 660 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:25.949045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7711d-eaf5-4363-aa0f-d7204949bf5c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:25.949340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7711d-eaf5-4363-aa0f-d7204949bf5c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:25.949680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7711d-eaf5-4363-aa0f-d7204949bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:25.977197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1bf7711d-eaf5-4363-aa0f-d7204949bf5c None None] MFA Rules not processed for user `7382f57666f34fb3946b8f29b3dd94ee`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:25.978438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1bf7711d-eaf5-4363-aa0f-d7204949bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:26.108749 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3368/6661] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:25 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Dec 25 21:33:26.110042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:26.120836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cddf9-b198-48cf-8dbe-9ee54f7c642a tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:26.127785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7382f57666f34fb3946b8f29b3dd94ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '715cc52a40844250b389066803a644e4', 'project_domain_id': 'default', 'roles': ['tempest-test_role-2133288116', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:26.129194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:26.129476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:26.129754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] PATH_INFO: `/v3/users/7382f57666f34fb3946b8f29b3dd94ee/application_credentials/832b5f9e5eb84b02a21407c4a17d6bd3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:26.131254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7382f57666f34fb3946b8f29b3dd94ee, application_credential_id=832b5f9e5eb84b02a21407c4a17d6bd3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:26.132803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:26.285308 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3294/6662] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:33:26 2021] DELETE /identity/v3/users/7382f57666f34fb3946b8f29b3dd94ee/application_credentials/832b5f9e5eb84b02a21407c4a17d6bd3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:26.289767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7711d-eaf5-4363-aa0f-d7204949bf5c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:26.358142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7711d-eaf5-4363-aa0f-d7204949bf5c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:26.362896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ddee8e8f1584ba9b38097322bc93c6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54dc0c0ff76d4d13a0c4eae2284595d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:26.363757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:26.364041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:26.364325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] PATH_INFO: `/v3/roles/e06a5d688e5547919d13d7f31c89987c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:26.366309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e06a5d688e5547919d13d7f31c89987c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:26.367949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:26.586661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] Invalidating the token cache because role e06a5d688e5547919d13d7f31c89987c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:26.587068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:26.587736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4dbdbe60-92fb-4ae2-9fc6-e119d426bdfc tempest-ApplicationCredentialsV3AdminTest-1011421681 tempest-ApplicationCredentialsV3AdminTest-1011421681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:26.589661 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3369/6663] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:26 2021] DELETE /identity/v3/roles/e06a5d688e5547919d13d7f31c89987c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:26.595746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:26.597983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:26.668845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22857c9-3111-4e93-8c5d-876fa47f9c85 tempest-ApplicationCredentialsV3AdminTest-1845225665 tempest-ApplicationCredentialsV3AdminTest-1845225665-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:26.731631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:26.732495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:26.732784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:26.733100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] PATH_INFO: `/v3/users/7382f57666f34fb3946b8f29b3dd94ee` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:26.734302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7382f57666f34fb3946b8f29b3dd94ee)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:26.736216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:26.983092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7382f57666f34fb3946b8f29b3dd94ee'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:26.991203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7382f57666f34fb3946b8f29b3dd94ee'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.003288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7382f57666f34fb3946b8f29b3dd94ee'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.003974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7382f57666f34fb3946b8f29b3dd94ee'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.004637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7382f57666f34fb3946b8f29b3dd94ee'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.070249 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3295/6664] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:26 2021] DELETE /identity/v3/users/7382f57666f34fb3946b8f29b3dd94ee => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:27.074958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:27.075274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:27.075552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:27.093575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:27.095400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:27.156163 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3370/6665] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:27.167656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:27.169533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:27.231085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952993b5-a7f3-4a20-b8f4-d69082a91409 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:27.236101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:27.237902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:27.243637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:27.243637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:27.249390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:27.250853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:27.260684 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3296/6666] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:33:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:33:27.677542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:27.679038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:27.704255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7293de-4f9f-4915-904f-eb59cad53197 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:27.711150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:27.712022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:27.712299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:27.713019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] PATH_INFO: `/v3/projects/715cc52a40844250b389066803a644e4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:27.714403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715cc52a40844250b389066803a644e4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:27.716316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:27.825320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715cc52a40844250b389066803a644e4', 'request_id': 'req-07142623-c90d-46dd-9bf5-cab4f801d081'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.944278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715cc52a40844250b389066803a644e4', 'request_id': 'req-07142623-c90d-46dd-9bf5-cab4f801d081'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.949835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715cc52a40844250b389066803a644e4', 'request_id': 'req-07142623-c90d-46dd-9bf5-cab4f801d081'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.972691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] The token cache is being invalidate because project 715cc52a40844250b389066803a644e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:27.976300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.977082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:27.978819 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3371/6667] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:27 2021] DELETE /identity/v3/projects/715cc52a40844250b389066803a644e4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:27.982875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:27.994332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d75b4-9035-4c77-96e8-6f32041bbf05 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:28.053423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:28.054285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:28.054566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:28.054937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] PATH_INFO: `/v3/users/8ddee8e8f1584ba9b38097322bc93c6f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:28.056158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddee8e8f1584ba9b38097322bc93c6f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:28.058100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:28.294173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddee8e8f1584ba9b38097322bc93c6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:28.301738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddee8e8f1584ba9b38097322bc93c6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:28.314127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddee8e8f1584ba9b38097322bc93c6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:28.314852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddee8e8f1584ba9b38097322bc93c6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:28.316814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-81f72deb-a258-421d-a416-a28e34404d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddee8e8f1584ba9b38097322bc93c6f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:28.404701 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3297/6668] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:27 2021] DELETE /identity/v3/users/8ddee8e8f1584ba9b38097322bc93c6f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:28.911948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:28.913605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:28.930783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07142623-c90d-46dd-9bf5-cab4f801d081 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:28.992635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:28.993544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:28.993824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:28.996466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] PATH_INFO: `/v3/projects/54dc0c0ff76d4d13a0c4eae2284595d3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:28.996466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dc0c0ff76d4d13a0c4eae2284595d3)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:28.997197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:29.153061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dc0c0ff76d4d13a0c4eae2284595d3', 'request_id': 'req-cefe5d4c-6961-425f-a56b-947bcdd02a2b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:29.250978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dc0c0ff76d4d13a0c4eae2284595d3', 'request_id': 'req-cefe5d4c-6961-425f-a56b-947bcdd02a2b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:29.258864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dc0c0ff76d4d13a0c4eae2284595d3', 'request_id': 'req-cefe5d4c-6961-425f-a56b-947bcdd02a2b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:29.271116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] The token cache is being invalidate because project 54dc0c0ff76d4d13a0c4eae2284595d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:29.276342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:29.276342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cefe5d4c-6961-425f-a56b-947bcdd02a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:29.276342 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3372/6669] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:28 2021] DELETE /identity/v3/projects/54dc0c0ff76d4d13a0c4eae2284595d3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:29.280264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac804e-e9ad-45cb-a728-db0abb0128dd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.280549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac804e-e9ad-45cb-a728-db0abb0128dd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.281045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac804e-e9ad-45cb-a728-db0abb0128dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.308166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-08ac804e-e9ad-45cb-a728-db0abb0128dd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:29.308166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08ac804e-e9ad-45cb-a728-db0abb0128dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:29.385286 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3298/6670] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:29.394537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846cec-38ee-41b9-a3cb-cfcbb0bff39c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.394944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846cec-38ee-41b9-a3cb-cfcbb0bff39c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.395119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846cec-38ee-41b9-a3cb-cfcbb0bff39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.416082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-69846cec-38ee-41b9-a3cb-cfcbb0bff39c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:29.418434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69846cec-38ee-41b9-a3cb-cfcbb0bff39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:29.425667 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3373/6671] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:29.429870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac804e-e9ad-45cb-a728-db0abb0128dd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:29.439699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac804e-e9ad-45cb-a728-db0abb0128dd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:29.444284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:29.446240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.446240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.446240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.446240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:29.446626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:29.448054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:29.459767 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3299/6672] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:33:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:29.464131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69846cec-38ee-41b9-a3cb-cfcbb0bff39c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:29.474290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69846cec-38ee-41b9-a3cb-cfcbb0bff39c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:29.479166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:29.479808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.480089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.480360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.481093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:29.482973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:29.586827 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3374/6673] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:29 2021] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:29.590984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:29.601847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee83b1-dc05-43c1-9f13-ab5a303be864 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:29.665427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:29.665427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.665427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.665427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.665898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:29.666330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:29.751082 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3300/6674] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:29 2021] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:29.752461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:29.763777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bd2a9-a9fc-44a7-a632-60f2b6ca38f9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:29.769613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:29.770275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.770556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.770831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.772442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:29.773830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:29.785569 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3375/6675] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:29.789589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:29.801499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a8ea-4edf-4a58-b981-6e3a32878e44 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:29.807167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429e50a-a149-4d59-a878-54cf9e22eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:29.807911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e50a-a149-4d59-a878-54cf9e22eb18 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.808265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e50a-a149-4d59-a878-54cf9e22eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.808673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e50a-a149-4d59-a878-54cf9e22eb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.809519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429e50a-a149-4d59-a878-54cf9e22eb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:29.811202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429e50a-a149-4d59-a878-54cf9e22eb18 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:29.822139 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3301/6676] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:29.826451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:29.837609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c2a0-9dbc-42f8-9074-2ab130aa9df7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:29.842234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:29.843093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.843372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.843641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] PATH_INFO: `/v3/projects/8a09e3ed86694636b1c9852cd9d169a5/users/9e0acc8893f1424e8ae27d95ebd08e33/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:29.858334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a09e3ed86694636b1c9852cd9d169a5, user_id=9e0acc8893f1424e8ae27d95ebd08e33, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:29.861944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:29.978087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3376/6677] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:29 2021] PUT /identity/v3/projects/8a09e3ed86694636b1c9852cd9d169a5/users/9e0acc8893f1424e8ae27d95ebd08e33/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:29.990490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dda4f-5e66-482f-856b-560efe92c2a0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:29.991236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dda4f-5e66-482f-856b-560efe92c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:29.991688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dda4f-5e66-482f-856b-560efe92c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:30.071265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-998dda4f-5e66-482f-856b-560efe92c2a0 None None] MFA Rules not processed for user `9e0acc8893f1424e8ae27d95ebd08e33`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:30.072496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-998dda4f-5e66-482f-856b-560efe92c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:30.213358 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3302/6678] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:30.218350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:30.300480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213526e-234f-4bd1-b610-dd83551c2a9c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:30.305600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:30.307002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:30.307002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:30.307900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:30.308728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:30.313499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:30.410127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3377/6679] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:30 2021] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:30.413893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dda4f-5e66-482f-856b-560efe92c2a0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:30.427825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dda4f-5e66-482f-856b-560efe92c2a0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:30.501851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:30.503536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:30.504114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:30.504539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:30.505624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:30.507779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:30.607509 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3303/6680] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:30 2021] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:30.612086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:30.626033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff674e-39b1-46ae-b231-66624ee87a3f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:30.631419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:30.632212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:30.632568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:30.632945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:30.633991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:30.635789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:30.651233 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3378/6681] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:33:30.655695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:30.674127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3920-cc9b-4409-a904-a45863471e49 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:30.680945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:30.682107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:30.682376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:30.682860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] PATH_INFO: `/v3/projects/f334cc15ef5248f896bee9c1baac72e0/users/6af3efc5ce2843b9be7246236f2eaa1a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:30.706322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f334cc15ef5248f896bee9c1baac72e0, user_id=6af3efc5ce2843b9be7246236f2eaa1a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:30.709259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:30.845278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3304/6682] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:30 2021] PUT /identity/v3/projects/f334cc15ef5248f896bee9c1baac72e0/users/6af3efc5ce2843b9be7246236f2eaa1a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:30.849233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:30.859198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060ce5-d479-4299-8cc4-e7262bf11fe0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:30.924198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2447-d314-43bb-aa04-1887a49302e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:30.924198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2447-d314-43bb-aa04-1887a49302e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:30.924198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2447-d314-43bb-aa04-1887a49302e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:30.924198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2447-d314-43bb-aa04-1887a49302e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:30.924949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2447-d314-43bb-aa04-1887a49302e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:30.926637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2447-d314-43bb-aa04-1887a49302e6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:30.943249 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3379/6683] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:30.948927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:30.961099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233bcfc-fb28-4c80-8d4d-c46f82c00edc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:30.973639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:30.974831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:30.975287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:30.976322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] PATH_INFO: `/v3/projects/f334cc15ef5248f896bee9c1baac72e0/users/6af3efc5ce2843b9be7246236f2eaa1a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:30.978802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f334cc15ef5248f896bee9c1baac72e0, user_id=6af3efc5ce2843b9be7246236f2eaa1a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:30.981696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:30.998148 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3305/6684] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:30 2021] PUT /identity/v3/projects/f334cc15ef5248f896bee9c1baac72e0/users/6af3efc5ce2843b9be7246236f2eaa1a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:31.015067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2f38-ac33-437a-94ee-27ae40538154 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:31.015680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2f38-ac33-437a-94ee-27ae40538154 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:31.016101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2f38-ac33-437a-94ee-27ae40538154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:31.052067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1b3e2f38-ac33-437a-94ee-27ae40538154 None None] MFA Rules not processed for user `6af3efc5ce2843b9be7246236f2eaa1a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:31.053547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b3e2f38-ac33-437a-94ee-27ae40538154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:31.149134 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3380/6685] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:31 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:31.153605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:31.164807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4a67d-70d5-43a2-a6e3-9955aea2dd2b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:31.170362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:31.171018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:31.171301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:31.171577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:31.172298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:31.174211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:31.325786 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3306/6686] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:31 2021] POST /identity/v3/projects => generated 350 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:31.330639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2f38-ac33-437a-94ee-27ae40538154 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:31.341236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2f38-ac33-437a-94ee-27ae40538154 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:31.417870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:31.418711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:31.419529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:31.420040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:31.420981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:31.424011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:31.560619 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3381/6687] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:31 2021] POST /identity/v3/projects => generated 350 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:31.565592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:31.579598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ee5b-fc13-402b-a180-37cdc6638211 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:31.673438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:31.674431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:31.674662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:31.674979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/users/9e0acc8893f1424e8ae27d95ebd08e33` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:31.676236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:get_user(user_id=9e0acc8893f1424e8ae27d95ebd08e33)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:31.678813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:31.680648 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3307/6688] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:33:31 2021] GET /identity/v3/users/9e0acc8893f1424e8ae27d95ebd08e33 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:31.686596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:31.702123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac262891-deee-4910-8f56-ee7b4d523e6f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:31.708958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:31.710057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:31.710348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:31.710668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:31.711666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:31.725953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:31.855895 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3382/6689] 10.222.0.32 () {60 vars in 1161 bytes} [Sat Dec 25 21:33:31 2021] POST /identity/v3/credentials => generated 430 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:31.857079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:31.868176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4b9d6-edd5-410c-b6e2-a44526712265 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:31.873537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:31.874458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:31.874762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:31.875037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials/01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:31.878116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:31.879913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:31.881663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:31.883287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.018234 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3308/6690] 10.222.0.32 () {60 vars in 1357 bytes} [Sat Dec 25 21:33:31 2021] PATCH /identity/v3/credentials/01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d => generated 433 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:32.020240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.030836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01a6c7-bb9e-4c41-9eab-c89177d17fba tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.038287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.039247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.039533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.039813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials/01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.042017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.044223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.046647 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3383/6691] 10.222.0.32 () {58 vars in 1334 bytes} [Sat Dec 25 21:33:32 2021] GET /identity/v3/credentials/01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d => generated 433 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:32.051668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.062639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dad1a-bc3a-440f-82c1-241453578c4a tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.069221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.070354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.070719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.071151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials/01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.073387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.075249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.192805 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3309/6692] 10.222.0.32 () {58 vars in 1337 bytes} [Sat Dec 25 21:33:32 2021] DELETE /identity/v3/credentials/01b38d6243bc101675e0235b8b529a4594710985615e84fb393680293d71584d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:32.198438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.209948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300ccb6-d592-4d2d-aa56-5262bea40342 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.215224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.216093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.216384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.216673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.217433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.219743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.306774 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3384/6693] 10.222.0.32 () {60 vars in 1161 bytes} [Sat Dec 25 21:33:32 2021] POST /identity/v3/credentials => generated 430 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:32.311228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.322325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d52f5-8a8d-4e17-b00e-8ae67b4cf82f tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.327571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.328977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.329247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.329545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.330329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.332145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.429879 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3310/6694] 10.222.0.32 () {60 vars in 1161 bytes} [Sat Dec 25 21:33:32 2021] POST /identity/v3/credentials => generated 429 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:32.433819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.443897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0228b-e5f9-479a-bd86-ce497aef34cf tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.449049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.455578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.455578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.455578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.455578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.455578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.461491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.463378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.465240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.467192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.469995 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3385/6695] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Dec 25 21:33:32 2021] GET /identity/v3/credentials => generated 944 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:32.474103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.485480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b612e3-05c1-488f-ad67-384af152063d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.490384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.491315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.491622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.491898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials/28cdb516ad7e4fc7fcc52a89c75f6a89d9dc06a3b4d713f36c1ebb9061d99e73` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.494175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=28cdb516ad7e4fc7fcc52a89c75f6a89d9dc06a3b4d713f36c1ebb9061d99e73)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.495932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.608730 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3311/6696] 10.222.0.32 () {58 vars in 1337 bytes} [Sat Dec 25 21:33:32 2021] DELETE /identity/v3/credentials/28cdb516ad7e4fc7fcc52a89c75f6a89d9dc06a3b4d713f36c1ebb9061d99e73 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:32.613555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.625045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8012d3-c2ad-4ac4-9e05-03c3f39b1ef5 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.630455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.631363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.631644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.631921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/credentials/6d2da9472427bd3048d1af53cab358d4670f03673094bdc6e88b7d2a9eb54afb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.633999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=6d2da9472427bd3048d1af53cab358d4670f03673094bdc6e88b7d2a9eb54afb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.635747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.735666 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3386/6697] 10.222.0.32 () {58 vars in 1337 bytes} [Sat Dec 25 21:33:32 2021] DELETE /identity/v3/credentials/6d2da9472427bd3048d1af53cab358d4670f03673094bdc6e88b7d2a9eb54afb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:32.740656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:32.751631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37ff22-f220-4cf2-95ba-57056e9a854d tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:32.756260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:32.757140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:32.757449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:32.757746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/projects/6105ea7dcb9845a2aa9a9a0012ca5184` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:32.758943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6105ea7dcb9845a2aa9a9a0012ca5184)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:32.760973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:32.919463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6105ea7dcb9845a2aa9a9a0012ca5184', 'request_id': 'req-5523eee9-d043-4b8a-b9b5-97a3f484e978'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:32.927007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6105ea7dcb9845a2aa9a9a0012ca5184', 'request_id': 'req-5523eee9-d043-4b8a-b9b5-97a3f484e978'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.046622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6105ea7dcb9845a2aa9a9a0012ca5184', 'request_id': 'req-5523eee9-d043-4b8a-b9b5-97a3f484e978'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.058426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] The token cache is being invalidate because project 6105ea7dcb9845a2aa9a9a0012ca5184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:33.058944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.059709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.061563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3312/6698] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:32 2021] DELETE /identity/v3/projects/6105ea7dcb9845a2aa9a9a0012ca5184 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:33.066247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:33.068444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:33.084736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a3938-eb36-475c-90db-7571e1bc03f4 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:33.143341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af3efc5ce2843b9be7246236f2eaa1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f334cc15ef5248f896bee9c1baac72e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:33.144210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:33.144498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:33.144776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] PATH_INFO: `/v3/projects/a3ee6529a5a84ed0b52dfe0a7e9894ae` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:33.146019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a3ee6529a5a84ed0b52dfe0a7e9894ae)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:33.148083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:33.264366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ee6529a5a84ed0b52dfe0a7e9894ae', 'request_id': 'req-6ad78996-209d-4e6c-8fac-6bcc0027a197'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.341369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ee6529a5a84ed0b52dfe0a7e9894ae', 'request_id': 'req-6ad78996-209d-4e6c-8fac-6bcc0027a197'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.350909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ee6529a5a84ed0b52dfe0a7e9894ae', 'request_id': 'req-6ad78996-209d-4e6c-8fac-6bcc0027a197'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.361203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] The token cache is being invalidate because project a3ee6529a5a84ed0b52dfe0a7e9894ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:33.361491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.362357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6ad78996-209d-4e6c-8fac-6bcc0027a197 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.363860 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3387/6699] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:33 2021] DELETE /identity/v3/projects/a3ee6529a5a84ed0b52dfe0a7e9894ae => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:33.367674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:33.369857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:33.436796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523eee9-d043-4b8a-b9b5-97a3f484e978 tempest-CredentialsTestJSON-1452714092 tempest-CredentialsTestJSON-1452714092-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:33.495195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:33.496059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:33.496337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:33.496609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] PATH_INFO: `/v3/users/9e0acc8893f1424e8ae27d95ebd08e33` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:33.501906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0acc8893f1424e8ae27d95ebd08e33)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:33.501906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:33.831572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0acc8893f1424e8ae27d95ebd08e33'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.838245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0acc8893f1424e8ae27d95ebd08e33'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.850499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0acc8893f1424e8ae27d95ebd08e33'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.851201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0acc8893f1424e8ae27d95ebd08e33'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.851797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0acc8893f1424e8ae27d95ebd08e33'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:33.954655 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3313/6700] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:33 2021] DELETE /identity/v3/users/9e0acc8893f1424e8ae27d95ebd08e33 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:33.959298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:33.959755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:33.959995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:33.979955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:33.981224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:34.039852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3388/6701] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:33:34.050044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:34.051863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:34.115690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141693-b4c2-4d8f-b3d8-31b93e82caee admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:34.119434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:34.120076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:34.120357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:34.120628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:34.131369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:34.132850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:34.143013 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3314/6702] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:33:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:33:34.637124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:34.638639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:34.651680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16c8b8-2766-46f9-a0c7-8b014b92e357 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:34.663403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:34.664478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:34.664824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:34.665433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] PATH_INFO: `/v3/projects/8a09e3ed86694636b1c9852cd9d169a5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:34.666991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a09e3ed86694636b1c9852cd9d169a5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:34.669530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:34.833792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a09e3ed86694636b1c9852cd9d169a5', 'request_id': 'req-224dda69-80e1-4b53-9e90-dcab09c30f71'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:34.924362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a09e3ed86694636b1c9852cd9d169a5', 'request_id': 'req-224dda69-80e1-4b53-9e90-dcab09c30f71'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:34.931275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a09e3ed86694636b1c9852cd9d169a5', 'request_id': 'req-224dda69-80e1-4b53-9e90-dcab09c30f71'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:34.941825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] The token cache is being invalidate because project 8a09e3ed86694636b1c9852cd9d169a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:34.942109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:34.942731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:34.944318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3389/6703] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:34 2021] DELETE /identity/v3/projects/8a09e3ed86694636b1c9852cd9d169a5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:34.948276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:34.958165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d85665-1a20-4e55-9b39-c4ad54fd4640 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:35.016681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:35.017596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:35.017878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:35.018151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] PATH_INFO: `/v3/users/6af3efc5ce2843b9be7246236f2eaa1a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:35.019381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af3efc5ce2843b9be7246236f2eaa1a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:35.021383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:35.214385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af3efc5ce2843b9be7246236f2eaa1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:35.221756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af3efc5ce2843b9be7246236f2eaa1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:35.233297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af3efc5ce2843b9be7246236f2eaa1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:35.234191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af3efc5ce2843b9be7246236f2eaa1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:35.235302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e7f924f-9740-4dd0-9534-812aac6c8c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af3efc5ce2843b9be7246236f2eaa1a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:35.305381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3315/6704] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:34 2021] DELETE /identity/v3/users/6af3efc5ce2843b9be7246236f2eaa1a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:35.772606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:35.774059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:35.792035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dda69-80e1-4b53-9e90-dcab09c30f71 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:35.852241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:35.853288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:35.853573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:35.853851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] PATH_INFO: `/v3/projects/f334cc15ef5248f896bee9c1baac72e0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:35.855071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f334cc15ef5248f896bee9c1baac72e0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:35.858026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:35.973642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f334cc15ef5248f896bee9c1baac72e0', 'request_id': 'req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:36.068262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f334cc15ef5248f896bee9c1baac72e0', 'request_id': 'req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:36.087568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f334cc15ef5248f896bee9c1baac72e0', 'request_id': 'req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:36.101607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] The token cache is being invalidate because project f334cc15ef5248f896bee9c1baac72e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:36.101891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:36.102719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7861a4b1-3676-411f-a03f-a6d1c22a5ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:36.109259 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3390/6705] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:35 2021] DELETE /identity/v3/projects/f334cc15ef5248f896bee9c1baac72e0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:36.116011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20949c-1af0-43bd-961a-9b900073d5cf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.116532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20949c-1af0-43bd-961a-9b900073d5cf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.116834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20949c-1af0-43bd-961a-9b900073d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.147986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-be20949c-1af0-43bd-961a-9b900073d5cf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:36.149375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be20949c-1af0-43bd-961a-9b900073d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:36.217523 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3316/6706] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:36.226903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb498-d81a-4c58-afc8-0086519f5ea0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.227415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb498-d81a-4c58-afc8-0086519f5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.227910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb498-d81a-4c58-afc8-0086519f5ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.249132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9d1fb498-d81a-4c58-afc8-0086519f5ea0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:36.250956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d1fb498-d81a-4c58-afc8-0086519f5ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:36.259908 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3391/6707] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:36.264555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20949c-1af0-43bd-961a-9b900073d5cf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:36.274383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20949c-1af0-43bd-961a-9b900073d5cf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:36.279005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:36.279653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.279937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.280204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.280965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:36.281295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:36.282889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:36.294498 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3317/6708] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:33:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:36.299475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb498-d81a-4c58-afc8-0086519f5ea0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:36.308975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb498-d81a-4c58-afc8-0086519f5ea0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:36.314297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:36.314942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.315223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.315495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.316190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:36.318129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:36.479394 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3392/6709] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:36 2021] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:36.483786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:36.501048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c722-e5c7-43b7-afc1-6c44275b37dd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:36.595618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:36.597042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.605074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.605074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.605074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:36.605074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:36.716916 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3318/6710] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:36 2021] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:36.719560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:36.731860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda6dbf-6544-4f62-a916-33b850d67578 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:36.737521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:36.738819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.739322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.739828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.740777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:36.742787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:36.759214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3393/6711] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:36 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:33:36.760239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:36.774665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757eb79-365b-48c0-a08e-e56be749a163 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:36.780040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc56fb-2db4-4700-bbe1-e6831c0271da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:36.780763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc56fb-2db4-4700-bbe1-e6831c0271da admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.781098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc56fb-2db4-4700-bbe1-e6831c0271da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.783637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc56fb-2db4-4700-bbe1-e6831c0271da admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.783637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc56fb-2db4-4700-bbe1-e6831c0271da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:36.784676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc56fb-2db4-4700-bbe1-e6831c0271da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:36.796245 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3319/6712] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:36 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:33:36.808852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:36.819617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb8f0-9952-4fe5-b1b9-785523111b1c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:36.825495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:36.826381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.826667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.826947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] PATH_INFO: `/v3/projects/6e167a3e902c4cf59212333cfa5effbb/users/052f3f3bce9144f181c83a6cd96836a4/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:36.843174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e167a3e902c4cf59212333cfa5effbb, user_id=052f3f3bce9144f181c83a6cd96836a4, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:36.847035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:36.942635 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3394/6713] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:36 2021] PUT /identity/v3/projects/6e167a3e902c4cf59212333cfa5effbb/users/052f3f3bce9144f181c83a6cd96836a4/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:36.954383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e22a8-3709-437a-a4d9-cd6d24173814 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:36.954957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e22a8-3709-437a-a4d9-cd6d24173814 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:36.955398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e22a8-3709-437a-a4d9-cd6d24173814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.001409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1a8e22a8-3709-437a-a4d9-cd6d24173814 None None] MFA Rules not processed for user `052f3f3bce9144f181c83a6cd96836a4`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:37.002618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1a8e22a8-3709-437a-a4d9-cd6d24173814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:37.091757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3320/6714] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:36 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:37.095570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:37.159482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d32253-474f-4c10-90a3-41251bdb0bfe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:37.165443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:37.166108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.166392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.168026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.168026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:37.169396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:37.281436 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3395/6715] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:37 2021] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:37.286531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e22a8-3709-437a-a4d9-cd6d24173814 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:37.302355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e22a8-3709-437a-a4d9-cd6d24173814 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:37.365540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:37.366373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.366646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.367077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.367789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:37.369995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:37.487900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3321/6716] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:37 2021] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:37.489432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:37.503005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e7927-ae69-4f58-a9c4-d8d7b2e347b5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:37.508700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:37.509482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.509947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.510211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.511136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:37.513086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:37.524545 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3396/6717] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:37 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:37.528721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:37.538649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3459d-2c6f-4fc8-bfcf-658540d94359 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:37.543548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:37.544429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.544707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.545022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] PATH_INFO: `/v3/projects/b66427851ab74428bcc579a006e07303/users/cbbbca7471474882bdd6754532f7542b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.560054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66427851ab74428bcc579a006e07303, user_id=cbbbca7471474882bdd6754532f7542b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:37.563301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:37.667189 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3322/6718] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:37 2021] PUT /identity/v3/projects/b66427851ab74428bcc579a006e07303/users/cbbbca7471474882bdd6754532f7542b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:37.671199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:37.682387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce46d7-4c70-4074-b578-a3ea61007449 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:37.742296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843aff4-80c7-4530-961f-0f57b8e1c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:37.743441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843aff4-80c7-4530-961f-0f57b8e1c353 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.743786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843aff4-80c7-4530-961f-0f57b8e1c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.744231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843aff4-80c7-4530-961f-0f57b8e1c353 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.745619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843aff4-80c7-4530-961f-0f57b8e1c353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:37.747459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843aff4-80c7-4530-961f-0f57b8e1c353 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:37.768353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:37.768516 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3397/6719] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:37 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:37.779383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6438f69-5746-4264-ad6c-aa510e27df17 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:37.787399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:37.787399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.787399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.787399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] PATH_INFO: `/v3/projects/b66427851ab74428bcc579a006e07303/users/cbbbca7471474882bdd6754532f7542b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.788208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66427851ab74428bcc579a006e07303, user_id=cbbbca7471474882bdd6754532f7542b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:37.790849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:37.800929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3323/6720] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:37 2021] PUT /identity/v3/projects/b66427851ab74428bcc579a006e07303/users/cbbbca7471474882bdd6754532f7542b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:37.813104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81155a-0c0e-4ae9-ac18-8f8182c9cbf2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.813624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81155a-0c0e-4ae9-ac18-8f8182c9cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.816413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81155a-0c0e-4ae9-ac18-8f8182c9cbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.849208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4c81155a-0c0e-4ae9-ac18-8f8182c9cbf2 None None] MFA Rules not processed for user `cbbbca7471474882bdd6754532f7542b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:37.850701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4c81155a-0c0e-4ae9-ac18-8f8182c9cbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:37.932384 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3398/6721] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:37 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:37.937266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:37.958417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34855ad6-e3a9-4dd5-b9fa-1065900ee09e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:37.964254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:37.965173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:37.965779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:37.966221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:37.966985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:37.968639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:38.080572 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3324/6722] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:33:37 2021] POST /identity/v3/domains => generated 276 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:38.085484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81155a-0c0e-4ae9-ac18-8f8182c9cbf2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:38.095883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81155a-0c0e-4ae9-ac18-8f8182c9cbf2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:38.159395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:38.160484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:38.160839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:38.161209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:38.162017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:38.164492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:38.283299 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3399/6723] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:38 2021] POST /identity/v3/projects => generated 402 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:38.286777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:38.301906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a33f9a-f446-459d-8117-d82374b2a7ea tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:38.364456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:38.365220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:38.365507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:38.365781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:38.366488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:38.368362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:38.498233 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3325/6724] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:38 2021] POST /identity/v3/groups => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:38.502449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:38.513118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7916a-0cae-4f85-a10a-ca7746a461f2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:38.527913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:38.528598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:38.533275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:38.533275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:38.533275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:38.533275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:38.697666 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3400/6725] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:38 2021] POST /identity/v3/users => generated 445 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:38.698886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:38.710055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea0bb4-2d0f-4aa1-9491-ee04b6e98faa tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:38.714861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:38.715590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:38.715979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:38.716319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:38.717171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:38.718767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:38.818308 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3326/6726] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:33:38 2021] POST /identity/v3/roles => generated 240 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:38.819584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:38.831469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231402-63c4-4e7c-abda-a009320f0d32 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:38.837195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:38.838122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:38.838412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:38.838803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/groups/3241b1d98fe54057bfca97356a2ddea6/roles/94e0e2034119423d8002ede1287d147a/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:38.846605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818a71f8db274dc385480e0e1b310df9, group_id=3241b1d98fe54057bfca97356a2ddea6, role_id=94e0e2034119423d8002ede1287d147a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:38.849729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:38.930964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3401/6727] 10.222.0.32 () {60 vars in 1584 bytes} [Sat Dec 25 21:33:38 2021] PUT /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/groups/3241b1d98fe54057bfca97356a2ddea6/roles/94e0e2034119423d8002ede1287d147a/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:38.935024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:38.955184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5402c-d9e4-49b1-8fb9-13d08e311993 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:39.018303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:39.019275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:39.019679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:39.020021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/groups/3241b1d98fe54057bfca97356a2ddea6/roles/94e0e2034119423d8002ede1287d147a/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:39.022873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:check_grant(project_id=818a71f8db274dc385480e0e1b310df9, group_id=3241b1d98fe54057bfca97356a2ddea6, role_id=94e0e2034119423d8002ede1287d147a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:39.025567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:39.037548 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3327/6728] 10.222.0.32 () {58 vars in 1566 bytes} [Sat Dec 25 21:33:38 2021] HEAD /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/groups/3241b1d98fe54057bfca97356a2ddea6/roles/94e0e2034119423d8002ede1287d147a/inherited_to_projects => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:39.038766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:39.052260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb18d8-2e60-4933-86e7-0bc41138d57a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:39.064442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:39.064442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:39.064442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:39.064949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/groups/3241b1d98fe54057bfca97356a2ddea6/roles/94e0e2034119423d8002ede1287d147a/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:39.064949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818a71f8db274dc385480e0e1b310df9, group_id=3241b1d98fe54057bfca97356a2ddea6, role_id=94e0e2034119423d8002ede1287d147a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:39.064949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:39.073981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 94e0e2034119423d8002ede1287d147a was removed from group 3241b1d98fe54057bfca97356a2ddea6 on project 818a71f8db274dc385480e0e1b310df9. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:39.074440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:39.075320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:39.166320 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3402/6729] 10.222.0.32 () {58 vars in 1568 bytes} [Sat Dec 25 21:33:39 2021] DELETE /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/groups/3241b1d98fe54057bfca97356a2ddea6/roles/94e0e2034119423d8002ede1287d147a/inherited_to_projects => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:39.171331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:39.173667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:39.192597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8b40-5317-4a30-8513-5d63e1981812 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:39.256756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:39.257686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:39.257965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:39.258256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles/94e0e2034119423d8002ede1287d147a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:39.260029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=94e0e2034119423d8002ede1287d147a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:39.262421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:39.374214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 94e0e2034119423d8002ede1287d147a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:39.374815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:39.375700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:39.377606 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3328/6730] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:39 2021] DELETE /identity/v3/roles/94e0e2034119423d8002ede1287d147a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:39.382583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:39.394715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9b2b8-405e-44a3-934d-d8f1e05e22d5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:39.458135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:39.458801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:39.459082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:39.459357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:39.460125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:39.461762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:39.579578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3403/6731] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:33:39 2021] POST /identity/v3/roles => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:39.580858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:39.582330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:39.597846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6445fc7-1f0f-4c37-9e46-16e1b3a09885 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:39.604252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:39.605337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:39.605699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:39.606047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/0fbe0668c3b044079ee9e69259aeefa9/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:39.622212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818a71f8db274dc385480e0e1b310df9, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=0fbe0668c3b044079ee9e69259aeefa9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:39.625698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:39.714658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3329/6732] 10.222.0.32 () {60 vars in 1581 bytes} [Sat Dec 25 21:33:39 2021] PUT /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/0fbe0668c3b044079ee9e69259aeefa9/inherited_to_projects => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:39.719142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:39.730426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be5c9b-e29d-4851-b6ce-eb36743007ad tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:39.794231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:39.795069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:39.795352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:39.795684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/0fbe0668c3b044079ee9e69259aeefa9/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:39.798552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:check_grant(project_id=818a71f8db274dc385480e0e1b310df9, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=0fbe0668c3b044079ee9e69259aeefa9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:39.799688 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:39.799688 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:33:39.799688 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:33:39.801652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:39.807500 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3404/6733] 10.222.0.32 () {58 vars in 1563 bytes} [Sat Dec 25 21:33:39 2021] HEAD /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/0fbe0668c3b044079ee9e69259aeefa9/inherited_to_projects => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:39.811733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:39.822789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4598-0392-4ce2-9424-ec3596510cf7 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:39.827524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:39.828383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:39.828668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:39.828991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/0fbe0668c3b044079ee9e69259aeefa9/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:39.831330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818a71f8db274dc385480e0e1b310df9, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=0fbe0668c3b044079ee9e69259aeefa9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:39.833983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:39.838854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 0fbe0668c3b044079ee9e69259aeefa9 was removed from user 87ae71a276fd4c3cae41f96d12dc5b8a on project 818a71f8db274dc385480e0e1b310df9. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:39.840751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:39.840751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:39.955118 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3330/6734] 10.222.0.32 () {58 vars in 1565 bytes} [Sat Dec 25 21:33:39 2021] DELETE /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/0fbe0668c3b044079ee9e69259aeefa9/inherited_to_projects => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:39.959898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:39.963892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:39.977461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffbd09-8a74-4158-8da6-d4eebed0e5ba tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.034738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.035627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.035916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.036190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles/0fbe0668c3b044079ee9e69259aeefa9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.037831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0fbe0668c3b044079ee9e69259aeefa9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.039523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:40.137127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 0fbe0668c3b044079ee9e69259aeefa9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:40.137127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:40.137127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:40.137127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3405/6735] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:39 2021] DELETE /identity/v3/roles/0fbe0668c3b044079ee9e69259aeefa9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:40.141299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:40.151436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffae95-767d-4b6a-b8bd-ddee5324af53 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.208961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.209638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.212099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.212099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.212099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.212662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:40.290841 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3331/6736] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:33:40 2021] POST /identity/v3/roles => generated 240 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:40.295014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:40.297385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:40.310393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fabff-a826-4c1c-8cac-b4ea1a8a0514 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.315556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.316347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.316657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.322647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/850feaa2b5a34600b3960dd99485e7ce/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.322647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=46aa86dc96e544008137439a1229fcea, group_id=3241b1d98fe54057bfca97356a2ddea6, role_id=850feaa2b5a34600b3960dd99485e7ce)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.322647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:40.397583 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3406/6737] 10.222.0.32 () {60 vars in 1581 bytes} [Sat Dec 25 21:33:40 2021] PUT /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/850feaa2b5a34600b3960dd99485e7ce/inherited_to_projects => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:40.401573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:40.412782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15686f9-d75e-4412-9864-ddca307000e8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.467010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.467853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.468138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.468418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.470693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=46aa86dc96e544008137439a1229fcea, group_id=3241b1d98fe54057bfca97356a2ddea6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.473251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:40.485352 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3332/6738] 10.222.0.32 () {58 vars in 1463 bytes} [Sat Dec 25 21:33:40 2021] GET /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/inherited_to_projects => generated 448 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:40.489544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:40.499760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0808c93-2756-40cc-a050-40ee12eb97e2 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.504403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.505273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.505555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.505831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/850feaa2b5a34600b3960dd99485e7ce/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.508049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=46aa86dc96e544008137439a1229fcea, group_id=3241b1d98fe54057bfca97356a2ddea6, role_id=850feaa2b5a34600b3960dd99485e7ce)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.510702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:40.517036 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3407/6739] 10.222.0.32 () {58 vars in 1563 bytes} [Sat Dec 25 21:33:40 2021] HEAD /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/850feaa2b5a34600b3960dd99485e7ce/inherited_to_projects => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:40.521420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:40.531719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f0be7-230e-488c-aa87-cbc2ed9bd555 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.536339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.537277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.537689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.537835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/850feaa2b5a34600b3960dd99485e7ce/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.540448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=46aa86dc96e544008137439a1229fcea, group_id=3241b1d98fe54057bfca97356a2ddea6, role_id=850feaa2b5a34600b3960dd99485e7ce)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.543183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:40.548599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 850feaa2b5a34600b3960dd99485e7ce was removed from group 3241b1d98fe54057bfca97356a2ddea6 on domain 46aa86dc96e544008137439a1229fcea. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:40.548911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:40.549585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:40.612061 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3333/6740] 10.222.0.32 () {58 vars in 1565 bytes} [Sat Dec 25 21:33:40 2021] DELETE /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/groups/3241b1d98fe54057bfca97356a2ddea6/roles/850feaa2b5a34600b3960dd99485e7ce/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:40.616041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:40.617780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:40.630309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d40ab-6508-43b7-9cd7-20d1b96c6935 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.689857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.690749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.691034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.691311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles/850feaa2b5a34600b3960dd99485e7ce` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.692806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=850feaa2b5a34600b3960dd99485e7ce)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.694481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:40.822961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 850feaa2b5a34600b3960dd99485e7ce has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:40.823357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:40.824019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:40.825913 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3408/6741] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:40 2021] DELETE /identity/v3/roles/850feaa2b5a34600b3960dd99485e7ce => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:40.831279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:40.841928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded38993-fc81-4a1d-9a65-89a3a51a29bc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:40.900467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:40.901120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:40.901408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:40.901692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:40.902500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:40.904085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:41.036128 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3334/6742] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:33:40 2021] POST /identity/v3/roles => generated 240 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:41.040144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:41.041681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:41.054792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546340e1-478f-4e6a-80bb-628576a114b0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:41.059498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:41.060339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:41.060621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:41.060929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/5de9066e10cf4e6eaf922a6a09d8c87e/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:41.063671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=46aa86dc96e544008137439a1229fcea, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=5de9066e10cf4e6eaf922a6a09d8c87e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:41.066375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:41.151341 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3409/6743] 10.222.0.32 () {60 vars in 1578 bytes} [Sat Dec 25 21:33:41 2021] PUT /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/5de9066e10cf4e6eaf922a6a09d8c87e/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:41.155371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:41.166142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a27bb-3f00-4ef3-98f8-9609dc89decc tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:41.247141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:41.248006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:41.248603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:41.248825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:41.252405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=46aa86dc96e544008137439a1229fcea, user_id=87ae71a276fd4c3cae41f96d12dc5b8a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:41.254959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:41.267846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3335/6744] 10.222.0.32 () {58 vars in 1460 bytes} [Sat Dec 25 21:33:41 2021] GET /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/inherited_to_projects => generated 447 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:41.272455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:41.283293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c55a8-78b8-4b1a-afe1-4487110caf93 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:41.288339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:41.289238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:41.289525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:41.290208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/5de9066e10cf4e6eaf922a6a09d8c87e/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:41.293058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=46aa86dc96e544008137439a1229fcea, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=5de9066e10cf4e6eaf922a6a09d8c87e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:41.295827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:41.307031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3410/6745] 10.222.0.32 () {58 vars in 1560 bytes} [Sat Dec 25 21:33:41 2021] HEAD /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/5de9066e10cf4e6eaf922a6a09d8c87e/inherited_to_projects => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:41.308057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:41.319339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cd3d5-4aaf-4ccb-b7a7-780f6d29759e tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:41.324334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:41.325468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:41.325758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:41.329929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/5de9066e10cf4e6eaf922a6a09d8c87e/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:41.329929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=46aa86dc96e544008137439a1229fcea, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=5de9066e10cf4e6eaf922a6a09d8c87e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:41.331669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:41.345641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 5de9066e10cf4e6eaf922a6a09d8c87e was removed from user 87ae71a276fd4c3cae41f96d12dc5b8a on domain 46aa86dc96e544008137439a1229fcea. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:41.345973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:41.346689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:41.448988 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3336/6746] 10.222.0.32 () {58 vars in 1562 bytes} [Sat Dec 25 21:33:41 2021] DELETE /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/5de9066e10cf4e6eaf922a6a09d8c87e/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:41.453098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:41.455072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:41.478945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e045b4-48fc-4042-b0b0-7fa740fcaef0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:41.554493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:41.555430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:41.556846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:41.556846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles/5de9066e10cf4e6eaf922a6a09d8c87e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:41.557799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5de9066e10cf4e6eaf922a6a09d8c87e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:41.560053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:41.708395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 5de9066e10cf4e6eaf922a6a09d8c87e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:41.709091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:41.709562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:41.711528 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3411/6747] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:41 2021] DELETE /identity/v3/roles/5de9066e10cf4e6eaf922a6a09d8c87e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:41.716736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:41.728507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca773a1-ebe9-4fae-a69d-5a47f7f904e4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:41.790840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:41.793479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:41.793479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:41.793479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:41.793479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:41.794468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:41.913540 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3337/6748] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:33:41 2021] POST /identity/v3/roles => generated 237 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:41.917827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:41.919360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:41.932557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13818-b0d1-4a79-a782-0eea3f3bb07a tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:41.937358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb026346-d852-4473-b3e2-59e5518a0e12 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:41.937948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb026346-d852-4473-b3e2-59e5518a0e12 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:41.938232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb026346-d852-4473-b3e2-59e5518a0e12 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:41.938506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb026346-d852-4473-b3e2-59e5518a0e12 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:41.939307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb026346-d852-4473-b3e2-59e5518a0e12 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:41.941238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb026346-d852-4473-b3e2-59e5518a0e12 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.038130 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3412/6749] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:41 2021] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:42.040826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.053683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5405d5-739b-412e-8fc5-58e8ac80c85c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.111777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.112670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.112998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.113279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/61073458b1214daab11891e38c2e2361/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.116595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=46aa86dc96e544008137439a1229fcea, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=61073458b1214daab11891e38c2e2361)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.122062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.194726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.195210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.196810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.198112 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3338/6750] 10.222.0.32 () {60 vars in 1578 bytes} [Sat Dec 25 21:33:42 2021] PUT /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/61073458b1214daab11891e38c2e2361/inherited_to_projects => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:42.202222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.220290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:42.221614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:42.264111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bd58c-36ee-41f9-b794-309a4439afeb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.271287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.272492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.273085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.273443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.274336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Adding query filter params (scope.project.id=818a71f8db274dc385480e0e1b310df9, user.id=87ae71a276fd4c3cae41f96d12dc5b8a) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:42.274861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.278584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.280436 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3413/6751] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:33:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:33:42.293978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.295526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:42.338772 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3339/6752] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:33:42 2021] GET /identity/v3/role_assignments?scope.project.id=818a71f8db274dc385480e0e1b310df9&user.id=87ae71a276fd4c3cae41f96d12dc5b8a&effective => generated 648 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:42.340693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.351892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985b424-5ce7-4804-8d0b-8193cca48d6b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.366264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.368715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.368715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.368715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.368715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Adding query filter params (scope.project.id=575a91032fee42469126a2912fb7ab98, user.id=87ae71a276fd4c3cae41f96d12dc5b8a) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:42.369421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.372193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.375361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7a57b-8f57-406a-a112-207a0a227131 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.381481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.382252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.382594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.382940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.396491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.398555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.410236 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3414/6753] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:33:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:33:42.460921 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3340/6754] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:33:42 2021] GET /identity/v3/role_assignments?scope.project.id=575a91032fee42469126a2912fb7ab98&user.id=87ae71a276fd4c3cae41f96d12dc5b8a&effective => generated 648 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:42.464902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.475896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb314ae-25d2-4c62-93c4-76a1a1705c40 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.481368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.482224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.482509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.482778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/61073458b1214daab11891e38c2e2361/inherited_to_projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.485117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=46aa86dc96e544008137439a1229fcea, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=61073458b1214daab11891e38c2e2361)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.487875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.495011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 61073458b1214daab11891e38c2e2361 was removed from user 87ae71a276fd4c3cae41f96d12dc5b8a on domain 46aa86dc96e544008137439a1229fcea. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:42.495526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:42.496354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:42.596050 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3415/6755] 10.222.0.32 () {58 vars in 1562 bytes} [Sat Dec 25 21:33:42 2021] DELETE /identity/v3/OS-INHERIT/domains/46aa86dc96e544008137439a1229fcea/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/61073458b1214daab11891e38c2e2361/inherited_to_projects => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:42.596573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.598535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:42.631615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c360b-1aff-4d40-9bfb-147cc640d677 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.731904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.732807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.734949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.734949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.735519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Adding query filter params (scope.project.id=818a71f8db274dc385480e0e1b310df9, user.id=87ae71a276fd4c3cae41f96d12dc5b8a) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:42.736098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.741507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.811398 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3341/6756] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:33:42 2021] GET /identity/v3/role_assignments?scope.project.id=818a71f8db274dc385480e0e1b310df9&user.id=87ae71a276fd4c3cae41f96d12dc5b8a&effective => generated 228 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:42.812769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.824420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d582cc-7a6b-46cf-a8af-8b709cdf58c1 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.834119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.835287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.835287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.835642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.836900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Adding query filter params (scope.project.id=575a91032fee42469126a2912fb7ab98, user.id=87ae71a276fd4c3cae41f96d12dc5b8a) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:42.842038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.842038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:42.918995 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3416/6757] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:33:42 2021] GET /identity/v3/role_assignments?scope.project.id=575a91032fee42469126a2912fb7ab98&user.id=87ae71a276fd4c3cae41f96d12dc5b8a&effective => generated 228 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:42.923171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:42.955504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ac97d-70e4-4ad5-9116-aa1cd352e8dd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:42.969280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:42.971673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:42.972679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:42.972987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/projects/575a91032fee42469126a2912fb7ab98` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:42.974345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_project(project_id=575a91032fee42469126a2912fb7ab98)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:42.976302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:43.176771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575a91032fee42469126a2912fb7ab98', 'request_id': 'req-3ba33671-93f8-4a59-9032-8a0244ddd31c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:43.176771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575a91032fee42469126a2912fb7ab98', 'request_id': 'req-3ba33671-93f8-4a59-9032-8a0244ddd31c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:43.286192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575a91032fee42469126a2912fb7ab98', 'request_id': 'req-3ba33671-93f8-4a59-9032-8a0244ddd31c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:43.300054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] The token cache is being invalidate because project 575a91032fee42469126a2912fb7ab98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:43.300376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:43.301298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:43.306266 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3342/6758] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:42 2021] DELETE /identity/v3/projects/575a91032fee42469126a2912fb7ab98 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:43.314244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:43.319178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:43.342328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8509657-c234-4b0b-8711-3d49561a4c23 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:43.430895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:43.431832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:43.432125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:43.432406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles/61073458b1214daab11891e38c2e2361` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:43.434037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=61073458b1214daab11891e38c2e2361)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:43.436180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:43.617395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 61073458b1214daab11891e38c2e2361 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:43.617759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:43.618672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:43.622454 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3417/6759] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:43 2021] DELETE /identity/v3/roles/61073458b1214daab11891e38c2e2361 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:43.627631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:43.640276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba33671-93f8-4a59-9032-8a0244ddd31c tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:43.726482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:43.727186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:43.727468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:43.727742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:43.728586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:43.731248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:43.834604 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3343/6760] 10.222.0.32 () {60 vars in 1142 bytes} [Sat Dec 25 21:33:43 2021] POST /identity/v3/roles => generated 239 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:43.838307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:43.839774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:43.870427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507688b0-fbb4-4c7c-be70-5be4e5b37132 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:43.881396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:43.882095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:43.882384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:43.882657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:43.883371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:43.888118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:44.410442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3418/6761] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:43 2021] POST /identity/v3/projects => generated 409 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:44.413536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:44.426967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025013c5-037e-424b-b31b-03a2958b3fc5 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:44.496967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:44.497987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:44.498380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:44.498760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/3ea22de5a87d4f0c8ee057a449f448e7/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:44.501999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:create_grant(project_id=818a71f8db274dc385480e0e1b310df9, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=3ea22de5a87d4f0c8ee057a449f448e7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:44.504802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:44.606872 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3344/6762] 10.222.0.32 () {60 vars in 1581 bytes} [Sat Dec 25 21:33:44 2021] PUT /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/3ea22de5a87d4f0c8ee057a449f448e7/inherited_to_projects => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:44.607385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:44.618973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603192e7-b6fb-4ce2-8a59-e0eda4e30644 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:44.684753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:44.685469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:44.685827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:44.686207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:44.687644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Adding query filter params (scope.project.id=1bfa403c782d417faa1a8a4defe9ef4c, user.id=87ae71a276fd4c3cae41f96d12dc5b8a) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:44.688182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:44.690299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:44.748518 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3419/6763] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:33:44 2021] GET /identity/v3/role_assignments?scope.project.id=1bfa403c782d417faa1a8a4defe9ef4c&user.id=87ae71a276fd4c3cae41f96d12dc5b8a&effective => generated 649 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:44.755039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:44.769738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb87b13-3808-49b1-a503-8259571a091b tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:44.775324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:44.776478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:44.776859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:44.786916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/3ea22de5a87d4f0c8ee057a449f448e7/inherited_to_projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:44.786916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=818a71f8db274dc385480e0e1b310df9, user_id=87ae71a276fd4c3cae41f96d12dc5b8a, role_id=3ea22de5a87d4f0c8ee057a449f448e7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:44.786916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:44.789070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 3ea22de5a87d4f0c8ee057a449f448e7 was removed from user 87ae71a276fd4c3cae41f96d12dc5b8a on project 818a71f8db274dc385480e0e1b310df9. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:44.789366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:44.791767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:44.892071 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3345/6764] 10.222.0.32 () {58 vars in 1565 bytes} [Sat Dec 25 21:33:44 2021] DELETE /identity/v3/OS-INHERIT/projects/818a71f8db274dc385480e0e1b310df9/users/87ae71a276fd4c3cae41f96d12dc5b8a/roles/3ea22de5a87d4f0c8ee057a449f448e7/inherited_to_projects => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:44.896265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:44.898292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:44.917145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac92f-62a3-499a-b298-e65adfdeadfd tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:44.998305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:44.998972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:44.999261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:44.999569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:45.001130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Adding query filter params (scope.project.id=1bfa403c782d417faa1a8a4defe9ef4c, user.id=87ae71a276fd4c3cae41f96d12dc5b8a) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:45.001449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:45.004448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:45.111404 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3420/6765] 10.222.0.32 () {58 vars in 1355 bytes} [Sat Dec 25 21:33:44 2021] GET /identity/v3/role_assignments?scope.project.id=1bfa403c782d417faa1a8a4defe9ef4c&user.id=87ae71a276fd4c3cae41f96d12dc5b8a&effective => generated 228 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:45.112296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:45.127111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e78e7-3bb1-4848-8658-58818ea8dae0 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:45.147519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:45.148608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:45.148934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:45.149226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/projects/1bfa403c782d417faa1a8a4defe9ef4c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:45.150619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1bfa403c782d417faa1a8a4defe9ef4c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:45.153733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:45.333060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfa403c782d417faa1a8a4defe9ef4c', 'request_id': 'req-ae9d018e-140b-4354-a227-6557f6794921'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:45.360745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfa403c782d417faa1a8a4defe9ef4c', 'request_id': 'req-ae9d018e-140b-4354-a227-6557f6794921'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:45.475260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfa403c782d417faa1a8a4defe9ef4c', 'request_id': 'req-ae9d018e-140b-4354-a227-6557f6794921'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:45.486150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] The token cache is being invalidate because project 1bfa403c782d417faa1a8a4defe9ef4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:45.487891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:45.488727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:45.491083 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3346/6766] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:45 2021] DELETE /identity/v3/projects/1bfa403c782d417faa1a8a4defe9ef4c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:45.494847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:45.496704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:45.522308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7589ac-d9a0-444d-a40d-07dd420e0ad4 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:45.622500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:45.624899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:45.624899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:45.624899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/roles/3ea22de5a87d4f0c8ee057a449f448e7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:45.625863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3ea22de5a87d4f0c8ee057a449f448e7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:45.628080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:45.926143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invalidating the token cache because role 3ea22de5a87d4f0c8ee057a449f448e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:45.926434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:45.927093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:45.929008 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3421/6767] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:45 2021] DELETE /identity/v3/roles/3ea22de5a87d4f0c8ee057a449f448e7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:45.933938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:45.945142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d018e-140b-4354-a227-6557f6794921 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:46.005854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:46.006760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:46.007108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:46.008041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/users/87ae71a276fd4c3cae41f96d12dc5b8a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:46.009433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_user(user_id=87ae71a276fd4c3cae41f96d12dc5b8a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:46.012094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:46.178344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ae71a276fd4c3cae41f96d12dc5b8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.185956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ae71a276fd4c3cae41f96d12dc5b8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.199959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ae71a276fd4c3cae41f96d12dc5b8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.203826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ae71a276fd4c3cae41f96d12dc5b8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.203826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ae71a276fd4c3cae41f96d12dc5b8a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.300508 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3347/6768] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:45 2021] DELETE /identity/v3/users/87ae71a276fd4c3cae41f96d12dc5b8a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:46.304155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:46.305988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:46.320788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77d5c7-8dc4-4702-b4d0-e9434c7d0cc6 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:46.419090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:46.420164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:46.420528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:46.420893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/groups/3241b1d98fe54057bfca97356a2ddea6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:46.423215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3241b1d98fe54057bfca97356a2ddea6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:46.425270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:46.544173 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3422/6769] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:33:46 2021] DELETE /identity/v3/groups/3241b1d98fe54057bfca97356a2ddea6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:46.548705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:46.550340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:46.564994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a431-fe9b-479b-bc49-44be7bcbbcfb tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:46.646799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:46.648061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:46.648424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:46.648768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/projects/818a71f8db274dc385480e0e1b310df9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:46.650128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_project(project_id=818a71f8db274dc385480e0e1b310df9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:46.652065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:46.826520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818a71f8db274dc385480e0e1b310df9', 'request_id': 'req-9ecf42c0-856e-4ce0-8618-5e6811c770a8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.834845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818a71f8db274dc385480e0e1b310df9', 'request_id': 'req-9ecf42c0-856e-4ce0-8618-5e6811c770a8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.941237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818a71f8db274dc385480e0e1b310df9', 'request_id': 'req-9ecf42c0-856e-4ce0-8618-5e6811c770a8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.962341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] The token cache is being invalidate because project 818a71f8db274dc385480e0e1b310df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:46.969043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.969043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:46.970060 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3348/6770] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:46 2021] DELETE /identity/v3/projects/818a71f8db274dc385480e0e1b310df9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:46.971103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:46.972967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:46.989204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf64d-e522-4bcf-9caf-2f9792a31e2f tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:47.082191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:47.083480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:47.083968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:47.084550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/domains/46aa86dc96e544008137439a1229fcea` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:47.085939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=46aa86dc96e544008137439a1229fcea)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:47.087547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:47.115647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '46aa86dc96e544008137439a1229fcea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.116353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '46aa86dc96e544008137439a1229fcea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.229659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '46aa86dc96e544008137439a1229fcea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.230400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '46aa86dc96e544008137439a1229fcea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.252387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:47.259608 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3423/6771] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:33:46 2021] PATCH /identity/v3/domains/46aa86dc96e544008137439a1229fcea => generated 277 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:47.264205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf42c0-856e-4ce0-8618-5e6811c770a8 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:47.381327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbbbca7471474882bdd6754532f7542b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b66427851ab74428bcc579a006e07303', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:47.382676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:47.383193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:47.383664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] PATH_INFO: `/v3/domains/46aa86dc96e544008137439a1229fcea` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:47.397594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=46aa86dc96e544008137439a1229fcea)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:47.400195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:47.455632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '46aa86dc96e544008137439a1229fcea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.471098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '46aa86dc96e544008137439a1229fcea'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.616091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46aa86dc96e544008137439a1229fcea', 'request_id': 'req-c976e429-d1bd-426b-b9a9-dbf0176e7318'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.628621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46aa86dc96e544008137439a1229fcea', 'request_id': 'req-c976e429-d1bd-426b-b9a9-dbf0176e7318'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.823239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46aa86dc96e544008137439a1229fcea', 'request_id': 'req-c976e429-d1bd-426b-b9a9-dbf0176e7318'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.836616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] The token cache is being invalidate because project 46aa86dc96e544008137439a1229fcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:47.837675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.838426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.849403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '46aa86dc96e544008137439a1229fcea', 'request_id': 'req-c976e429-d1bd-426b-b9a9-dbf0176e7318'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.850295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '46aa86dc96e544008137439a1229fcea', 'request_id': 'req-c976e429-d1bd-426b-b9a9-dbf0176e7318'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.851005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c976e429-d1bd-426b-b9a9-dbf0176e7318 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '46aa86dc96e544008137439a1229fcea', 'request_id': 'req-c976e429-d1bd-426b-b9a9-dbf0176e7318'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:47.866435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:47.866908 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3349/6772] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:33:47 2021] DELETE /identity/v3/domains/46aa86dc96e544008137439a1229fcea => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:47.869044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:47.992260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d35d54-e2cc-4994-8933-8dc42b329574 tempest-InheritsV3TestJSON-714002037 tempest-InheritsV3TestJSON-714002037-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:48.075147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:48.076200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:48.076485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:48.076760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] PATH_INFO: `/v3/users/052f3f3bce9144f181c83a6cd96836a4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:48.078730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=052f3f3bce9144f181c83a6cd96836a4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:48.080657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:48.311290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052f3f3bce9144f181c83a6cd96836a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:48.349183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052f3f3bce9144f181c83a6cd96836a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:48.369004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052f3f3bce9144f181c83a6cd96836a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:48.370407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052f3f3bce9144f181c83a6cd96836a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:48.473540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052f3f3bce9144f181c83a6cd96836a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:48.479462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3424/6773] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:47 2021] DELETE /identity/v3/users/052f3f3bce9144f181c83a6cd96836a4 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:48.483973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:48.484445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:48.484562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:48.507364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:48.508569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:48.593033 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3350/6774] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:48.597641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:48.600150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:48.677839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a170c3e-6302-436b-ac37-762012146ece admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:48.681826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:48.682480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:48.682770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:48.683050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:48.696160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:48.703111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:48.708856 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3425/6775] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:33:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:33:49.493720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:49.498627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:49.518119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cc99b-728e-4bcd-9b25-0bad0eba3bc1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:49.525358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:49.526480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:49.527252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:49.527252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] PATH_INFO: `/v3/projects/6e167a3e902c4cf59212333cfa5effbb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:49.528791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e167a3e902c4cf59212333cfa5effbb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:49.530838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:49.682002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e167a3e902c4cf59212333cfa5effbb', 'request_id': 'req-dbcebc29-ebff-4703-b7ed-32334f1389e8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:49.689231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e167a3e902c4cf59212333cfa5effbb', 'request_id': 'req-dbcebc29-ebff-4703-b7ed-32334f1389e8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:49.808413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e167a3e902c4cf59212333cfa5effbb', 'request_id': 'req-dbcebc29-ebff-4703-b7ed-32334f1389e8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:49.826660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] The token cache is being invalidate because project 6e167a3e902c4cf59212333cfa5effbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:49.827263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:49.828694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:49.830416 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3351/6776] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:49 2021] DELETE /identity/v3/projects/6e167a3e902c4cf59212333cfa5effbb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:49.842650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:49.854229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301e8cb-2bd2-4546-8f3a-3edc7f1f1040 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:49.931171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:49.932163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:49.932384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:49.932702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] PATH_INFO: `/v3/users/cbbbca7471474882bdd6754532f7542b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:49.934293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbbca7471474882bdd6754532f7542b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:49.936419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:50.131459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbbca7471474882bdd6754532f7542b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:50.150853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbbca7471474882bdd6754532f7542b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:50.164863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbbca7471474882bdd6754532f7542b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:50.169390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbbca7471474882bdd6754532f7542b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:50.246456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc69aa4b-9bac-4179-b57e-a7d1f08a17da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbbca7471474882bdd6754532f7542b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:50.266980 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3426/6777] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:49 2021] DELETE /identity/v3/users/cbbbca7471474882bdd6754532f7542b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:50.898373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:50.900140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:50.924670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebc29-ebff-4703-b7ed-32334f1389e8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:51.020699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:51.021868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:51.022153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:51.022433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] PATH_INFO: `/v3/projects/b66427851ab74428bcc579a006e07303` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:51.023658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66427851ab74428bcc579a006e07303)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:51.025605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:51.150725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66427851ab74428bcc579a006e07303', 'request_id': 'req-5e45f981-8359-47fe-991c-b3c28dca0a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:51.159144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66427851ab74428bcc579a006e07303', 'request_id': 'req-5e45f981-8359-47fe-991c-b3c28dca0a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:51.254279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66427851ab74428bcc579a006e07303', 'request_id': 'req-5e45f981-8359-47fe-991c-b3c28dca0a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:51.278413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] The token cache is being invalidate because project b66427851ab74428bcc579a006e07303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:51.279125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:51.279831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5e45f981-8359-47fe-991c-b3c28dca0a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:51.281968 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3352/6778] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:50 2021] DELETE /identity/v3/projects/b66427851ab74428bcc579a006e07303 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:51.287951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1161f3-267d-4e80-ad20-c9bbc207b2e1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:51.288525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1161f3-267d-4e80-ad20-c9bbc207b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:51.288525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1161f3-267d-4e80-ad20-c9bbc207b2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:51.313742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bb1161f3-267d-4e80-ad20-c9bbc207b2e1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:51.314991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bb1161f3-267d-4e80-ad20-c9bbc207b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:51.394849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3427/6779] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:51.399399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14ff6-768e-484f-ab79-d26b75a7631a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:51.399693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14ff6-768e-484f-ab79-d26b75a7631a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:51.399975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14ff6-768e-484f-ab79-d26b75a7631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:51.428822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-64b14ff6-768e-484f-ab79-d26b75a7631a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:51.433339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-64b14ff6-768e-484f-ab79-d26b75a7631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:51.479312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1161f3-267d-4e80-ad20-c9bbc207b2e1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:51.479506 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3353/6780] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:51.490528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1161f3-267d-4e80-ad20-c9bbc207b2e1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:51.504251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:51.504251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:51.504251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:51.504251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:51.504679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:51.504679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:51.504679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:51.517683 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3428/6781] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:33:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:51.519359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b14ff6-768e-484f-ab79-d26b75a7631a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:51.532143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b14ff6-768e-484f-ab79-d26b75a7631a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:51.537696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:51.538657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:51.539123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:51.539568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:51.540422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:51.542383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:51.689803 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3354/6782] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:51 2021] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:51.691880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:51.706811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6947-f3bf-4e6a-96fb-8de9a763db88 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:51.828829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:51.830072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:51.830072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:51.830300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:51.830947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:51.834196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:51.946297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3429/6783] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:51 2021] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:51.947912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:51.960990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b648-9c50-4b2c-90a2-3532bc746418 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:51.967505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:51.967505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:51.967811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:51.968912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:51.969913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:51.971610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:51.988976 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3355/6784] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:51.989173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:52.005827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13be043-40ce-44a6-88b9-c017c47f7b7d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:52.012566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0fc0b-8cd3-4fe5-b816-f62d5e94e63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:52.013926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fc0b-8cd3-4fe5-b816-f62d5e94e63c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:52.014736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fc0b-8cd3-4fe5-b816-f62d5e94e63c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:52.015659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0fc0b-8cd3-4fe5-b816-f62d5e94e63c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:52.016623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0fc0b-8cd3-4fe5-b816-f62d5e94e63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:52.018733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0fc0b-8cd3-4fe5-b816-f62d5e94e63c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:52.037558 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3430/6785] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:51 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:52.038494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:52.058491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01a8a-22d7-4073-b581-9c92cddeaf6d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:52.074432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:52.076758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:52.077887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:52.078387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] PATH_INFO: `/v3/projects/6960af5360b44d7b9ab5fb5e86e066f5/users/398e56b6b9dc46ef9b208fc2976508c7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:52.105678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6960af5360b44d7b9ab5fb5e86e066f5, user_id=398e56b6b9dc46ef9b208fc2976508c7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:52.111575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:52.251637 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3356/6786] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:52 2021] PUT /identity/v3/projects/6960af5360b44d7b9ab5fb5e86e066f5/users/398e56b6b9dc46ef9b208fc2976508c7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:52.267614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb857c-35c1-4356-96c6-00e08955ded4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:52.268001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb857c-35c1-4356-96c6-00e08955ded4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:52.268200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb857c-35c1-4356-96c6-00e08955ded4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:52.349442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fceb857c-35c1-4356-96c6-00e08955ded4 None None] MFA Rules not processed for user `398e56b6b9dc46ef9b208fc2976508c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:52.350782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fceb857c-35c1-4356-96c6-00e08955ded4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:52.479944 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3431/6787] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:52 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:52.485406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:52.560531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aa030-07e5-41aa-bed7-06c99cd6ffb2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:52.565704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:52.566371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:52.566706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:52.566985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:52.567909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:52.570018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:52.696945 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3357/6788] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:52 2021] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:52.703203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb857c-35c1-4356-96c6-00e08955ded4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:52.719636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb857c-35c1-4356-96c6-00e08955ded4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:52.802552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:52.804089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:52.804716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:52.805398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:52.806737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:52.813421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:52.888905 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3432/6789] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:52 2021] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:52.893596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:52.908646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceeb9f-ba37-4bf7-b8c2-bbf5506bcf7a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:52.933203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:52.934866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:52.935915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:52.937554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:52.939152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:52.943722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:52.978680 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3358/6790] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:52 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:52.984855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:52.996629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88058ac8-c08a-42dd-bbe0-b4603abec7e2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:53.009485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:53.013301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.013301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.013301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] PATH_INFO: `/v3/projects/1ba99872425b4cb4bd901c1d9b6b814a/users/f8062afb3c5843ada8496f1e38682443/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.029908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba99872425b4cb4bd901c1d9b6b814a, user_id=f8062afb3c5843ada8496f1e38682443, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:53.033171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:53.102964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3433/6791] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:52 2021] PUT /identity/v3/projects/1ba99872425b4cb4bd901c1d9b6b814a/users/f8062afb3c5843ada8496f1e38682443/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:53.108026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:53.120702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c790aa-5652-488f-a8a9-5075723c6255 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:53.200399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bca9a-0170-4dc0-8f82-93c1a50bff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:53.201184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bca9a-0170-4dc0-8f82-93c1a50bff6e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.201470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bca9a-0170-4dc0-8f82-93c1a50bff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.201745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bca9a-0170-4dc0-8f82-93c1a50bff6e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.203098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bca9a-0170-4dc0-8f82-93c1a50bff6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:53.204865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bca9a-0170-4dc0-8f82-93c1a50bff6e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:53.220760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3359/6792] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:33:53 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:53.222450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:53.235217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f3221-f07d-4a9a-a8fc-20d4813966c8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:53.240270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:53.241353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.241635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.241945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] PATH_INFO: `/v3/projects/1ba99872425b4cb4bd901c1d9b6b814a/users/f8062afb3c5843ada8496f1e38682443/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.244157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba99872425b4cb4bd901c1d9b6b814a, user_id=f8062afb3c5843ada8496f1e38682443, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:53.246868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:53.258645 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3434/6793] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:33:53 2021] PUT /identity/v3/projects/1ba99872425b4cb4bd901c1d9b6b814a/users/f8062afb3c5843ada8496f1e38682443/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:53.272307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524373c-0438-42f7-b974-9d68d319957c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.276458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524373c-0438-42f7-b974-9d68d319957c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.276458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524373c-0438-42f7-b974-9d68d319957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.300984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b524373c-0438-42f7-b974-9d68d319957c None None] MFA Rules not processed for user `f8062afb3c5843ada8496f1e38682443`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:33:53.302444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b524373c-0438-42f7-b974-9d68d319957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:53.378739 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3360/6794] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:33:53 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:33:53.383895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:53.395647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847b8b5-6a73-431c-a959-4b3c659c4df9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:53.400663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:53.401349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.401633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.402213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.402739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:53.404572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:53.643132 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3435/6795] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:53 2021] POST /identity/v3/projects => generated 359 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:53.647735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524373c-0438-42f7-b974-9d68d319957c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:53.657811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524373c-0438-42f7-b974-9d68d319957c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:53.716628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:53.717321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.717602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.718402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.719974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:53.721911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:53.853620 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3361/6796] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:33:53 2021] POST /identity/v3/users => generated 413 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:53.857770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:53.873535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39958b2f-ccf2-4dde-9587-b92a3d298d86 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:53.878749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:53.879635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.879947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.880223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/users/4ea6dd9809f947938e3d79d664d45566` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.897108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_user(user_id=4ea6dd9809f947938e3d79d664d45566)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:53.899410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:53.904761 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3436/6797] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:33:53 2021] GET /identity/v3/users/4ea6dd9809f947938e3d79d664d45566 => generated 413 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:53.906397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:53.918157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cec41-0e66-4c17-92fc-cb34f6f52679 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:53.925383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:53.926317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:53.926605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:53.926895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/users/4ea6dd9809f947938e3d79d664d45566` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:53.928343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4ea6dd9809f947938e3d79d664d45566)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:53.930635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:54.066054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea6dd9809f947938e3d79d664d45566'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.075391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea6dd9809f947938e3d79d664d45566'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.089810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea6dd9809f947938e3d79d664d45566'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.091151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea6dd9809f947938e3d79d664d45566'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.091915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea6dd9809f947938e3d79d664d45566'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.190647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:54.192130 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3362/6798] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:33:53 2021] DELETE /identity/v3/users/4ea6dd9809f947938e3d79d664d45566 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:33:54.193529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:54.213000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275cd9-f2f7-43bd-92a9-c0fa3cf956cf tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:54.282357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:54.283228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:54.283517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:54.283948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/ffdfdb517dde40c5b15256eff7c51804` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:54.285295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffdfdb517dde40c5b15256eff7c51804)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:54.287409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:54.386372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdfdb517dde40c5b15256eff7c51804', 'request_id': 'req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.534998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdfdb517dde40c5b15256eff7c51804', 'request_id': 'req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.541722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdfdb517dde40c5b15256eff7c51804', 'request_id': 'req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.552251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project ffdfdb517dde40c5b15256eff7c51804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:54.552530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.553263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.554857 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3437/6799] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:54 2021] DELETE /identity/v3/projects/ffdfdb517dde40c5b15256eff7c51804 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:54.560061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:54.576403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5219-0570-4701-b416-d95f67e3dc3b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:54.645536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:54.646212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:54.646553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:54.646763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:54.647475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:54.649258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:54.750562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3363/6800] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:54 2021] POST /identity/v3/projects => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:54.754526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:54.755881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:54.770467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e0b0-c39c-44eb-beb5-afe922fdceb5 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:54.824250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:54.824898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:54.825194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:54.825469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:54.826220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:33:54.826525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:54.828922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:54.846541 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3438/6801] 10.222.0.32 () {58 vars in 1159 bytes} [Sat Dec 25 21:33:54 2021] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:33:54.850955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:54.861621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253875a-2c47-44ef-a00b-5beb1b6bd956 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:54.867635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:54.867635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:54.867635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:54.868061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:54.868541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:54.870553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:54.883101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3364/6802] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:33:54 2021] GET /identity/v3/domains => generated 830 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:54.887361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:54.898602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a648703-8386-46fd-a8e7-11499ffb518c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:54.903535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:54.904450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:54.907626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:54.907626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/a57ef2c4fc1244458d1773b72e271172` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:54.907626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:update_project(project_id=a57ef2c4fc1244458d1773b72e271172)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:54.908092 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:54.908092 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:33:54.908092 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:33:54.909094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:54.919811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:54.920479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.004819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.005505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.007946 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3439/6803] 10.222.0.32 () {60 vars in 1251 bytes} [Sat Dec 25 21:33:54 2021] PATCH /identity/v3/projects/a57ef2c4fc1244458d1773b72e271172 => generated 363 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:55.012304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:55.014614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:55.028818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a44ad1-70ba-43dc-8632-37ee0126170b tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:55.085420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:55.086892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:55.087421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:55.087945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/a57ef2c4fc1244458d1773b72e271172` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:55.100269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a57ef2c4fc1244458d1773b72e271172)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:55.102009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:55.126351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.135587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.216145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172', 'request_id': 'req-deb21bc9-dd44-4b0b-bcee-610c6187f720'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.222967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172', 'request_id': 'req-deb21bc9-dd44-4b0b-bcee-610c6187f720'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.317631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172', 'request_id': 'req-deb21bc9-dd44-4b0b-bcee-610c6187f720'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.330604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project a57ef2c4fc1244458d1773b72e271172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:55.330942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.331715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.340770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172', 'request_id': 'req-deb21bc9-dd44-4b0b-bcee-610c6187f720'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.341474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172', 'request_id': 'req-deb21bc9-dd44-4b0b-bcee-610c6187f720'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.342133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a57ef2c4fc1244458d1773b72e271172', 'request_id': 'req-deb21bc9-dd44-4b0b-bcee-610c6187f720'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.350417 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3365/6804] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:55 2021] DELETE /identity/v3/projects/a57ef2c4fc1244458d1773b72e271172 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:55.355502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:55.365723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047048a1-76ab-4d34-acb2-b96f1e6c503f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:55.428753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:55.429684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:55.429972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:55.430354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:55.431079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:55.433438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:55.547056 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3440/6805] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:55 2021] POST /identity/v3/projects => generated 359 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:55.548353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:55.549850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:55.563631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21bc9-dd44-4b0b-bcee-610c6187f720 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:55.619007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:55.619939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:55.620218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:55.620491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/84ae5753c1184d3bb4585b0c07a5e6f0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:55.625640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=84ae5753c1184d3bb4585b0c07a5e6f0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:55.627815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:55.633312 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3366/6806] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:33:55 2021] GET /identity/v3/projects/84ae5753c1184d3bb4585b0c07a5e6f0 => generated 359 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:55.636658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:55.646467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233924d8-991a-48ae-8c8b-f599e0de7b0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:55.651395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:55.652264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:55.652544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:55.652991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/84ae5753c1184d3bb4585b0c07a5e6f0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:55.654864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=84ae5753c1184d3bb4585b0c07a5e6f0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:55.657294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:55.790171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ae5753c1184d3bb4585b0c07a5e6f0', 'request_id': 'req-bb007615-2009-40f6-bb4c-2e2b546f9f79'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.883258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ae5753c1184d3bb4585b0c07a5e6f0', 'request_id': 'req-bb007615-2009-40f6-bb4c-2e2b546f9f79'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.891141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ae5753c1184d3bb4585b0c07a5e6f0', 'request_id': 'req-bb007615-2009-40f6-bb4c-2e2b546f9f79'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.901408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project 84ae5753c1184d3bb4585b0c07a5e6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:55.901695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.902449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:55.904259 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3441/6807] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:55 2021] DELETE /identity/v3/projects/84ae5753c1184d3bb4585b0c07a5e6f0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:55.909602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:55.911309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:55.926378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd84be-38f1-47fe-86b5-e8a69154922c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:55.984858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:55.985565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:55.985855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:55.986143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:55.986844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:55.988696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:56.077833 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3367/6808] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:55 2021] POST /identity/v3/projects => generated 358 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:56.081498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:56.092336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb007615-2009-40f6-bb4c-2e2b546f9f79 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:56.153251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:56.154170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:56.154474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:56.154751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/b7ece50d34fb42a2a861de68a6155f02` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:56.156461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=b7ece50d34fb42a2a861de68a6155f02)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:56.158603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:56.160297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3442/6809] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:33:56 2021] GET /identity/v3/projects/b7ece50d34fb42a2a861de68a6155f02 => generated 358 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:56.164635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:56.175891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc00ca-baaf-4b5f-b187-5a25683b1d82 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:56.180752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:56.181642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:56.182040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:56.182322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/b7ece50d34fb42a2a861de68a6155f02` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:56.183522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7ece50d34fb42a2a861de68a6155f02)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:56.185610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:56.317656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ece50d34fb42a2a861de68a6155f02', 'request_id': 'req-45e844ce-a899-4dd9-9780-e4b95221ba39'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.324319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ece50d34fb42a2a861de68a6155f02', 'request_id': 'req-45e844ce-a899-4dd9-9780-e4b95221ba39'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.426155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ece50d34fb42a2a861de68a6155f02', 'request_id': 'req-45e844ce-a899-4dd9-9780-e4b95221ba39'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.437341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project b7ece50d34fb42a2a861de68a6155f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:56.437623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.438363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.439974 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3368/6810] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:56 2021] DELETE /identity/v3/projects/b7ece50d34fb42a2a861de68a6155f02 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:56.445366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:56.447243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:56.459949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4290f-29ce-44f9-ac0e-ee215106ee0d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:56.516527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:56.517239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:56.517526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:56.517808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:56.518497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:56.520326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:56.641460 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3443/6811] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:33:56 2021] POST /identity/v3/projects => generated 347 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:56.642916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:56.653849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e844ce-a899-4dd9-9780-e4b95221ba39 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:56.712520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:56.713529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:56.713819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:56.714101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/45dd68033ea1438d8ec9f22a9d80915d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:56.715291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=45dd68033ea1438d8ec9f22a9d80915d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:56.717451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:56.719832 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3369/6812] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:33:56 2021] GET /identity/v3/projects/45dd68033ea1438d8ec9f22a9d80915d => generated 347 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:56.724671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:56.737978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b1dc3-1b52-4b09-8866-d6b25edadf1a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:56.743132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:56.744316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:56.744660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:56.745002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/45dd68033ea1438d8ec9f22a9d80915d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:56.746307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45dd68033ea1438d8ec9f22a9d80915d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:56.748411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:56.891020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45dd68033ea1438d8ec9f22a9d80915d', 'request_id': 'req-05563ecd-0448-460e-a828-aeeb0f9d9e1c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.980460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45dd68033ea1438d8ec9f22a9d80915d', 'request_id': 'req-05563ecd-0448-460e-a828-aeeb0f9d9e1c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.988626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45dd68033ea1438d8ec9f22a9d80915d', 'request_id': 'req-05563ecd-0448-460e-a828-aeeb0f9d9e1c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.998660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project 45dd68033ea1438d8ec9f22a9d80915d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:56.998944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:56.999686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.001305 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3444/6813] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:56 2021] DELETE /identity/v3/projects/45dd68033ea1438d8ec9f22a9d80915d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:57.006155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:57.008162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:57.021994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe62d-a358-4b3f-9ab5-392b2dbd736d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:57.081467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:57.082146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:57.082431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:57.082710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:57.083656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:57.085277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:57.148449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3370/6814] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:33:57 2021] POST /identity/v3/domains => generated 276 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:57.152658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:57.162739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05563ecd-0448-460e-a828-aeeb0f9d9e1c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:57.219289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:57.219937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:57.220219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:57.220494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:57.221211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:57.223202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:57.345384 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3445/6815] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:57 2021] POST /identity/v3/projects => generated 403 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:57.349600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:57.360465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4281f2b-0730-40a6-843e-bd573e789c8a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:57.430066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:57.430857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:57.431142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:57.431418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/29b71f421f324008bc6fd65ca1a36768` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:57.432615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=29b71f421f324008bc6fd65ca1a36768)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:57.434776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:57.440669 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3371/6816] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:33:57 2021] GET /identity/v3/projects/29b71f421f324008bc6fd65ca1a36768 => generated 403 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:33:57.441154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:57.451549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4f16-3fe6-4a57-9e32-f03098b95465 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:57.457013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:57.457851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:57.458130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:57.458403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/29b71f421f324008bc6fd65ca1a36768` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:57.459865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29b71f421f324008bc6fd65ca1a36768)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:57.461821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:57.565779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b71f421f324008bc6fd65ca1a36768', 'request_id': 'req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.643683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b71f421f324008bc6fd65ca1a36768', 'request_id': 'req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.650381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b71f421f324008bc6fd65ca1a36768', 'request_id': 'req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.660959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project 29b71f421f324008bc6fd65ca1a36768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:57.661243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.661885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.663462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3446/6817] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:57 2021] DELETE /identity/v3/projects/29b71f421f324008bc6fd65ca1a36768 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:57.667714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:57.669509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:57.682074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864c6f2-bfd1-4763-a36f-b2986927733c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:57.746312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:57.747201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:57.747567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:57.749836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains/ce3e503064fb4511be6c98342488fa9e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:57.750258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ce3e503064fb4511be6c98342488fa9e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:57.751975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:57.791852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.794056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.952099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.952680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:57.955220 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3372/6818] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:33:57 2021] PATCH /identity/v3/domains/ce3e503064fb4511be6c98342488fa9e => generated 277 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:57.962281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:57.981925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef953f2f-ce1f-496b-8f51-1c53a0aaa088 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:58.080467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:58.080675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:58.081251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:58.081923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains/ce3e503064fb4511be6c98342488fa9e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:58.093544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ce3e503064fb4511be6c98342488fa9e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:58.095150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:58.118725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.128783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.255706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e', 'request_id': 'req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.348737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e', 'request_id': 'req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.357728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e', 'request_id': 'req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.368694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project ce3e503064fb4511be6c98342488fa9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:58.369171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.369811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.377151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e', 'request_id': 'req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.377767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e', 'request_id': 'req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.378370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ce3e503064fb4511be6c98342488fa9e', 'request_id': 'req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:58.386278 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3447/6819] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:33:57 2021] DELETE /identity/v3/domains/ce3e503064fb4511be6c98342488fa9e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:58.391477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:58.392918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:58.406063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ebf8d-3b75-418d-a09d-a6409c7ba74c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:58.466388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:58.467052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:58.467338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:58.468172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:58.468922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:58.472281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:58.567601 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3373/6820] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:33:58 2021] POST /identity/v3/domains => generated 277 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:58.568793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:58.570499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:58.585314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63e4d-d9a8-4a8b-a87c-9779a40c3226 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:58.642915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:58.643580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:58.643867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:58.644145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:58.644869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:58.646786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:58.791047 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3448/6821] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:58 2021] POST /identity/v3/projects => generated 410 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:33:58.792304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:58.804793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dbdf-d6f6-4af6-b911-e6db0c75180e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:58.866612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:58.867282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:58.867569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:58.867850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:58.868550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:58.870491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:59.011163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3374/6822] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:33:58 2021] POST /identity/v3/projects => generated 404 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:33:59.021744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:59.033448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0ad75-fd05-48f7-95d9-f677d2e8c4fd tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:59.096367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:59.097265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:59.097554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:59.097828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/9ec2d3537b2c485383e5a34f1ac9ef6e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:59.099023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9ec2d3537b2c485383e5a34f1ac9ef6e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:59.100934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:59.218056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec2d3537b2c485383e5a34f1ac9ef6e', 'request_id': 'req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.298011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec2d3537b2c485383e5a34f1ac9ef6e', 'request_id': 'req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.305169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec2d3537b2c485383e5a34f1ac9ef6e', 'request_id': 'req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.318233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project 9ec2d3537b2c485383e5a34f1ac9ef6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:59.318734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.320551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.323147 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3449/6823] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:59 2021] DELETE /identity/v3/projects/9ec2d3537b2c485383e5a34f1ac9ef6e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:59.327368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:59.329174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:33:59.355811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28eca-7f2e-484d-bd79-80b5eaeb5045 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:59.416067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:59.417089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:59.417415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:59.418009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/6c88a4b906bf495d9dfab7f035739c50` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:59.418949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c88a4b906bf495d9dfab7f035739c50)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:59.421433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:59.585004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c88a4b906bf495d9dfab7f035739c50', 'request_id': 'req-d65d987c-6c73-4805-8395-b450ef619a4e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.591866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c88a4b906bf495d9dfab7f035739c50', 'request_id': 'req-d65d987c-6c73-4805-8395-b450ef619a4e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.740758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c88a4b906bf495d9dfab7f035739c50', 'request_id': 'req-d65d987c-6c73-4805-8395-b450ef619a4e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.752513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project 6c88a4b906bf495d9dfab7f035739c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:33:59.752702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.753363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.754875 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3375/6824] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:33:59 2021] DELETE /identity/v3/projects/6c88a4b906bf495d9dfab7f035739c50 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:33:59.759036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:59.769149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb26b20-4cdf-424e-ad4d-5cc41d8a0b52 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:33:59.827587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:33:59.827587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:33:59.827905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:33:59.828097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains/c0c5a39427014ae4991bcbe191a1b345` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:33:59.829444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c0c5a39427014ae4991bcbe191a1b345)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:33:59.831033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:33:59.852169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.852920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.978780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.980904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:33:59.986920 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3450/6825] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:33:59 2021] PATCH /identity/v3/domains/c0c5a39427014ae4991bcbe191a1b345 => generated 278 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:33:59.988937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:33:59.990342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:00.004466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d987c-6c73-4805-8395-b450ef619a4e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:00.062148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:00.063023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:00.063321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:00.063598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains/c0c5a39427014ae4991bcbe191a1b345` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:00.075380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c0c5a39427014ae4991bcbe191a1b345)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:00.081384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:00.101773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.111919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.236790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345', 'request_id': 'req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.243388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345', 'request_id': 'req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.357846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345', 'request_id': 'req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.375845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project c0c5a39427014ae4991bcbe191a1b345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:00.376130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.376812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.385874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345', 'request_id': 'req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.386564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345', 'request_id': 'req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.387270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c0c5a39427014ae4991bcbe191a1b345', 'request_id': 'req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.396521 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3376/6826] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:33:59 2021] DELETE /identity/v3/domains/c0c5a39427014ae4991bcbe191a1b345 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:00.401656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:00.407575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:00.416574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5406-25c4-45ac-ac84-8993f77ac39c tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:00.481109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:00.481767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:00.482045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:00.482318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:00.483013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:00.485496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:00.611180 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3451/6827] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:00 2021] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:00.615374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:00.616825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:00.630696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9eacc-b9b2-4d08-b8b5-340f4bb26cde tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:00.688986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:00.689833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:00.690113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:00.690383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/fa3a3358604c4ff4832e6ba92fe53cf4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:00.691577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=fa3a3358604c4ff4832e6ba92fe53cf4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:00.693928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:00.695835 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3377/6828] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:00 2021] GET /identity/v3/projects/fa3a3358604c4ff4832e6ba92fe53cf4 => generated 377 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:00.699835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:00.711473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e599-4af2-4e2a-8bca-7b467686eeb4 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:00.716243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:00.716919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:00.717214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:00.717496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:00.718732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:00.720743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:00.741704 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3452/6829] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:34:00 2021] GET /identity/v3/projects => generated 7282 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:00.745874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:00.755784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f332af-d3f9-47f6-9ff6-001b3a07188e tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:00.760541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:00.761425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:00.762643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:00.762643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/fa3a3358604c4ff4832e6ba92fe53cf4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:00.763506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa3a3358604c4ff4832e6ba92fe53cf4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:00.766169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:00.933600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3a3358604c4ff4832e6ba92fe53cf4', 'request_id': 'req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:00.939834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3a3358604c4ff4832e6ba92fe53cf4', 'request_id': 'req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.034217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3a3358604c4ff4832e6ba92fe53cf4', 'request_id': 'req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.045215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project fa3a3358604c4ff4832e6ba92fe53cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:01.045500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.046150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.047868 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3378/6830] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:00 2021] DELETE /identity/v3/projects/fa3a3358604c4ff4832e6ba92fe53cf4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:01.052697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:01.054736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:01.067986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0b1f-feb6-4efb-b0a0-03aa106d230d tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:01.125611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:01.126185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:01.126493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:01.126772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:01.127530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:01.129565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:01.227068 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3453/6831] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:34:01 2021] POST /identity/v3/projects => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:01.234983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:01.245544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfb53a-b9d0-4e04-b0b6-a86cf0cff277 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:01.304357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:01.305240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:01.305525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:01.305829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/44b0e03220fe40bd96efe379c57606b2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:01.307124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:update_project(project_id=44b0e03220fe40bd96efe379c57606b2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:01.308177 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:01.308177 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:34:01.308177 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:34:01.309389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:01.411491 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3379/6832] 10.222.0.32 () {60 vars in 1251 bytes} [Sat Dec 25 21:34:01 2021] PATCH /identity/v3/projects/44b0e03220fe40bd96efe379c57606b2 => generated 360 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:01.415650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:01.435686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0b834-51df-4ade-aa9c-eb63ce165516 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:01.440291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:01.441182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:01.441469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:01.441770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/44b0e03220fe40bd96efe379c57606b2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:01.454022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=44b0e03220fe40bd96efe379c57606b2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:01.456311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:01.458096 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3454/6833] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:01 2021] GET /identity/v3/projects/44b0e03220fe40bd96efe379c57606b2 => generated 347 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:01.462439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:01.473324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e44c2-7d92-40f6-9737-b70ae7722575 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:01.478013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:01.478909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:01.479193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:01.479467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/44b0e03220fe40bd96efe379c57606b2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:01.480671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=44b0e03220fe40bd96efe379c57606b2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:01.482614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:01.664426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b0e03220fe40bd96efe379c57606b2', 'request_id': 'req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.672428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b0e03220fe40bd96efe379c57606b2', 'request_id': 'req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.754310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b0e03220fe40bd96efe379c57606b2', 'request_id': 'req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.767414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project 44b0e03220fe40bd96efe379c57606b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:01.767816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.768579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:01.770749 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3380/6834] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:01 2021] DELETE /identity/v3/projects/44b0e03220fe40bd96efe379c57606b2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:01.775825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:01.790326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:01.792274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e826f-3f25-48e4-875a-138f305ded6a tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:01.852858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:01.853731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:01.854019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:01.854295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:01.855018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:01.859656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:01.976396 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3455/6835] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:01 2021] POST /identity/v3/projects => generated 359 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:01.977892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:01.989218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242eabe-37f6-4c68-ad2a-c3a3bf3299a9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:02.055230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:02.056229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:02.056585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:02.056965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/cf6355f2c75944939f36b658ac0a729e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:02.058408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:update_project(project_id=cf6355f2c75944939f36b658ac0a729e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:02.060594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:02.354324 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3381/6836] 10.222.0.32 () {60 vars in 1251 bytes} [Sat Dec 25 21:34:01 2021] PATCH /identity/v3/projects/cf6355f2c75944939f36b658ac0a729e => generated 371 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:02.355903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:02.367817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478877e-b713-4d75-a164-2224f47cf0b8 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:02.376127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:02.377265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:02.377762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:02.378142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/cf6355f2c75944939f36b658ac0a729e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:02.392909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=cf6355f2c75944939f36b658ac0a729e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:02.395214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:02.397102 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3456/6837] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:02 2021] GET /identity/v3/projects/cf6355f2c75944939f36b658ac0a729e => generated 358 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:02.401405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:02.411784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89de8f-dbfb-4983-82e8-f756b58b6b07 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:02.417061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:02.418021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:02.418309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:02.418589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/cf6355f2c75944939f36b658ac0a729e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:02.419823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cf6355f2c75944939f36b658ac0a729e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:02.422315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:02.536144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6355f2c75944939f36b658ac0a729e', 'request_id': 'req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:02.542478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6355f2c75944939f36b658ac0a729e', 'request_id': 'req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:02.645744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6355f2c75944939f36b658ac0a729e', 'request_id': 'req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:02.656671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project cf6355f2c75944939f36b658ac0a729e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:02.656983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:02.657627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:02.659280 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3382/6838] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:02 2021] DELETE /identity/v3/projects/cf6355f2c75944939f36b658ac0a729e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:02.664478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:02.666437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:02.679877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482eeb3-549a-4fb9-9bdf-71fead7be2d9 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:02.738242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:02.738900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:02.739216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:02.739496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:02.740179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:02.742163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:02.851482 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3457/6839] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:02 2021] POST /identity/v3/projects => generated 355 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:02.855817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:02.867239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fd7d5-73cf-4286-9b88-eb640ff7dc00 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:02.923970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:02.924826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:02.925396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:02.925679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/8367c4c1d4dc4bafab844ed7fa0cab15` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:02.926948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:update_project(project_id=8367c4c1d4dc4bafab844ed7fa0cab15)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:02.928955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:03.046632 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3383/6840] 10.222.0.32 () {60 vars in 1251 bytes} [Sat Dec 25 21:34:02 2021] PATCH /identity/v3/projects/8367c4c1d4dc4bafab844ed7fa0cab15 => generated 369 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:03.050964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:03.063907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb00e1-efed-4031-9c70-9730dafdba0f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:03.069022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:03.070538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:03.070538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:03.070538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/8367c4c1d4dc4bafab844ed7fa0cab15` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:03.084166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:get_project(project_id=8367c4c1d4dc4bafab844ed7fa0cab15)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:03.087367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:03.088416 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3458/6841] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:03 2021] GET /identity/v3/projects/8367c4c1d4dc4bafab844ed7fa0cab15 => generated 356 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:34:03.093155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:03.103341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba971b-affe-43ab-a00c-058ca0f2f795 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:03.108257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:03.109349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:03.109794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:03.110144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/projects/8367c4c1d4dc4bafab844ed7fa0cab15` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:03.111388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8367c4c1d4dc4bafab844ed7fa0cab15)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:03.113416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:03.289546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8367c4c1d4dc4bafab844ed7fa0cab15', 'request_id': 'req-12d679b7-0f5a-4d0c-819e-849657735f77'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.296099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8367c4c1d4dc4bafab844ed7fa0cab15', 'request_id': 'req-12d679b7-0f5a-4d0c-819e-849657735f77'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.405494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8367c4c1d4dc4bafab844ed7fa0cab15', 'request_id': 'req-12d679b7-0f5a-4d0c-819e-849657735f77'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.416149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] The token cache is being invalidate because project 8367c4c1d4dc4bafab844ed7fa0cab15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:03.416430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.417088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.418701 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3384/6842] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:03 2021] DELETE /identity/v3/projects/8367c4c1d4dc4bafab844ed7fa0cab15 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:03.423569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:03.425480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:03.439340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0184a-a507-432a-b564-6ba4b9f7794f tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:03.493881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:03.494737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:03.495023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:03.495300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains/c0c5a39427014ae4991bcbe191a1b345` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:03.506135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:34:03.517183 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Could not find domain: c0c5a39427014ae4991bcbe191a1b345.: keystone.exception.DomainNotFound: Could not find domain: c0c5a39427014ae4991bcbe191a1b345. Dec 25 21:34:03.524670 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3459/6843] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:34:03 2021] PATCH /identity/v3/domains/c0c5a39427014ae4991bcbe191a1b345 => generated 112 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:34:03.527828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:03.538598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d679b7-0f5a-4d0c-819e-849657735f77 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:03.544217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8062afb3c5843ada8496f1e38682443', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba99872425b4cb4bd901c1d9b6b814a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:03.547771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:03.548040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:03.548040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:03.548040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] PATH_INFO: `/v3/domains/ce3e503064fb4511be6c98342488fa9e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:03.548344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:03.553455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 25 21:34:03.563432 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Could not find domain: ce3e503064fb4511be6c98342488fa9e.: keystone.exception.DomainNotFound: Could not find domain: ce3e503064fb4511be6c98342488fa9e. Dec 25 21:34:03.565791 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3385/6844] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:34:03 2021] PATCH /identity/v3/domains/ce3e503064fb4511be6c98342488fa9e => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:34:03.573356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:03.575011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:03.627739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3c786-27d6-4dce-8524-595d7fb6f715 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:03.627739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ef201-576d-459a-aeaf-c59b9e8783ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:03.627739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef201-576d-459a-aeaf-c59b9e8783ff service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:03.627739 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef201-576d-459a-aeaf-c59b9e8783ff service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:03.628148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef201-576d-459a-aeaf-c59b9e8783ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:03.629437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b6ef201-576d-459a-aeaf-c59b9e8783ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:03.642939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f52e2-b4fe-4fb9-be2b-bc432d7a7397 tempest-ProjectsTestJSON-590152398 tempest-ProjectsTestJSON-590152398-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:03.646138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ef201-576d-459a-aeaf-c59b9e8783ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:03.647612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ef201-576d-459a-aeaf-c59b9e8783ff service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:03.647862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:03.648737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:03.649047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:03.649320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] PATH_INFO: `/v3/users/398e56b6b9dc46ef9b208fc2976508c7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:03.650589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398e56b6b9dc46ef9b208fc2976508c7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:03.652480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:03.658434 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3460/6845] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:34:03.883433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398e56b6b9dc46ef9b208fc2976508c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.892199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398e56b6b9dc46ef9b208fc2976508c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.904362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398e56b6b9dc46ef9b208fc2976508c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.905117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398e56b6b9dc46ef9b208fc2976508c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.905776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398e56b6b9dc46ef9b208fc2976508c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:03.983515 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3386/6846] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:03 2021] DELETE /identity/v3/users/398e56b6b9dc46ef9b208fc2976508c7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:03.986042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533408b1-5053-40aa-9921-54bad01824ee None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:03.986336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533408b1-5053-40aa-9921-54bad01824ee None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:03.986642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533408b1-5053-40aa-9921-54bad01824ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:04.005189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-533408b1-5053-40aa-9921-54bad01824ee None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:04.006461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-533408b1-5053-40aa-9921-54bad01824ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:04.066087 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3461/6847] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:04.076064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:04.077527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:04.136183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d97114-f319-494e-91e7-354b097cb686 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:04.140045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:04.140744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:04.141073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:04.141379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:04.150370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:04.151790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:04.162292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3387/6848] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:04.633463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533408b1-5053-40aa-9921-54bad01824ee None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:04.635464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-533408b1-5053-40aa-9921-54bad01824ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:04.662107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533408b1-5053-40aa-9921-54bad01824ee None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:04.680119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:04.681762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:04.682216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:04.682650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] PATH_INFO: `/v3/projects/6960af5360b44d7b9ab5fb5e86e066f5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:04.684345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6960af5360b44d7b9ab5fb5e86e066f5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:04.688156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:04.816015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6960af5360b44d7b9ab5fb5e86e066f5', 'request_id': 'req-334e2e3e-85d2-49a2-96b5-0e9d370d3914'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:04.857500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:04.859034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:04.901060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6960af5360b44d7b9ab5fb5e86e066f5', 'request_id': 'req-334e2e3e-85d2-49a2-96b5-0e9d370d3914'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:04.917163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6960af5360b44d7b9ab5fb5e86e066f5', 'request_id': 'req-334e2e3e-85d2-49a2-96b5-0e9d370d3914'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:04.928896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] The token cache is being invalidate because project 6960af5360b44d7b9ab5fb5e86e066f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:04.929380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:04.930135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:04.932301 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3462/6849] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:04 2021] DELETE /identity/v3/projects/6960af5360b44d7b9ab5fb5e86e066f5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:04.937983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:04.939858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:04.972254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c8a56-5129-468e-840d-368b8d3f8a92 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:05.069694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362c4da-7358-4573-a36e-d5351a7701e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:05.070647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362c4da-7358-4573-a36e-d5351a7701e8 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:05.071215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362c4da-7358-4573-a36e-d5351a7701e8 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:05.071596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362c4da-7358-4573-a36e-d5351a7701e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:05.074238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d362c4da-7358-4573-a36e-d5351a7701e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:05.074680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e2e3e-85d2-49a2-96b5-0e9d370d3914 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:05.082346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:05.083225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:05.083506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:05.083776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] PATH_INFO: `/v3/users/f8062afb3c5843ada8496f1e38682443` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:05.085028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8062afb3c5843ada8496f1e38682443)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:05.087151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:05.092479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362c4da-7358-4573-a36e-d5351a7701e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:05.094133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362c4da-7358-4573-a36e-d5351a7701e8 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:05.108394 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3388/6850] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:05.311642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8062afb3c5843ada8496f1e38682443'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:05.325401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8062afb3c5843ada8496f1e38682443'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:05.338334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8062afb3c5843ada8496f1e38682443'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:05.339119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8062afb3c5843ada8496f1e38682443'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:05.425920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8062afb3c5843ada8496f1e38682443'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:05.433116 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3463/6851] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:04 2021] DELETE /identity/v3/users/f8062afb3c5843ada8496f1e38682443 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:05.616520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b837c3-589d-4147-939b-a20455c9caef None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:05.616844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b837c3-589d-4147-939b-a20455c9caef None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:05.617155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b837c3-589d-4147-939b-a20455c9caef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:05.637356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-72b837c3-589d-4147-939b-a20455c9caef None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:05.638849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-72b837c3-589d-4147-939b-a20455c9caef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:05.725026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3389/6852] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:05.750758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:05.752673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:05.826408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf81114-611b-46a0-bddb-a03d4c57f949 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:05.832678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba88bda-7c48-4191-bd68-47cd71b0d350 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:05.833371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88bda-7c48-4191-bd68-47cd71b0d350 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:05.833649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88bda-7c48-4191-bd68-47cd71b0d350 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:05.833916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88bda-7c48-4191-bd68-47cd71b0d350 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:05.845635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba88bda-7c48-4191-bd68-47cd71b0d350 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:05.847387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba88bda-7c48-4191-bd68-47cd71b0d350 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:05.858560 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3464/6853] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:06.221114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b837c3-589d-4147-939b-a20455c9caef None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:06.223436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-72b837c3-589d-4147-939b-a20455c9caef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:06.341358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b837c3-589d-4147-939b-a20455c9caef None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:06.348749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:06.350009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:06.350386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:06.350654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] PATH_INFO: `/v3/projects/1ba99872425b4cb4bd901c1d9b6b814a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:06.351979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba99872425b4cb4bd901c1d9b6b814a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:06.353938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:06.517994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba99872425b4cb4bd901c1d9b6b814a', 'request_id': 'req-e7b5ab20-1ee9-4d50-997f-3e56f404946d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:06.528842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba99872425b4cb4bd901c1d9b6b814a', 'request_id': 'req-e7b5ab20-1ee9-4d50-997f-3e56f404946d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:06.622893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba99872425b4cb4bd901c1d9b6b814a', 'request_id': 'req-e7b5ab20-1ee9-4d50-997f-3e56f404946d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:06.635923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] The token cache is being invalidate because project 1ba99872425b4cb4bd901c1d9b6b814a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:06.636412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:06.637104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:06.638906 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3390/6854] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:06 2021] DELETE /identity/v3/projects/1ba99872425b4cb4bd901c1d9b6b814a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:06.644766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2bf68-88cf-4fab-8fd0-14073d9f1554 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:06.645171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2bf68-88cf-4fab-8fd0-14073d9f1554 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:06.645536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2bf68-88cf-4fab-8fd0-14073d9f1554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:06.672444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-85d2bf68-88cf-4fab-8fd0-14073d9f1554 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:06.672444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-85d2bf68-88cf-4fab-8fd0-14073d9f1554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:06.691670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:06.693268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:06.804156 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3465/6855] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:06.814999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465ec0b-6420-4196-afea-86fb847794cc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:06.815591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465ec0b-6420-4196-afea-86fb847794cc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:06.816087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465ec0b-6420-4196-afea-86fb847794cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:06.865241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e465ec0b-6420-4196-afea-86fb847794cc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:06.866401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e465ec0b-6420-4196-afea-86fb847794cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:06.872750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5ab20-1ee9-4d50-997f-3e56f404946d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:06.881810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:06.882697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:06.882982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:06.883245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] PATH_INFO: `/v3/users/4a10d60f8b244da881d219d6fdc011f5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:06.883525 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3466/6856] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:06.884660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a10d60f8b244da881d219d6fdc011f5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:06.887170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:06.889068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465ec0b-6420-4196-afea-86fb847794cc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:06.901761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465ec0b-6420-4196-afea-86fb847794cc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:06.910209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:06.911000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:06.911382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:06.912051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:06.912748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:06.913282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:06.915400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:06.933095 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3467/6857] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:34:06.936940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:06.957409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ac4d-ffb1-457d-8add-157531fcd715 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:06.967304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:06.968254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:06.969251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:06.969757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:06.970530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:06.972694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:07.125071 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3468/6858] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:06 2021] POST /identity/v3/projects => generated 395 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:34:07.129044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:07.244223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a10d60f8b244da881d219d6fdc011f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:07.267460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a467f7-9912-483f-b6a6-efa093c3ce22 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:07.269974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a10d60f8b244da881d219d6fdc011f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:07.274771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:07.275471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.276036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.276324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.277131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:07.279432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:07.308042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a10d60f8b244da881d219d6fdc011f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:07.309679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a10d60f8b244da881d219d6fdc011f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:07.313159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c2d13830-3ea7-4465-89f0-28a293ac8dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a10d60f8b244da881d219d6fdc011f5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:07.458084 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3469/6859] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:07 2021] POST /identity/v3/users => generated 298 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:07.459350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:07.461381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:07.474257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eac4e-0780-4fb6-b782-88aac4004277 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:07.478981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:07.479639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.479925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.480208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.480974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:07.482599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:07.492963 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3470/6860] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:07.500060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:07.500205 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3391/6861] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:06 2021] DELETE /identity/v3/users/4a10d60f8b244da881d219d6fdc011f5 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:07.502574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.502875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.503153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.507837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea087bf6-e2d1-4712-bdec-267da2137fe7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:07.525338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:07.526480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:07.589380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:07.590132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.590429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.590685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.591419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:07.593431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:07.609378 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3471/6862] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:34:07.616282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:07.620494 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3392/6863] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:07.628676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694e8df-1406-4026-ae92-58d36bf0a5d8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:07.632128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:07.633545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:07.636023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ced9-a6d1-47f1-80cc-b5046af39876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:07.637058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ced9-a6d1-47f1-80cc-b5046af39876 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.637716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ced9-a6d1-47f1-80cc-b5046af39876 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.644723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ced9-a6d1-47f1-80cc-b5046af39876 admin admin] PATH_INFO: `/v3/projects/cc6b6f52b03140e58205529ded5555d8/users/ab5399c6553d456bbb7d453c0afd6a13/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.665942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2ced9-a6d1-47f1-80cc-b5046af39876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6b6f52b03140e58205529ded5555d8, user_id=ab5399c6553d456bbb7d453c0afd6a13, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:07.670850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2ced9-a6d1-47f1-80cc-b5046af39876 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:07.707169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c42f1-75a0-4cf0-b324-09dba7df275b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:07.711304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:07.712506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.712690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.713212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.724773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:07.726745 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3472/6864] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:07 2021] PUT /identity/v3/projects/cc6b6f52b03140e58205529ded5555d8/users/ab5399c6553d456bbb7d453c0afd6a13/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:07.726975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:07.739167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945096d-e63f-429a-8bf7-5929ae3cc6c3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.739436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945096d-e63f-429a-8bf7-5929ae3cc6c3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.739733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945096d-e63f-429a-8bf7-5929ae3cc6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.748589 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3393/6865] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:34:07.785607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4945096d-e63f-429a-8bf7-5929ae3cc6c3 None None] MFA Rules not processed for user `ab5399c6553d456bbb7d453c0afd6a13`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:07.787899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4945096d-e63f-429a-8bf7-5929ae3cc6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:07.900661 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3473/6866] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:07 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:07.907867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:07.918940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269a20a-1dc6-42b7-8f49-d3fb2a2190f2 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:07.993236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:07.994065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:07.994416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:07.994793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:07.995821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:07.998561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:08.122219 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3394/6867] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:07 2021] POST /identity/v3/projects => generated 397 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:08.126152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945096d-e63f-429a-8bf7-5929ae3cc6c3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:08.139221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945096d-e63f-429a-8bf7-5929ae3cc6c3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:08.200188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:08.200861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.201174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.201451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.202160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:08.204544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:08.272615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:08.281487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:08.299463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2e658-59cb-4916-84d4-97ec4ef93cc0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:08.301828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:08.303006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.303538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.304193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] PATH_INFO: `/v3/projects/45b0c92954754ea791ec111677972332` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.305734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b0c92954754ea791ec111677972332)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:08.306034 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3474/6868] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:08 2021] POST /identity/v3/users => generated 305 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:08.308310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:08.313173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:08.342729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae42c-a991-4ba8-8658-f4f031489d8e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:08.355762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:08.369075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.369352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.369630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.375341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:08.386187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:08.429909 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3475/6869] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:08 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:08.431169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:08.458996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd263-4980-4560-9a19-820508fbb61d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:08.472175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:08.473535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.475727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.475727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] PATH_INFO: `/v3/projects/5d23794eafd2497f9c842fedead93168/users/f3a34e958a4b4311857edada049a6c3e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.518471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d23794eafd2497f9c842fedead93168, user_id=f3a34e958a4b4311857edada049a6c3e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:08.521483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:08.636978 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3476/6870] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:08 2021] PUT /identity/v3/projects/5d23794eafd2497f9c842fedead93168/users/f3a34e958a4b4311857edada049a6c3e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:08.639496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:08.650270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b0c92954754ea791ec111677972332', 'request_id': 'req-dac0931a-a7fb-4575-a093-438f3b5c380b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:08.697825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b0c92954754ea791ec111677972332', 'request_id': 'req-dac0931a-a7fb-4575-a093-438f3b5c380b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:08.732971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff1adb-f0ce-412c-a0f0-8c7b173eed25 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:08.792476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:08.793215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.793498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.793774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.794499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:08.796220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:08.806750 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3477/6871] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:08 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:08.810761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:08.822372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db73d08-6745-44c5-b251-7dc388ae4036 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:08.828659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df26995-a446-4782-b4c9-def65cfeaf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:08.829909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26995-a446-4782-b4c9-def65cfeaf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.830449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26995-a446-4782-b4c9-def65cfeaf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.830836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df26995-a446-4782-b4c9-def65cfeaf30 admin admin] PATH_INFO: `/v3/projects/5d23794eafd2497f9c842fedead93168/users/f3a34e958a4b4311857edada049a6c3e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.834832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df26995-a446-4782-b4c9-def65cfeaf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d23794eafd2497f9c842fedead93168, user_id=f3a34e958a4b4311857edada049a6c3e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:08.838032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df26995-a446-4782-b4c9-def65cfeaf30 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:08.848455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b0c92954754ea791ec111677972332', 'request_id': 'req-dac0931a-a7fb-4575-a093-438f3b5c380b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:08.858652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3478/6872] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:08 2021] PUT /identity/v3/projects/5d23794eafd2497f9c842fedead93168/users/f3a34e958a4b4311857edada049a6c3e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:08.861173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] The token cache is being invalidate because project 45b0c92954754ea791ec111677972332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:08.861534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:08.862283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dac0931a-a7fb-4575-a093-438f3b5c380b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:08.864132 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3395/6873] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:08 2021] DELETE /identity/v3/projects/45b0c92954754ea791ec111677972332 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:08.868934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.869227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.869498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.869623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd5f9-0def-401b-8a9e-de55f2d9e6b3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:08.869956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd5f9-0def-401b-8a9e-de55f2d9e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:08.870316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd5f9-0def-401b-8a9e-de55f2d9e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:08.902955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4e7bd5f9-0def-401b-8a9e-de55f2d9e6b3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:08.904203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4e7bd5f9-0def-401b-8a9e-de55f2d9e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:08.923307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] MFA Rules not processed for user `f3a34e958a4b4311857edada049a6c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:08.925190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:09.004073 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3396/6874] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:09.012095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212bce6-1b30-44f4-8b33-63d36424a278 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.021483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212bce6-1b30-44f4-8b33-63d36424a278 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.021483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212bce6-1b30-44f4-8b33-63d36424a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.056304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c212bce6-1b30-44f4-8b33-63d36424a278 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:09.057642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c212bce6-1b30-44f4-8b33-63d36424a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:09.067068 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3479/6875] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:08 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:09.068079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.070326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:09.076742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3397/6876] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:09.081928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212bce6-1b30-44f4-8b33-63d36424a278 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.109087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212bce6-1b30-44f4-8b33-63d36424a278 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.125897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.131904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.132714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.134626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.134754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:09.135046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.136706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.176026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3398/6877] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:09.181737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.194077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe080d8-8958-4e0b-82a4-d42b8e61ed3c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.194824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad236-d303-42c8-bfba-9b5d19324ae8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.203820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5399c6553d456bbb7d453c0afd6a13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc6b6f52b03140e58205529ded5555d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.204095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.205028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.205347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.205556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.205944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.206187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.206625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.206748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.207644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.208934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.219938 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Dec 25 21:34:09.221615 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3480/6878] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/projects => generated 136 bytes in 154 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:34:09.227999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.247394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f822a5d-3fee-4486-bc14-db871b73b8f1 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.255373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a34e958a4b4311857edada049a6c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d23794eafd2497f9c842fedead93168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.256268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.256632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.262601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.262601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.262601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.268198 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Invalid input for field 'name': '' is too short Dec 25 21:34:09.268198 ncdv-master-1 devstack@keystone.service[96733]: Failed validating 'minLength' in schema['properties']['name']: Dec 25 21:34:09.268198 ncdv-master-1 devstack@keystone.service[96733]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 25 21:34:09.268198 ncdv-master-1 devstack@keystone.service[96733]: On instance['name']: Dec 25 21:34:09.268198 ncdv-master-1 devstack@keystone.service[96733]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Dec 25 21:34:09.274764 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3481/6879] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/projects => generated 283 bytes in 47 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:34:09.275598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.287390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1ce9d-c542-4b98-a00e-654119c15988 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.292718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a34e958a4b4311857edada049a6c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d23794eafd2497f9c842fedead93168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.293469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.293757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.294045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.294878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.296788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.303827 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 25 21:34:09.303827 ncdv-master-1 devstack@keystone.service[96733]: Failed validating 'maxLength' in schema['properties']['name']: Dec 25 21:34:09.303827 ncdv-master-1 devstack@keystone.service[96733]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Dec 25 21:34:09.303827 ncdv-master-1 devstack@keystone.service[96733]: On instance['name']: Dec 25 21:34:09.303827 ncdv-master-1 devstack@keystone.service[96733]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Dec 25 21:34:09.305724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3482/6880] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/projects => generated 412 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:34:09.316716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.326299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eda71-6c5a-4969-8a4e-0c706530e5e7 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.333249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a34e958a4b4311857edada049a6c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d23794eafd2497f9c842fedead93168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.334287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.334637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.335096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] PATH_INFO: `/v3/projects/c3904e302b544dbfaea928eb90037a08` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.346901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c3904e302b544dbfaea928eb90037a08)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.347790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3399/6881] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:09.350922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.351978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.371498 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Could not find project: c3904e302b544dbfaea928eb90037a08.: keystone.exception.ProjectNotFound: Could not find project: c3904e302b544dbfaea928eb90037a08. Dec 25 21:34:09.373240 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3483/6882] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:09 2021] DELETE /identity/v3/projects/c3904e302b544dbfaea928eb90037a08 => generated 113 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Dec 25 21:34:09.381049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.397779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63af4-0739-4779-96c4-bc33720bb520 tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.471758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fb52-bf59-481b-8426-df56cb1777b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.477718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.479795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.480308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.480852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.481986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.486477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.518467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5399c6553d456bbb7d453c0afd6a13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc6b6f52b03140e58205529ded5555d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.518467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.518467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.518801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.518801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.521730 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Dec 25 21:34:09.523907 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3484/6883] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:34:09 2021] GET /identity/v3/projects => generated 135 bytes in 144 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:34:09.528954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.576151 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3400/6884] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:09.577014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.592635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823893f1-615f-4d0a-927b-e6dcc82d95d0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.599086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.599774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.600059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.600336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.601283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.603083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.613882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130bf86-de32-4701-81d4-93b8a2668d91 tempest-ProjectsNegativeStaticTestJSON-546139879 tempest-ProjectsNegativeStaticTestJSON-546139879-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.615840 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3401/6885] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:09 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:09.619231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a34e958a4b4311857edada049a6c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d23794eafd2497f9c842fedead93168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.621177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.621315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.621315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.621315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.621592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.623747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.630215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d07a7-7407-46ea-9bae-1508442e510b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.635503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.636263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.638540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.638540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.638540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.639700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.652064 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3402/6886] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:09 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:09.656971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.674374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d69e-989f-4ec7-8eaa-7e29abb8d305 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.684326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a1d7-e0a7-4673-bc21-d6ea3530ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.686062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a1d7-e0a7-4673-bc21-d6ea3530ae7b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.686332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a1d7-e0a7-4673-bc21-d6ea3530ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.686617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a1d7-e0a7-4673-bc21-d6ea3530ae7b admin admin] PATH_INFO: `/v3/projects/14f47a8e0d5f4e858f4f0ddf0fb5f347/users/3707d8197a4a43e1be6a10b4b3c58004/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.708522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a1d7-e0a7-4673-bc21-d6ea3530ae7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f47a8e0d5f4e858f4f0ddf0fb5f347, user_id=3707d8197a4a43e1be6a10b4b3c58004, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.711676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a1d7-e0a7-4673-bc21-d6ea3530ae7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.742555 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3485/6887] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/projects => generated 358 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:34:09.746607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:09.819477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745891bb-40e1-441c-ac93-49c5cddab61e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:09.824226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a34e958a4b4311857edada049a6c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d23794eafd2497f9c842fedead93168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:09.824905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.825212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.825474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.831422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:09.831422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:09.867111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3403/6888] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:09 2021] PUT /identity/v3/projects/14f47a8e0d5f4e858f4f0ddf0fb5f347/users/3707d8197a4a43e1be6a10b4b3c58004/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:09.907335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:09.907335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:09.907335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:09.915503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] MFA Rules not processed for user `3707d8197a4a43e1be6a10b4b3c58004`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:09.934656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:10.030534 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3404/6889] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:10.044551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:10.046004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:10.113830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.sql.core [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1930112718' for key 'project.ixu_project_name_domain_id'") Dec 25 21:34:10.113830 ncdv-master-1 devstack@keystone.service[96733]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 25 21:34:10.113830 ncdv-master-1 devstack@keystone.service[96733]: [parameters: {'id': '3d1de60e0b4347f49a916f9bda67ca47', 'name': 'tempest-project-dup-1930112718', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 25 21:34:10.113830 ncdv-master-1 devstack@keystone.service[96733]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=96733) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 25 21:34:10.119944 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1930112718, project id 3d1de60e0b4347f49a916f9bda67ca47.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1930112718, project id 3d1de60e0b4347f49a916f9bda67ca47. Dec 25 21:34:10.121436 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3486/6890] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:34:09 2021] POST /identity/v3/projects => generated 285 bytes in 375 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 25 21:34:10.127731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:10.128243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7359047-2af3-454a-866f-29f0b81ef617 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:10.132765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:10.133957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:10.134435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:10.134913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:10.141111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ea6ab-c972-474b-9ad1-64c34408264d tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:10.157357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:10.163201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:10.197052 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3405/6891] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:10 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:34:10.215699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a34e958a4b4311857edada049a6c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d23794eafd2497f9c842fedead93168', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:10.215699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:10.215699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:10.216418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] PATH_INFO: `/v3/projects/fa778b04e3bf4758bf4b300edce155d9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:10.219441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa778b04e3bf4758bf4b300edce155d9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:10.221677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:10.419758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa778b04e3bf4758bf4b300edce155d9', 'request_id': 'req-757ab088-a206-4fd4-bcc0-b41c99af033e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:10.519037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa778b04e3bf4758bf4b300edce155d9', 'request_id': 'req-757ab088-a206-4fd4-bcc0-b41c99af033e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:10.525772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa778b04e3bf4758bf4b300edce155d9', 'request_id': 'req-757ab088-a206-4fd4-bcc0-b41c99af033e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:10.536506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] The token cache is being invalidate because project fa778b04e3bf4758bf4b300edce155d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:10.536789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:10.537754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-757ab088-a206-4fd4-bcc0-b41c99af033e tempest-ProjectsNegativeStaticTestJSON-1425631360 tempest-ProjectsNegativeStaticTestJSON-1425631360-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:10.540126 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3487/6892] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:10 2021] DELETE /identity/v3/projects/fa778b04e3bf4758bf4b300edce155d9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:10.547244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:10.549180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:10.635763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c495a7-7bd6-4b9e-b28f-fdf14fdb3f8a service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:10.699815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:10.700695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:10.701019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:10.701321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] PATH_INFO: `/v3/users/ab5399c6553d456bbb7d453c0afd6a13` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:10.703072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5399c6553d456bbb7d453c0afd6a13)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:10.705011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:10.989727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5399c6553d456bbb7d453c0afd6a13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:11.005796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5399c6553d456bbb7d453c0afd6a13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:11.020597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5399c6553d456bbb7d453c0afd6a13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:11.024505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5399c6553d456bbb7d453c0afd6a13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:11.024505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5399c6553d456bbb7d453c0afd6a13'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:11.134961 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3406/6893] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:10 2021] DELETE /identity/v3/users/ab5399c6553d456bbb7d453c0afd6a13 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:11.140440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:11.141063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:11.141244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:11.171206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:11.173054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:11.282914 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3488/6894] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:11.294031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:11.296761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:11.388540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654e720-c6dc-4a6c-8d5e-392901a7394a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:11.392719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:11.393580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:11.393866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:11.394144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:11.404234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:11.405870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:11.415847 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3407/6895] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:11.975783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:11.977643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:12.025288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc78f7-b9f8-4d2f-a9d0-3e1e2cd61ee9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:12.029017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:12.029701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:12.029988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:12.030269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] PATH_INFO: `/v3/projects/cc6b6f52b03140e58205529ded5555d8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:12.032126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc6b6f52b03140e58205529ded5555d8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:12.035030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:12.176189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6b6f52b03140e58205529ded5555d8', 'request_id': 'req-07c49225-64d3-4cee-9dc9-8deca1228de6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.234928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6b6f52b03140e58205529ded5555d8', 'request_id': 'req-07c49225-64d3-4cee-9dc9-8deca1228de6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.242816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6b6f52b03140e58205529ded5555d8', 'request_id': 'req-07c49225-64d3-4cee-9dc9-8deca1228de6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.260152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] The token cache is being invalidate because project cc6b6f52b03140e58205529ded5555d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:12.260738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.261922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.267809 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3489/6896] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:11 2021] DELETE /identity/v3/projects/cc6b6f52b03140e58205529ded5555d8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:12.268733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:12.279109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81834c8c-7fae-431a-b882-f70e608e8e1f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:12.370981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:12.372383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:12.372774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:12.373185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] PATH_INFO: `/v3/users/f3a34e958a4b4311857edada049a6c3e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:12.375303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a34e958a4b4311857edada049a6c3e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:12.377435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:12.593093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a34e958a4b4311857edada049a6c3e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.599665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a34e958a4b4311857edada049a6c3e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.611198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a34e958a4b4311857edada049a6c3e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.611961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a34e958a4b4311857edada049a6c3e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.612459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9a2e2b9e-5756-4c07-8b05-9f4f3d0b35aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a34e958a4b4311857edada049a6c3e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:12.694563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3408/6897] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:12 2021] DELETE /identity/v3/users/f3a34e958a4b4311857edada049a6c3e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:13.133066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:13.134710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:13.165144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c49225-64d3-4cee-9dc9-8deca1228de6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:13.226853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:13.227718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:13.228000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:13.228272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] PATH_INFO: `/v3/projects/5d23794eafd2497f9c842fedead93168` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:13.229618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d23794eafd2497f9c842fedead93168)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:13.231883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:13.365088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d23794eafd2497f9c842fedead93168', 'request_id': 'req-2dab85a8-b168-427d-a77d-f1cff6574112'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:13.414122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d23794eafd2497f9c842fedead93168', 'request_id': 'req-2dab85a8-b168-427d-a77d-f1cff6574112'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:13.420856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d23794eafd2497f9c842fedead93168', 'request_id': 'req-2dab85a8-b168-427d-a77d-f1cff6574112'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:13.432792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] The token cache is being invalidate because project 5d23794eafd2497f9c842fedead93168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:13.433197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:13.433912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2dab85a8-b168-427d-a77d-f1cff6574112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:13.437057 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3490/6898] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:13 2021] DELETE /identity/v3/projects/5d23794eafd2497f9c842fedead93168 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:13.443678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8722b-4c51-4c32-8f01-1b7875859f4e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:13.444832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8722b-4c51-4c32-8f01-1b7875859f4e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:13.445557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8722b-4c51-4c32-8f01-1b7875859f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:13.470273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-acd8722b-4c51-4c32-8f01-1b7875859f4e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:13.471777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-acd8722b-4c51-4c32-8f01-1b7875859f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:13.536672 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3409/6899] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:13.545386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374e000-be2b-492f-822e-61acbaef1617 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:13.545782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374e000-be2b-492f-822e-61acbaef1617 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:13.546820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374e000-be2b-492f-822e-61acbaef1617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:13.600721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0374e000-be2b-492f-822e-61acbaef1617 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:13.605621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0374e000-be2b-492f-822e-61acbaef1617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:13.620512 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3491/6900] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:13.621495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8722b-4c51-4c32-8f01-1b7875859f4e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:13.631522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8722b-4c51-4c32-8f01-1b7875859f4e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:13.636497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:13.637575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:13.637934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:13.638134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:13.638866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:13.639168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:13.641374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:13.659003 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3410/6901] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:13.663707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374e000-be2b-492f-822e-61acbaef1617 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:13.674537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374e000-be2b-492f-822e-61acbaef1617 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:13.679963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:13.680715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:13.681055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:13.681346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:13.682041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:13.683945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:14.192074 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3492/6902] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:13 2021] POST /identity/v3/projects => generated 365 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:14.196302 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:14.206361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9edea7-0e72-4a79-9e4c-9e82b02307e6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:14.282041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:14.282821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:14.283188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:14.283534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:14.284298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:14.286568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:14.395054 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3411/6903] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:14 2021] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:14.398660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:14.414134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dc2f0-de3c-49a1-836c-b7fbb6aa19d6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:14.419294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:14.419959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:14.420415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:14.420775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:14.421621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:14.423414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:14.439848 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3493/6904] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:14 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:34:14.440986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:14.451654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86536a6-7036-43ae-a737-1d286296579d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:14.458764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936a1a8-4d22-4742-8a11-e2b54faf3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:14.460439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a1a8-4d22-4742-8a11-e2b54faf3692 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:14.460439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a1a8-4d22-4742-8a11-e2b54faf3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:14.460439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936a1a8-4d22-4742-8a11-e2b54faf3692 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:14.461437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936a1a8-4d22-4742-8a11-e2b54faf3692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:14.463271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936a1a8-4d22-4742-8a11-e2b54faf3692 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:14.475717 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3412/6905] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:14.479568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:14.491107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac97b4-d05a-4752-843d-79fd02ab87ee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:14.496049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:14.504175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:14.504175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:14.504175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] PATH_INFO: `/v3/projects/f1ad5acecd6f460bbc009c2db885c9bf/users/5d2a4b9ff08c4442a1159c0886e8ae25/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:14.512429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ad5acecd6f460bbc009c2db885c9bf, user_id=5d2a4b9ff08c4442a1159c0886e8ae25, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:14.515633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:14.588206 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3494/6906] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:14 2021] PUT /identity/v3/projects/f1ad5acecd6f460bbc009c2db885c9bf/users/5d2a4b9ff08c4442a1159c0886e8ae25/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:14.599177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dae2e-8bab-48f9-a1c6-f953005584ed None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:14.599468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dae2e-8bab-48f9-a1c6-f953005584ed None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:14.599747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dae2e-8bab-48f9-a1c6-f953005584ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:14.627467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d02dae2e-8bab-48f9-a1c6-f953005584ed None None] MFA Rules not processed for user `5d2a4b9ff08c4442a1159c0886e8ae25`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:14.628677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d02dae2e-8bab-48f9-a1c6-f953005584ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:14.707063 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3413/6907] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:14 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:14.710226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:14.782825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7da151-cc35-48b4-bdd9-59a33c1672cc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:14.790709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:14.791670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:14.792127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:14.792582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:14.793708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:14.797105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:14.915236 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3495/6908] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:14 2021] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:34:14.919522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dae2e-8bab-48f9-a1c6-f953005584ed None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:14.930980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dae2e-8bab-48f9-a1c6-f953005584ed None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:14.993068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:14.993841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:14.994108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:14.994366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:14.995066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:14.997280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:15.083576 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3414/6909] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:14 2021] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:15.084751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:15.096126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7471b47-4c8b-4981-98a7-4b05c2a5fed1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:15.100726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:15.101417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:15.101704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:15.101978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:15.102703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:15.104296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:15.114778 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3496/6910] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:34:15.118984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:15.129317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c53c-a615-4a23-90b7-6c1ef970d7a0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:15.134008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:15.134911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:15.135194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:15.135469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] PATH_INFO: `/v3/projects/ed6835295e9a4046a52607b1968f7b32/users/c95dac7d3a264b91a35632196fbe5a76/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:15.151532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6835295e9a4046a52607b1968f7b32, user_id=c95dac7d3a264b91a35632196fbe5a76, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:15.154254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:15.241514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3415/6911] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:15 2021] PUT /identity/v3/projects/ed6835295e9a4046a52607b1968f7b32/users/c95dac7d3a264b91a35632196fbe5a76/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:15.245498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:15.256558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5ea35-fc8f-49d3-8aa7-436afdbafef8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:15.316590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d13c4-cad3-40be-8ea0-ea33574bca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:15.320849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d13c4-cad3-40be-8ea0-ea33574bca62 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:15.320849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d13c4-cad3-40be-8ea0-ea33574bca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:15.320849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d13c4-cad3-40be-8ea0-ea33574bca62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:15.320849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d13c4-cad3-40be-8ea0-ea33574bca62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:15.321527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d13c4-cad3-40be-8ea0-ea33574bca62 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:15.335996 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3497/6912] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:34:15.353626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:15.365760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7c463-86c5-4c33-9d0a-932a5177f8b7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:15.372377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:15.373575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:15.374747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:15.375236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] PATH_INFO: `/v3/projects/ed6835295e9a4046a52607b1968f7b32/users/c95dac7d3a264b91a35632196fbe5a76/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:15.377539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6835295e9a4046a52607b1968f7b32, user_id=c95dac7d3a264b91a35632196fbe5a76, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:15.380646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:15.392607 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3416/6913] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:15 2021] PUT /identity/v3/projects/ed6835295e9a4046a52607b1968f7b32/users/c95dac7d3a264b91a35632196fbe5a76/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:15.408990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb1902-20e7-49e3-b705-f0ed12f2d03f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:15.409618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb1902-20e7-49e3-b705-f0ed12f2d03f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:15.409797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb1902-20e7-49e3-b705-f0ed12f2d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:15.448335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-10fb1902-20e7-49e3-b705-f0ed12f2d03f None None] MFA Rules not processed for user `c95dac7d3a264b91a35632196fbe5a76`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:15.506305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-10fb1902-20e7-49e3-b705-f0ed12f2d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:15.526264 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3498/6914] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:15 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:15.530587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:15.546062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ffff5-1764-48bf-9f2c-60439271c2b8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:15.563031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:15.563762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:15.564051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:15.564335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:15.565148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:15.566370 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:15.566370 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:34:15.566370 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:34:15.567648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.123177 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3417/6915] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:34:15 2021] POST /identity/v3/regions => generated 224 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:16.125363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb1902-20e7-49e3-b705-f0ed12f2d03f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.134789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb1902-20e7-49e3-b705-f0ed12f2d03f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:16.149745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:16.150400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:16.150689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:16.150971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:16.151704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:16.152839 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:16.152839 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:34:16.152839 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:34:16.153748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.257484 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3499/6916] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:34:16 2021] POST /identity/v3/regions => generated 224 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:16.262340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.274678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6c73-d912-4264-9c4c-241b06c1bce3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:16.289706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:16.290578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:16.290865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:16.291143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/2a4edb2f-9c13-4dd4-b0a6-5446a560ea42` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:16.291867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:create_region(region_id=2a4edb2f-9c13-4dd4-b0a6-5446a560ea42)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:16.293681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.405302 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3418/6917] 10.222.0.32 () {60 vars in 1258 bytes} [Sat Dec 25 21:34:16 2021] PUT /identity/v3/regions/2a4edb2f-9c13-4dd4-b0a6-5446a560ea42 => generated 232 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:34:16.409254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.420026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c9d0-6179-4e7e-a274-32426f43cf7c tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:16.437151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:16.438028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:16.438306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:16.438575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/2a4edb2f-9c13-4dd4-b0a6-5446a560ea42` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:16.439220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2a4edb2f-9c13-4dd4-b0a6-5446a560ea42)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:16.440926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.540763 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3500/6918] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:34:16 2021] DELETE /identity/v3/regions/2a4edb2f-9c13-4dd4-b0a6-5446a560ea42 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:16.550631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.556608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92421b1-0beb-4265-ba68-80ff7f2254a3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:16.572010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:16.572659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:16.572973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:16.579417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:16.579417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:16.579417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.657174 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3419/6919] 10.222.0.32 () {60 vars in 1149 bytes} [Sat Dec 25 21:34:16 2021] POST /identity/v3/regions => generated 254 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:16.661154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.673959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7383e0-0b13-428c-b784-255790a71ec3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:16.696072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:16.696993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:16.697367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:16.697546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/1422e96284ee49c5942dcf0b654b7bfa` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:16.698287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:update_region(region_id=1422e96284ee49c5942dcf0b654b7bfa)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:16.699326 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:16.699326 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:34:16.699326 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:34:16.700220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.776685 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3501/6920] 10.222.0.32 () {60 vars in 1249 bytes} [Sat Dec 25 21:34:16 2021] PATCH /identity/v3/regions/1422e96284ee49c5942dcf0b654b7bfa => generated 253 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:34:16.781342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.791779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0fdd-a951-4203-9ab7-38f578c44db8 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:16.805710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:16.806547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:16.806828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:16.807104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/1422e96284ee49c5942dcf0b654b7bfa` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:16.807759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:get_region(region_id=1422e96284ee49c5942dcf0b654b7bfa)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:16.808851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.814169 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3420/6921] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:34:16 2021] GET /identity/v3/regions/1422e96284ee49c5942dcf0b654b7bfa => generated 253 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:34:16.818083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.828843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df322d2d-4ba1-44ae-a05e-4dcf9d21717f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:16.833557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:16.834386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:16.834797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:16.835064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/1422e96284ee49c5942dcf0b654b7bfa` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:16.835716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1422e96284ee49c5942dcf0b654b7bfa)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:16.837337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:16.970381 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3502/6922] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:16 2021] DELETE /identity/v3/regions/1422e96284ee49c5942dcf0b654b7bfa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:16.974652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:16.984619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99013ba2-1318-4cbc-a84c-4aedd0cb8172 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.007200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.008161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.008639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.009148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.010185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.011869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.024939 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3421/6923] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:34:16 2021] GET /identity/v3/regions => generated 670 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:17.026779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.040280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9d7f-c402-431e-879c-b6910273595f tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.046551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.047556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.047937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.048316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/1422e96284ee49c5942dcf0b654b7bfa` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.049159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:delete_region(region_id=1422e96284ee49c5942dcf0b654b7bfa)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.050950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.066880 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Could not find region: 1422e96284ee49c5942dcf0b654b7bfa.: keystone.exception.RegionNotFound: Could not find region: 1422e96284ee49c5942dcf0b654b7bfa. Dec 25 21:34:17.068153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3503/6924] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:17 2021] DELETE /identity/v3/regions/1422e96284ee49c5942dcf0b654b7bfa => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:34:17.073671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.084086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121fa6f-5e5e-447a-8af8-9ccca1b8b689 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.089857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.090610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.090965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.091566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.092372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.093583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.099444 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3422/6925] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:34:17 2021] GET /identity/v3/regions => generated 670 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:17.104333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.117554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25bab4-48c2-45b1-a321-216f565b9a07 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.129584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.129584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.129584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.129918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.129918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.129918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.231784 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3504/6926] 10.222.0.32 () {60 vars in 1149 bytes} [Sat Dec 25 21:34:17 2021] POST /identity/v3/regions => generated 253 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:34:17.233184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.244893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58b4f9-5951-4493-96f2-4f87adbee8b6 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.264988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.264988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.264988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.265364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.266040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Adding query filter params (parent_region_id=7b9c2b821d4c4895a1284fb7626deefc) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:17.266346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.267759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.276116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3423/6927] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:34:17 2021] GET /identity/v3/regions?parent_region_id=7b9c2b821d4c4895a1284fb7626deefc => generated 399 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:17.277338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.289039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d7d2c-c8e1-4902-9df9-b4e09901a1f9 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.295578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.297498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.298018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.298412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/2e0476a85b204de9b60f4743efed8c43` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.299814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2e0476a85b204de9b60f4743efed8c43)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.301802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.381193 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3505/6928] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:17 2021] DELETE /identity/v3/regions/2e0476a85b204de9b60f4743efed8c43 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:17.385939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.397077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736ab2e-d2c2-44fc-838d-c0497b171b43 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.413103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.414023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.414309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.414585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/dd590727cbf748cd9cbbd97aa0a1eaff` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.415329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dd590727cbf748cd9cbbd97aa0a1eaff)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.416985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.525141 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3424/6929] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:17 2021] DELETE /identity/v3/regions/dd590727cbf748cd9cbbd97aa0a1eaff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:17.529189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.540170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaeb88-766e-4818-84f8-16a9089440c3 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.555330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667739a-cc5f-4b99-9345-d350e4fb877b tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95dac7d3a264b91a35632196fbe5a76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6835295e9a4046a52607b1968f7b32', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.559121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667739a-cc5f-4b99-9345-d350e4fb877b tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.559121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667739a-cc5f-4b99-9345-d350e4fb877b tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.559121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667739a-cc5f-4b99-9345-d350e4fb877b tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] PATH_INFO: `/v3/regions/7b9c2b821d4c4895a1284fb7626deefc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.559121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667739a-cc5f-4b99-9345-d350e4fb877b tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7b9c2b821d4c4895a1284fb7626deefc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.559603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667739a-cc5f-4b99-9345-d350e4fb877b tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.674741 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3506/6930] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:34:17 2021] DELETE /identity/v3/regions/7b9c2b821d4c4895a1284fb7626deefc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:17.678738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:17.749447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2060cb9-3c5d-4219-ba23-491d787b5f75 tempest-RegionsTestJSON-1620874521 tempest-RegionsTestJSON-1620874521-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:17.764953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:17.766003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:17.766369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:17.766722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] PATH_INFO: `/v3/users/5d2a4b9ff08c4442a1159c0886e8ae25` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:17.768013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2a4b9ff08c4442a1159c0886e8ae25)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:17.770334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:17.925034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2a4b9ff08c4442a1159c0886e8ae25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:17.931697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2a4b9ff08c4442a1159c0886e8ae25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:17.944379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2a4b9ff08c4442a1159c0886e8ae25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:17.950050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2a4b9ff08c4442a1159c0886e8ae25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:17.950727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2a4b9ff08c4442a1159c0886e8ae25'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:18.022524 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3425/6931] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:17 2021] DELETE /identity/v3/users/5d2a4b9ff08c4442a1159c0886e8ae25 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:18.026993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:18.027281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:18.027554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:18.046069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:18.047427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:18.107034 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3507/6932] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:18.116930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:18.119099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:18.195799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36caa5-a74d-4c9c-b9d3-092f28a11670 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:18.199933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:18.200581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:18.204063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:18.204063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:18.211161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:18.212584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:18.223836 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3426/6933] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:18.837872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:18.839363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:18.852393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4f2d-11bf-490f-921c-b0966e200edb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:18.857430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:18.858414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:18.859859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:18.863468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] PATH_INFO: `/v3/projects/f1ad5acecd6f460bbc009c2db885c9bf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:18.863468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ad5acecd6f460bbc009c2db885c9bf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:18.864632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:18.978869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ad5acecd6f460bbc009c2db885c9bf', 'request_id': 'req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.049196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ad5acecd6f460bbc009c2db885c9bf', 'request_id': 'req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.056580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ad5acecd6f460bbc009c2db885c9bf', 'request_id': 'req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.068150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] The token cache is being invalidate because project f1ad5acecd6f460bbc009c2db885c9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:19.068532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.069250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.071072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3508/6934] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:18 2021] DELETE /identity/v3/projects/f1ad5acecd6f460bbc009c2db885c9bf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:19.075282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:19.095006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f174f-c764-4eb2-a113-ecff59accdd8 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:19.147193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:19.148073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:19.148354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:19.148624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] PATH_INFO: `/v3/users/c95dac7d3a264b91a35632196fbe5a76` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:19.149846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95dac7d3a264b91a35632196fbe5a76)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:19.151850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:19.351709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95dac7d3a264b91a35632196fbe5a76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.363471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95dac7d3a264b91a35632196fbe5a76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.380282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95dac7d3a264b91a35632196fbe5a76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.381183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95dac7d3a264b91a35632196fbe5a76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.381832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a910b85e-2dba-4bb4-9502-0aae09c9b3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95dac7d3a264b91a35632196fbe5a76'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:19.451274 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3427/6935] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:19 2021] DELETE /identity/v3/users/c95dac7d3a264b91a35632196fbe5a76 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:19.903256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:19.904801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:19.925832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0405c-e9c1-4ff2-83fd-8985d616d7ec admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:20.007273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:20.008307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.008723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.009139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] PATH_INFO: `/v3/projects/ed6835295e9a4046a52607b1968f7b32` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.011000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6835295e9a4046a52607b1968f7b32)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:20.013245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:20.182740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6835295e9a4046a52607b1968f7b32', 'request_id': 'req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:20.293802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6835295e9a4046a52607b1968f7b32', 'request_id': 'req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:20.300824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6835295e9a4046a52607b1968f7b32', 'request_id': 'req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:20.311298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] The token cache is being invalidate because project ed6835295e9a4046a52607b1968f7b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:20.311616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:20.312746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6014e51e-fa70-4c0e-8c5f-c78c3d6c1466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:20.313954 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3509/6936] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:19 2021] DELETE /identity/v3/projects/ed6835295e9a4046a52607b1968f7b32 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:20.323118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36873a1-fc18-4732-b388-d4f121f0b16b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.323630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36873a1-fc18-4732-b388-d4f121f0b16b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.323733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36873a1-fc18-4732-b388-d4f121f0b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.343669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c36873a1-fc18-4732-b388-d4f121f0b16b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:20.344122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c36873a1-fc18-4732-b388-d4f121f0b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:20.406463 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3428/6937] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:20.414207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610903b5-8105-4c59-a9a2-05ecd491b53a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.414491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610903b5-8105-4c59-a9a2-05ecd491b53a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.414767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610903b5-8105-4c59-a9a2-05ecd491b53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.436682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-610903b5-8105-4c59-a9a2-05ecd491b53a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:20.437939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-610903b5-8105-4c59-a9a2-05ecd491b53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:20.446710 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3510/6938] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:20.450931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36873a1-fc18-4732-b388-d4f121f0b16b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:20.464578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36873a1-fc18-4732-b388-d4f121f0b16b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:20.471360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:20.472041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.472434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.472998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.473823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:20.474150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:20.476720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:20.492581 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3429/6939] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:20.497437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610903b5-8105-4c59-a9a2-05ecd491b53a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:20.508399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610903b5-8105-4c59-a9a2-05ecd491b53a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:20.515043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:20.515713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.515990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.516273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.517011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:20.518923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:20.620996 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3511/6940] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:20 2021] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:20.625660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:20.635610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e45510-6bb9-4fe4-8a3c-b77d1503d602 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:20.690989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:20.692061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.692061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.692251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.693027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:20.694976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:20.809069 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3430/6941] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:20 2021] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:20.810439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:20.822573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe281bdf-614c-4fbe-906b-22a78eae20d1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:20.830062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:20.830724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.832031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.832031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.832246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:20.833951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:20.845559 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3512/6942] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:20.854770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:20.865655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f457d9-a783-4b7d-acc2-d00939dfee71 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:20.871044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa3f1-c3d4-41cd-bf2e-7a4b599bb7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:20.871863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa3f1-c3d4-41cd-bf2e-7a4b599bb7df admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.872141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa3f1-c3d4-41cd-bf2e-7a4b599bb7df admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.872418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa3f1-c3d4-41cd-bf2e-7a4b599bb7df admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.873324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fa3f1-c3d4-41cd-bf2e-7a4b599bb7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:20.875462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fa3f1-c3d4-41cd-bf2e-7a4b599bb7df admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:20.885984 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3431/6943] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:20.891177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:20.903183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d526-f547-4bfd-9183-90fc51806122 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:20.909458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:20.910353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:20.910655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:20.910957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] PATH_INFO: `/v3/projects/f61a0566d14547059cbece8d41c7e2d5/users/02ee8227ee6649518833718a98e9484a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:20.926573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61a0566d14547059cbece8d41c7e2d5, user_id=02ee8227ee6649518833718a98e9484a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:20.929163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:21.083266 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3513/6944] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:20 2021] PUT /identity/v3/projects/f61a0566d14547059cbece8d41c7e2d5/users/02ee8227ee6649518833718a98e9484a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:21.084943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd04ae-21cc-4185-bab5-6cf489b091a9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:21.085240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd04ae-21cc-4185-bab5-6cf489b091a9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:21.085522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd04ae-21cc-4185-bab5-6cf489b091a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:21.116822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eabd04ae-21cc-4185-bab5-6cf489b091a9 None None] MFA Rules not processed for user `02ee8227ee6649518833718a98e9484a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:21.120352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eabd04ae-21cc-4185-bab5-6cf489b091a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:21.212591 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3432/6945] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:21 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:21.225059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:21.226819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:21.299333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0942d9-f26c-41db-b08a-d8726f4f4c2d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:21.303022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:21.303667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:21.303944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:21.304216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:21.313143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:21.314561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:21.323351 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3514/6946] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:21 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:21.575721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ae9a-1050-49bc-b776-54224f1a2ff6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:21.576209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ae9a-1050-49bc-b776-54224f1a2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:21.576317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ae9a-1050-49bc-b776-54224f1a2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:21.597409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8cf2ae9a-1050-49bc-b776-54224f1a2ff6 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:21.598614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8cf2ae9a-1050-49bc-b776-54224f1a2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:21.669326 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3433/6947] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:21 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:21.682629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:21.684016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:21.762749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2d365-b669-4530-8505-973a875cb694 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:21.769618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:21.770455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:21.770813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:21.771275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:21.781000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:21.786168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:21.792077 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3515/6948] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:22.563492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:22.564057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:22.564396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:22.584264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:22.586210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:22.593766 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3434/6949] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:22.606955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:22.626005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fc612-1deb-4cbf-8ef0-9dd89639a22f service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:22.634299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38523467-ecec-4f73-99a9-58ac4b200164 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:22.634965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523467-ecec-4f73-99a9-58ac4b200164 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:22.635249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523467-ecec-4f73-99a9-58ac4b200164 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:22.635529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523467-ecec-4f73-99a9-58ac4b200164 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:22.646407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38523467-ecec-4f73-99a9-58ac4b200164 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:22.652270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38523467-ecec-4f73-99a9-58ac4b200164 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:22.656661 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3516/6950] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:22.947921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:22.949395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:23.047453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bad3e5-1e4b-47d1-a795-8fa8a2bb0eea None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:23.052227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:23.053125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:23.054458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:23.054458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] PATH_INFO: `/v3/users/f2237f90a5db4203805e0a7f287f0964` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:23.054863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2237f90a5db4203805e0a7f287f0964)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:23.056762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:23.248002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2237f90a5db4203805e0a7f287f0964'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:23.255204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2237f90a5db4203805e0a7f287f0964'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:23.269863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2237f90a5db4203805e0a7f287f0964'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:23.270922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2237f90a5db4203805e0a7f287f0964'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:23.272037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d769dd51-3469-4fed-9e9b-34f3cfac33f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2237f90a5db4203805e0a7f287f0964'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:23.342194 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3435/6951] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:22 2021] DELETE /identity/v3/users/f2237f90a5db4203805e0a7f287f0964 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:23.376631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:23.377239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:23.377690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:23.398364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:23.399596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:23.476949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3517/6952] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:23.482566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:23.483193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:23.483660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:23.493757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:23.495183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:23.505771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:23.506907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:23.515205 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3436/6953] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:23.530826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:23.530826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:23.602977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214949-3b1c-4087-9d9d-a863e16df9db None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:23.608796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:23.609882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:23.610066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:23.610395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:23.621387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:23.623470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:23.634680 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3518/6954] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:23.637076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c37d-530f-4306-bbf8-ba4a4583bc5a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:23.644216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:23.644927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:23.645178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:23.649106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:23.664793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:23.666453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:23.675668 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3437/6955] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:23.703707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:23.705338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:23.777730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8944-e613-4c78-bfa9-90ba5d6b194b service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:23.781804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:23.782656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:23.782938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:23.783212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] PATH_INFO: `/v3/projects/71418288426545dea311f347bd0cbfdb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:23.784440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71418288426545dea311f347bd0cbfdb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:23.786362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:23.905778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71418288426545dea311f347bd0cbfdb', 'request_id': 'req-db33190d-b7fc-492b-9387-f0ef92520f06'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:23.990770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71418288426545dea311f347bd0cbfdb', 'request_id': 'req-db33190d-b7fc-492b-9387-f0ef92520f06'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:23.997612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71418288426545dea311f347bd0cbfdb', 'request_id': 'req-db33190d-b7fc-492b-9387-f0ef92520f06'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.011434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] The token cache is being invalidate because project 71418288426545dea311f347bd0cbfdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:24.012029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.012681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-db33190d-b7fc-492b-9387-f0ef92520f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.016746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3519/6956] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:23 2021] DELETE /identity/v3/projects/71418288426545dea311f347bd0cbfdb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:24.020619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:24.032764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b24c24-575b-48e9-9b5c-2b73f1872057 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:24.100744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:24.102021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:24.102258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:24.102420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] PATH_INFO: `/v3/users/dd61f1d8c49940b992308e416fdb2c6e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:24.103822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd61f1d8c49940b992308e416fdb2c6e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:24.106288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:24.144270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:24.144556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:24.144831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:24.164368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:24.169315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:24.221923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3520/6957] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:24.234621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:24.236159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:24.301869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd61f1d8c49940b992308e416fdb2c6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.309019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd61f1d8c49940b992308e416fdb2c6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.315704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0a8f4-1970-4429-9b54-6049478256b8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:24.321776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd61f1d8c49940b992308e416fdb2c6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.322881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd61f1d8c49940b992308e416fdb2c6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.323645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5f5e8c9a-44df-48a2-bf53-32da6316c9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd61f1d8c49940b992308e416fdb2c6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:24.328225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:24.329070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:24.329513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:24.329929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:24.332209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:24.346339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:24.348014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:24.356683 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3521/6958] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:24.424364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3438/6959] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:24 2021] DELETE /identity/v3/users/dd61f1d8c49940b992308e416fdb2c6e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:24.768087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:24.769625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:24.784550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88818d-338c-4cf5-93d0-ecffb65bfa0a service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:24.851178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:24.852665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:24.852981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:24.853259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] PATH_INFO: `/v3/projects/065784da9c2c4ec791d79f36c0ffb7e9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:24.854602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065784da9c2c4ec791d79f36c0ffb7e9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:24.856832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.012497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065784da9c2c4ec791d79f36c0ffb7e9', 'request_id': 'req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:25.164556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065784da9c2c4ec791d79f36c0ffb7e9', 'request_id': 'req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:25.172842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065784da9c2c4ec791d79f36c0ffb7e9', 'request_id': 'req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:25.188274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] The token cache is being invalidate because project 065784da9c2c4ec791d79f36c0ffb7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:25.188274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:25.188274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0a56775-e7e8-46d7-bdd1-85d17b1b1677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:25.188667 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3522/6960] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:24 2021] DELETE /identity/v3/projects/065784da9c2c4ec791d79f36c0ffb7e9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:25.195640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86b2e5-eb4b-4a0e-a673-cae9efc30e7e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.196095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86b2e5-eb4b-4a0e-a673-cae9efc30e7e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.196183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86b2e5-eb4b-4a0e-a673-cae9efc30e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.214050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4b86b2e5-eb4b-4a0e-a673-cae9efc30e7e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:25.215258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4b86b2e5-eb4b-4a0e-a673-cae9efc30e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:25.225193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.225478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.225753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.245562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:25.246815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:25.281445 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3439/6961] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:25.289093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abc62e-de11-4671-9978-cb7d58a4f06e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.289390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abc62e-de11-4671-9978-cb7d58a4f06e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.289661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abc62e-de11-4671-9978-cb7d58a4f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.308858 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3523/6962] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:25.314667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-16abc62e-de11-4671-9978-cb7d58a4f06e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:25.315939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-16abc62e-de11-4671-9978-cb7d58a4f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:25.323933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.324403 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3440/6963] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:25.325756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:25.328404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abc62e-de11-4671-9978-cb7d58a4f06e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.337932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abc62e-de11-4671-9978-cb7d58a4f06e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:25.343238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:25.343833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.344174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.344455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.345268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:25.345573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:25.347170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.362540 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3441/6964] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:25.363658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.373391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5440252-3848-4600-906f-a82b7126d8bf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:25.379135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:25.379792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.380119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.380358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.381098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:25.382994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.409210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f72b-e4f5-479f-b495-ff9b5653d386 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:25.414431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:25.415076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.415357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.415630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.424640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:25.426269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.434297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3524/6965] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:25.501757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3442/6966] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:25 2021] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:25.503349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.518267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd785bb5-a140-46f9-bb72-787906750a4c service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:25.580700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:25.581473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.581827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.582097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.582784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:25.584735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.666385 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3525/6967] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:25 2021] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:25.673341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.683570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edc95a-0489-44c7-835c-3f058b5ec332 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:25.688126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:25.688828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.689161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.689433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.690157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:25.691734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.702319 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3443/6968] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:34:25.706046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.715914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee7d99-a460-4fcd-9287-0959c80967d9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:25.721684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec0759-332b-41f7-8215-58bd0a4f92ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:25.722348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec0759-332b-41f7-8215-58bd0a4f92ac admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.722721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec0759-332b-41f7-8215-58bd0a4f92ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.723006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec0759-332b-41f7-8215-58bd0a4f92ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.723791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec0759-332b-41f7-8215-58bd0a4f92ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:25.725519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec0759-332b-41f7-8215-58bd0a4f92ac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.735479 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3526/6969] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:25.739683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.749741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f882a-6e48-4961-9567-30f73a874ef5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:25.756650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:25.756650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.756650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.757049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] PATH_INFO: `/v3/projects/a416565d81324f55b88111b36c4a777c/users/c3a55c151bef4387a4fef00ab6687a20/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.772261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a416565d81324f55b88111b36c4a777c, user_id=c3a55c151bef4387a4fef00ab6687a20, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:25.774908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:25.872894 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3444/6970] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:25 2021] PUT /identity/v3/projects/a416565d81324f55b88111b36c4a777c/users/c3a55c151bef4387a4fef00ab6687a20/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:25.878576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212dd5-5b4b-4a0a-ba17-5be712e1c6d4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:25.879036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212dd5-5b4b-4a0a-ba17-5be712e1c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:25.879162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d212dd5-5b4b-4a0a-ba17-5be712e1c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:25.898218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3d212dd5-5b4b-4a0a-ba17-5be712e1c6d4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:25.898622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3d212dd5-5b4b-4a0a-ba17-5be712e1c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:25.965852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3527/6971] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:25.976781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:25.979329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:26.045332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:26.045827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:26.047764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318379ce-a51a-46e6-bab6-818e57a27265 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:26.047897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:26.050963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:26.051634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:26.052440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:26.052731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:26.063308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:26.064554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:26.064738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:26.065936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:26.075652 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3445/6972] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:26.126169 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3528/6973] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:26.140181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:26.209995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a5d7b-879e-4781-b4ea-0cae2eb8dad1 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:26.215519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76abb6-dce1-4dc5-87bb-1f929cd0b82c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:26.216179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76abb6-dce1-4dc5-87bb-1f929cd0b82c service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:26.216465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76abb6-dce1-4dc5-87bb-1f929cd0b82c service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:26.216779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76abb6-dce1-4dc5-87bb-1f929cd0b82c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:26.228717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76abb6-dce1-4dc5-87bb-1f929cd0b82c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:26.230929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76abb6-dce1-4dc5-87bb-1f929cd0b82c service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:26.240851 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3446/6974] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:26.873879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:26.875512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:26.890272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccce5f-4789-4952-86f7-b797695f4b12 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:26.895484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:26.896376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:26.896654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:26.896951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] PATH_INFO: `/v3/users/02ee8227ee6649518833718a98e9484a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:26.898162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ee8227ee6649518833718a98e9484a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:26.900061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:27.210314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ee8227ee6649518833718a98e9484a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:27.225304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ee8227ee6649518833718a98e9484a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:27.253532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ee8227ee6649518833718a98e9484a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:27.254761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ee8227ee6649518833718a98e9484a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:27.364181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ee8227ee6649518833718a98e9484a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:27.370780 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3529/6975] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:26 2021] DELETE /identity/v3/users/02ee8227ee6649518833718a98e9484a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:27.380292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994424b1-d808-4033-b846-046cdee2fb4c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:27.380798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994424b1-d808-4033-b846-046cdee2fb4c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:27.380930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994424b1-d808-4033-b846-046cdee2fb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:27.398540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-994424b1-d808-4033-b846-046cdee2fb4c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:27.400337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-994424b1-d808-4033-b846-046cdee2fb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:27.457255 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3447/6976] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:27.467339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:27.468769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:27.533286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd8d12-0b60-466c-989e-7fa316ee459e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:27.536968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:27.537640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:27.537922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:27.538640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:27.547358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:27.548793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:27.559029 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3530/6977] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:34:27.610074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:27.610447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:27.610793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:27.659166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] MFA Rules not processed for user `c3a55c151bef4387a4fef00ab6687a20`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:27.660716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:27.757024 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3448/6978] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:27 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:27.768213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:27.769845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:27.841583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81201f9e-e7e8-448b-9390-7edb2b4914c2 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:27.845545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae185649-de9f-4878-9c25-02747448ead8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:27.846187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185649-de9f-4878-9c25-02747448ead8 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:27.846470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185649-de9f-4878-9c25-02747448ead8 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:27.846937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185649-de9f-4878-9c25-02747448ead8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:27.857007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae185649-de9f-4878-9c25-02747448ead8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:27.858989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae185649-de9f-4878-9c25-02747448ead8 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:27.871751 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3531/6979] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:27 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:27.973737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:27.975549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:27.991052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bed10-6877-47ed-b0b1-8deb770eb9fa None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:27.996804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:27.997811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:27.998089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:27.999130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] PATH_INFO: `/v3/projects/f61a0566d14547059cbece8d41c7e2d5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.000455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61a0566d14547059cbece8d41c7e2d5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:28.002821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:28.139992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61a0566d14547059cbece8d41c7e2d5', 'request_id': 'req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:28.146056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61a0566d14547059cbece8d41c7e2d5', 'request_id': 'req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:28.225092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61a0566d14547059cbece8d41c7e2d5', 'request_id': 'req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:28.236618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] The token cache is being invalidate because project f61a0566d14547059cbece8d41c7e2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:28.236926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:28.237567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7d820b2-cfbf-4a9b-81ca-c12a34a832d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:28.239176 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3449/6980] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:27 2021] DELETE /identity/v3/projects/f61a0566d14547059cbece8d41c7e2d5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:28.245156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f720bc-ce3a-445b-bbd8-73b16b7d5a84 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.245652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f720bc-ce3a-445b-bbd8-73b16b7d5a84 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.245758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f720bc-ce3a-445b-bbd8-73b16b7d5a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.264360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d0f720bc-ce3a-445b-bbd8-73b16b7d5a84 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:28.265810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d0f720bc-ce3a-445b-bbd8-73b16b7d5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:28.327070 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3532/6981] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:28.336441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727d4d-7a75-4d2e-9409-b0184f29961d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.336724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727d4d-7a75-4d2e-9409-b0184f29961d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.337046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d727d4d-7a75-4d2e-9409-b0184f29961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.361256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5d727d4d-7a75-4d2e-9409-b0184f29961d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:28.362483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5d727d4d-7a75-4d2e-9409-b0184f29961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:28.370663 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3450/6982] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:28.375135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f720bc-ce3a-445b-bbd8-73b16b7d5a84 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:28.395788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f720bc-ce3a-445b-bbd8-73b16b7d5a84 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:28.395788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:28.395788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.395788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.396204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.396204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:28.396204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:28.396204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:28.407490 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3533/6983] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:28.411842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d727d4d-7a75-4d2e-9409-b0184f29961d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:28.421743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d727d4d-7a75-4d2e-9409-b0184f29961d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:28.426532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:28.427203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.427485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.427873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.428559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:28.430578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:28.541157 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3451/6984] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:28 2021] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:28.545316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:28.556292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d7021-5bb7-4dea-bffc-d5919f0eaa73 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:28.619650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:28.620321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.620598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.620869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.621711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:28.623667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:28.720906 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3534/6985] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:28 2021] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:28.722726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:28.733728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1eb03-08f8-4fc2-9670-673920041460 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:28.738132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:28.738861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.739219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.739565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.740364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:28.742333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:28.753377 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3452/6986] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:28.759665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:28.771762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381002f6-604a-4cb1-bf29-7e588253b764 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:28.777210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ccacc-b9ae-4b6f-81f9-b111946c3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:28.779544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ccacc-b9ae-4b6f-81f9-b111946c3d1e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.779544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ccacc-b9ae-4b6f-81f9-b111946c3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.779544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ccacc-b9ae-4b6f-81f9-b111946c3d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.779544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ccacc-b9ae-4b6f-81f9-b111946c3d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:28.781441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ccacc-b9ae-4b6f-81f9-b111946c3d1e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:28.791710 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3535/6987] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:28.795916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:28.806610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809286de-be30-459d-9dc0-ca97ed1b9fc5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:28.811428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:28.812310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.812590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.812861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] PATH_INFO: `/v3/projects/4330e6d32b3840028a8e75fc07fcc1f3/users/e8324be7354f4a9fbab8ed46ad05b47c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:28.827563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4330e6d32b3840028a8e75fc07fcc1f3, user_id=e8324be7354f4a9fbab8ed46ad05b47c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:28.830254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:28.936348 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3453/6988] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:28 2021] PUT /identity/v3/projects/4330e6d32b3840028a8e75fc07fcc1f3/users/e8324be7354f4a9fbab8ed46ad05b47c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:28.946578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484cc40-14f7-45be-8046-56882d2db887 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:28.946915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484cc40-14f7-45be-8046-56882d2db887 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:28.947195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484cc40-14f7-45be-8046-56882d2db887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:29.019551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8484cc40-14f7-45be-8046-56882d2db887 None None] MFA Rules not processed for user `e8324be7354f4a9fbab8ed46ad05b47c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:29.020751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8484cc40-14f7-45be-8046-56882d2db887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:29.086689 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3536/6989] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:29.103736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:29.105515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:29.165971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f0f7a-e96f-48ec-80ed-796d19d034e8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:29.169645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:29.170317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:29.170597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:29.170873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:29.179175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:29.180628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:29.189961 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3454/6990] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:29 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:34:29.495747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bacc1-4937-4e47-9172-a2d067531718 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:29.496224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bacc1-4937-4e47-9172-a2d067531718 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:29.496325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bacc1-4937-4e47-9172-a2d067531718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:29.515362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-738bacc1-4937-4e47-9172-a2d067531718 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:29.516562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-738bacc1-4937-4e47-9172-a2d067531718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:29.571376 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3537/6991] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:29.583999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:29.585437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:29.655375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83383-7562-478d-84bf-5e92d1ec8f01 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:29.660945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:29.661593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:29.661874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:29.662227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:29.672742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:29.674356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:29.682412 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3455/6992] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:30.505899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9427d1-55a0-40ae-89cb-fb407e93e727 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:30.506354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9427d1-55a0-40ae-89cb-fb407e93e727 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:30.506508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9427d1-55a0-40ae-89cb-fb407e93e727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:30.525232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bd9427d1-55a0-40ae-89cb-fb407e93e727 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:30.526422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd9427d1-55a0-40ae-89cb-fb407e93e727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:30.533737 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3538/6993] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:30.546768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:30.559948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8fac0-5791-4973-8379-2be86255f100 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:30.565810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:30.566420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:30.566704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:30.566982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:30.575276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:30.576842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:30.585800 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3456/6994] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:31.494624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7888c-96fd-45e4-9403-9219f6b0e82d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:31.494926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7888c-96fd-45e4-9403-9219f6b0e82d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:31.495203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7888c-96fd-45e4-9403-9219f6b0e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:31.516537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a7d7888c-96fd-45e4-9403-9219f6b0e82d None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:31.517998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a7d7888c-96fd-45e4-9403-9219f6b0e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:31.525748 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3539/6995] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:31.539781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:31.552767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a66d3-9d17-48af-a332-c70828a4d2c1 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:31.559499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:31.560147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:31.560428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:31.562299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:31.571915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:31.573512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:31.582606 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3457/6996] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:32.387382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117ceb-087e-4b36-be23-c7e3204c05e5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:32.387675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117ceb-087e-4b36-be23-c7e3204c05e5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:32.387955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117ceb-087e-4b36-be23-c7e3204c05e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:32.406083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3e117ceb-087e-4b36-be23-c7e3204c05e5 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:32.407277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3e117ceb-087e-4b36-be23-c7e3204c05e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:32.415238 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3540/6997] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:32.429251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:32.443709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f537e-9756-49e5-9a20-ab034a4798a2 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:32.448767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:32.452038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:32.452038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:32.452038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:32.458665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:32.460211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:32.468391 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3458/6998] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:33.280131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dbd7d-c60b-4303-95df-af7b76ad1af8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:33.280647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dbd7d-c60b-4303-95df-af7b76ad1af8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:33.282090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dbd7d-c60b-4303-95df-af7b76ad1af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:33.300279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fa3dbd7d-c60b-4303-95df-af7b76ad1af8 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:33.301705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa3dbd7d-c60b-4303-95df-af7b76ad1af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:33.309385 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3541/6999] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:33.322640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:33.335906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb73fc-ae38-4e0e-9e24-41a1c5a6165f service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:33.341004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:33.341633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:33.341911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:33.342180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:33.350334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:33.351918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:33.359961 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3459/7000] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:34.132869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022fa8-adf1-4ae3-a475-2fe76dd6bf69 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:34.133181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022fa8-adf1-4ae3-a475-2fe76dd6bf69 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:34.133463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022fa8-adf1-4ae3-a475-2fe76dd6bf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:34.151410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2f022fa8-adf1-4ae3-a475-2fe76dd6bf69 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:34.152601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2f022fa8-adf1-4ae3-a475-2fe76dd6bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:34.160443 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3542/7001] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:34:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:34.173266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:34.186071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c11581-40a4-4193-84f3-87f2bafdaed2 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:34.191206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:34.191837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:34.192119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:34.195583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:34.200604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:34.202201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:34.210426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3460/7002] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:35.424055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca544045-0a0c-4b42-8320-237efc46e539 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:35.424547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca544045-0a0c-4b42-8320-237efc46e539 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:35.424653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca544045-0a0c-4b42-8320-237efc46e539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:35.442723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ca544045-0a0c-4b42-8320-237efc46e539 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:35.443905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ca544045-0a0c-4b42-8320-237efc46e539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:35.451040 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3543/7003] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:35.463650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:35.476327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0def-459e-4b04-915a-0e253eb76333 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:35.481432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:35.482065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:35.482348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:35.482621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:35.491755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:35.493385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:35.502498 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3461/7004] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:35.948528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08a77-6a2e-490d-a685-37ce7dcfe386 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:35.948528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08a77-6a2e-490d-a685-37ce7dcfe386 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:35.948528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb08a77-6a2e-490d-a685-37ce7dcfe386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:35.967350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0cb08a77-6a2e-490d-a685-37ce7dcfe386 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:35.969255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0cb08a77-6a2e-490d-a685-37ce7dcfe386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:35.976463 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3544/7005] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:35.989612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:36.002285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a469-9faa-459f-88cd-d39695232897 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:36.007381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:36.011757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:36.011757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:36.011757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:36.017488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:36.019102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:36.027345 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3462/7006] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:36.389458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973e66b-96b7-4aba-a0eb-0f754e74efd0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:36.389792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973e66b-96b7-4aba-a0eb-0f754e74efd0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:36.390081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973e66b-96b7-4aba-a0eb-0f754e74efd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:36.408498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b973e66b-96b7-4aba-a0eb-0f754e74efd0 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:36.409705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b973e66b-96b7-4aba-a0eb-0f754e74efd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:36.417132 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3545/7007] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:36.432730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:36.446252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6617-c0f8-4f79-bde5-e857e2dba73d service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:36.451369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:36.452009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:36.452292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:36.453232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:36.461344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:36.462900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:36.479184 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3463/7008] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:36.984370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08440be2-be86-46e4-9f93-985f676e6fa9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:36.984910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08440be2-be86-46e4-9f93-985f676e6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:36.985143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08440be2-be86-46e4-9f93-985f676e6fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:37.008074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-08440be2-be86-46e4-9f93-985f676e6fa9 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:37.009313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-08440be2-be86-46e4-9f93-985f676e6fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:37.017118 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3546/7009] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:37.030696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:37.043274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb678f7-be92-43b7-9a17-70e0f0658f97 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:37.049047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:37.049739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:37.050019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:37.050314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:37.059108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:37.060675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:37.069478 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3464/7010] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:37.741977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a13772-93c2-461d-b70f-d0c085e8779a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:37.742262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a13772-93c2-461d-b70f-d0c085e8779a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:37.742534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a13772-93c2-461d-b70f-d0c085e8779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:37.762106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-99a13772-93c2-461d-b70f-d0c085e8779a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:37.763305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-99a13772-93c2-461d-b70f-d0c085e8779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:37.771535 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3547/7011] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:37.785590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:37.800099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822e8b3-1f1b-447d-933e-43693cc527b1 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:37.806185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:37.806876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:37.807158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:37.807432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:37.817553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:37.819163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:37.828960 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3465/7012] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 25 21:34:38.214315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89fa5c-378b-4f96-bde2-1621d888232a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:38.217794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89fa5c-378b-4f96-bde2-1621d888232a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:38.217794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89fa5c-378b-4f96-bde2-1621d888232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:38.237293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3e89fa5c-378b-4f96-bde2-1621d888232a None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:38.238619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3e89fa5c-378b-4f96-bde2-1621d888232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:38.248373 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3548/7013] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:34:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:38.262876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:38.276771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924062b-e67b-467c-a6af-d7ae352bbb8f service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:38.283389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f182b18-afa6-4e70-8291-9df9f9815b4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:38.284413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182b18-afa6-4e70-8291-9df9f9815b4d service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:38.284933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182b18-afa6-4e70-8291-9df9f9815b4d service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:38.285309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182b18-afa6-4e70-8291-9df9f9815b4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:38.294863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f182b18-afa6-4e70-8291-9df9f9815b4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:38.297406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f182b18-afa6-4e70-8291-9df9f9815b4d service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:38.307846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3466/7014] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:34:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:38.855370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89fa5c-378b-4f96-bde2-1621d888232a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:38.918046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89fa5c-378b-4f96-bde2-1621d888232a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:38.923230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:38.924308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:38.924527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:38.924805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] PATH_INFO: `/v3/users/e8324be7354f4a9fbab8ed46ad05b47c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:38.926059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8324be7354f4a9fbab8ed46ad05b47c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:38.932086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:39.147483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8324be7354f4a9fbab8ed46ad05b47c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:39.154538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8324be7354f4a9fbab8ed46ad05b47c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:39.166840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8324be7354f4a9fbab8ed46ad05b47c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:39.167559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8324be7354f4a9fbab8ed46ad05b47c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:39.237474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8324be7354f4a9fbab8ed46ad05b47c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:39.244065 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3549/7015] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:38 2021] DELETE /identity/v3/users/e8324be7354f4a9fbab8ed46ad05b47c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:39.248646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:39.249117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:39.249293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:39.267404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:39.268716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:39.328620 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3467/7016] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:39.338786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:39.340191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:39.406498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e65ac-09de-4227-8a7f-b9b48f324cbe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:39.411869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee5b42-248f-4c02-b275-26706499ac71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:39.413063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee5b42-248f-4c02-b275-26706499ac71 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:39.414071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee5b42-248f-4c02-b275-26706499ac71 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:39.414518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee5b42-248f-4c02-b275-26706499ac71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:39.427286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee5b42-248f-4c02-b275-26706499ac71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:39.428903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee5b42-248f-4c02-b275-26706499ac71 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:39.441841 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3550/7017] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:39.891450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:39.893075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:39.905208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812bb8f-c422-43e9-9cc6-7904119bb721 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:39.910080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:39.911018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:39.911240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:39.911520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] PATH_INFO: `/v3/projects/4330e6d32b3840028a8e75fc07fcc1f3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:39.912951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4330e6d32b3840028a8e75fc07fcc1f3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:39.914928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:40.044887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4330e6d32b3840028a8e75fc07fcc1f3', 'request_id': 'req-56299b78-9563-4562-b431-9dc9f1672d52'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:40.051623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4330e6d32b3840028a8e75fc07fcc1f3', 'request_id': 'req-56299b78-9563-4562-b431-9dc9f1672d52'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:40.150084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4330e6d32b3840028a8e75fc07fcc1f3', 'request_id': 'req-56299b78-9563-4562-b431-9dc9f1672d52'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:40.161392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] The token cache is being invalidate because project 4330e6d32b3840028a8e75fc07fcc1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:40.161706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:40.162371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-56299b78-9563-4562-b431-9dc9f1672d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:40.163924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3468/7018] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:39 2021] DELETE /identity/v3/projects/4330e6d32b3840028a8e75fc07fcc1f3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:40.169749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cc7a-2a6f-4f8c-9660-5db9b07a548f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.170038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cc7a-2a6f-4f8c-9660-5db9b07a548f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.170315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cc7a-2a6f-4f8c-9660-5db9b07a548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.188834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a380cc7a-2a6f-4f8c-9660-5db9b07a548f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:40.190059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a380cc7a-2a6f-4f8c-9660-5db9b07a548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:40.249114 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3551/7019] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:40.258455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f23a3-02d8-460d-a0da-516f4d07d41a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.258972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f23a3-02d8-460d-a0da-516f4d07d41a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.259085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f23a3-02d8-460d-a0da-516f4d07d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.277970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-447f23a3-02d8-460d-a0da-516f4d07d41a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:40.279165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-447f23a3-02d8-460d-a0da-516f4d07d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:40.287722 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3469/7020] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:40.292025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380cc7a-2a6f-4f8c-9660-5db9b07a548f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:40.312259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380cc7a-2a6f-4f8c-9660-5db9b07a548f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:40.319180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:40.319840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.320188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.320448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.321275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:40.321579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:40.323809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:40.335946 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3552/7021] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:40.340524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f23a3-02d8-460d-a0da-516f4d07d41a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:40.350815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f23a3-02d8-460d-a0da-516f4d07d41a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:40.356022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:40.356730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.357190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.357479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.358174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:40.360817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:40.474048 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3470/7022] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:40 2021] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:40.478314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:40.488545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bbb8-cfae-4cc0-ab68-128ab0ff9ce3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:40.547350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:40.548484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.548757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.549067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.550345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:40.552332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:40.649309 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3553/7023] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:40 2021] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:40.653550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:40.664795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fc55a-69f8-4c56-b389-55df4be50365 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:40.669410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:40.670053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.670332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.670603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.671387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:40.672983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:40.683653 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3471/7024] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:40.687729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:40.698396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed81484-b2b5-4944-b7e2-59b25174a632 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:40.703094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe7fd3-422f-4684-8fea-4d0de9076457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:40.703731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7fd3-422f-4684-8fea-4d0de9076457 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.704009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7fd3-422f-4684-8fea-4d0de9076457 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.704278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe7fd3-422f-4684-8fea-4d0de9076457 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.705068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe7fd3-422f-4684-8fea-4d0de9076457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:40.706636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe7fd3-422f-4684-8fea-4d0de9076457 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:40.716614 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3554/7025] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:40.721842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:40.733819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f420d-1b23-444b-97d3-7495bbd51cdd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:40.739121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:40.740080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.740358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.740631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] PATH_INFO: `/v3/projects/01ccd4a958914319be9790d5308929d3/users/3951bb68c49e4bcb81383852d9c2d8ea/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.756967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ccd4a958914319be9790d5308929d3, user_id=3951bb68c49e4bcb81383852d9c2d8ea, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:40.759512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:40.918980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3472/7026] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:40 2021] PUT /identity/v3/projects/01ccd4a958914319be9790d5308929d3/users/3951bb68c49e4bcb81383852d9c2d8ea/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:40.930114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54fc28-9260-40ea-9303-1750f15e677d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:40.930408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54fc28-9260-40ea-9303-1750f15e677d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:40.930718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54fc28-9260-40ea-9303-1750f15e677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:40.965528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bd54fc28-9260-40ea-9303-1750f15e677d None None] MFA Rules not processed for user `3951bb68c49e4bcb81383852d9c2d8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:40.966782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd54fc28-9260-40ea-9303-1750f15e677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:41.032000 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3555/7027] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:40 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:41.044715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:41.046499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:41.109415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f1de9-ddcb-48ae-bc26-196cefb8b781 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:41.113435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49693d1-09e1-400b-bc4e-54a8606a3676 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:41.114324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49693d1-09e1-400b-bc4e-54a8606a3676 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:41.114686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49693d1-09e1-400b-bc4e-54a8606a3676 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:41.115045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49693d1-09e1-400b-bc4e-54a8606a3676 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:41.124654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49693d1-09e1-400b-bc4e-54a8606a3676 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:41.126209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49693d1-09e1-400b-bc4e-54a8606a3676 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:41.135626 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3473/7028] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:41 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:42.580851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54fc28-9260-40ea-9303-1750f15e677d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:42.649820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54fc28-9260-40ea-9303-1750f15e677d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:42.654495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:42.655407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:42.655687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:42.655959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] PATH_INFO: `/v3/users/3951bb68c49e4bcb81383852d9c2d8ea` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:42.657182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3951bb68c49e4bcb81383852d9c2d8ea)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:42.659133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:42.920069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3951bb68c49e4bcb81383852d9c2d8ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:42.927041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3951bb68c49e4bcb81383852d9c2d8ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:42.939204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3951bb68c49e4bcb81383852d9c2d8ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:42.939901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3951bb68c49e4bcb81383852d9c2d8ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:43.054967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3951bb68c49e4bcb81383852d9c2d8ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:43.062555 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3556/7029] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:42 2021] DELETE /identity/v3/users/3951bb68c49e4bcb81383852d9c2d8ea => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:43.067238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:43.067694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:43.068017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:43.086178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:43.087639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:43.153294 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3474/7030] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:43.165333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:43.166802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:43.230970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef6116-701f-40a7-a71b-8d228cc5e951 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:43.235613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2728083-c2a8-46b8-b616-fbd87cf78867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:43.236255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728083-c2a8-46b8-b616-fbd87cf78867 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:43.239890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728083-c2a8-46b8-b616-fbd87cf78867 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:43.239890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728083-c2a8-46b8-b616-fbd87cf78867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:43.246195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2728083-c2a8-46b8-b616-fbd87cf78867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:43.247680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2728083-c2a8-46b8-b616-fbd87cf78867 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:43.258061 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3557/7031] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:43.717236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:43.718695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:43.736125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76ffd2-7a49-4a4f-b50c-45c99fdd578b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:43.742214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:43.743622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:43.743961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:43.744271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] PATH_INFO: `/v3/projects/01ccd4a958914319be9790d5308929d3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:43.745768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ccd4a958914319be9790d5308929d3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:43.750996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:43.903211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ccd4a958914319be9790d5308929d3', 'request_id': 'req-a7723caa-2b9f-4662-9c4b-572d17f4490e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:43.910670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ccd4a958914319be9790d5308929d3', 'request_id': 'req-a7723caa-2b9f-4662-9c4b-572d17f4490e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:44.019360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ccd4a958914319be9790d5308929d3', 'request_id': 'req-a7723caa-2b9f-4662-9c4b-572d17f4490e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:44.031928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] The token cache is being invalidate because project 01ccd4a958914319be9790d5308929d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:44.032321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:44.033096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7723caa-2b9f-4662-9c4b-572d17f4490e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:44.034778 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3475/7032] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:43 2021] DELETE /identity/v3/projects/01ccd4a958914319be9790d5308929d3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:44.042602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9153a0-d596-4868-ae64-8a0e4177f6fe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.043112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9153a0-d596-4868-ae64-8a0e4177f6fe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.043239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9153a0-d596-4868-ae64-8a0e4177f6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.063306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bb9153a0-d596-4868-ae64-8a0e4177f6fe None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:44.064561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bb9153a0-d596-4868-ae64-8a0e4177f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:44.132422 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3558/7033] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:44.140583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac73ac-6242-4b72-a62f-5e36222475f6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.141164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac73ac-6242-4b72-a62f-5e36222475f6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.141321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac73ac-6242-4b72-a62f-5e36222475f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.161128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d4ac73ac-6242-4b72-a62f-5e36222475f6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:44.162471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4ac73ac-6242-4b72-a62f-5e36222475f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:44.171621 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3476/7034] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:44.176242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9153a0-d596-4868-ae64-8a0e4177f6fe None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:44.187115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9153a0-d596-4868-ae64-8a0e4177f6fe None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:44.192066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:44.192868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.193183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.193454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.194187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:44.194497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:44.196144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:44.209441 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3559/7035] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:34:44.213841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac73ac-6242-4b72-a62f-5e36222475f6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:44.223423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac73ac-6242-4b72-a62f-5e36222475f6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:44.228078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:44.228722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.229046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.229322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.230004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:44.231876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:44.330617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3477/7036] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:44 2021] POST /identity/v3/projects => generated 407 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:44.334704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:44.346806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30025b9b-81d4-48e7-9a02-5f3c24eca434 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:44.403824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:44.404488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.404773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.405081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.406359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:44.408322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:44.522168 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3560/7037] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:44 2021] POST /identity/v3/users => generated 304 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:34:44.524098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:44.535026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82771e10-ed43-4c14-9f7b-3505d32a9439 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:44.539773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:44.542506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.542506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.542506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.542506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:44.543322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:44.553616 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3478/7038] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:44.557615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:44.568499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e433e-7e1e-4b72-8fcf-59d41040cef5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:44.573344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a304d6e-9d29-4e97-8cdb-280b16870ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:44.574153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a304d6e-9d29-4e97-8cdb-280b16870ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.574459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a304d6e-9d29-4e97-8cdb-280b16870ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.574736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a304d6e-9d29-4e97-8cdb-280b16870ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.575456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a304d6e-9d29-4e97-8cdb-280b16870ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:44.577684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a304d6e-9d29-4e97-8cdb-280b16870ce3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:44.588011 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3561/7039] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:44.592026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:44.601910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0208e1-5500-42f6-b1c5-6a096189f266 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:44.606484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:44.607348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.607621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.607887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] PATH_INFO: `/v3/projects/ad1414d6c0fc45feb4c2be308a56ace1/users/45f3e8bccdc14c8684f264648c45b07d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.623522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1414d6c0fc45feb4c2be308a56ace1, user_id=45f3e8bccdc14c8684f264648c45b07d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:44.626803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:44.724195 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3479/7040] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:44 2021] PUT /identity/v3/projects/ad1414d6c0fc45feb4c2be308a56ace1/users/45f3e8bccdc14c8684f264648c45b07d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:44.734244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569af63-1987-4371-8ac3-68c3e6f8fa73 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.734545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569af63-1987-4371-8ac3-68c3e6f8fa73 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.734825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569af63-1987-4371-8ac3-68c3e6f8fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.772100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8569af63-1987-4371-8ac3-68c3e6f8fa73 None None] MFA Rules not processed for user `45f3e8bccdc14c8684f264648c45b07d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:44.773506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8569af63-1987-4371-8ac3-68c3e6f8fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:44.850468 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3562/7041] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:44 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:44.855201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:44.937499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9461d-6482-4296-8f36-9da1c36422a0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:44.942867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:44.943551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:44.943840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:44.944117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:44.944831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:44.946752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:45.061972 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3480/7042] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:44 2021] POST /identity/v3/projects => generated 405 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:34:45.066756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569af63-1987-4371-8ac3-68c3e6f8fa73 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:45.077585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569af63-1987-4371-8ac3-68c3e6f8fa73 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:45.133128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:45.133816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:45.134095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:45.134368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:45.135089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:45.137331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:45.230183 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3563/7043] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:45 2021] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:45.234182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:45.245108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bbe8d-05ed-4af1-95f0-8cc193b3b649 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:45.249861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:45.251060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:45.251341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:45.251616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:45.252342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:45.253970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:45.265361 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3481/7044] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:45.269496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:45.279862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29f0a0-5a1b-45cd-9b22-7b443fad2ad8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:45.285310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:45.286220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:45.288423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:45.288423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] PATH_INFO: `/v3/projects/bdca30e94d1640749b9ee58b584fe2a4/users/57652b3f85e044449c7ed2ecde2cb322/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:45.302458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdca30e94d1640749b9ee58b584fe2a4, user_id=57652b3f85e044449c7ed2ecde2cb322, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:45.305173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:45.414652 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3564/7045] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:45 2021] PUT /identity/v3/projects/bdca30e94d1640749b9ee58b584fe2a4/users/57652b3f85e044449c7ed2ecde2cb322/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:45.418830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:45.431251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3685e1-4358-4b7c-abd2-c39400132f50 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:45.486877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69888423-4649-4955-8259-6ab5b34ff8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:45.487966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888423-4649-4955-8259-6ab5b34ff8ad admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:45.488404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888423-4649-4955-8259-6ab5b34ff8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:45.488840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69888423-4649-4955-8259-6ab5b34ff8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:45.489597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69888423-4649-4955-8259-6ab5b34ff8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:45.491188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69888423-4649-4955-8259-6ab5b34ff8ad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:45.501158 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3482/7046] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:45 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:45.505370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:45.515737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b8e4c-869f-41c2-9085-bff7356b0805 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:45.520415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:45.521330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:45.521610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:45.521882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] PATH_INFO: `/v3/projects/bdca30e94d1640749b9ee58b584fe2a4/users/57652b3f85e044449c7ed2ecde2cb322/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:45.523868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdca30e94d1640749b9ee58b584fe2a4, user_id=57652b3f85e044449c7ed2ecde2cb322, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:45.526489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:45.537120 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3565/7047] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:45 2021] PUT /identity/v3/projects/bdca30e94d1640749b9ee58b584fe2a4/users/57652b3f85e044449c7ed2ecde2cb322/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:45.622358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:45.622589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:45.622827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:45.649826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] MFA Rules not processed for user `57652b3f85e044449c7ed2ecde2cb322`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:45.651042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:45.718650 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3483/7048] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:45 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:45.730040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:45.732171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:45.797848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7d25-45ed-4368-8b97-71fb4429ed79 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:45.803578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:45.804330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:45.804671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:45.805125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:45.876239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:45.876239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:45.885098 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3566/7049] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:45 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:46.832344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:46.833856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:46.919083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44073e95-4461-4e7b-94fb-7963e59affe5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:46.926228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237618d-e122-4509-a52e-ded9949063b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:46.927840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237618d-e122-4509-a52e-ded9949063b7 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:46.927840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237618d-e122-4509-a52e-ded9949063b7 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:46.927840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237618d-e122-4509-a52e-ded9949063b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:46.937430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237618d-e122-4509-a52e-ded9949063b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:46.939065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237618d-e122-4509-a52e-ded9949063b7 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:46.953031 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3484/7050] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:46 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:53.936817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:54.001883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71ea9-d461-48f3-9ad2-293343d71df7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:54.006524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:54.007523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:54.007815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:54.008187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] PATH_INFO: `/v3/users/45f3e8bccdc14c8684f264648c45b07d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:54.012565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f3e8bccdc14c8684f264648c45b07d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:54.014559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:54.181974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f3e8bccdc14c8684f264648c45b07d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:54.188628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f3e8bccdc14c8684f264648c45b07d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:54.203919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f3e8bccdc14c8684f264648c45b07d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:54.205084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f3e8bccdc14c8684f264648c45b07d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:54.277112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f3e8bccdc14c8684f264648c45b07d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:54.283999 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3567/7051] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:53 2021] DELETE /identity/v3/users/45f3e8bccdc14c8684f264648c45b07d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:54.288534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:54.289049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:54.289172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:54.305595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:54.306771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:54.367418 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3485/7052] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:54.378038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:54.379467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:54.439210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc72f46-2559-4f5c-b903-83aa3976355f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:54.442848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:54.443488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:54.443771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:54.444046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:54.454755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:54.456169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:54.466796 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3568/7053] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:34:54.736275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:54.742524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:54.757610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb672-21e7-49bb-9467-c680f35f96ad None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:54.762649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:54.763516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:54.763804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:54.764077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] PATH_INFO: `/v3/projects/ad1414d6c0fc45feb4c2be308a56ace1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:54.765295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1414d6c0fc45feb4c2be308a56ace1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:54.767172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:54.911304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1414d6c0fc45feb4c2be308a56ace1', 'request_id': 'req-5815f799-6763-4b05-bae3-22837d880779'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:54.917279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1414d6c0fc45feb4c2be308a56ace1', 'request_id': 'req-5815f799-6763-4b05-bae3-22837d880779'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:54.997448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1414d6c0fc45feb4c2be308a56ace1', 'request_id': 'req-5815f799-6763-4b05-bae3-22837d880779'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.011323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] The token cache is being invalidate because project ad1414d6c0fc45feb4c2be308a56ace1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:55.014661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.014661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.014661 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3486/7054] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:54 2021] DELETE /identity/v3/projects/ad1414d6c0fc45feb4c2be308a56ace1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:55.017803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:55.027467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45761c-be30-4e5c-9f94-86da8622d752 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:55.083116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:55.083984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:55.084264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:55.084538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] PATH_INFO: `/v3/users/57652b3f85e044449c7ed2ecde2cb322` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:55.085768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57652b3f85e044449c7ed2ecde2cb322)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:55.087797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:55.245305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57652b3f85e044449c7ed2ecde2cb322'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.252063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57652b3f85e044449c7ed2ecde2cb322'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.263427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57652b3f85e044449c7ed2ecde2cb322'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.264112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57652b3f85e044449c7ed2ecde2cb322'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.322164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-62952fb2-2a27-4430-aec5-b880b2b013d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57652b3f85e044449c7ed2ecde2cb322'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.328215 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3569/7055] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:34:55 2021] DELETE /identity/v3/users/57652b3f85e044449c7ed2ecde2cb322 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:34:55.614527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:55.615963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:55.628942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815f799-6763-4b05-bae3-22837d880779 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:55.697496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:55.698369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:55.698675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:55.698951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] PATH_INFO: `/v3/projects/bdca30e94d1640749b9ee58b584fe2a4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:55.700211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdca30e94d1640749b9ee58b584fe2a4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:55.702133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:55.812847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdca30e94d1640749b9ee58b584fe2a4', 'request_id': 'req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.818797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdca30e94d1640749b9ee58b584fe2a4', 'request_id': 'req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.915690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdca30e94d1640749b9ee58b584fe2a4', 'request_id': 'req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.927604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] The token cache is being invalidate because project bdca30e94d1640749b9ee58b584fe2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:34:55.927897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.928554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4c8aa201-9590-4d36-b66a-7ac4d5f706fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:34:55.930114 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3487/7056] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:34:55 2021] DELETE /identity/v3/projects/bdca30e94d1640749b9ee58b584fe2a4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:55.935758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618befd-6bbc-482a-bd5b-4a517ff5f546 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:55.936071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618befd-6bbc-482a-bd5b-4a517ff5f546 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:55.936348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618befd-6bbc-482a-bd5b-4a517ff5f546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:55.957386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1618befd-6bbc-482a-bd5b-4a517ff5f546 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:55.958614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1618befd-6bbc-482a-bd5b-4a517ff5f546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:56.016850 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3570/7057] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:56.024569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648015-1feb-4cb2-a883-ddc5e4ac602f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.029904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648015-1feb-4cb2-a883-ddc5e4ac602f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.029904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648015-1feb-4cb2-a883-ddc5e4ac602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.043251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cc648015-1feb-4cb2-a883-ddc5e4ac602f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:56.044446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc648015-1feb-4cb2-a883-ddc5e4ac602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:56.054269 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3488/7058] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:34:56.058422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618befd-6bbc-482a-bd5b-4a517ff5f546 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:56.068667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618befd-6bbc-482a-bd5b-4a517ff5f546 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:56.073214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:56.075870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.075870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.075870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.075870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:34:56.075870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:56.076974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:56.089380 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3571/7059] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:34:56.093852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648015-1feb-4cb2-a883-ddc5e4ac602f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:56.103232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648015-1feb-4cb2-a883-ddc5e4ac602f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:56.107931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:56.108575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.108856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.109171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.109872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:56.111754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:56.220287 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3489/7060] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:34:56 2021] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:56.224359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:56.235348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910b9b2-c0af-4446-9d3c-784d7e42b882 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:56.291166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:56.291831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.292137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.292411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.293130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:56.295134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:56.431987 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3572/7061] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:34:56 2021] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:34:56.436109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:56.446915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8a49-c213-4b3f-9074-164aec52c018 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:56.451532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:56.452181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.452460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.452736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.453498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:56.455114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:56.465726 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3490/7062] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:56.469387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:56.479728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931993d-5477-4206-814c-a1585d04b2d7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:56.484460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8d36-3727-4a1a-807a-5fa2a4473498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:56.485644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8d36-3727-4a1a-807a-5fa2a4473498 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.485922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8d36-3727-4a1a-807a-5fa2a4473498 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.486194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8d36-3727-4a1a-807a-5fa2a4473498 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.486918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8d36-3727-4a1a-807a-5fa2a4473498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:56.488510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8d36-3727-4a1a-807a-5fa2a4473498 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:56.498269 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3573/7063] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:34:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:34:56.503172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:56.513319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e00cb5-d3b4-4962-b920-a08101185bc2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:56.517952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:56.518857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.519136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.519442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] PATH_INFO: `/v3/projects/fc472bb54bf742e6b51376c1e8d4f228/users/a6b53d14dd95494288f4a312be7cf038/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.535761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc472bb54bf742e6b51376c1e8d4f228, user_id=a6b53d14dd95494288f4a312be7cf038, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:56.538557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:56.607510 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3491/7064] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:34:56 2021] PUT /identity/v3/projects/fc472bb54bf742e6b51376c1e8d4f228/users/a6b53d14dd95494288f4a312be7cf038/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:34:56.623167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.623760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.624165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.652486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] MFA Rules not processed for user `a6b53d14dd95494288f4a312be7cf038`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:34:56.653779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:56.723706 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3574/7065] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:34:56 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:34:56.734442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:34:56.737061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:34:56.795795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b27e6-efeb-4bd1-b8ea-599046f9497d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:34:56.800507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7fa23-b85d-472f-87d7-f1150835c3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:34:56.801284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7fa23-b85d-472f-87d7-f1150835c3cf service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:34:56.801692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7fa23-b85d-472f-87d7-f1150835c3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:34:56.802007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7fa23-b85d-472f-87d7-f1150835c3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:34:56.810664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7fa23-b85d-472f-87d7-f1150835c3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:34:56.812569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7fa23-b85d-472f-87d7-f1150835c3cf service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:34:56.825265 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3492/7066] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:34:56 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:06.746597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:06.748064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:06.832323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116b780-9232-47a7-ada6-db175b6eb11d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:06.837406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:06.838051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:06.838331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:06.838603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:06.840400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:06.854798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:06.856500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:06.869478 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3575/7067] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:07.421364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5db8-a47a-4218-8e39-9e3fa7ff4faa None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:07.421855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5db8-a47a-4218-8e39-9e3fa7ff4faa None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:07.421985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5db8-a47a-4218-8e39-9e3fa7ff4faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:07.440289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0fac5db8-a47a-4218-8e39-9e3fa7ff4faa None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:07.441758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0fac5db8-a47a-4218-8e39-9e3fa7ff4faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:07.503965 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3493/7068] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 21:35:07 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:07.552479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:07.559484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:07.663959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc73b-ed49-42b8-b42b-5e165a75b512 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:07.669105 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9af4c2-e0c1-47b8-bd1d-8969dea2aea1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:07.669751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9af4c2-e0c1-47b8-bd1d-8969dea2aea1 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:07.670036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9af4c2-e0c1-47b8-bd1d-8969dea2aea1 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:07.670305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9af4c2-e0c1-47b8-bd1d-8969dea2aea1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:07.679162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9af4c2-e0c1-47b8-bd1d-8969dea2aea1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:07.680812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9af4c2-e0c1-47b8-bd1d-8969dea2aea1 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:07.689485 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3576/7069] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 21:35:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 21:35:11.354489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac5db8-a47a-4218-8e39-9e3fa7ff4faa None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:11.447344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac5db8-a47a-4218-8e39-9e3fa7ff4faa None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:11.455432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:11.457172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:11.459141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:11.459549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] PATH_INFO: `/v3/users/a6b53d14dd95494288f4a312be7cf038` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:11.461486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b53d14dd95494288f4a312be7cf038)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:11.463685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:11.724021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b53d14dd95494288f4a312be7cf038'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:11.731270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b53d14dd95494288f4a312be7cf038'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:11.743863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b53d14dd95494288f4a312be7cf038'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:11.744640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b53d14dd95494288f4a312be7cf038'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:11.745252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b53d14dd95494288f4a312be7cf038'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:11.854516 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3494/7070] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:11 2021] DELETE /identity/v3/users/a6b53d14dd95494288f4a312be7cf038 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:11.859257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:11.859804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:11.861820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:11.880662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:11.881977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:11.974889 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3577/7071] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:11.982430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:11.983883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:12.048952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c003b1d-d3ce-4d53-b17b-95e00238b2fb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:12.052786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12db88-ec8f-4619-82cf-723918fdba8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:12.053404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12db88-ec8f-4619-82cf-723918fdba8c service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.053692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12db88-ec8f-4619-82cf-723918fdba8c service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.053970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12db88-ec8f-4619-82cf-723918fdba8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.063460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12db88-ec8f-4619-82cf-723918fdba8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:12.065633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12db88-ec8f-4619-82cf-723918fdba8c service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:12.074955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3495/7072] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:12.296238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:12.297794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:12.311334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a6429-a05f-4baa-a308-3134a8d47ca9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:12.316225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:12.318060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.318351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.318604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] PATH_INFO: `/v3/projects/fc472bb54bf742e6b51376c1e8d4f228` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.319807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc472bb54bf742e6b51376c1e8d4f228)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:12.322283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:12.439223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc472bb54bf742e6b51376c1e8d4f228', 'request_id': 'req-ac984660-0ea2-4e0d-a020-7e096db9fc6a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:12.494324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc472bb54bf742e6b51376c1e8d4f228', 'request_id': 'req-ac984660-0ea2-4e0d-a020-7e096db9fc6a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:12.501072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc472bb54bf742e6b51376c1e8d4f228', 'request_id': 'req-ac984660-0ea2-4e0d-a020-7e096db9fc6a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:12.511365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] The token cache is being invalidate because project fc472bb54bf742e6b51376c1e8d4f228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:12.511650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:12.512268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ac984660-0ea2-4e0d-a020-7e096db9fc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:12.513831 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3578/7073] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:12 2021] DELETE /identity/v3/projects/fc472bb54bf742e6b51376c1e8d4f228 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:12.519903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f998b-7db9-4e68-8990-fc7fe575df51 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.520437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f998b-7db9-4e68-8990-fc7fe575df51 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.520547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f998b-7db9-4e68-8990-fc7fe575df51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.541149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fa7f998b-7db9-4e68-8990-fc7fe575df51 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:12.542386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fa7f998b-7db9-4e68-8990-fc7fe575df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:12.601025 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3496/7074] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:12.608663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e7e6-7980-49c8-9235-229e23667874 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.608983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e7e6-7980-49c8-9235-229e23667874 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.609266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061e7e6-7980-49c8-9235-229e23667874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.628310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0061e7e6-7980-49c8-9235-229e23667874 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:12.629575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0061e7e6-7980-49c8-9235-229e23667874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:12.638030 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3579/7075] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:12.642717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f998b-7db9-4e68-8990-fc7fe575df51 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:12.652553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f998b-7db9-4e68-8990-fc7fe575df51 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:12.657382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:12.658650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.658933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.659211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.659940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:12.660252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:12.661894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:12.673400 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3497/7076] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:12.677676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061e7e6-7980-49c8-9235-229e23667874 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:12.687478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061e7e6-7980-49c8-9235-229e23667874 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:12.692193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:12.692846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.697271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.697271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.697271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:12.697271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:12.788133 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3580/7077] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:12 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:12.791975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:12.801957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c331a-46c5-4a6b-8da9-047d32725226 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:12.857078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:12.857661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.857940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.858215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.859629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:12.861166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:12.963526 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3498/7078] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:12 2021] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:12.968349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:12.979464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b083-70cf-4c47-b8a5-321eaef0af09 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:12.984099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:12.984753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:12.985068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:12.985343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:12.986150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:12.987713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:12.998135 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3581/7079] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:13.002685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:13.013289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811a10d-6a96-4383-beb5-3911084a924d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:13.018876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c26a7e-bf83-4e9f-8088-6f70daba712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:13.019794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c26a7e-bf83-4e9f-8088-6f70daba712c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:13.020238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c26a7e-bf83-4e9f-8088-6f70daba712c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:13.020525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c26a7e-bf83-4e9f-8088-6f70daba712c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:13.021310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c26a7e-bf83-4e9f-8088-6f70daba712c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:13.023086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c26a7e-bf83-4e9f-8088-6f70daba712c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:13.033957 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3499/7080] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:13.038525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:13.048413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72d8df-55c6-4725-8fd0-cbcb33e32bcd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:13.054717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:13.055613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:13.055897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:13.056195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] PATH_INFO: `/v3/projects/a3a4aa5a23794c159555b6bf41f0f7f9/users/c5705508f222489ebda8a6669f4418fc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:13.073285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a4aa5a23794c159555b6bf41f0f7f9, user_id=c5705508f222489ebda8a6669f4418fc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:13.076423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:13.157454 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3582/7081] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:13 2021] PUT /identity/v3/projects/a3a4aa5a23794c159555b6bf41f0f7f9/users/c5705508f222489ebda8a6669f4418fc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:13.167923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6894a-29f1-4e7d-b635-fc69c131fe98 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:13.168245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6894a-29f1-4e7d-b635-fc69c131fe98 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:13.168527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6894a-29f1-4e7d-b635-fc69c131fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:13.194575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d7f6894a-29f1-4e7d-b635-fc69c131fe98 None None] MFA Rules not processed for user `c5705508f222489ebda8a6669f4418fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:13.195805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d7f6894a-29f1-4e7d-b635-fc69c131fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:13.258078 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3500/7082] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:13 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:13.269566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:13.271255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:13.329038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059b3a2-a4d5-401e-9344-bab1377bffa0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:13.333345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46036a53-6bba-42c8-845a-be833187cf22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:13.333980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036a53-6bba-42c8-845a-be833187cf22 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:13.334269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036a53-6bba-42c8-845a-be833187cf22 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:13.334546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036a53-6bba-42c8-845a-be833187cf22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:13.342756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46036a53-6bba-42c8-845a-be833187cf22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:13.344181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46036a53-6bba-42c8-845a-be833187cf22 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:13.352967 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3583/7083] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:13 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:13.367560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6894a-29f1-4e7d-b635-fc69c131fe98 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:13.431211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6894a-29f1-4e7d-b635-fc69c131fe98 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:13.435893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:13.436760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:13.437078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:13.437358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] PATH_INFO: `/v3/users/c5705508f222489ebda8a6669f4418fc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:13.438579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5705508f222489ebda8a6669f4418fc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:13.441144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:13.633595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5705508f222489ebda8a6669f4418fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:13.640559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5705508f222489ebda8a6669f4418fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:13.652485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5705508f222489ebda8a6669f4418fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:13.653320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5705508f222489ebda8a6669f4418fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:13.653937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5705508f222489ebda8a6669f4418fc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:13.706114 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3501/7084] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:13 2021] DELETE /identity/v3/users/c5705508f222489ebda8a6669f4418fc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:13.710925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:13.711220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:13.711503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:13.729588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:13.730781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:13.789783 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3584/7085] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:13.800425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:13.801855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:13.859106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203869e0-83fa-40dd-9d51-fdd0c748f662 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:13.863378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de6d4-e916-4e21-8105-d7384b6fcb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:13.864041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de6d4-e916-4e21-8105-d7384b6fcb5e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:13.864299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de6d4-e916-4e21-8105-d7384b6fcb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:13.864602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de6d4-e916-4e21-8105-d7384b6fcb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:13.873918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de6d4-e916-4e21-8105-d7384b6fcb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:13.875339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de6d4-e916-4e21-8105-d7384b6fcb5e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:13.890264 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3502/7086] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:14.309072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:14.314644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:14.326675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66659dbf-fead-4acf-8b02-526bba22e22e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:14.331580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:14.332425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:14.332693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:14.333157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] PATH_INFO: `/v3/projects/a3a4aa5a23794c159555b6bf41f0f7f9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:14.334282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a4aa5a23794c159555b6bf41f0f7f9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:14.336119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:14.472118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a4aa5a23794c159555b6bf41f0f7f9', 'request_id': 'req-7728b9ae-7849-46a3-8dcd-f8a5127f6295'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:14.546394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a4aa5a23794c159555b6bf41f0f7f9', 'request_id': 'req-7728b9ae-7849-46a3-8dcd-f8a5127f6295'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:14.554799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a4aa5a23794c159555b6bf41f0f7f9', 'request_id': 'req-7728b9ae-7849-46a3-8dcd-f8a5127f6295'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:14.565850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] The token cache is being invalidate because project a3a4aa5a23794c159555b6bf41f0f7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:14.566131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:14.566896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7728b9ae-7849-46a3-8dcd-f8a5127f6295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:14.568578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3585/7087] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:14 2021] DELETE /identity/v3/projects/a3a4aa5a23794c159555b6bf41f0f7f9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:14.574150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec5d8-0546-4363-bad4-483599ffd49e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:14.574440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec5d8-0546-4363-bad4-483599ffd49e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:14.574719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ec5d8-0546-4363-bad4-483599ffd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:14.593104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a18ec5d8-0546-4363-bad4-483599ffd49e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:14.594332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a18ec5d8-0546-4363-bad4-483599ffd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:14.658292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3503/7088] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:14.667514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43760-9a02-4799-9c21-c034f1366b60 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:14.667865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43760-9a02-4799-9c21-c034f1366b60 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:14.668222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43760-9a02-4799-9c21-c034f1366b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:14.687451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-64e43760-9a02-4799-9c21-c034f1366b60 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:14.688638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-64e43760-9a02-4799-9c21-c034f1366b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:14.697633 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3586/7089] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:14.701965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec5d8-0546-4363-bad4-483599ffd49e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:14.712191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ec5d8-0546-4363-bad4-483599ffd49e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:14.716960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:14.717613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:14.717897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:14.718176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:14.718914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:14.719224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:14.721382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:14.734579 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3504/7090] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:14.739923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43760-9a02-4799-9c21-c034f1366b60 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:14.750170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43760-9a02-4799-9c21-c034f1366b60 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:14.755082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:14.755762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:14.756255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:14.756585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:14.757309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:14.759191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:14.861989 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3587/7091] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:14 2021] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:14.862130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:14.869475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9948b26-a4db-4b3b-a8f1-39a90c97ed1b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:14.927108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:14.927770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:14.928059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:14.928330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:14.929095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:14.931023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.037548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.039366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:15.053178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94990-74af-45a4-9d25-93289d5c29ff admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.055422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3505/7092] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:14 2021] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:15.059419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.061383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.062257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.062540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.062876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] PATH_INFO: `/v3/users/3707d8197a4a43e1be6a10b4b3c58004` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.064207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3707d8197a4a43e1be6a10b4b3c58004)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.066167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.073316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36055eb7-7486-4f37-8b96-777ad95c492d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.078804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.079502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.080347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.080785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.081563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.083177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.094503 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3506/7093] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:15 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:15.098968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.108581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf8cf1-de85-4823-a585-449b58a4d243 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.113453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.114102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.114388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.114672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.115386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.117003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.129982 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3507/7094] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:15.134386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.145464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca4127-8e74-46cb-86b4-d1d82ca794e3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.150220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb548a5-9842-49f0-88f0-d3414759327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.151096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb548a5-9842-49f0-88f0-d3414759327b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.151380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb548a5-9842-49f0-88f0-d3414759327b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.151657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb548a5-9842-49f0-88f0-d3414759327b admin admin] PATH_INFO: `/v3/projects/4129751af30b47ed920a9c2fe6286abd/users/96726c1c279f473abf1192f90fcc2636/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.166516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb548a5-9842-49f0-88f0-d3414759327b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4129751af30b47ed920a9c2fe6286abd, user_id=96726c1c279f473abf1192f90fcc2636, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.169177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb548a5-9842-49f0-88f0-d3414759327b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.283249 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3508/7095] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:15 2021] PUT /identity/v3/projects/4129751af30b47ed920a9c2fe6286abd/users/96726c1c279f473abf1192f90fcc2636/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:15.293316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533307-9c19-4ce1-bfc3-df3318cad307 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.293602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533307-9c19-4ce1-bfc3-df3318cad307 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.293876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533307-9c19-4ce1-bfc3-df3318cad307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.321636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2b533307-9c19-4ce1-bfc3-df3318cad307 None None] MFA Rules not processed for user `96726c1c279f473abf1192f90fcc2636`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:15.322921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2b533307-9c19-4ce1-bfc3-df3318cad307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:15.372382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3707d8197a4a43e1be6a10b4b3c58004'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:15.379786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3707d8197a4a43e1be6a10b4b3c58004'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:15.386812 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3509/7096] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:15 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:15.391017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533307-9c19-4ce1-bfc3-df3318cad307 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.393213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3707d8197a4a43e1be6a10b4b3c58004'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:15.393941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3707d8197a4a43e1be6a10b4b3c58004'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:15.453372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533307-9c19-4ce1-bfc3-df3318cad307 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.458696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.459348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.459628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.459907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.460592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.462513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.499110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4f0beda-6c78-4e52-873a-e06a5ade40a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3707d8197a4a43e1be6a10b4b3c58004'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:15.506147 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3588/7097] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:15 2021] DELETE /identity/v3/users/3707d8197a4a43e1be6a10b4b3c58004 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:15.510985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.511301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.511608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.530292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:15.531479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:15.558477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3510/7098] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:15 2021] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:15.562290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.563909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:15.592420 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3589/7099] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:15.603198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.604570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:15.630118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487ba75-e1c6-4832-86b8-70acf066d8c4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.634883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.635549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.636141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.636395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.637118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.639090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.664586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252790f-2bd6-4a24-912a-7c3a81e10ce3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.712138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.712781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.713086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.713359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.722285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.723701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.733066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3590/7100] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:15.750948 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3511/7101] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:15 2021] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:15.753446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.763639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6000-529f-445a-b426-e0fe4c1444cc service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.768417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.769126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.769438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.769718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.770481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.772099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.785928 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3591/7102] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:15.787298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.797575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1960b1-2405-44c9-885c-9147176e954e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.802775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.803658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.803936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.804211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] PATH_INFO: `/v3/projects/59840ba6b6a34d8db2a48b0b0de81726/users/272cae7c81524e21a9514ac28040c467/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.824844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59840ba6b6a34d8db2a48b0b0de81726, user_id=272cae7c81524e21a9514ac28040c467, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:15.827520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:15.917874 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3512/7103] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:15 2021] PUT /identity/v3/projects/59840ba6b6a34d8db2a48b0b0de81726/users/272cae7c81524e21a9514ac28040c467/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:15.921893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:15.932656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e697-b7a8-4686-8ba8-6e99ece417ef admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:15.996703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39445d-2276-47ce-80e5-65428fb975b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:15.997401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39445d-2276-47ce-80e5-65428fb975b7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:15.997683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39445d-2276-47ce-80e5-65428fb975b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:15.997954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39445d-2276-47ce-80e5-65428fb975b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:15.998680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39445d-2276-47ce-80e5-65428fb975b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.000416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39445d-2276-47ce-80e5-65428fb975b7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:16.011431 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3592/7104] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:15 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:16.015726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:16.026605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d17e2-6095-420c-af95-1d48735b712e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:16.031366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:16.032241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.032514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.033414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] PATH_INFO: `/v3/projects/59840ba6b6a34d8db2a48b0b0de81726/users/272cae7c81524e21a9514ac28040c467/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.035415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59840ba6b6a34d8db2a48b0b0de81726, user_id=272cae7c81524e21a9514ac28040c467, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.038170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:16.049635 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3513/7105] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:16 2021] PUT /identity/v3/projects/59840ba6b6a34d8db2a48b0b0de81726/users/272cae7c81524e21a9514ac28040c467/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:16.059703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.059988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.060262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.087136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] MFA Rules not processed for user `272cae7c81524e21a9514ac28040c467`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:16.088349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:16.157351 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3593/7106] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:16 2021] POST /identity/v3/auth/tokens => generated 3295 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:16.162017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:16.163869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:16.175441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:16.176864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:16.234727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4ded-b6df-4a63-9871-1fb61894adb3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:16.240125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241705-aa69-47d7-b3dc-18519607365a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:16.242040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:16.242540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.242833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.243115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] PATH_INFO: `/v3/projects/14f47a8e0d5f4e858f4f0ddf0fb5f347` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.244353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f47a8e0d5f4e858f4f0ddf0fb5f347)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.246098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910de7b-09b9-4271-9039-93f00af09c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:16.246308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:16.247093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910de7b-09b9-4271-9039-93f00af09c56 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.247378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910de7b-09b9-4271-9039-93f00af09c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.247651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910de7b-09b9-4271-9039-93f00af09c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.259288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910de7b-09b9-4271-9039-93f00af09c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.261084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910de7b-09b9-4271-9039-93f00af09c56 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:16.280218 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3594/7107] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:16 2021] GET /identity/v3/auth/tokens => generated 3295 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:16.391427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f47a8e0d5f4e858f4f0ddf0fb5f347', 'request_id': 'req-a7073e21-a573-4104-92e4-217236982ff7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:16.397959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f47a8e0d5f4e858f4f0ddf0fb5f347', 'request_id': 'req-a7073e21-a573-4104-92e4-217236982ff7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:16.517759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f47a8e0d5f4e858f4f0ddf0fb5f347', 'request_id': 'req-a7073e21-a573-4104-92e4-217236982ff7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:16.528379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] The token cache is being invalidate because project 14f47a8e0d5f4e858f4f0ddf0fb5f347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:16.528671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:16.529333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:16.530884 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3514/7108] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:16 2021] DELETE /identity/v3/projects/14f47a8e0d5f4e858f4f0ddf0fb5f347 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:16.537122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bb23-2894-48e3-a7ca-59e6520c426f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.537627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bb23-2894-48e3-a7ca-59e6520c426f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.537732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bb23-2894-48e3-a7ca-59e6520c426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.555982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-30b7bb23-2894-48e3-a7ca-59e6520c426f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:16.559517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-30b7bb23-2894-48e3-a7ca-59e6520c426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:16.586110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:16.588469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:16.624936 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3595/7109] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:16.628647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30ccc-cf5f-4fb4-87e2-58ab98a587c7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.628959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30ccc-cf5f-4fb4-87e2-58ab98a587c7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.629242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30ccc-cf5f-4fb4-87e2-58ab98a587c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.648042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e0f30ccc-cf5f-4fb4-87e2-58ab98a587c7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:16.649313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e0f30ccc-cf5f-4fb4-87e2-58ab98a587c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:16.652149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073e21-a573-4104-92e4-217236982ff7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:16.655822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:16.657130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.657412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.657729 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3596/7110] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:16.657871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.660233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:16.663137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30ccc-cf5f-4fb4-87e2-58ab98a587c7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:16.672837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30ccc-cf5f-4fb4-87e2-58ab98a587c7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:16.677614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:16.681393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.681393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.681393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.681393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:16.681393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.681870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:16.692995 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3597/7111] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:35:16.697160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:16.707843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2423e-cc8e-4bd8-bc7d-d9dc09118664 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:16.712685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:16.713404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.713636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.713913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.714625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.716618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:16.722384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.723806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:16.733929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3515/7112] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:16 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:16.844335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3598/7113] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:16 2021] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:16.848503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:16.859588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5feed-6ff7-4652-836e-e5182a59a143 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:16.916402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:16.917110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:16.917394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:16.917671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:16.918373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:16.920272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:17.014101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3516/7114] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:16 2021] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:17.018764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:17.028934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a308-4b33-4ec0-bbf5-b9f838e5b883 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:17.033508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:17.034149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:17.034430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:17.034709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:17.035566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:17.038356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:17.052396 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3599/7115] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:17 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:17.053802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:17.065810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61829-4a28-43d6-99c1-f80f7e915414 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:17.072841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34bdae-2656-4d60-868f-9429e971727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:17.073561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bdae-2656-4d60-868f-9429e971727f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:17.073849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bdae-2656-4d60-868f-9429e971727f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:17.074723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bdae-2656-4d60-868f-9429e971727f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:17.074888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34bdae-2656-4d60-868f-9429e971727f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:17.076495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34bdae-2656-4d60-868f-9429e971727f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:17.087600 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3517/7116] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:17.091970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:17.102064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574ee04-802e-4e2e-b077-b997eb17c9e0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:17.106881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:17.107763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:17.108044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:17.108319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] PATH_INFO: `/v3/projects/609b19a4efc34c8fa016adb3a5fdb23b/users/322d719e1dbd4014b58f2f7ed9641f2f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:17.123899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609b19a4efc34c8fa016adb3a5fdb23b, user_id=322d719e1dbd4014b58f2f7ed9641f2f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:17.126631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:17.237583 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3600/7117] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:17 2021] PUT /identity/v3/projects/609b19a4efc34c8fa016adb3a5fdb23b/users/322d719e1dbd4014b58f2f7ed9641f2f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:17.248385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:17.248679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:17.248996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:17.276731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] MFA Rules not processed for user `322d719e1dbd4014b58f2f7ed9641f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:17.280589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:17.342972 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3518/7118] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:17 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:17.438857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:17.503853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6e065-3f2f-406e-a7dc-1592efa3c062 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:17.507971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f91c-3162-4961-a4eb-0a346d394dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:17.508610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f91c-3162-4961-a4eb-0a346d394dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:17.508926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f91c-3162-4961-a4eb-0a346d394dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:17.509256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f91c-3162-4961-a4eb-0a346d394dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:17.520680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f91c-3162-4961-a4eb-0a346d394dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:17.522467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f91c-3162-4961-a4eb-0a346d394dc4 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:17.535726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3601/7119] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:17 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:21.442979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:21.444356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:21.521054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370994a6-83c4-45b5-8400-0e6155450620 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:21.525985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:21.526889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:21.527167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:21.527439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] PATH_INFO: `/v3/users/3a838ec078394a5cba918617920febff` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:21.528637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a838ec078394a5cba918617920febff)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:21.530570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:21.777335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a838ec078394a5cba918617920febff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:21.784048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a838ec078394a5cba918617920febff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:21.795935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a838ec078394a5cba918617920febff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:21.796603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a838ec078394a5cba918617920febff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:21.797224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a838ec078394a5cba918617920febff'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:21.877315 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3519/7120] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:21 2021] DELETE /identity/v3/users/3a838ec078394a5cba918617920febff => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:21.881864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8427-98ce-454b-918f-662861c916a5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:21.882404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8427-98ce-454b-918f-662861c916a5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:21.882404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8427-98ce-454b-918f-662861c916a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:21.900200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-638b8427-98ce-454b-918f-662861c916a5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:21.901410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-638b8427-98ce-454b-918f-662861c916a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:21.966723 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3602/7121] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:21.977248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:21.978822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:22.045364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a97de-35fa-4772-a5cc-f000ed790766 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:22.049076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:22.049744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:22.050048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:22.050319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:22.059343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:22.060812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:22.071173 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3520/7122] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:22.451759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8427-98ce-454b-918f-662861c916a5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:22.453499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-638b8427-98ce-454b-918f-662861c916a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:22.465894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8427-98ce-454b-918f-662861c916a5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:22.471026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:22.474207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:22.474207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:22.474207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] PATH_INFO: `/v3/users/96726c1c279f473abf1192f90fcc2636` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:22.474207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] RBAC: Authorizing `identity:delete_user(user_id=96726c1c279f473abf1192f90fcc2636)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:22.476091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:22.501812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:22.504085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:22.521563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea8e07-0977-4d8f-a950-c4ee61f3ae34 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:22.526797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:22.527672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:22.527948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:22.528439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] PATH_INFO: `/v3/projects/758f44503e1c41dc9aecca962e0c75f6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:22.529586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758f44503e1c41dc9aecca962e0c75f6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:22.531467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:22.731324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758f44503e1c41dc9aecca962e0c75f6', 'request_id': 'req-8107e6c5-79e6-4439-873c-e045edd4bd69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.735737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96726c1c279f473abf1192f90fcc2636'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.742293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758f44503e1c41dc9aecca962e0c75f6', 'request_id': 'req-8107e6c5-79e6-4439-873c-e045edd4bd69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.745309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96726c1c279f473abf1192f90fcc2636'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.759445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96726c1c279f473abf1192f90fcc2636'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.760275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96726c1c279f473abf1192f90fcc2636'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.872007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758f44503e1c41dc9aecca962e0c75f6', 'request_id': 'req-8107e6c5-79e6-4439-873c-e045edd4bd69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.901865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] The token cache is being invalidate because project 758f44503e1c41dc9aecca962e0c75f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:22.902145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.903859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:22.921444 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3521/7123] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:22 2021] DELETE /identity/v3/projects/758f44503e1c41dc9aecca962e0c75f6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:22.921444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:22.921444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:22.999036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-91292ef2-4cc5-4f25-8780-8aa286d3856a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96726c1c279f473abf1192f90fcc2636'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:23.000402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e6c5-79e6-4439-873c-e045edd4bd69 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:23.005734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:23.006864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:23.007226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:23.007576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] PATH_INFO: `/v3/users/52233d3e7d064c6e9ba87283f4a0eb7b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:23.007943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3603/7124] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:22 2021] DELETE /identity/v3/users/96726c1c279f473abf1192f90fcc2636 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:23.009180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52233d3e7d064c6e9ba87283f4a0eb7b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:23.011310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:23.012918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:23.013211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:23.013681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:23.045689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:23.047906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:23.115328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3604/7125] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:23.125080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:23.127551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:23.185442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f207376-8510-4a33-932c-02b4bbcea689 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:23.189963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:23.194412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:23.194412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:23.194412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:23.203586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:23.205115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:23.216160 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3605/7126] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:23.268095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52233d3e7d064c6e9ba87283f4a0eb7b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:23.275499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52233d3e7d064c6e9ba87283f4a0eb7b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:23.293982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52233d3e7d064c6e9ba87283f4a0eb7b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:23.294988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52233d3e7d064c6e9ba87283f4a0eb7b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:23.295797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52233d3e7d064c6e9ba87283f4a0eb7b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:23.394306 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3522/7127] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:22 2021] DELETE /identity/v3/users/52233d3e7d064c6e9ba87283f4a0eb7b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:23.763241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:23.765528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:23.779302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1aeb3-7f07-46a4-b58f-cf1b0224d95e service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:23.844609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:23.845587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:23.846037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:23.846390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] PATH_INFO: `/v3/projects/4129751af30b47ed920a9c2fe6286abd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:23.847757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4129751af30b47ed920a9c2fe6286abd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:23.849813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:23.931086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:23.933215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:23.950159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e608d21-d79d-4659-9b28-c0eab9f1a33f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:23.956345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:23.957348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:23.957596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:23.957885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] PATH_INFO: `/v3/projects/30c46ac2ae5b47ed9025da4c12ac0d41` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:23.959186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c46ac2ae5b47ed9025da4c12ac0d41)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:23.961047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:23.989257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4129751af30b47ed920a9c2fe6286abd', 'request_id': 'req-af7c10c1-57ee-49b0-a657-97f04642bd07'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.091216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c46ac2ae5b47ed9025da4c12ac0d41', 'request_id': 'req-dde0652f-2788-49a0-9f9d-e81521645924'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.097343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c46ac2ae5b47ed9025da4c12ac0d41', 'request_id': 'req-dde0652f-2788-49a0-9f9d-e81521645924'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.099200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4129751af30b47ed920a9c2fe6286abd', 'request_id': 'req-af7c10c1-57ee-49b0-a657-97f04642bd07'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.105998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4129751af30b47ed920a9c2fe6286abd', 'request_id': 'req-af7c10c1-57ee-49b0-a657-97f04642bd07'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.116459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] The token cache is being invalidate because project 4129751af30b47ed920a9c2fe6286abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:24.116735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.117398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.118912 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3606/7128] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:23 2021] DELETE /identity/v3/projects/4129751af30b47ed920a9c2fe6286abd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:24.125837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:24.127112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:24.185776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c46ac2ae5b47ed9025da4c12ac0d41', 'request_id': 'req-dde0652f-2788-49a0-9f9d-e81521645924'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.188257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c10c1-57ee-49b0-a657-97f04642bd07 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:24.197485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] The token cache is being invalidate because project 30c46ac2ae5b47ed9025da4c12ac0d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:24.197779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.198405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-dde0652f-2788-49a0-9f9d-e81521645924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.200160 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3523/7129] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:23 2021] DELETE /identity/v3/projects/30c46ac2ae5b47ed9025da4c12ac0d41 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:24.205795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12568-1346-44bc-bfc5-fecdda9a6f7b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.206182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12568-1346-44bc-bfc5-fecdda9a6f7b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.206466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12568-1346-44bc-bfc5-fecdda9a6f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.230340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05b12568-1346-44bc-bfc5-fecdda9a6f7b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:24.233978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05b12568-1346-44bc-bfc5-fecdda9a6f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:24.248707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:24.250259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.250546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.250829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] PATH_INFO: `/v3/users/272cae7c81524e21a9514ac28040c467` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.252107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=272cae7c81524e21a9514ac28040c467)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:24.254069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:24.296740 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3524/7130] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:24.305281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b718-7ec5-4521-8f46-461d6ca65f65 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.306827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b718-7ec5-4521-8f46-461d6ca65f65 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.306827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b718-7ec5-4521-8f46-461d6ca65f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.323313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b2f7b718-7ec5-4521-8f46-461d6ca65f65 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:24.324484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b2f7b718-7ec5-4521-8f46-461d6ca65f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:24.333272 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3525/7131] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:24.337319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7b718-7ec5-4521-8f46-461d6ca65f65 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:24.346050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7b718-7ec5-4521-8f46-461d6ca65f65 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:24.352272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:24.353121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.353550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.353828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.357439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:24.357439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:24.357439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:24.370776 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3526/7132] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:35:24.374608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:24.385069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024e7e-1687-4793-9e1f-71a7f3424a45 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:24.390451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:24.391181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.391488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.391732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.392451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:24.394361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:24.444494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272cae7c81524e21a9514ac28040c467'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.451244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272cae7c81524e21a9514ac28040c467'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.468514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272cae7c81524e21a9514ac28040c467'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.469306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272cae7c81524e21a9514ac28040c467'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.537472 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3527/7133] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:24 2021] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:24.541455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:24.574790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272cae7c81524e21a9514ac28040c467'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:24.583284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3607/7134] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:24 2021] DELETE /identity/v3/users/272cae7c81524e21a9514ac28040c467 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:24.640187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86756-14e0-41f8-88e1-a5618483a44b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:24.715576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:24.716255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.716538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.716833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.717542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:24.719440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:24.810422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3528/7135] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:24 2021] POST /identity/v3/users => generated 296 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:24.814416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:24.816321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:24.829559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f867e-c90b-4180-8a53-81592073ed4f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:24.835055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:24.835836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.836264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.836601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.837442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:24.839096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:24.850719 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3608/7136] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:24 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:24.854838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:24.868664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614efb1e-d510-4c53-ae2e-d6af30b05c87 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:24.873403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c713-aaf5-4833-9835-729afa1111dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:24.874082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c713-aaf5-4833-9835-729afa1111dc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.874362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c713-aaf5-4833-9835-729afa1111dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.874634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c713-aaf5-4833-9835-729afa1111dc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.875359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34c713-aaf5-4833-9835-729afa1111dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:24.877487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34c713-aaf5-4833-9835-729afa1111dc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:24.896471 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3529/7137] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:24 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:24.898195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:24.915090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357205e-d1f5-4374-8373-3b40362eda39 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:24.919887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:24.922108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:24.925972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:24.925972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] PATH_INFO: `/v3/projects/1bc56591137b41fb994355d22d888d0e/users/20d2b0754f0a480f87c5fd59ffb453a2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:24.943833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc56591137b41fb994355d22d888d0e, user_id=20d2b0754f0a480f87c5fd59ffb453a2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:24.946561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.086722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7886b0-bbbb-4a59-9ffe-a00661dde42a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.087247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7886b0-bbbb-4a59-9ffe-a00661dde42a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.087372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7886b0-bbbb-4a59-9ffe-a00661dde42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.097124 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3609/7138] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:24 2021] PUT /identity/v3/projects/1bc56591137b41fb994355d22d888d0e/users/20d2b0754f0a480f87c5fd59ffb453a2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:25.098102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.106924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:25.132150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2c7886b0-bbbb-4a59-9ffe-a00661dde42a None None] MFA Rules not processed for user `171c198b6b734cd698b3c1eaf76a0234`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:25.133602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2c7886b0-bbbb-4a59-9ffe-a00661dde42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:25.186817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f611f0-4833-4094-9a46-a84934a8768c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.193614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.194493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.194774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.195064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] PATH_INFO: `/v3/projects/59840ba6b6a34d8db2a48b0b0de81726` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.197176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59840ba6b6a34d8db2a48b0b0de81726)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.199843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.210636 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3530/7139] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:25.215069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a0803-a510-4b77-8861-1d6b925a3fcc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.215069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a0803-a510-4b77-8861-1d6b925a3fcc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.215069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a0803-a510-4b77-8861-1d6b925a3fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.240660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-450a0803-a510-4b77-8861-1d6b925a3fcc None None] MFA Rules not processed for user `20d2b0754f0a480f87c5fd59ffb453a2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:25.241909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-450a0803-a510-4b77-8861-1d6b925a3fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:25.320351 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3531/7140] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:25.324688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a0803-a510-4b77-8861-1d6b925a3fcc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.335134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a0803-a510-4b77-8861-1d6b925a3fcc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.339888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.340543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.340827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.343597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.343597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.343810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.359468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59840ba6b6a34d8db2a48b0b0de81726', 'request_id': 'req-ce7b06e0-9a93-4eba-8feb-a72cff439f30'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:25.448657 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3532/7141] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:25.449034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59840ba6b6a34d8db2a48b0b0de81726', 'request_id': 'req-ce7b06e0-9a93-4eba-8feb-a72cff439f30'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:25.449932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.456498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59840ba6b6a34d8db2a48b0b0de81726', 'request_id': 'req-ce7b06e0-9a93-4eba-8feb-a72cff439f30'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:25.467496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] The token cache is being invalidate because project 59840ba6b6a34d8db2a48b0b0de81726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:25.467987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:25.468832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ce7b06e0-9a93-4eba-8feb-a72cff439f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:25.470427 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3610/7142] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:25 2021] DELETE /identity/v3/projects/59840ba6b6a34d8db2a48b0b0de81726 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:25.478483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cda00f-a5a1-41b0-8c39-c5ea638e6091 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.492471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cda00f-a5a1-41b0-8c39-c5ea638e6091 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.492471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cda00f-a5a1-41b0-8c39-c5ea638e6091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.499047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c8cda00f-a5a1-41b0-8c39-c5ea638e6091 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:25.500266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8cda00f-a5a1-41b0-8c39-c5ea638e6091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:25.522331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06d9e-2a08-4d6d-812d-03b55f077204 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.527801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.528484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.528946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.529239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.531510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.531880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.562687 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3611/7143] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:25.572169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8cc44-22c1-4a71-a89c-c7380fafd0f0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.572457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8cc44-22c1-4a71-a89c-c7380fafd0f0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.572747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8cc44-22c1-4a71-a89c-c7380fafd0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.594686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6bc8cc44-22c1-4a71-a89c-c7380fafd0f0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:25.595936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6bc8cc44-22c1-4a71-a89c-c7380fafd0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:25.604609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3612/7144] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:25.608646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8cc44-22c1-4a71-a89c-c7380fafd0f0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.619114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8cc44-22c1-4a71-a89c-c7380fafd0f0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.624657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.631235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.631235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.631235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.631235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:25.631235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.631235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.638968 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3533/7145] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:25.642237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.644803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:25.650895 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3613/7146] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:35:25.651854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.662805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea3212-1e4f-41a3-bca7-e3c3b2b74e94 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.669568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.670371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.670617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115f61e-a3b2-4f3a-889d-99fb248bd8ae admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.670792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.671215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.671939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.674599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.686986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.687166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.687456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.687771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.688556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.690190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.703448 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3534/7147] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:25 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:25.707533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.717425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5228cc-7fd3-45f4-9c5d-320f4f1cb55a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.722170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.723566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.723843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.724114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] PATH_INFO: `/v3/projects/26fe8a2707834a54b9eb09e48cec709c/users/684b24a3b5ee45ffa63f11ca9c123f58/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.740096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fe8a2707834a54b9eb09e48cec709c, user_id=684b24a3b5ee45ffa63f11ca9c123f58, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.742902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.794672 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3614/7148] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:25.798700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.866986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc17a3-c658-4f70-8cf6-1ac9794218e6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.873139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.873808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.874087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.874366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.875086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.877202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.890724 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3535/7149] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:25 2021] PUT /identity/v3/projects/26fe8a2707834a54b9eb09e48cec709c/users/684b24a3b5ee45ffa63f11ca9c123f58/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:25.894692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:25.969555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7edc-83ef-4bd9-9f6e-9741452e96a6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:25.975526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:25.975672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:25.975929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:25.976208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:25.976966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:25.978684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:25.989739 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3536/7150] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:25 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:25.995695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.004429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a018a-32b3-472e-ac50-4c917ec39946 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.009104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815747c0-0edb-4488-8410-86413ba86cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.009976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815747c0-0edb-4488-8410-86413ba86cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.010258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815747c0-0edb-4488-8410-86413ba86cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.010532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815747c0-0edb-4488-8410-86413ba86cb7 admin admin] PATH_INFO: `/v3/projects/26fe8a2707834a54b9eb09e48cec709c/users/684b24a3b5ee45ffa63f11ca9c123f58/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.012794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815747c0-0edb-4488-8410-86413ba86cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fe8a2707834a54b9eb09e48cec709c, user_id=684b24a3b5ee45ffa63f11ca9c123f58, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.016560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815747c0-0edb-4488-8410-86413ba86cb7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.021146 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3615/7151] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:25 2021] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:26.025185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.027082 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3537/7152] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:25 2021] PUT /identity/v3/projects/26fe8a2707834a54b9eb09e48cec709c/users/684b24a3b5ee45ffa63f11ca9c123f58/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:26.035273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686509f-d9c4-4828-9bef-c9552e878c17 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.038055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.041422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.041422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.068113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] MFA Rules not processed for user `684b24a3b5ee45ffa63f11ca9c123f58`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:26.069498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:26.098615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.099627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.100086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.100540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.101493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.103129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.116698 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3616/7153] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:26 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:26.121938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.128394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3ec76-6eaa-4c13-8d28-4306aaae66bc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.133396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.134055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.134339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.134614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.135337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.137235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.141788 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3538/7154] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:26 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:26.149068 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3617/7155] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:26.152186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.153534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.153702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:26.165606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf742c57-f839-41c5-9fa1-3f9a9def01c6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.170588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ada6-b6d4-4807-8231-64ce72b8b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.171440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ada6-b6d4-4807-8231-64ce72b8b30b admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.171631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ada6-b6d4-4807-8231-64ce72b8b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.171910 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ada6-b6d4-4807-8231-64ce72b8b30b admin admin] PATH_INFO: `/v3/projects/a9646d83b7ab4472bbb04340bdcd7b8e/users/22f0a7782d8145fd8e0baaf79e5380f6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.188802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33ada6-b6d4-4807-8231-64ce72b8b30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9646d83b7ab4472bbb04340bdcd7b8e, user_id=22f0a7782d8145fd8e0baaf79e5380f6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.190651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33ada6-b6d4-4807-8231-64ce72b8b30b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.224232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2c8bc-a965-48da-85d3-cb6abd13a18e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.228770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.230076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.230076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.230076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.239511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.240998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.253180 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3539/7156] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:26 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:26.306634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.308106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:26.322041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecd4f7-4121-4c8a-a2fc-ce448bf44517 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.324479 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3618/7157] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:26 2021] PUT /identity/v3/projects/a9646d83b7ab4472bbb04340bdcd7b8e/users/22f0a7782d8145fd8e0baaf79e5380f6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:26.335436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0aaa5-59de-4a50-afc6-d13367b84136 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.335806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0aaa5-59de-4a50-afc6-d13367b84136 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.336156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0aaa5-59de-4a50-afc6-d13367b84136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.365891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-28c0aaa5-59de-4a50-afc6-d13367b84136 None None] MFA Rules not processed for user `22f0a7782d8145fd8e0baaf79e5380f6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:26.367144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-28c0aaa5-59de-4a50-afc6-d13367b84136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:26.377495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.378161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.378446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.378718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.380633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:26.438135 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3619/7158] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:26 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:26.442961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0aaa5-59de-4a50-afc6-d13367b84136 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.456281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.458562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.467864 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3540/7159] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:26 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:26.512149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0aaa5-59de-4a50-afc6-d13367b84136 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.518420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.519095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.519376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.519652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.520943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.523107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.690291 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3620/7160] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:26 2021] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:26.695365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.706890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732c23a-12d8-48e1-a1c1-f3d31e21d070 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.771666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.772371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.772651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.772958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.774051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.775610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:26.884219 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3541/7161] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:26 2021] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:26.887832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:26.898594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84930f7a-56e3-4586-97f5-b39c2cb697f3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:26.903403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:26.904172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:26.932863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:26.932863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:26.932863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:26.932863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:27.062910 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3621/7162] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:26 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:27.072147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:27.082500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d481449-4447-4f2d-b8db-e89dd03355f1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:27.087153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:27.088044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:27.088326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:27.088604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] PATH_INFO: `/v3/projects/1c6c05dc76664cae8afb7d51403eaead/users/64732b629a8c459e9b97344944c0db1d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:27.103833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c05dc76664cae8afb7d51403eaead, user_id=64732b629a8c459e9b97344944c0db1d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:27.106691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:27.202229 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3542/7163] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:27 2021] PUT /identity/v3/projects/1c6c05dc76664cae8afb7d51403eaead/users/64732b629a8c459e9b97344944c0db1d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:27.203515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:27.226288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf9a9-202a-4704-8f0f-1d00a03fb80d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:27.305314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160f790-18b1-4f41-b95a-40d4dc4aebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:27.315869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f790-18b1-4f41-b95a-40d4dc4aebde admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:27.316187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f790-18b1-4f41-b95a-40d4dc4aebde admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:27.316394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f790-18b1-4f41-b95a-40d4dc4aebde admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:27.317359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160f790-18b1-4f41-b95a-40d4dc4aebde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:27.319011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160f790-18b1-4f41-b95a-40d4dc4aebde admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:27.332413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3622/7164] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:27.338523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:27.355799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f7e34-84e5-4293-a321-692dd964a1a8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:27.369986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:27.369986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:27.369986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:27.369986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] PATH_INFO: `/v3/projects/1c6c05dc76664cae8afb7d51403eaead/users/64732b629a8c459e9b97344944c0db1d/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:27.371077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c05dc76664cae8afb7d51403eaead, user_id=64732b629a8c459e9b97344944c0db1d, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:27.374167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:27.394178 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3543/7165] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:27 2021] PUT /identity/v3/projects/1c6c05dc76664cae8afb7d51403eaead/users/64732b629a8c459e9b97344944c0db1d/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:27.405297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde1de5-41ac-46fb-bf76-826c2ffe32fa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:27.405592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde1de5-41ac-46fb-bf76-826c2ffe32fa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:27.405903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde1de5-41ac-46fb-bf76-826c2ffe32fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:27.435412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cdde1de5-41ac-46fb-bf76-826c2ffe32fa None None] MFA Rules not processed for user `64732b629a8c459e9b97344944c0db1d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:27.436689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cdde1de5-41ac-46fb-bf76-826c2ffe32fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:27.504049 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3623/7166] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:27 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:27.514118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:27.571169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3514-b76e-4a2a-b5ad-49b9dd59477a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:27.574773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef6213-7c69-4ea1-8f7a-b956c3ad07ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:27.575435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6213-7c69-4ea1-8f7a-b956c3ad07ff service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:27.575714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6213-7c69-4ea1-8f7a-b956c3ad07ff service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:27.575989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6213-7c69-4ea1-8f7a-b956c3ad07ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:27.587905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef6213-7c69-4ea1-8f7a-b956c3ad07ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:27.589386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef6213-7c69-4ea1-8f7a-b956c3ad07ff service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:27.602757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3544/7167] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:27 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:31.111157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde1de5-41ac-46fb-bf76-826c2ffe32fa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:31.194186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde1de5-41ac-46fb-bf76-826c2ffe32fa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:31.203014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:31.204243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:31.204610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:31.205123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] PATH_INFO: `/v3/users/22f0a7782d8145fd8e0baaf79e5380f6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:31.206874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f0a7782d8145fd8e0baaf79e5380f6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:31.210035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:31.424706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f0a7782d8145fd8e0baaf79e5380f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:31.433693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f0a7782d8145fd8e0baaf79e5380f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:31.450337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f0a7782d8145fd8e0baaf79e5380f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:31.451745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f0a7782d8145fd8e0baaf79e5380f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:31.534710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f0a7782d8145fd8e0baaf79e5380f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:31.543240 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3624/7168] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:31 2021] DELETE /identity/v3/users/22f0a7782d8145fd8e0baaf79e5380f6 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:31.546009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:31.546543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:31.546652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:31.574330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:31.575974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:31.654248 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3545/7169] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:31.664490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:31.665948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:31.730300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f0cdb-86ab-4cdc-a513-1cbd0a5000b3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:31.733982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:31.734646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:31.734913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:31.735191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:31.744812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:31.746280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:31.755735 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3625/7170] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:32.285046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:32.287029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:32.299130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fbb33-8fe0-45c7-8285-03c4d1d8894e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:32.304024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:32.304986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:32.305612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:32.305612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] PATH_INFO: `/v3/projects/a9646d83b7ab4472bbb04340bdcd7b8e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:32.306760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9646d83b7ab4472bbb04340bdcd7b8e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:32.308558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:32.431453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9646d83b7ab4472bbb04340bdcd7b8e', 'request_id': 'req-e9e13af1-9c52-4141-9257-2f49349857a8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.437741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9646d83b7ab4472bbb04340bdcd7b8e', 'request_id': 'req-e9e13af1-9c52-4141-9257-2f49349857a8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.536044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9646d83b7ab4472bbb04340bdcd7b8e', 'request_id': 'req-e9e13af1-9c52-4141-9257-2f49349857a8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.551532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] The token cache is being invalidate because project a9646d83b7ab4472bbb04340bdcd7b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:32.552168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.552445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.554226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3546/7171] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:32 2021] DELETE /identity/v3/projects/a9646d83b7ab4472bbb04340bdcd7b8e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:32.558260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:32.569736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c69cf-cce9-4757-ac54-607cec76071d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:32.629966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:32.630830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:32.631113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:32.631383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] PATH_INFO: `/v3/users/64732b629a8c459e9b97344944c0db1d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:32.632565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64732b629a8c459e9b97344944c0db1d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:32.634505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:32.823918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64732b629a8c459e9b97344944c0db1d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.831483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64732b629a8c459e9b97344944c0db1d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.844180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64732b629a8c459e9b97344944c0db1d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.844952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64732b629a8c459e9b97344944c0db1d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.929725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c888da8c-7b3a-4d63-8f01-2b8f450b7273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64732b629a8c459e9b97344944c0db1d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:32.936277 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3626/7172] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:32 2021] DELETE /identity/v3/users/64732b629a8c459e9b97344944c0db1d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:33.377384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:33.382841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:33.399724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13af1-9c52-4141-9257-2f49349857a8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:33.465271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:33.466181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:33.466468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:33.466748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] PATH_INFO: `/v3/projects/1c6c05dc76664cae8afb7d51403eaead` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:33.467970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6c05dc76664cae8afb7d51403eaead)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:33.469954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:33.585920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6c05dc76664cae8afb7d51403eaead', 'request_id': 'req-853cee84-cd8f-432d-b463-53bcd64fa64d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:33.591955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6c05dc76664cae8afb7d51403eaead', 'request_id': 'req-853cee84-cd8f-432d-b463-53bcd64fa64d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:33.661488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6c05dc76664cae8afb7d51403eaead', 'request_id': 'req-853cee84-cd8f-432d-b463-53bcd64fa64d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:33.675242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] The token cache is being invalidate because project 1c6c05dc76664cae8afb7d51403eaead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:33.675535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:33.676233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-853cee84-cd8f-432d-b463-53bcd64fa64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:33.677824 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3547/7173] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:33 2021] DELETE /identity/v3/projects/1c6c05dc76664cae8afb7d51403eaead => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:33.684703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc65-d9de-486b-9543-946b66bff591 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:33.685263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc65-d9de-486b-9543-946b66bff591 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:33.685369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc65-d9de-486b-9543-946b66bff591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:33.706345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4a54cc65-d9de-486b-9543-946b66bff591 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:33.711002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4a54cc65-d9de-486b-9543-946b66bff591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:33.786200 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3627/7174] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:33.794381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92218-7333-4890-8153-4c933064910a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:33.794725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92218-7333-4890-8153-4c933064910a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:33.795006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92218-7333-4890-8153-4c933064910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:33.818381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-54f92218-7333-4890-8153-4c933064910a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:33.819925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-54f92218-7333-4890-8153-4c933064910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:33.829662 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3548/7175] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:33.834399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cc65-d9de-486b-9543-946b66bff591 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:33.850318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cc65-d9de-486b-9543-946b66bff591 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:33.855224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:33.855903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:33.856185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:33.856461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:33.857233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:33.857538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:33.859207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:33.871077 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3628/7176] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:33.875429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92218-7333-4890-8153-4c933064910a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:33.884935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92218-7333-4890-8153-4c933064910a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:33.890005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:33.890643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:33.890914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:33.891212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:33.891914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:33.893950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:34.016826 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3549/7177] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:33 2021] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:34.021477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:34.033422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041cffe-3ac6-4535-8e82-67c9db739232 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:34.092058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:34.092721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.093050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.093386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.094024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:34.098801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:34.232686 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3629/7178] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:34 2021] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:34.236954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:34.247619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf193-7e7e-40f0-8730-73aa544f0f80 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:34.252353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:34.253051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.253338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.261481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.261481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:34.261481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:34.266800 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3550/7179] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:34.271344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:34.281360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d588539-20d1-42c5-a905-e12160ab40c0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:34.287157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6bec-353e-4957-9928-6337d355f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:34.287834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6bec-353e-4957-9928-6337d355f494 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.288115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6bec-353e-4957-9928-6337d355f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.288389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6bec-353e-4957-9928-6337d355f494 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.289208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6bec-353e-4957-9928-6337d355f494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:34.290785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6bec-353e-4957-9928-6337d355f494 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:34.301797 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3630/7180] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:34.305774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:34.315801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccf079-444e-4259-91df-6900094b52b3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:34.321071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:34.321950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.322234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.322511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] PATH_INFO: `/v3/projects/ea8a973672df4114a3a8705d32362c0d/users/262c330da3cd4fd699a5bf8710fde1dc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.338746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8a973672df4114a3a8705d32362c0d, user_id=262c330da3cd4fd699a5bf8710fde1dc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:34.341446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:34.468566 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3551/7181] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:34 2021] PUT /identity/v3/projects/ea8a973672df4114a3a8705d32362c0d/users/262c330da3cd4fd699a5bf8710fde1dc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:34.478682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.478971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.479250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.506253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] MFA Rules not processed for user `262c330da3cd4fd699a5bf8710fde1dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:34.507392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:34.571800 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3631/7182] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:34 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:34.576248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:34.653485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047e7b2-33b5-4836-9f3a-d845d1917c4f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:34.659394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:34.660360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.660842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.661483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.662243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:34.664160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:34.689936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:34.691495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:34.753840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea142e12-479a-42f7-a00f-63fc1d1b0a95 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:34.765804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:34.767862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.767862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.767862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.771317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:34.786225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:34.788610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:34.803552 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3552/7183] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:34 2021] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:34.804773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:34.805622 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3632/7184] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:34.919625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90291a-6396-48a5-a45a-485b4727bea6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:34.927481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:34.928427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:34.929284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:34.929284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:34.934718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:34.934718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:35.039577 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3553/7185] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:34 2021] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:35.043528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:35.058658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b601a0-63c7-4d9a-8e46-c9288910a548 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:35.064341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:35.065133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:35.070195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:35.070195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:35.070195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:35.070195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:35.079618 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3633/7186] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:35 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:35.083766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:35.093730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c68ad-85aa-49c1-81c9-aa321dbf7d01 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:35.099211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:35.100093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:35.100365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:35.100640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] PATH_INFO: `/v3/projects/199a07784e0549d19c6db10fed31e40c/users/f0127ea355aa4b85a0d51733120e67c2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:35.124743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199a07784e0549d19c6db10fed31e40c, user_id=f0127ea355aa4b85a0d51733120e67c2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:35.127828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:35.221337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3554/7187] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:35 2021] PUT /identity/v3/projects/199a07784e0549d19c6db10fed31e40c/users/f0127ea355aa4b85a0d51733120e67c2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:35.225752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:35.235849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14981-2c69-492a-976b-9b08a36b42eb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:35.295452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1664d74-d5ca-4710-ae21-353a4c276581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:35.296054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664d74-d5ca-4710-ae21-353a4c276581 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:35.296334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664d74-d5ca-4710-ae21-353a4c276581 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:35.296606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1664d74-d5ca-4710-ae21-353a4c276581 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:35.297398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1664d74-d5ca-4710-ae21-353a4c276581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:35.299018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1664d74-d5ca-4710-ae21-353a4c276581 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:35.310313 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3634/7188] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:35 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:35.314663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:35.325217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d86d5-ac4e-4103-ba28-0223fa661680 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:35.329889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:35.330772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:35.331056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:35.331387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] PATH_INFO: `/v3/projects/199a07784e0549d19c6db10fed31e40c/users/f0127ea355aa4b85a0d51733120e67c2/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:35.333487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199a07784e0549d19c6db10fed31e40c, user_id=f0127ea355aa4b85a0d51733120e67c2, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:35.336151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:35.346685 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3555/7189] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:35 2021] PUT /identity/v3/projects/199a07784e0549d19c6db10fed31e40c/users/f0127ea355aa4b85a0d51733120e67c2/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:35.358066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffc2ab-8743-4850-b81b-fbccf72b047e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:35.358357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffc2ab-8743-4850-b81b-fbccf72b047e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:35.358647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffc2ab-8743-4850-b81b-fbccf72b047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:35.385892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e8ffc2ab-8743-4850-b81b-fbccf72b047e None None] MFA Rules not processed for user `f0127ea355aa4b85a0d51733120e67c2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:35.387370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e8ffc2ab-8743-4850-b81b-fbccf72b047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:35.457025 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3635/7190] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:35 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:35.468974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:35.471028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:35.532416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f68e7c-4862-40d9-b01c-89e73ba1ce08 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:35.537027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd159e71-e2a0-4170-8a59-6919f7dc6a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:35.537645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159e71-e2a0-4170-8a59-6919f7dc6a38 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:35.537930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159e71-e2a0-4170-8a59-6919f7dc6a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:35.538210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159e71-e2a0-4170-8a59-6919f7dc6a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:35.547817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd159e71-e2a0-4170-8a59-6919f7dc6a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:35.549289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd159e71-e2a0-4170-8a59-6919f7dc6a38 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:35.559175 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3556/7191] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:35 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:35.736770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffc2ab-8743-4850-b81b-fbccf72b047e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:35.808325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffc2ab-8743-4850-b81b-fbccf72b047e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:35.813094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:35.817809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:35.817809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:35.817809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] PATH_INFO: `/v3/users/262c330da3cd4fd699a5bf8710fde1dc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:35.817809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=262c330da3cd4fd699a5bf8710fde1dc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:35.818383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:36.114138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262c330da3cd4fd699a5bf8710fde1dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:36.126684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262c330da3cd4fd699a5bf8710fde1dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:36.143576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262c330da3cd4fd699a5bf8710fde1dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:36.144666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262c330da3cd4fd699a5bf8710fde1dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:36.220599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262c330da3cd4fd699a5bf8710fde1dc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:36.227198 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3636/7192] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:35 2021] DELETE /identity/v3/users/262c330da3cd4fd699a5bf8710fde1dc => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:36.231866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:36.232358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:36.232358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:36.250428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:36.251636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:36.311545 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3557/7193] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:36.322802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:36.324792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:36.390380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ec129-311d-4ae6-a099-034a6a833ecc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:36.395282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:36.395939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:36.396219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:36.396493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:36.406778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:36.408142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:36.418479 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3637/7194] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:36.880848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:36.883269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:36.932898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671408b2-65c0-4245-a324-f4bacf19f77d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:36.955735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:36.956782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:36.958160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:36.958160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] PATH_INFO: `/v3/projects/ea8a973672df4114a3a8705d32362c0d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:36.960950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8a973672df4114a3a8705d32362c0d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:36.962864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:37.135352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8a973672df4114a3a8705d32362c0d', 'request_id': 'req-b180ada0-84b4-455a-9160-9bcfb49d2ca1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.142134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8a973672df4114a3a8705d32362c0d', 'request_id': 'req-b180ada0-84b4-455a-9160-9bcfb49d2ca1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.231609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8a973672df4114a3a8705d32362c0d', 'request_id': 'req-b180ada0-84b4-455a-9160-9bcfb49d2ca1'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.243024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] The token cache is being invalidate because project ea8a973672df4114a3a8705d32362c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:37.243678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.243966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.245541 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3558/7195] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:36 2021] DELETE /identity/v3/projects/ea8a973672df4114a3a8705d32362c0d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:37.249574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:37.260071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eb21e-3fb5-4ce2-8e17-6086004d8b02 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:37.342871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:37.344167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:37.344452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:37.344720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] PATH_INFO: `/v3/users/f0127ea355aa4b85a0d51733120e67c2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:37.346006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0127ea355aa4b85a0d51733120e67c2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:37.347938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:37.568176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0127ea355aa4b85a0d51733120e67c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.577820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0127ea355aa4b85a0d51733120e67c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.594297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0127ea355aa4b85a0d51733120e67c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.595119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0127ea355aa4b85a0d51733120e67c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.689302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e3bf523-a1e3-4cc3-a309-d99cd8ebcc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0127ea355aa4b85a0d51733120e67c2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:37.699765 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3638/7196] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:37 2021] DELETE /identity/v3/users/f0127ea355aa4b85a0d51733120e67c2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:38.210915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:38.212932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:38.230513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180ada0-84b4-455a-9160-9bcfb49d2ca1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:38.313335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:38.315119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:38.315667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:38.316245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] PATH_INFO: `/v3/projects/199a07784e0549d19c6db10fed31e40c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:38.318273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=199a07784e0549d19c6db10fed31e40c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:38.320913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:38.450869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199a07784e0549d19c6db10fed31e40c', 'request_id': 'req-3421f0b0-2046-4e9d-aed8-948adc20a5db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:38.459436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199a07784e0549d19c6db10fed31e40c', 'request_id': 'req-3421f0b0-2046-4e9d-aed8-948adc20a5db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:38.575796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199a07784e0549d19c6db10fed31e40c', 'request_id': 'req-3421f0b0-2046-4e9d-aed8-948adc20a5db'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:38.596450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] The token cache is being invalidate because project 199a07784e0549d19c6db10fed31e40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:38.596746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:38.597619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3421f0b0-2046-4e9d-aed8-948adc20a5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:38.600092 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3559/7197] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:38 2021] DELETE /identity/v3/projects/199a07784e0549d19c6db10fed31e40c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:38.606742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810eefe-45f9-43f8-ad74-892fa72c5124 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:38.607724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810eefe-45f9-43f8-ad74-892fa72c5124 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:38.608198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810eefe-45f9-43f8-ad74-892fa72c5124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:38.660027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c810eefe-45f9-43f8-ad74-892fa72c5124 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:38.661845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c810eefe-45f9-43f8-ad74-892fa72c5124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:38.742992 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3639/7198] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:38.751701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04340-46cf-4b2b-a2f5-e5d64980a375 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:38.751906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04340-46cf-4b2b-a2f5-e5d64980a375 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:38.752295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04340-46cf-4b2b-a2f5-e5d64980a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:38.777332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e5e04340-46cf-4b2b-a2f5-e5d64980a375 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:38.778544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e5e04340-46cf-4b2b-a2f5-e5d64980a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:38.787185 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3560/7199] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:38.791411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810eefe-45f9-43f8-ad74-892fa72c5124 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:38.801170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810eefe-45f9-43f8-ad74-892fa72c5124 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:38.805805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:38.806448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:38.806727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:38.807002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:38.807721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:38.808023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:38.809645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:38.821533 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3640/7200] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:38.825819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04340-46cf-4b2b-a2f5-e5d64980a375 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:38.835697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04340-46cf-4b2b-a2f5-e5d64980a375 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:38.841833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:38.842759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:38.843043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:38.843311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:38.844007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:38.845928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:38.962390 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3561/7201] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:38 2021] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:38.968158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:38.986225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0472f9-f2ff-4358-b38e-1534ae159877 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:39.043676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:39.044338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.044619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.047300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.047300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:39.047550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:39.119341 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3641/7202] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:38 2021] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:39.120908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:39.131998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e764ed6-c527-4f96-99ba-8ccd971e25e1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:39.137017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:39.137692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.137972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.138246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.138980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:39.140595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:39.155676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3562/7203] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:39.157166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:39.183293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62b964-5cda-451b-a983-745dee933e04 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:39.195248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90fc7-648d-480e-978f-5e649142e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:39.195248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90fc7-648d-480e-978f-5e649142e60e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.195248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90fc7-648d-480e-978f-5e649142e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.195683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90fc7-648d-480e-978f-5e649142e60e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.196468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90fc7-648d-480e-978f-5e649142e60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:39.198183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90fc7-648d-480e-978f-5e649142e60e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:39.213734 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3642/7204] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:39 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:39.214948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:39.225584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763a53-6a60-4862-b6c3-eb3b46c8282a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:39.233245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:39.234244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.234647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.234989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] PATH_INFO: `/v3/projects/8ce89a6806504787a5c3bbd15557230a/users/72079959f2bc4432b2dd35173a17a348/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.256461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce89a6806504787a5c3bbd15557230a, user_id=72079959f2bc4432b2dd35173a17a348, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:39.259128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:39.346239 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3563/7205] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:39 2021] PUT /identity/v3/projects/8ce89a6806504787a5c3bbd15557230a/users/72079959f2bc4432b2dd35173a17a348/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:39.357704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557fa29-e20b-4ff8-8c47-9d8442b1237d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.357990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557fa29-e20b-4ff8-8c47-9d8442b1237d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.358265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557fa29-e20b-4ff8-8c47-9d8442b1237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.389362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7557fa29-e20b-4ff8-8c47-9d8442b1237d None None] MFA Rules not processed for user `72079959f2bc4432b2dd35173a17a348`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:39.390580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7557fa29-e20b-4ff8-8c47-9d8442b1237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:39.458921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:39.460936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:39.466685 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3643/7206] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:39 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:39.470834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557fa29-e20b-4ff8-8c47-9d8442b1237d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:39.555536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d4787-bbe0-4a0c-a65a-84f9d3a85ecf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:39.562963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:39.564836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.565168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.565451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] PATH_INFO: `/v3/users/517838d2d4a942bfa8b332c767c60904` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.567890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] RBAC: Authorizing `identity:delete_user(user_id=517838d2d4a942bfa8b332c767c60904)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:39.569940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:39.575490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557fa29-e20b-4ff8-8c47-9d8442b1237d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:39.578838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:39.579498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.579779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.580195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.580980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:39.582927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:39.783347 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3644/7207] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:39 2021] POST /identity/v3/projects => generated 387 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:39.784190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:39.786418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:39.838121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517838d2d4a942bfa8b332c767c60904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:39.865358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517838d2d4a942bfa8b332c767c60904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:39.878809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517838d2d4a942bfa8b332c767c60904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:39.879535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517838d2d4a942bfa8b332c767c60904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:39.880148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517838d2d4a942bfa8b332c767c60904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:39.887460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93eed-2475-4c66-957d-6b4888b00fb7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:39.893142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:39.894150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:39.904816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:39.904816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:39.904816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:39.911788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:39.913434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:39.926847 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3645/7208] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:39.927716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:39.929311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.016141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6713bf4-1402-4e3c-9805-38fe0b1be83b service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.024218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.025167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.031291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.031291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.031291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.031291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.051618 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3564/7209] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:39 2021] DELETE /identity/v3/users/517838d2d4a942bfa8b332c767c60904 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:40.105046 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3646/7210] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:39 2021] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:40.109815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.189680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ef9da-b6ab-40b6-a1b5-c659daf4e33b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.196012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.196958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.197249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.203287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.203287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.203287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.211365 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3565/7211] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:40.215631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.226790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7562-3c47-4fb8-81ca-09044cff90da admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.231743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.232671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.232991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.233271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] PATH_INFO: `/v3/projects/601e57b8cc574f4da7d7e7c9a2c35d2c/users/ab82142ba7b643339f0cedcf39d5a397/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.250238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601e57b8cc574f4da7d7e7c9a2c35d2c, user_id=ab82142ba7b643339f0cedcf39d5a397, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.253059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.388863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.391705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.400858 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3647/7212] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:40 2021] PUT /identity/v3/projects/601e57b8cc574f4da7d7e7c9a2c35d2c/users/ab82142ba7b643339f0cedcf39d5a397/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:40.409033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.421243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e987793-e982-4be4-b379-0ad3a8e8e6fa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.486113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6a94-85d2-4a92-b2e4-67fc7544b6a1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.491574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.492247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.492522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.492797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.493576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.495186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.495748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105781-637f-4620-ab67-0e479201423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.496684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105781-637f-4620-ab67-0e479201423c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.497000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105781-637f-4620-ab67-0e479201423c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.497280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105781-637f-4620-ab67-0e479201423c admin admin] PATH_INFO: `/v3/projects/0560c323ec8e41b3bc05939e12e049d5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.498963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105781-637f-4620-ab67-0e479201423c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0560c323ec8e41b3bc05939e12e049d5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.501091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105781-637f-4620-ab67-0e479201423c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.506001 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3648/7213] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:40 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:40.509947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.520179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb591226-9346-4711-9645-0e5c01b2c053 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.526101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b465a2-f331-42fb-b217-9bfa4aa318fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.527224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b465a2-f331-42fb-b217-9bfa4aa318fd admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.527511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b465a2-f331-42fb-b217-9bfa4aa318fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.527789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b465a2-f331-42fb-b217-9bfa4aa318fd admin admin] PATH_INFO: `/v3/projects/601e57b8cc574f4da7d7e7c9a2c35d2c/users/ab82142ba7b643339f0cedcf39d5a397/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.530087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b465a2-f331-42fb-b217-9bfa4aa318fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=601e57b8cc574f4da7d7e7c9a2c35d2c, user_id=ab82142ba7b643339f0cedcf39d5a397, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.533010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b465a2-f331-42fb-b217-9bfa4aa318fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.544315 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3649/7214] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:40 2021] PUT /identity/v3/projects/601e57b8cc574f4da7d7e7c9a2c35d2c/users/ab82142ba7b643339f0cedcf39d5a397/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:40.556145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.556436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.556715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.583791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] MFA Rules not processed for user `ab82142ba7b643339f0cedcf39d5a397`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:40.585073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.611076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-52105781-637f-4620-ab67-0e479201423c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0560c323ec8e41b3bc05939e12e049d5', 'request_id': 'req-52105781-637f-4620-ab67-0e479201423c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:40.623997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-52105781-637f-4620-ab67-0e479201423c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0560c323ec8e41b3bc05939e12e049d5', 'request_id': 'req-52105781-637f-4620-ab67-0e479201423c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:40.662811 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3650/7215] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:40 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:40.675490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.677505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.706029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-52105781-637f-4620-ab67-0e479201423c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0560c323ec8e41b3bc05939e12e049d5', 'request_id': 'req-52105781-637f-4620-ab67-0e479201423c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:40.717298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-52105781-637f-4620-ab67-0e479201423c admin admin] The token cache is being invalidate because project 0560c323ec8e41b3bc05939e12e049d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:40.717592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-52105781-637f-4620-ab67-0e479201423c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:40.718325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-52105781-637f-4620-ab67-0e479201423c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:40.719935 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3566/7216] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:40 2021] DELETE /identity/v3/projects/0560c323ec8e41b3bc05939e12e049d5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:40.729195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e41aa-c7fa-4cdd-b900-616a3ba39c52 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.729195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e41aa-c7fa-4cdd-b900-616a3ba39c52 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.729195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e41aa-c7fa-4cdd-b900-616a3ba39c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.737500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec829c-9605-4056-a0f0-2a56da0ddbba None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.765272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e27e41aa-c7fa-4cdd-b900-616a3ba39c52 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:40.765272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e27e41aa-c7fa-4cdd-b900-616a3ba39c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.791360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.792004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.792280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.792553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.794500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.824330 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3567/7217] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:40.831816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483be2b-aa61-453f-a0b1-910a63eb3d37 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.832144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483be2b-aa61-453f-a0b1-910a63eb3d37 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.836848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483be2b-aa61-453f-a0b1-910a63eb3d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.851681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7483be2b-aa61-453f-a0b1-910a63eb3d37 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:40.852944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7483be2b-aa61-453f-a0b1-910a63eb3d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.861837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.866233 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3568/7218] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:40.866901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.867175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483be2b-aa61-453f-a0b1-910a63eb3d37 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.874246 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3651/7219] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:40 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:40.876976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483be2b-aa61-453f-a0b1-910a63eb3d37 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.882279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.882960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.883270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.883577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.885150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:40.885465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.887327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.902569 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3569/7220] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:40.906757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.920140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbadc2-93ab-4faa-a7d3-8288c0b737eb service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.926471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.927315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.927797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.928251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.929196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.932206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:40.956477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:40.961119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:40.980496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3e0d3-3d0f-476d-bf27-52449b7ec358 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:40.985380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:40.988932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:40.989184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:40.989487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] PATH_INFO: `/v3/users/72079959f2bc4432b2dd35173a17a348` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:40.990847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] RBAC: Authorizing `identity:delete_user(user_id=72079959f2bc4432b2dd35173a17a348)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:40.992758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:41.039705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3652/7221] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:40 2021] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:41.044633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:41.107333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba67415-cdba-43d4-988c-1d3633763062 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:41.112142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:41.112801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.113121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.113398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.114122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:41.116075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:41.235193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72079959f2bc4432b2dd35173a17a348'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:41.244940 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3653/7222] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:41 2021] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:41.247574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72079959f2bc4432b2dd35173a17a348'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:41.248905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:41.259223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fdb7-4f14-4bd6-a02d-746840f8d933 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:41.259784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72079959f2bc4432b2dd35173a17a348'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:41.260622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72079959f2bc4432b2dd35173a17a348'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:41.264687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-aac06fa7-1305-4dd6-a3e5-6ee11d4aabee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72079959f2bc4432b2dd35173a17a348'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:41.264808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:41.265089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.265376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.265656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.266381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:41.267960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:41.278732 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3654/7223] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:41.283701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:41.285604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:41.298616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885443f9-4454-45bb-b091-ba04a3945e06 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:41.303345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:41.304002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.304305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.304561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.305314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:41.306901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:41.318883 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3655/7224] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:41.323540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:41.334703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02c5a-e688-4431-a092-a3a02f71e6bb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:41.339483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3af87-5c18-4bde-818e-57a4ab8e64fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:41.340366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3af87-5c18-4bde-818e-57a4ab8e64fd admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.340791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3af87-5c18-4bde-818e-57a4ab8e64fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.341109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3af87-5c18-4bde-818e-57a4ab8e64fd admin admin] PATH_INFO: `/v3/projects/c530b50e6e7943e08432ece63ea91869/users/a374b7bb43fb44df8b39ff0bee55d21e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.359693 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3570/7225] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:40 2021] DELETE /identity/v3/users/72079959f2bc4432b2dd35173a17a348 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:41.364373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.364667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.368427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.368575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3af87-5c18-4bde-818e-57a4ab8e64fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c530b50e6e7943e08432ece63ea91869, user_id=a374b7bb43fb44df8b39ff0bee55d21e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:41.370667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3af87-5c18-4bde-818e-57a4ab8e64fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:41.386042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:41.387533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:41.449039 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3571/7226] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:41.459683 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3656/7227] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:41 2021] PUT /identity/v3/projects/c530b50e6e7943e08432ece63ea91869/users/a374b7bb43fb44df8b39ff0bee55d21e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:41.461641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:41.463140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:41.469949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.470237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.470513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.497598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] MFA Rules not processed for user `a374b7bb43fb44df8b39ff0bee55d21e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:41.498735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:41.527694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa5302-4561-45c0-9c33-18161a0a5ad5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:41.568746 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3657/7228] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:41 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:41.579957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:41.580587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:41.581286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.581401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:41.581558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.581828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.646360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:41.647798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:41.657471 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3572/7229] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:41.666387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2eb4b-a336-4040-a3af-3ae5e4dcd63d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:41.672044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:41.672741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:41.673056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:41.674201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:41.682246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:41.683833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:41.693708 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3658/7230] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:41 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:42.100026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:42.101637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:42.116598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2735b6-5450-4226-986c-c5c5fece6ec3 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:42.122033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:42.128092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:42.128092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:42.128092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] PATH_INFO: `/v3/projects/8ce89a6806504787a5c3bbd15557230a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:42.128092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce89a6806504787a5c3bbd15557230a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:42.128092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:42.277092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce89a6806504787a5c3bbd15557230a', 'request_id': 'req-32788cc0-efbf-4db2-b058-b5badbaeb01d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.283843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce89a6806504787a5c3bbd15557230a', 'request_id': 'req-32788cc0-efbf-4db2-b058-b5badbaeb01d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.369124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce89a6806504787a5c3bbd15557230a', 'request_id': 'req-32788cc0-efbf-4db2-b058-b5badbaeb01d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.381794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] The token cache is being invalidate because project 8ce89a6806504787a5c3bbd15557230a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:42.382086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.382756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.384364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3573/7231] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:42 2021] DELETE /identity/v3/projects/8ce89a6806504787a5c3bbd15557230a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:42.388592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:42.400608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b147b2-65db-4499-b06c-7538d6cfbb1a service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:42.477549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:42.478584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:42.478854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:42.479126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] PATH_INFO: `/v3/users/ab82142ba7b643339f0cedcf39d5a397` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:42.480374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab82142ba7b643339f0cedcf39d5a397)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:42.482370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:42.498001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:42.502221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:42.584621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32788cc0-efbf-4db2-b058-b5badbaeb01d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:42.588369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:42.589063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:42.589345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:42.589622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:42.591394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:42.654271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:42.655727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:42.676944 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3574/7232] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:42 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:42.724299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab82142ba7b643339f0cedcf39d5a397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.731644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab82142ba7b643339f0cedcf39d5a397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.744001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab82142ba7b643339f0cedcf39d5a397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.744844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab82142ba7b643339f0cedcf39d5a397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.830476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1fbdea28-d76b-4ee7-b1f9-1d42b6782a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab82142ba7b643339f0cedcf39d5a397'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:42.834846 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3659/7233] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:42 2021] DELETE /identity/v3/users/ab82142ba7b643339f0cedcf39d5a397 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:43.245626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:43.247272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:43.263103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59a517-cb65-488e-b9d4-b10a281f4843 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:43.326606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:43.327861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:43.328149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:43.328427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] PATH_INFO: `/v3/projects/601e57b8cc574f4da7d7e7c9a2c35d2c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:43.330422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=601e57b8cc574f4da7d7e7c9a2c35d2c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:43.332410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:43.460422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601e57b8cc574f4da7d7e7c9a2c35d2c', 'request_id': 'req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:43.466655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601e57b8cc574f4da7d7e7c9a2c35d2c', 'request_id': 'req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:43.523841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601e57b8cc574f4da7d7e7c9a2c35d2c', 'request_id': 'req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:43.535106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] The token cache is being invalidate because project 601e57b8cc574f4da7d7e7c9a2c35d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:43.535493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:43.537353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c7a9a8b3-ccb1-478d-bfcd-91727615dbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:43.539058 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3575/7234] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:43 2021] DELETE /identity/v3/projects/601e57b8cc574f4da7d7e7c9a2c35d2c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:43.544647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac985-f1cc-40ad-a657-203f9385fd45 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:43.545233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac985-f1cc-40ad-a657-203f9385fd45 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:43.545233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ac985-f1cc-40ad-a657-203f9385fd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:43.583147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e14ac985-f1cc-40ad-a657-203f9385fd45 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:43.585065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e14ac985-f1cc-40ad-a657-203f9385fd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:43.671090 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3660/7235] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:43.680357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf05b4-880b-43c9-994d-b1625cfc4534 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:43.680648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf05b4-880b-43c9-994d-b1625cfc4534 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:43.680962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf05b4-880b-43c9-994d-b1625cfc4534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:43.699391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-aacf05b4-880b-43c9-994d-b1625cfc4534 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:43.700607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aacf05b4-880b-43c9-994d-b1625cfc4534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:43.711132 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3576/7236] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:43.715341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac985-f1cc-40ad-a657-203f9385fd45 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:43.725707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ac985-f1cc-40ad-a657-203f9385fd45 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:43.730737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:43.731388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:43.731664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:43.731934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:43.732658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:43.732998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:43.734574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:43.746369 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3661/7237] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:43.750693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf05b4-880b-43c9-994d-b1625cfc4534 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:43.759904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf05b4-880b-43c9-994d-b1625cfc4534 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:43.765035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:43.765684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:43.765964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:43.766239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:43.766939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:43.768991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:43.903922 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3577/7238] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:43 2021] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:43.907798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:43.918594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fec29b-e411-441c-a3e7-556ec61426f7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:43.978341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:43.979034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:43.979319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:43.979595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:43.980280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:43.982218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.138608 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3662/7239] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:43 2021] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:44.139838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:44.151294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c63152-d111-4cb4-b904-cbf875acf220 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:44.156132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:44.156807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.157120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.157391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.158145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:44.159720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.173434 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3578/7240] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:44.174687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:44.185570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55011660-81ad-4e62-90d2-619362fd288b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:44.190706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c44bd-4cc2-40aa-bf32-e5bc264c0400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:44.191366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c44bd-4cc2-40aa-bf32-e5bc264c0400 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.191649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c44bd-4cc2-40aa-bf32-e5bc264c0400 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.192657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c44bd-4cc2-40aa-bf32-e5bc264c0400 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.193177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c44bd-4cc2-40aa-bf32-e5bc264c0400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:44.194768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c44bd-4cc2-40aa-bf32-e5bc264c0400 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.205234 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3663/7241] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:44.210026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:44.220117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d76f-92e5-4dda-a23e-2dbadecbb050 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:44.225305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01961-e269-4804-b067-e85267720224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:44.226276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01961-e269-4804-b067-e85267720224 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.226563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01961-e269-4804-b067-e85267720224 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.236786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01961-e269-4804-b067-e85267720224 admin admin] PATH_INFO: `/v3/projects/5a489896e9e44cfab05ddcf2bec0b1f8/users/35e0fca3dd5a40628cf232685f11edf5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.243649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01961-e269-4804-b067-e85267720224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a489896e9e44cfab05ddcf2bec0b1f8, user_id=35e0fca3dd5a40628cf232685f11edf5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:44.246481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01961-e269-4804-b067-e85267720224 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.359820 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3579/7242] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:44 2021] PUT /identity/v3/projects/5a489896e9e44cfab05ddcf2bec0b1f8/users/35e0fca3dd5a40628cf232685f11edf5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:44.371618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a000412-1208-4f28-ba69-208f85b7a914 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.371926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a000412-1208-4f28-ba69-208f85b7a914 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.372199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a000412-1208-4f28-ba69-208f85b7a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.414353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0a000412-1208-4f28-ba69-208f85b7a914 None None] MFA Rules not processed for user `35e0fca3dd5a40628cf232685f11edf5`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:44.416147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0a000412-1208-4f28-ba69-208f85b7a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:44.507241 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3664/7243] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:44 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:44.512313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01961-e269-4804-b067-e85267720224 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:44.598567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01961-e269-4804-b067-e85267720224 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:44.604922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:44.605917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.606270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.606627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.607427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:44.609497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.729354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3580/7244] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:44 2021] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:44.732365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a000412-1208-4f28-ba69-208f85b7a914 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:44.747292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a000412-1208-4f28-ba69-208f85b7a914 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:44.802326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:44.802996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.803278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.803552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.804243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:44.806276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.904198 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3665/7245] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:44 2021] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:44.905528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:44.917447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38758b0a-ebf1-4751-b581-209270eeb824 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:44.922175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:44.922855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.923135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.923413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.924135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:44.925845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.940627 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3581/7246] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:44.942245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:44.971604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433fae4-bb76-4465-a94b-e9bda8b834c4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:44.979499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51c9f-9607-4c59-9e35-2a943d26c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:44.980715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51c9f-9607-4c59-9e35-2a943d26c83f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:44.980715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51c9f-9607-4c59-9e35-2a943d26c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:44.980715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51c9f-9607-4c59-9e35-2a943d26c83f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:44.981486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51c9f-9607-4c59-9e35-2a943d26c83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:44.983273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c51c9f-9607-4c59-9e35-2a943d26c83f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:44.995462 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3666/7247] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:44 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:44.999936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.010808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20b7e-d2fe-4280-82d9-bc07a432260b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:45.022763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:45.023776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.024044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.024325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] PATH_INFO: `/v3/projects/ccc4f0d845ce4759bce20484724b3a13/users/18b0353f3bfe4a2987f00e525ad759a5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.041652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc4f0d845ce4759bce20484724b3a13, user_id=18b0353f3bfe4a2987f00e525ad759a5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:45.044309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:45.140538 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3582/7248] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:44 2021] PUT /identity/v3/projects/ccc4f0d845ce4759bce20484724b3a13/users/18b0353f3bfe4a2987f00e525ad759a5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:45.150995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcbfb-6975-498f-b0ac-f466980a1edf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.151286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcbfb-6975-498f-b0ac-f466980a1edf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.151586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcbfb-6975-498f-b0ac-f466980a1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.183515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-050dcbfb-6975-498f-b0ac-f466980a1edf None None] MFA Rules not processed for user `18b0353f3bfe4a2987f00e525ad759a5`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:45.184696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-050dcbfb-6975-498f-b0ac-f466980a1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:45.275650 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3667/7249] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:45 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:45.280151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.355256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2aed-deaa-449d-ac1f-596689ac111b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:45.362886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:45.363569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.363895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.364186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.364916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:45.366891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:45.438274 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3583/7250] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:45 2021] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:45.443438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dcbfb-6975-498f-b0ac-f466980a1edf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.454413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dcbfb-6975-498f-b0ac-f466980a1edf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:45.495702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.497624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:45.537068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:45.538220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.538948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.539573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.540807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:45.543527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:45.578466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a4a00-4cd3-44a9-8d65-5266287b1550 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:45.585289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:45.586366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.586649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.587630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] PATH_INFO: `/v3/users/20d2b0754f0a480f87c5fd59ffb453a2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.589031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d2b0754f0a480f87c5fd59ffb453a2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:45.591011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:45.658003 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3668/7251] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:45 2021] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:45.659159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.669744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016ad4-dae9-4dcf-b66c-71d8f46ea939 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:45.674640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:45.675302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.675579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.675847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.676598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:45.678246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:45.691426 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3669/7252] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:45.696331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.708287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9606e-2899-45ae-bc68-79e174bcc6d4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:45.714160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:45.715905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.716406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.716939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] PATH_INFO: `/v3/projects/c6b83f9204bf4748ad1452b448e5e25f/users/89f2dea2780f4936920a6aca4839cb05/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.741120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b83f9204bf4748ad1452b448e5e25f, user_id=89f2dea2780f4936920a6aca4839cb05, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:45.745200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:45.865922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d2b0754f0a480f87c5fd59ffb453a2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:45.877662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d2b0754f0a480f87c5fd59ffb453a2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:45.882898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3670/7253] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:45 2021] PUT /identity/v3/projects/c6b83f9204bf4748ad1452b448e5e25f/users/89f2dea2780f4936920a6aca4839cb05/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:45.884394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.893794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d2b0754f0a480f87c5fd59ffb453a2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:45.894558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d2b0754f0a480f87c5fd59ffb453a2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:45.895395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00e7e24a-5148-407d-8784-917301a24ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d2b0754f0a480f87c5fd59ffb453a2'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:45.965216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0ab26-b147-4a89-b453-a0568eccd658 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:45.970323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:45.970999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:45.971723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:45.971723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:45.972254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:45.974518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:45.988017 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3671/7254] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:45 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:45.989278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:45.992483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:46.006066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb444c5-5d1a-46bf-b25a-6684e54609ed admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:46.011659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca61263-fac6-4980-a2ff-9b51d37d4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:46.012561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61263-fac6-4980-a2ff-9b51d37d4d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:46.012842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61263-fac6-4980-a2ff-9b51d37d4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:46.013173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61263-fac6-4980-a2ff-9b51d37d4d36 admin admin] PATH_INFO: `/v3/projects/c6b83f9204bf4748ad1452b448e5e25f/users/89f2dea2780f4936920a6aca4839cb05/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:46.015447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca61263-fac6-4980-a2ff-9b51d37d4d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b83f9204bf4748ad1452b448e5e25f, user_id=89f2dea2780f4936920a6aca4839cb05, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:46.018147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca61263-fac6-4980-a2ff-9b51d37d4d36 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:46.029508 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3672/7255] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:45 2021] PUT /identity/v3/projects/c6b83f9204bf4748ad1452b448e5e25f/users/89f2dea2780f4936920a6aca4839cb05/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:46.040476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:46.040786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:46.041104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:46.049778 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3584/7256] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:45 2021] DELETE /identity/v3/users/20d2b0754f0a480f87c5fd59ffb453a2 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:46.059360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:46.059654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:46.059931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:46.073805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] MFA Rules not processed for user `89f2dea2780f4936920a6aca4839cb05`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:46.075322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:46.077948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:46.079137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:46.148099 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3585/7257] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:46.150446 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3673/7258] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:46 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:46.159232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:46.159232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:46.168830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:46.170472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:46.234093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bcc03-5045-4175-aa4d-d647a3a93f06 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:46.239217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:46.239865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:46.240207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:46.240486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:46.242546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633b015-1b7e-4f27-a645-5a0f3d023fcf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:46.246919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:46.248500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:46.248500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:46.248500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:46.251060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:46.252736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:46.259465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:46.261632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:46.263011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3586/7259] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:46.272910 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3674/7260] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:46 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:35:46.759582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:46.762612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:46.778124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077bb0a-4d07-4780-8f2e-d55705186d31 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:46.783393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:46.785756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:46.785756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:46.786829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] PATH_INFO: `/v3/projects/1bc56591137b41fb994355d22d888d0e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:46.788090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc56591137b41fb994355d22d888d0e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:46.790211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:46.924085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc56591137b41fb994355d22d888d0e', 'request_id': 'req-3baa6c2a-f433-4554-80af-b9afc0795ef0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:46.930657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc56591137b41fb994355d22d888d0e', 'request_id': 'req-3baa6c2a-f433-4554-80af-b9afc0795ef0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.020688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc56591137b41fb994355d22d888d0e', 'request_id': 'req-3baa6c2a-f433-4554-80af-b9afc0795ef0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.031061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] The token cache is being invalidate because project 1bc56591137b41fb994355d22d888d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:47.031343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.031955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.033593 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3587/7261] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:46 2021] DELETE /identity/v3/projects/1bc56591137b41fb994355d22d888d0e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:47.037776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:47.048617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9bfa-1b2b-4abe-98fd-fe3b4ea36987 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:47.108082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:47.109002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:47.109284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:47.109559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] PATH_INFO: `/v3/users/684b24a3b5ee45ffa63f11ca9c123f58` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:47.110746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=684b24a3b5ee45ffa63f11ca9c123f58)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:47.112648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:47.366539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684b24a3b5ee45ffa63f11ca9c123f58'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.374054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684b24a3b5ee45ffa63f11ca9c123f58'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.389111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684b24a3b5ee45ffa63f11ca9c123f58'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.389950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684b24a3b5ee45ffa63f11ca9c123f58'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.463072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:47.464452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:47.483300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684b24a3b5ee45ffa63f11ca9c123f58'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:47.489657 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3675/7262] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:47 2021] DELETE /identity/v3/users/684b24a3b5ee45ffa63f11ca9c123f58 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:47.524993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6c2a-f433-4554-80af-b9afc0795ef0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:47.576804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd033cd-f10a-429b-9250-b95877b11fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:47.577837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033cd-f10a-429b-9250-b95877b11fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:47.578280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033cd-f10a-429b-9250-b95877b11fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:47.578517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033cd-f10a-429b-9250-b95877b11fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:47.580296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-abd033cd-f10a-429b-9250-b95877b11fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:47.641884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd033cd-f10a-429b-9250-b95877b11fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:47.643309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd033cd-f10a-429b-9250-b95877b11fb4 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:47.652861 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3588/7263] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:47 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:47.924907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:47.926576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:47.997556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a42e06-de43-4c7f-bc89-1449b57d1e82 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:48.002372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:48.003229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:48.003508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:48.003775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] PATH_INFO: `/v3/projects/26fe8a2707834a54b9eb09e48cec709c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:48.004992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fe8a2707834a54b9eb09e48cec709c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:48.007504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:48.128705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fe8a2707834a54b9eb09e48cec709c', 'request_id': 'req-fe6dffce-abc1-4cae-9e70-d75c41886b96'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:48.232893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fe8a2707834a54b9eb09e48cec709c', 'request_id': 'req-fe6dffce-abc1-4cae-9e70-d75c41886b96'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:48.240260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fe8a2707834a54b9eb09e48cec709c', 'request_id': 'req-fe6dffce-abc1-4cae-9e70-d75c41886b96'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:48.250113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] The token cache is being invalidate because project 26fe8a2707834a54b9eb09e48cec709c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:48.250400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:48.251025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fe6dffce-abc1-4cae-9e70-d75c41886b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:48.252578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3676/7264] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:47 2021] DELETE /identity/v3/projects/26fe8a2707834a54b9eb09e48cec709c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:48.259515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cf412-8ecc-4a6b-847e-f47fe7fcd0a4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:48.259983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cf412-8ecc-4a6b-847e-f47fe7fcd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:48.266694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cf412-8ecc-4a6b-847e-f47fe7fcd0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:48.277550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fb7cf412-8ecc-4a6b-847e-f47fe7fcd0a4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:48.278766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fb7cf412-8ecc-4a6b-847e-f47fe7fcd0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:48.340953 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3589/7265] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:48.349420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e612e-434a-4360-8164-5b6037089a50 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:48.349736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e612e-434a-4360-8164-5b6037089a50 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:48.350018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e612e-434a-4360-8164-5b6037089a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:48.368837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6d3e612e-434a-4360-8164-5b6037089a50 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:48.370059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6d3e612e-434a-4360-8164-5b6037089a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:48.378265 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3677/7266] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:48.383277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cf412-8ecc-4a6b-847e-f47fe7fcd0a4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:48.393234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cf412-8ecc-4a6b-847e-f47fe7fcd0a4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:48.398964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:48.399752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:48.400106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:48.400393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:48.401154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:48.401583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:48.409209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:48.418360 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3590/7267] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:48.420868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e612e-434a-4360-8164-5b6037089a50 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:48.431296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e612e-434a-4360-8164-5b6037089a50 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:48.453204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:48.453204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:48.453204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:48.453204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:48.453980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:48.453980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:48.849996 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3678/7268] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:48 2021] POST /identity/v3/projects => generated 381 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:48.851190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:48.861471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4ff2-886b-419f-9a10-fc72d50f04c8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:48.917580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:48.918219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:48.918526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:48.918804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:48.919802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:48.923646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.084306 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3591/7269] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:48 2021] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:49.088544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.100043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9cf35-2217-4733-971d-3b0516f5d5e2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.105088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.105881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.106165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.106453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.107159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.108752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.119564 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3679/7270] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:49.123871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.134273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8b803-7e72-4609-9dd6-610d4fca0d5f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.139402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a9be1-3e13-4c00-87ac-f5625fe7670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.140080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9be1-3e13-4c00-87ac-f5625fe7670c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.140395 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9be1-3e13-4c00-87ac-f5625fe7670c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.140676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9be1-3e13-4c00-87ac-f5625fe7670c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.141443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a9be1-3e13-4c00-87ac-f5625fe7670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.143071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a9be1-3e13-4c00-87ac-f5625fe7670c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.158296 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3592/7271] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:35:49.158419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.168808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94b6a-a21e-45f7-ad1b-1d848c792709 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.173660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.174541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.174825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.175104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] PATH_INFO: `/v3/projects/772568b2382d492e88caeda66324c1c9/users/68c6277ab56a4d1a9b02f1ba62e608bf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.190311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772568b2382d492e88caeda66324c1c9, user_id=68c6277ab56a4d1a9b02f1ba62e608bf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.193083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.272615 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3680/7272] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:49 2021] PUT /identity/v3/projects/772568b2382d492e88caeda66324c1c9/users/68c6277ab56a4d1a9b02f1ba62e608bf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:49.282825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27038dc5-d7d5-4671-8517-469062b43fe5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.289228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27038dc5-d7d5-4671-8517-469062b43fe5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.289228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27038dc5-d7d5-4671-8517-469062b43fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.311881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-27038dc5-d7d5-4671-8517-469062b43fe5 None None] MFA Rules not processed for user `68c6277ab56a4d1a9b02f1ba62e608bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:49.313276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-27038dc5-d7d5-4671-8517-469062b43fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:49.376276 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3593/7273] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:49 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:49.381134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.444284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b8f3-5083-49c7-9791-8ce3a6a88d38 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.449102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.449798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.450080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.450355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.451067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.453053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.559045 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3681/7274] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:49 2021] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:49.563107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27038dc5-d7d5-4671-8517-469062b43fe5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.574388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27038dc5-d7d5-4671-8517-469062b43fe5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.628474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.629184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.629468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.629745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.630963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.632934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.700212 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3594/7275] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:49 2021] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:49.703103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.713420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b3dc-14cd-43d0-9099-a84e9f1e84f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.718195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.723270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.723270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.723270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.723270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.723270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.732338 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3682/7276] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:49.736454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.746845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca62aaf-adcf-46b7-aba9-ccc030d71e21 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.751521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.752391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.752675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.752991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] PATH_INFO: `/v3/projects/bb40c95cae4340f182737ee8dc2232ba/users/75bce69b0bb1472cb6cca088ee26c036/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.768183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb40c95cae4340f182737ee8dc2232ba, user_id=75bce69b0bb1472cb6cca088ee26c036, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.770876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.860608 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3595/7277] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:49 2021] PUT /identity/v3/projects/bb40c95cae4340f182737ee8dc2232ba/users/75bce69b0bb1472cb6cca088ee26c036/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:35:49.865239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.875075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31c40-8d86-4a95-8c6e-e2572095a44e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.929530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0db6af-0dc1-4908-8cd4-51fd49258713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.930185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0db6af-0dc1-4908-8cd4-51fd49258713 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.930459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0db6af-0dc1-4908-8cd4-51fd49258713 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.930738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0db6af-0dc1-4908-8cd4-51fd49258713 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.931486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0db6af-0dc1-4908-8cd4-51fd49258713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.933089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0db6af-0dc1-4908-8cd4-51fd49258713 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.942572 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3683/7278] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:49 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:49.948102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:49.960486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd34a1-b9e4-490a-9e2c-5add95e633e3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:49.966121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:49.966536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.966813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.967083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] PATH_INFO: `/v3/projects/bb40c95cae4340f182737ee8dc2232ba/users/75bce69b0bb1472cb6cca088ee26c036/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:49.969125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb40c95cae4340f182737ee8dc2232ba, user_id=75bce69b0bb1472cb6cca088ee26c036, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:49.971739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:49.984640 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3596/7279] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:49 2021] PUT /identity/v3/projects/bb40c95cae4340f182737ee8dc2232ba/users/75bce69b0bb1472cb6cca088ee26c036/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:49.995744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbb704-d966-4b9f-a9fa-eac0558aa45e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:49.996136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbb704-d966-4b9f-a9fa-eac0558aa45e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:49.996389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbb704-d966-4b9f-a9fa-eac0558aa45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:50.022965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9adbb704-d966-4b9f-a9fa-eac0558aa45e None None] MFA Rules not processed for user `75bce69b0bb1472cb6cca088ee26c036`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:50.024148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9adbb704-d966-4b9f-a9fa-eac0558aa45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:50.094941 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3684/7280] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:49 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:50.106132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:50.107830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:50.171185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b50ac-1c34-4576-ba24-664003a90398 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:50.174949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:50.175619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:50.175903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:50.176183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:50.185849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:50.187270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:50.196648 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3597/7281] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:50 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:50.321942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbb704-d966-4b9f-a9fa-eac0558aa45e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:50.333784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbb704-d966-4b9f-a9fa-eac0558aa45e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:50.337451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c6f64-e80a-4741-8c7c-4bc5ef6c9da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:50.338084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c6f64-e80a-4741-8c7c-4bc5ef6c9da4 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:50.338362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c6f64-e80a-4741-8c7c-4bc5ef6c9da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:50.338634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c6f64-e80a-4741-8c7c-4bc5ef6c9da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:50.396738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c6f64-e80a-4741-8c7c-4bc5ef6c9da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:50.398204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c6f64-e80a-4741-8c7c-4bc5ef6c9da4 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:50.407075 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3685/7282] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:50 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:50.999659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:51.062566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f2aff-1503-4bb3-b541-14203caa8402 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:51.067255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:51.068595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:51.068919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:51.069179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] PATH_INFO: `/v3/users/68c6277ab56a4d1a9b02f1ba62e608bf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:51.070381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c6277ab56a4d1a9b02f1ba62e608bf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:51.072280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:51.250990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c6277ab56a4d1a9b02f1ba62e608bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:51.258211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c6277ab56a4d1a9b02f1ba62e608bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:51.269642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c6277ab56a4d1a9b02f1ba62e608bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:51.270289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c6277ab56a4d1a9b02f1ba62e608bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:51.271074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c6277ab56a4d1a9b02f1ba62e608bf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:51.388491 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3598/7283] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:50 2021] DELETE /identity/v3/users/68c6277ab56a4d1a9b02f1ba62e608bf => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:51.393050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:51.393567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:51.393684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:51.410887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:51.412074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:51.470804 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3686/7284] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:51.480705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:51.482116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:51.545798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828fc65-5fc9-4ef8-873c-de4a1d20033c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:51.549538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:51.550186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:51.550463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:51.550736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:51.560073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:51.563888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:51.571883 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3599/7285] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:35:52.102546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:52.104104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:52.121432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6224c-bc59-4a9f-be19-79a6295f7c90 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:52.136782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:52.138002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:52.138288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:52.138562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] PATH_INFO: `/v3/projects/772568b2382d492e88caeda66324c1c9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:52.139904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772568b2382d492e88caeda66324c1c9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:52.142056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:52.336282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772568b2382d492e88caeda66324c1c9', 'request_id': 'req-c4720a7a-3773-457e-bf90-c0cd1d289eb7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.398118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772568b2382d492e88caeda66324c1c9', 'request_id': 'req-c4720a7a-3773-457e-bf90-c0cd1d289eb7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.404797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772568b2382d492e88caeda66324c1c9', 'request_id': 'req-c4720a7a-3773-457e-bf90-c0cd1d289eb7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.415233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] The token cache is being invalidate because project 772568b2382d492e88caeda66324c1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:52.415541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.416179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.417723 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3687/7286] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:52 2021] DELETE /identity/v3/projects/772568b2382d492e88caeda66324c1c9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:52.425525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:52.435534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71809548-1e5b-482a-b5ed-77028a1521b9 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:52.492506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:52.493402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:52.493680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:52.493950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] PATH_INFO: `/v3/users/75bce69b0bb1472cb6cca088ee26c036` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:52.495269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bce69b0bb1472cb6cca088ee26c036)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:52.497272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:52.709144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bce69b0bb1472cb6cca088ee26c036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.715816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bce69b0bb1472cb6cca088ee26c036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.727513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bce69b0bb1472cb6cca088ee26c036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.728203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bce69b0bb1472cb6cca088ee26c036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.728831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4312f53c-6c8f-4003-8f70-6c85df7914c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bce69b0bb1472cb6cca088ee26c036'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:52.843595 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3600/7287] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:35:52 2021] DELETE /identity/v3/users/75bce69b0bb1472cb6cca088ee26c036 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:53.309080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:53.310573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:53.327824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4720a7a-3773-457e-bf90-c0cd1d289eb7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:53.402605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:53.403472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:53.403748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:53.404020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] PATH_INFO: `/v3/projects/bb40c95cae4340f182737ee8dc2232ba` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:53.405247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb40c95cae4340f182737ee8dc2232ba)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:53.407155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:53.546689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb40c95cae4340f182737ee8dc2232ba', 'request_id': 'req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:53.643592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb40c95cae4340f182737ee8dc2232ba', 'request_id': 'req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:53.654691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb40c95cae4340f182737ee8dc2232ba', 'request_id': 'req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:53.680102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] The token cache is being invalidate because project bb40c95cae4340f182737ee8dc2232ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:35:53.680102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:53.680102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ba0ba4a-dc62-4dd3-8616-3175be28aff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:35:53.680102 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3688/7288] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:35:53 2021] DELETE /identity/v3/projects/bb40c95cae4340f182737ee8dc2232ba => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:53.680978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152ec1-f926-4762-b1c4-7333f9c0d638 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:53.681457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152ec1-f926-4762-b1c4-7333f9c0d638 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:53.681660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84152ec1-f926-4762-b1c4-7333f9c0d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:53.699381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-84152ec1-f926-4762-b1c4-7333f9c0d638 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:53.700866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-84152ec1-f926-4762-b1c4-7333f9c0d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:53.770875 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3601/7289] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:35:53.780138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19f5d-f424-427c-b27d-3dd894446ba9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:53.780513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19f5d-f424-427c-b27d-3dd894446ba9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:53.780799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a19f5d-f424-427c-b27d-3dd894446ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:53.800091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-54a19f5d-f424-427c-b27d-3dd894446ba9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:53.801548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-54a19f5d-f424-427c-b27d-3dd894446ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:53.810200 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3689/7290] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:53.814651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84152ec1-f926-4762-b1c4-7333f9c0d638 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:53.825617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84152ec1-f926-4762-b1c4-7333f9c0d638 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:53.831052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:53.831721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:53.832007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:53.832290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:53.833137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:35:53.833394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:53.835649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:53.848348 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3602/7291] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:35:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:35:53.852988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19f5d-f424-427c-b27d-3dd894446ba9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:53.862621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a19f5d-f424-427c-b27d-3dd894446ba9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:53.867554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:53.870584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:53.870584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:53.870584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:53.870584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:53.871342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:53.964101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3690/7292] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:35:53 2021] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:35:53.965514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:53.975840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fbaab-33cd-4f19-9453-c389c9233eee admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:54.034756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:54.035446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:54.035730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:54.036512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:54.037933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:54.040047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:54.179109 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3603/7293] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:35:53 2021] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:35:54.180497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:54.190986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbd321-10ac-4b59-b7d9-aa5f70684c80 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:54.196429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:54.196866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:54.197208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:54.197482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:54.198265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:54.199785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:54.210508 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3691/7294] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:54.214853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:54.225428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2996fa-a3c8-484c-9299-0f1a6f035675 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:54.230827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f097f2c-b42f-47ab-bb05-4d8589cedd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:54.231521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097f2c-b42f-47ab-bb05-4d8589cedd0c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:54.231807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097f2c-b42f-47ab-bb05-4d8589cedd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:54.232086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097f2c-b42f-47ab-bb05-4d8589cedd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:54.232830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f097f2c-b42f-47ab-bb05-4d8589cedd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:54.234536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f097f2c-b42f-47ab-bb05-4d8589cedd0c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:54.245730 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3604/7295] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:35:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:35:54.251894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:54.262666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935e321-16a2-43b9-9a64-bc5a276f2c8f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:54.267262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:54.268124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:54.268397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:54.268666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] PATH_INFO: `/v3/projects/8b128fa80d8f41ce94e104a231c3069f/users/ab1d8e3c05a64747b9a159c46820702b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:54.283155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b128fa80d8f41ce94e104a231c3069f, user_id=ab1d8e3c05a64747b9a159c46820702b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:54.285822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:54.357987 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3692/7296] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:35:54 2021] PUT /identity/v3/projects/8b128fa80d8f41ce94e104a231c3069f/users/ab1d8e3c05a64747b9a159c46820702b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:35:54.368970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:54.369261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:54.369535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:54.400128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] MFA Rules not processed for user `ab1d8e3c05a64747b9a159c46820702b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:35:54.401373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:54.463106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3605/7297] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:35:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:35:54.474613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:35:54.476412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:35:54.534948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd357-f4cc-469f-ba4a-08fad1164ed2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:35:54.539137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:35:54.539829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:35:54.540109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:35:54.540380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:35:54.548509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:35:54.549947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:35:54.559225 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3693/7298] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:35:54 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:12.848772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:12.849304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:12.907703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dc583-a0ea-476f-9d09-003df7a1241a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:12.911704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:12.912335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:12.912615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:12.912912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:12.914745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:12.973529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:12.975094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:12.989481 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3606/7299] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:12 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:13.480042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:13.481579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:13.563572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf9a97-5863-46a5-94a1-49240bb33414 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:13.569005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3df9b-3991-4726-80bb-c2e1e8bc2b49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:13.569729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3df9b-3991-4726-80bb-c2e1e8bc2b49 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:13.575523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3df9b-3991-4726-80bb-c2e1e8bc2b49 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:13.575523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3df9b-3991-4726-80bb-c2e1e8bc2b49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:13.575523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69e3df9b-3991-4726-80bb-c2e1e8bc2b49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:13.587992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3df9b-3991-4726-80bb-c2e1e8bc2b49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:13.589725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3df9b-3991-4726-80bb-c2e1e8bc2b49 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:13.602148 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3694/7300] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:19.966218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:19.967681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:20.037766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed93ca-8b7d-4d4d-bd3d-3082df8c8e32 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:20.044856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:20.046200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:20.046623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:20.047036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] PATH_INFO: `/v3/users/a374b7bb43fb44df8b39ff0bee55d21e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:20.048791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a374b7bb43fb44df8b39ff0bee55d21e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:20.051936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:20.263007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a374b7bb43fb44df8b39ff0bee55d21e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:20.270462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a374b7bb43fb44df8b39ff0bee55d21e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:20.283641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a374b7bb43fb44df8b39ff0bee55d21e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:20.284360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a374b7bb43fb44df8b39ff0bee55d21e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:20.285026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a374b7bb43fb44df8b39ff0bee55d21e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:20.334779 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3607/7301] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:19 2021] DELETE /identity/v3/users/a374b7bb43fb44df8b39ff0bee55d21e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:20.339778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:20.340307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:20.340307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:20.361200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:20.363028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:20.429000 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3695/7302] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:20.440224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:20.440787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:20.501544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e214a-59bc-401b-928a-37cc61985a29 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:20.505164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b51da-2392-4c2c-838d-4a53c863f240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:20.509073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b51da-2392-4c2c-838d-4a53c863f240 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:20.509073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b51da-2392-4c2c-838d-4a53c863f240 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:20.509073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b51da-2392-4c2c-838d-4a53c863f240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:20.515814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b51da-2392-4c2c-838d-4a53c863f240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:20.517304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b51da-2392-4c2c-838d-4a53c863f240 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:20.527597 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3608/7303] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:20.942777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:20.946025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:20.957998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb992d-25c3-496c-a079-aad746a0a2ba None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:20.964331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:20.965265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:20.965547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:20.965819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] PATH_INFO: `/v3/projects/c530b50e6e7943e08432ece63ea91869` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:20.967115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c530b50e6e7943e08432ece63ea91869)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:20.969207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:21.090798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c530b50e6e7943e08432ece63ea91869', 'request_id': 'req-ca1cf55f-881f-48b1-b895-7fa56f4c409d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:21.152899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c530b50e6e7943e08432ece63ea91869', 'request_id': 'req-ca1cf55f-881f-48b1-b895-7fa56f4c409d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:21.160165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c530b50e6e7943e08432ece63ea91869', 'request_id': 'req-ca1cf55f-881f-48b1-b895-7fa56f4c409d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:21.170766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] The token cache is being invalidate because project c530b50e6e7943e08432ece63ea91869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:21.171054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:21.171762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ca1cf55f-881f-48b1-b895-7fa56f4c409d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:21.173321 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3696/7304] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:20 2021] DELETE /identity/v3/projects/c530b50e6e7943e08432ece63ea91869 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:21.184506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd0de-6718-4ba2-adca-679e2d9cdf7f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.185055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd0de-6718-4ba2-adca-679e2d9cdf7f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.185055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd0de-6718-4ba2-adca-679e2d9cdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.203993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3cdcd0de-6718-4ba2-adca-679e2d9cdf7f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:21.205214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3cdcd0de-6718-4ba2-adca-679e2d9cdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:21.267305 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3609/7305] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:21.274812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b33f7e-7bda-4dd2-bc89-469e88500d34 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.275094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b33f7e-7bda-4dd2-bc89-469e88500d34 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.275365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b33f7e-7bda-4dd2-bc89-469e88500d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.293831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a3b33f7e-7bda-4dd2-bc89-469e88500d34 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:21.295037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3b33f7e-7bda-4dd2-bc89-469e88500d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:21.302910 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3697/7306] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:21.307801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd0de-6718-4ba2-adca-679e2d9cdf7f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:21.317361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd0de-6718-4ba2-adca-679e2d9cdf7f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:21.322572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:21.323245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.323517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.323790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.324505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:21.324808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:21.326412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:21.337559 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3610/7307] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:21.341745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b33f7e-7bda-4dd2-bc89-469e88500d34 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:21.350820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b33f7e-7bda-4dd2-bc89-469e88500d34 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:21.355655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:21.356292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.356569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.356842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.361373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:21.361373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:21.456923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3698/7308] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:21 2021] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:21.461196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:21.471087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454cf03-c42a-4728-962f-423c8dc318e2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:21.526056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:21.526650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.526931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.527205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.527978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:21.529967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:21.627377 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3611/7309] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:21 2021] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:21.631579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:21.642152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4e1c9-df46-40ab-937a-99099462ba42 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:21.646998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:21.648157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.648157 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.648421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.649016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:21.650673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:21.661252 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3699/7310] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:21.665051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:21.675990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974aa15-4d73-49de-aea0-d06ec8174074 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:21.680717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dbdf8-ce12-4e69-ae80-e2868c7e4a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:21.682076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dbdf8-ce12-4e69-ae80-e2868c7e4a70 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.682358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dbdf8-ce12-4e69-ae80-e2868c7e4a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.682726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dbdf8-ce12-4e69-ae80-e2868c7e4a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.683415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dbdf8-ce12-4e69-ae80-e2868c7e4a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:21.685016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dbdf8-ce12-4e69-ae80-e2868c7e4a70 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:21.694883 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3612/7311] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:21.698928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:21.713704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684e960-9e99-4e01-9cd2-51f2d58488f7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:21.714510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:21.715418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.715699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.715972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] PATH_INFO: `/v3/projects/1cbcd5810b554d29b718a6b114e479b3/users/02d999afe00544a8a0b30f7f8d43cedb/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.731170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbcd5810b554d29b718a6b114e479b3, user_id=02d999afe00544a8a0b30f7f8d43cedb, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:21.733841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:21.845213 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3700/7312] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:21 2021] PUT /identity/v3/projects/1cbcd5810b554d29b718a6b114e479b3/users/02d999afe00544a8a0b30f7f8d43cedb/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:21.857730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f84f2-33fb-4370-9e7a-e5cffb728fc7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:21.858020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f84f2-33fb-4370-9e7a-e5cffb728fc7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:21.858297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f84f2-33fb-4370-9e7a-e5cffb728fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:21.885036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8b2f84f2-33fb-4370-9e7a-e5cffb728fc7 None None] MFA Rules not processed for user `02d999afe00544a8a0b30f7f8d43cedb`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:21.886235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b2f84f2-33fb-4370-9e7a-e5cffb728fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:21.953032 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3613/7313] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:21 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:21.955332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.015802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8986e-c33c-4c4e-814a-f4b4670a8311 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.020829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.022263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.022263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.022263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.022798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.024706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.096709 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3701/7314] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:21 2021] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:22.100785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f84f2-33fb-4370-9e7a-e5cffb728fc7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.112394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f84f2-33fb-4370-9e7a-e5cffb728fc7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.167807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.168528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.168810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.169113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.169804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.171758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.238077 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3614/7315] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:22 2021] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:22.242233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.252752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc6a0-9dec-4015-86d8-916db59d5582 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.257444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.258090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.258376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.258652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.259925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.261546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.272141 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3702/7316] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:22.277015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.287014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72bea-58ae-45ac-b8bb-b99fc5285aed admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.291899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.292767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.293080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.293358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] PATH_INFO: `/v3/projects/7ee81cdcbfc64f76acf668215524dc60/users/f38afe3220394af593efc5a689a2b9c9/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.308961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee81cdcbfc64f76acf668215524dc60, user_id=f38afe3220394af593efc5a689a2b9c9, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.311593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.398192 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3615/7317] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:22 2021] PUT /identity/v3/projects/7ee81cdcbfc64f76acf668215524dc60/users/f38afe3220394af593efc5a689a2b9c9/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:22.402824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.412985 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd65324-580a-476c-9ea5-a10fb9257ff4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.479068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa905-e102-4ca6-8701-8c7e4d015849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.479767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa905-e102-4ca6-8701-8c7e4d015849 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.480039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa905-e102-4ca6-8701-8c7e4d015849 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.480314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa905-e102-4ca6-8701-8c7e4d015849 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.481074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daa905-e102-4ca6-8701-8c7e4d015849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.482657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daa905-e102-4ca6-8701-8c7e4d015849 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.495564 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3703/7318] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:22 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:22.497087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.507384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e547c4-7e75-4776-9a19-7125e9cf11f4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.512757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.513654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.513998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.514267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] PATH_INFO: `/v3/projects/7ee81cdcbfc64f76acf668215524dc60/users/f38afe3220394af593efc5a689a2b9c9/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.516235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee81cdcbfc64f76acf668215524dc60, user_id=f38afe3220394af593efc5a689a2b9c9, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.518882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.529695 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3616/7319] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:22 2021] PUT /identity/v3/projects/7ee81cdcbfc64f76acf668215524dc60/users/f38afe3220394af593efc5a689a2b9c9/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:22.539743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75dc2-f092-49b3-95c3-cc4f0b272864 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.540037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75dc2-f092-49b3-95c3-cc4f0b272864 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.540317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75dc2-f092-49b3-95c3-cc4f0b272864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.565623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-41b75dc2-f092-49b3-95c3-cc4f0b272864 None None] MFA Rules not processed for user `f38afe3220394af593efc5a689a2b9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:22.566815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-41b75dc2-f092-49b3-95c3-cc4f0b272864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:22.633411 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3704/7320] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:22 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:22.638831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.649360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127c35a-2af2-424c-934b-bb9de95092f6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.653905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.654545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.654825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.655096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.655841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.657499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.755161 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3617/7321] 10.222.0.32 () {60 vars in 1148 bytes} [Sat Dec 25 21:36:22 2021] POST /identity/v3/domains => generated 275 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:22.760497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75dc2-f092-49b3-95c3-cc4f0b272864 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.770218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75dc2-f092-49b3-95c3-cc4f0b272864 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.824624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.825335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.825621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.825895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.826592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.828476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:22.924392 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3705/7322] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:22 2021] POST /identity/v3/groups => generated 281 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:22.928254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:22.938973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da63ae-332f-47db-87d5-f3d11fba15eb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:22.944911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:22.945192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:22.945476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:22.945756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2f46b15461d34a1daa4e8125f9359ec0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:22.957570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:update_group(group_id=2f46b15461d34a1daa4e8125f9359ec0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:22.958756 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:36:22.958756 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:36:22.958756 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:36:22.960152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.027231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3618/7323] 10.222.0.32 () {60 vars in 1246 bytes} [Sat Dec 25 21:36:22 2021] PATCH /identity/v3/groups/2f46b15461d34a1daa4e8125f9359ec0 => generated 293 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:23.031326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.042048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dd1fa-49b7-4896-b849-0916eceb198f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.046684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.047522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.047802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.048076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2f46b15461d34a1daa4e8125f9359ec0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.053152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:get_group(group_id=2f46b15461d34a1daa4e8125f9359ec0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.055109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.057430 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3706/7324] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:23 2021] GET /identity/v3/groups/2f46b15461d34a1daa4e8125f9359ec0 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:23.062171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.079769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e0ea1-bf4a-4c71-8b89-7a96cc05e274 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.084588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.085479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.085789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.086069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2f46b15461d34a1daa4e8125f9359ec0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.087342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:update_group(group_id=2f46b15461d34a1daa4e8125f9359ec0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.089338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.199059 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3619/7325] 10.222.0.32 () {60 vars in 1245 bytes} [Sat Dec 25 21:36:23 2021] PATCH /identity/v3/groups/2f46b15461d34a1daa4e8125f9359ec0 => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:23.203064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.213073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a749d-911a-414b-878d-4d5afc8db7d4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.217795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.218632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.219070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.219219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2f46b15461d34a1daa4e8125f9359ec0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.224127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2f46b15461d34a1daa4e8125f9359ec0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.226090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.357252 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3707/7326] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:36:23 2021] DELETE /identity/v3/groups/2f46b15461d34a1daa4e8125f9359ec0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:23.362280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.372565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770418f-1331-407c-a5b4-c6d36c33a6af tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.429394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.430049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.430330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.430605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.431286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.433184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.530925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3620/7327] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:23 2021] POST /identity/v3/groups => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:23.534957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.546033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5700e-65e4-4240-8504-bf37de30a358 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.552365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.552365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.552365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.552707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.552707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.554355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.624165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3708/7328] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:23 2021] POST /identity/v3/users => generated 323 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:23.628253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.638688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77baf3-0992-49ef-be65-8e5247488791 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.643323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.644200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.644487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.644757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/4e6fce00f2d84d53b76f379b3e298947` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.662960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2e081285a04b4067b39b53d572900272, user_id=4e6fce00f2d84d53b76f379b3e298947)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.664899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.752568 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3621/7329] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:36:23 2021] PUT /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/4e6fce00f2d84d53b76f379b3e298947 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:23.756756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.767860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e3a45-7fda-4cf8-a5e7-93583d5d3c21 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.823654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.824321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.824605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.824892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.825633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.827635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:23.951015 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3709/7330] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:23 2021] POST /identity/v3/users => generated 323 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:23.955238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:23.972566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba271fc8-801e-448f-b8cd-a7458f843064 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:23.972566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:23.973066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:23.973351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:23.973628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/cb83c7a84abc4315ab3aac281e4771ce` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:23.987893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2e081285a04b4067b39b53d572900272, user_id=cb83c7a84abc4315ab3aac281e4771ce)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:23.989832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.095772 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3622/7331] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:36:23 2021] PUT /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/cb83c7a84abc4315ab3aac281e4771ce => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:24.100032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:24.110351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc18b-d770-4838-8e02-ac1d6ebbb970 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:24.167655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:24.168394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:24.168742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:24.169071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:24.169777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:24.171847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.271526 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3710/7332] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:24 2021] POST /identity/v3/users => generated 323 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:24.275561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:24.285921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8c715-71c9-4b3d-a86d-263f03edaf8a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:24.290616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:24.291502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:24.291786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:24.292064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/782735eb45ce413687fb3889518ba1c9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:24.306714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2e081285a04b4067b39b53d572900272, user_id=782735eb45ce413687fb3889518ba1c9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:24.309250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.376357 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3623/7333] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:36:24 2021] PUT /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/782735eb45ce413687fb3889518ba1c9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:24.380699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:24.391772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4332-2b6e-46c9-b526-60c54f78ea60 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:24.446560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:24.447381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:24.447666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:24.448587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:24.449871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=2e081285a04b4067b39b53d572900272)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:24.451057 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:36:24.451057 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:36:24.451057 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:36:24.452229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.470720 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3711/7334] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:36:24 2021] GET /identity/v3/groups/2e081285a04b4067b39b53d572900272/users => generated 1085 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:24.482694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:24.487012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef3d9-0dd0-49e0-ad64-409af707079d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:24.492453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:24.493736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:24.494027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:24.494305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/4e6fce00f2d84d53b76f379b3e298947` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:24.497247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=2e081285a04b4067b39b53d572900272, user_id=4e6fce00f2d84d53b76f379b3e298947)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:24.498278 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:36:24.498278 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:36:24.498278 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:36:24.499800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.525156 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3624/7335] 10.222.0.32 () {58 vars in 1341 bytes} [Sat Dec 25 21:36:24 2021] HEAD /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/4e6fce00f2d84d53b76f379b3e298947 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:24.526632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:24.539126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809b0cd-4d1f-474a-9cc2-963f0932d77a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:24.549086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:24.549086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:24.549086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:24.549926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/4e6fce00f2d84d53b76f379b3e298947` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:24.550889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2e081285a04b4067b39b53d572900272, user_id=4e6fce00f2d84d53b76f379b3e298947)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:24.553543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.689425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4e6fce00f2d84d53b76f379b3e298947'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:24.776003 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3712/7336] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:36:24 2021] DELETE /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/4e6fce00f2d84d53b76f379b3e298947 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:24.780681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:24.790546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5e2a-75c1-4137-9067-bb7032a13b52 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:24.845982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:24.846874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:24.847160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:24.847457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/cb83c7a84abc4315ab3aac281e4771ce` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:24.849268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=2e081285a04b4067b39b53d572900272, user_id=cb83c7a84abc4315ab3aac281e4771ce)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:24.851160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.864906 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3625/7337] 10.222.0.32 () {58 vars in 1341 bytes} [Sat Dec 25 21:36:24 2021] HEAD /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/cb83c7a84abc4315ab3aac281e4771ce => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:24.869210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:24.880126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121241-14f4-49d1-a078-204531ba2017 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:24.884696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:24.886186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:24.886463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:24.886736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/cb83c7a84abc4315ab3aac281e4771ce` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:24.888759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2e081285a04b4067b39b53d572900272, user_id=cb83c7a84abc4315ab3aac281e4771ce)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:24.890670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:24.934476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cb83c7a84abc4315ab3aac281e4771ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:24.999693 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3713/7338] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:36:24 2021] DELETE /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/cb83c7a84abc4315ab3aac281e4771ce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:25.003733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:25.014629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd12ad7-5853-411a-b446-e36032497439 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:25.082621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:25.083533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:25.083939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:25.084343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/782735eb45ce413687fb3889518ba1c9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:25.086166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=2e081285a04b4067b39b53d572900272, user_id=782735eb45ce413687fb3889518ba1c9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:25.088692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:25.102434 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3626/7339] 10.222.0.32 () {58 vars in 1341 bytes} [Sat Dec 25 21:36:25 2021] HEAD /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/782735eb45ce413687fb3889518ba1c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:25.106523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:25.116887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e321-3fb9-421e-be44-2ada75c93819 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:25.122442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:25.123365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:25.123654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:25.123934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users/782735eb45ce413687fb3889518ba1c9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:25.125742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2e081285a04b4067b39b53d572900272, user_id=782735eb45ce413687fb3889518ba1c9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:25.127652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:25.266859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '782735eb45ce413687fb3889518ba1c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.394965 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3714/7340] 10.222.0.32 () {58 vars in 1343 bytes} [Sat Dec 25 21:36:25 2021] DELETE /identity/v3/groups/2e081285a04b4067b39b53d572900272/users/782735eb45ce413687fb3889518ba1c9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:25.399034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:25.409802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6caba-fe72-43f1-88d7-2d9aa8a5c653 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:25.467920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:25.468761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:25.469079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:25.469355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:25.470586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=2e081285a04b4067b39b53d572900272)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:25.471600 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:36:25.471600 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:36:25.471600 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:36:25.472773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:25.482808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3627/7341] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:36:25 2021] GET /identity/v3/groups/2e081285a04b4067b39b53d572900272/users => generated 145 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:25.487039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:25.503712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d0ea7-e69a-404f-80c8-9dd4e43aa07a tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:25.503712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:25.503988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:25.504245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:25.504536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users/782735eb45ce413687fb3889518ba1c9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:25.505979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_user(user_id=782735eb45ce413687fb3889518ba1c9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:25.508145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:25.607113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782735eb45ce413687fb3889518ba1c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.614608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782735eb45ce413687fb3889518ba1c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.621050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:25.622738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:25.631249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782735eb45ce413687fb3889518ba1c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.632388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782735eb45ce413687fb3889518ba1c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.692440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6510-a4f3-4dea-a3a6-c4c20dca788f tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:25.701195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:25.701195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:25.701195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:25.701195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] PATH_INFO: `/v3/users/ab1d8e3c05a64747b9a159c46820702b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:25.701649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1d8e3c05a64747b9a159c46820702b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:25.701968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:25.735784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782735eb45ce413687fb3889518ba1c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.742442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3715/7342] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:25 2021] DELETE /identity/v3/users/782735eb45ce413687fb3889518ba1c9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:25.746637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:25.748381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:25.836865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303bf5b-4829-4f18-a89e-e34624ec0e50 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:25.841435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:25.842299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:25.842603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:25.842872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users/cb83c7a84abc4315ab3aac281e4771ce` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:25.844088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cb83c7a84abc4315ab3aac281e4771ce)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:25.846032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:25.892498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1d8e3c05a64747b9a159c46820702b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.899639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1d8e3c05a64747b9a159c46820702b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.911420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1d8e3c05a64747b9a159c46820702b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.912120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1d8e3c05a64747b9a159c46820702b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.912732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e4e55bd3-d418-4918-a153-06168c678d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1d8e3c05a64747b9a159c46820702b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.952382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb83c7a84abc4315ab3aac281e4771ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.959132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb83c7a84abc4315ab3aac281e4771ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.971495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb83c7a84abc4315ab3aac281e4771ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.972249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb83c7a84abc4315ab3aac281e4771ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:25.982194 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3628/7343] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:25 2021] DELETE /identity/v3/users/ab1d8e3c05a64747b9a159c46820702b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:25.986719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:25.987069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:25.987349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.003783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:26.005008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:26.038434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb83c7a84abc4315ab3aac281e4771ce'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:26.044742 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3716/7344] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:25 2021] DELETE /identity/v3/users/cb83c7a84abc4315ab3aac281e4771ce => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:26.048799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:26.050180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:26.062205 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3629/7345] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:26.072796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:26.074779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:26.119268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea5cb6-8b94-4e8f-affc-51569045af53 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:26.124197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:26.125107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:26.125390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:26.125713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users/4e6fce00f2d84d53b76f379b3e298947` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.126875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4e6fce00f2d84d53b76f379b3e298947)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:26.128794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:26.142206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b53d-cd7e-420a-a7e4-8818dca16bd2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:26.189610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:26.190273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:26.190634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:26.190983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.241097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6fce00f2d84d53b76f379b3e298947'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:26.248807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6fce00f2d84d53b76f379b3e298947'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:26.255931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:26.257428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:26.261749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6fce00f2d84d53b76f379b3e298947'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:26.262916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6fce00f2d84d53b76f379b3e298947'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:26.270479 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3630/7346] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:26.359724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6fce00f2d84d53b76f379b3e298947'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:26.367380 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3717/7347] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:26 2021] DELETE /identity/v3/users/4e6fce00f2d84d53b76f379b3e298947 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:26.372388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:26.383328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f200df-fbfc-454d-a2fb-27ba033673b1 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:26.439970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:26.440746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:26.441078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:26.441360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/2e081285a04b4067b39b53d572900272` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.442658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2e081285a04b4067b39b53d572900272)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:26.445029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:26.542962 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3631/7348] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:36:26 2021] DELETE /identity/v3/groups/2e081285a04b4067b39b53d572900272 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:26.543138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:26.545318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:26.560382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204fd1e-4a7f-40d0-b3dd-3f6699899b59 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:26.621306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:26.621999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:26.622260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:26.622535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.623233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:26.625164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:26.715595 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3718/7349] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:26 2021] POST /identity/v3/groups => generated 326 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:26.715793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:26.717244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:26.718948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:26.740607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4784-ee5b-4759-bc37-e42949626978 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:26.748587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:26.749892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:26.750628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:26.751109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.752022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:26.754171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:26.787656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ea573-aef1-446a-8d1c-d8391086c323 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:26.793657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:26.796408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:26.796408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:26.796408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] PATH_INFO: `/v3/projects/8b128fa80d8f41ce94e104a231c3069f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.796408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b128fa80d8f41ce94e104a231c3069f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:26.798299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:26.879186 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3719/7350] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:26 2021] POST /identity/v3/groups => generated 326 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:26.882012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:26.892275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d810-ab15-4c66-a6b1-256b94524660 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:26.901359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:26.902134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:26.910190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:26.910190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:26.910190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:26.910190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:26.917708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b128fa80d8f41ce94e104a231c3069f', 'request_id': 'req-6427c628-c601-4777-9a16-cb2db4d07a2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:26.924100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b128fa80d8f41ce94e104a231c3069f', 'request_id': 'req-6427c628-c601-4777-9a16-cb2db4d07a2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.010420 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3720/7351] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:26 2021] POST /identity/v3/groups => generated 327 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:27.014726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.025903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91528fe5-8687-4a33-aadb-aecbc16083b1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.032825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b128fa80d8f41ce94e104a231c3069f', 'request_id': 'req-6427c628-c601-4777-9a16-cb2db4d07a2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.045047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] The token cache is being invalidate because project 8b128fa80d8f41ce94e104a231c3069f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:27.045336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.046039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6427c628-c601-4777-9a16-cb2db4d07a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.047659 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3632/7352] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:26 2021] DELETE /identity/v3/projects/8b128fa80d8f41ce94e104a231c3069f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:27.053408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7adaa0-1feb-44ad-b8bc-0497b69d87a9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.053764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7adaa0-1feb-44ad-b8bc-0497b69d87a9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.054045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7adaa0-1feb-44ad-b8bc-0497b69d87a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.076674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7a7adaa0-1feb-44ad-b8bc-0497b69d87a9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:27.077976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7a7adaa0-1feb-44ad-b8bc-0497b69d87a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:27.095390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.096063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.096344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.096625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.097388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.098403 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:36:27.098403 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:36:27.098403 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:36:27.099631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.108173 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3721/7353] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:36:27 2021] GET /identity/v3/groups => generated 1489 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:27.113693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.116248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:27.128986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a510a82-3bf7-48ab-8dfe-d9929f547b96 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.135191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.139242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.139242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.139242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/1dd49f1722764a65808da1e19c58c98e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.143092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1dd49f1722764a65808da1e19c58c98e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.145169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.146142 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3633/7354] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:27.155298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadae93-c711-4e09-8c6c-0025dcce2f06 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.155617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadae93-c711-4e09-8c6c-0025dcce2f06 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.156019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadae93-c711-4e09-8c6c-0025dcce2f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.174520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-adadae93-c711-4e09-8c6c-0025dcce2f06 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:27.175708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-adadae93-c711-4e09-8c6c-0025dcce2f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:27.183770 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3634/7355] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:27.187744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadae93-c711-4e09-8c6c-0025dcce2f06 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.196515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadae93-c711-4e09-8c6c-0025dcce2f06 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.201140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.201753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.202038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.202313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.203081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:27.203389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.204997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.224359 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3635/7356] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:36:27.227373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.237711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da8ff3-a5dd-4b49-80eb-dc5aa1d0ae02 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.242450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.243102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.243388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.243666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.244383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.246270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.260762 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3722/7357] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:36:27 2021] DELETE /identity/v3/groups/1dd49f1722764a65808da1e19c58c98e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:27.264979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.325460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fc5fe-a2e4-4780-b630-172ed3eb4efa tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.330260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.331110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.331396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.331673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/0efe925dbf19404881d034e56aed2514` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.336757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0efe925dbf19404881d034e56aed2514)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.341821 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3636/7358] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:27 2021] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:27.341990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.342657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.413514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262589-f903-4c4f-95ee-9e6c0e1debc7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.419097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.420987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.420987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.420987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.421317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.423091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.449757 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3723/7359] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:36:27 2021] DELETE /identity/v3/groups/0efe925dbf19404881d034e56aed2514 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:27.454289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.515323 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3637/7360] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:27 2021] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:27.517889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.519673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:27.521456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e88ba5-3f8a-453d-b620-090a1dd2f1c4 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.526953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.527802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.528113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.528999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/9a13d9478f0a49648d5d357c47747c99` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.532366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545fc1-7150-4fe2-884c-5ce00905ac2c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.533384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9a13d9478f0a49648d5d357c47747c99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.535340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.587647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.589356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.589636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.589912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] PATH_INFO: `/v3/users/35e0fca3dd5a40628cf232685f11edf5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.591162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e0fca3dd5a40628cf232685f11edf5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.593148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.620489 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3724/7361] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:36:27 2021] DELETE /identity/v3/groups/9a13d9478f0a49648d5d357c47747c99 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:27.621355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.684573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137b12-809e-409a-8284-307b67c0f23e tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.689527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.690189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.690475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.690734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.691577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.693178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.703705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3725/7362] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:27 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:27.704478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.767104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f019-a3a8-4e65-88bc-cd0ad5e70eac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.772173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.772838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.774335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.774335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.774335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.776208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.788467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e0fca3dd5a40628cf232685f11edf5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.798447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e0fca3dd5a40628cf232685f11edf5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.812548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e0fca3dd5a40628cf232685f11edf5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.813290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e0fca3dd5a40628cf232685f11edf5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.813978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e0fca3dd5a40628cf232685f11edf5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:27.882620 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3726/7363] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:27 2021] POST /identity/v3/users => generated 321 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:27.883908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.886342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:27.900892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3ec2f-f65a-433f-a515-a9272dd1e0fb tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.902111 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3638/7364] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:27 2021] DELETE /identity/v3/users/35e0fca3dd5a40628cf232685f11edf5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:27.905189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:27.905189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:27.959009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba3e04-de7b-4b59-bd57-178c8feda36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.959682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3e04-de7b-4b59-bd57-178c8feda36c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.960125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3e04-de7b-4b59-bd57-178c8feda36c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.960402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3e04-de7b-4b59-bd57-178c8feda36c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.961276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba3e04-de7b-4b59-bd57-178c8feda36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.963168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba3e04-de7b-4b59-bd57-178c8feda36c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.970059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d9a4-a2f1-4b9e-9a1f-d0c5607b11ba admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:27.974778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:27.978066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3727/7365] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:27 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:27.978198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.978198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.978198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.978533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51735b83-cb7e-41a8-b567-a5ab945afe7f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:27.978533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51735b83-cb7e-41a8-b567-a5ab945afe7f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:27.978720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:27.978831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51735b83-cb7e-41a8-b567-a5ab945afe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:27.978941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:27.994811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-51735b83-cb7e-41a8-b567-a5ab945afe7f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:27.996681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-51735b83-cb7e-41a8-b567-a5ab945afe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:28.004828 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3728/7366] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:28.005635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51735b83-cb7e-41a8-b567-a5ab945afe7f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.016015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51735b83-cb7e-41a8-b567-a5ab945afe7f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.021233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.022049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.022350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.022621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] PATH_INFO: `/v3/projects/be78166c9f60433db2d55212d563610b/users/d5401ab34b3b4de1b516d5d367b9748b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.036109 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3639/7367] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:27 2021] POST /identity/v3/groups => generated 326 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:28.036109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.036109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:28.040845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be78166c9f60433db2d55212d563610b, user_id=d5401ab34b3b4de1b516d5d367b9748b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.041990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.094841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44056ebc-68f0-4e38-9017-5e2ce32ed9f3 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.098542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e53db-e66f-40ab-9fb0-9e6caf44282f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.099197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e53db-e66f-40ab-9fb0-9e6caf44282f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.099484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e53db-e66f-40ab-9fb0-9e6caf44282f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.099766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e53db-e66f-40ab-9fb0-9e6caf44282f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.109334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e53db-e66f-40ab-9fb0-9e6caf44282f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.110780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e53db-e66f-40ab-9fb0-9e6caf44282f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.119101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3729/7368] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:28 2021] PUT /identity/v3/projects/be78166c9f60433db2d55212d563610b/users/d5401ab34b3b4de1b516d5d367b9748b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:28.121116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.121929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3640/7369] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:28.130335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335196c-ad8f-40d3-925e-88aeec015531 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.130629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335196c-ad8f-40d3-925e-88aeec015531 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.130909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335196c-ad8f-40d3-925e-88aeec015531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.159550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5335196c-ad8f-40d3-925e-88aeec015531 None None] MFA Rules not processed for user `d5401ab34b3b4de1b516d5d367b9748b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:28.160771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5335196c-ad8f-40d3-925e-88aeec015531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:28.189556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1634b-c056-4e66-9d37-30acda622deb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.195302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.196228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.196507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.196987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/41795be789be4e24a86aacb5d74e11be/users/704b399a4b004219a3bdcce8842a4612` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.217128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=41795be789be4e24a86aacb5d74e11be, user_id=704b399a4b004219a3bdcce8842a4612)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.219303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.231459 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3641/7370] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:28 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:28.235811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335196c-ad8f-40d3-925e-88aeec015531 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.298619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335196c-ad8f-40d3-925e-88aeec015531 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.303683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.304437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.304727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.305217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.305913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.308478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.320313 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3730/7371] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:36:28 2021] PUT /identity/v3/groups/41795be789be4e24a86aacb5d74e11be/users/704b399a4b004219a3bdcce8842a4612 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:28.324212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.403694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793e8c-61ad-4883-8964-ec8342e2beac tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.413159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.413834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.414308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.415363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.416411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.419499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.433647 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3642/7372] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:28 2021] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:28.437704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.502140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9b7d-9f7a-41e1-9fab-ad7236fe48e7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.506887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.507551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.507837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.508118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.508835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.510810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.549284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3731/7373] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:28 2021] POST /identity/v3/groups => generated 326 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:28.552823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.564195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d1eed-e197-4557-be4a-768b06d2d48d tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.622397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.623501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.623867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.624055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/933201eb9e524193bea1d9355115cffc/users/704b399a4b004219a3bdcce8842a4612` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.629729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=933201eb9e524193bea1d9355115cffc, user_id=704b399a4b004219a3bdcce8842a4612)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.631634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.644751 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3643/7374] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:28 2021] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:28.645582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.647475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:28.659801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1a997-e1ce-4682-985e-6430465ce549 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.664852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.665795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.666118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.666414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] PATH_INFO: `/v3/projects/5a489896e9e44cfab05ddcf2bec0b1f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.668288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a489896e9e44cfab05ddcf2bec0b1f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.670250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.788144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3732/7375] 10.222.0.32 () {60 vars in 1359 bytes} [Sat Dec 25 21:36:28 2021] PUT /identity/v3/groups/933201eb9e524193bea1d9355115cffc/users/704b399a4b004219a3bdcce8842a4612 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:28.791223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.811744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a489896e9e44cfab05ddcf2bec0b1f8', 'request_id': 'req-b3850e23-288e-45ce-aebf-0ca898813157'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:28.818659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a489896e9e44cfab05ddcf2bec0b1f8', 'request_id': 'req-b3850e23-288e-45ce-aebf-0ca898813157'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:28.851267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ef31-18ee-4c7c-a87c-8fee7d4c2457 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.907346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.908013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.908299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.908577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.909344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.910942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.912627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a489896e9e44cfab05ddcf2bec0b1f8', 'request_id': 'req-b3850e23-288e-45ce-aebf-0ca898813157'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:28.921181 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3733/7376] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:28 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:28.922049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.924301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] The token cache is being invalidate because project 5a489896e9e44cfab05ddcf2bec0b1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:28.924839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:28.925506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:28.927247 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3644/7377] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:28 2021] DELETE /identity/v3/projects/5a489896e9e44cfab05ddcf2bec0b1f8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:28.927970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:28.929387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:28.941860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3850e23-288e-45ce-aebf-0ca898813157 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.952788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.953723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.954032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.954310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] PATH_INFO: `/v3/projects/187abdf716bc49d8bb8d23f5bf25d1b4/users/d93d062139bf48e49eabc47952422ad3/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.971554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187abdf716bc49d8bb8d23f5bf25d1b4, user_id=d93d062139bf48e49eabc47952422ad3, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.974309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:28.984812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e2dc1-3330-41e3-8b6a-0b7dd5d2c636 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:28.989534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:28.990394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:28.991197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:28.991197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users/704b399a4b004219a3bdcce8842a4612/groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:28.992264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=704b399a4b004219a3bdcce8842a4612)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:28.994376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.009182 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3734/7378] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:36:28 2021] GET /identity/v3/users/704b399a4b004219a3bdcce8842a4612/groups => generated 838 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:29.010013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.012515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.025870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cede7-b798-4e22-b635-bdf12588f163 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.031246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.032114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.032397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.032670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] PATH_INFO: `/v3/users/18b0353f3bfe4a2987f00e525ad759a5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.034049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b0353f3bfe4a2987f00e525ad759a5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.035870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.072452 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3645/7379] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:28 2021] PUT /identity/v3/projects/187abdf716bc49d8bb8d23f5bf25d1b4/users/d93d062139bf48e49eabc47952422ad3/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:29.073775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.075328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.147892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed1d8-e240-4575-9861-0095e9340789 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.153071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.153920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.154199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.154473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/933201eb9e524193bea1d9355115cffc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.155718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_group(group_id=933201eb9e524193bea1d9355115cffc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.157756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.200333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b0353f3bfe4a2987f00e525ad759a5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.207188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b0353f3bfe4a2987f00e525ad759a5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.220267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b0353f3bfe4a2987f00e525ad759a5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.221132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b0353f3bfe4a2987f00e525ad759a5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.329679 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3646/7380] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:36:29 2021] DELETE /identity/v3/groups/933201eb9e524193bea1d9355115cffc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:29.330453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.375271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b0353f3bfe4a2987f00e525ad759a5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.382039 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3735/7381] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:29 2021] DELETE /identity/v3/users/18b0353f3bfe4a2987f00e525ad759a5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:29.382880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.384197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.391226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d1c1-6822-4a39-bb65-ed1f20110eb1 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.455575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.456256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.456535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.456807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.457567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.459152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.462112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad538af-174a-492e-8184-da46747c3ece admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.467590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.468535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.468865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.469389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/groups/41795be789be4e24a86aacb5d74e11be` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.473004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_group(group_id=41795be789be4e24a86aacb5d74e11be)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.475183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.479286 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3647/7382] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:29 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:29.483485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.485248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.498281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9abb9-bf58-41a7-88e7-1df8ca1c5d6c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.503148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fc777-148a-4b7d-8e93-3fea666e1af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.504026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fc777-148a-4b7d-8e93-3fea666e1af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.504306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fc777-148a-4b7d-8e93-3fea666e1af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.504576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fc777-148a-4b7d-8e93-3fea666e1af4 admin admin] PATH_INFO: `/v3/projects/187abdf716bc49d8bb8d23f5bf25d1b4/users/d93d062139bf48e49eabc47952422ad3/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.506703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fc777-148a-4b7d-8e93-3fea666e1af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187abdf716bc49d8bb8d23f5bf25d1b4, user_id=d93d062139bf48e49eabc47952422ad3, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.509340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fc777-148a-4b7d-8e93-3fea666e1af4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.522386 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3648/7383] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:29 2021] PUT /identity/v3/projects/187abdf716bc49d8bb8d23f5bf25d1b4/users/d93d062139bf48e49eabc47952422ad3/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:29.532405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.532695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.533020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.559650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] MFA Rules not processed for user `d93d062139bf48e49eabc47952422ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:29.560846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.587277 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3736/7384] 10.222.0.32 () {58 vars in 1226 bytes} [Sat Dec 25 21:36:29 2021] DELETE /identity/v3/groups/41795be789be4e24a86aacb5d74e11be => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:29.593596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.647196 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3649/7385] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:29 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:29.656910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.659209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.664441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3bdb4-da93-40d2-b5dc-4b65d9b679b5 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.669328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.670201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.670480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.670847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/users/704b399a4b004219a3bdcce8842a4612` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.672086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_user(user_id=704b399a4b004219a3bdcce8842a4612)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.674048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.719752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14907c3-3533-4403-a7ac-20daf5b0bac1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.768158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.768804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.769124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.769404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.771220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.804392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704b399a4b004219a3bdcce8842a4612'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.812005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704b399a4b004219a3bdcce8842a4612'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.824331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704b399a4b004219a3bdcce8842a4612'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.825129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704b399a4b004219a3bdcce8842a4612'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.829816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.834569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:29.840737 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3650/7386] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:29 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:29.841638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.842971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.919140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704b399a4b004219a3bdcce8842a4612'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:29.925101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fe0bc-55c8-4e8d-8b16-4a8eb582b22d service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:29.925717 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3737/7387] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:29 2021] DELETE /identity/v3/users/704b399a4b004219a3bdcce8842a4612 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:29.931264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:29.933378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:29.985015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:29.985930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:29.986212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:29.986507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] PATH_INFO: `/v3/projects/ccc4f0d845ce4759bce20484724b3a13` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:29.988095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc4f0d845ce4759bce20484724b3a13)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:29.989874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:30.007247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df4e42-1a9f-479d-8634-d6051184cdef tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:30.011946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:30.013086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:30.013368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:30.013640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/domains/387616e01aa347b3ba6f53b4c09d32a2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:30.015104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=387616e01aa347b3ba6f53b4c09d32a2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:30.016670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:30.036086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.037060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.118581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc4f0d845ce4759bce20484724b3a13', 'request_id': 'req-477de655-3920-4ed4-922f-6e3b00210b45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.124580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc4f0d845ce4759bce20484724b3a13', 'request_id': 'req-477de655-3920-4ed4-922f-6e3b00210b45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.169641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.170286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.172851 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3738/7388] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:36:29 2021] PATCH /identity/v3/domains/387616e01aa347b3ba6f53b4c09d32a2 => generated 276 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:30.176783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:30.178116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:30.215957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc4f0d845ce4759bce20484724b3a13', 'request_id': 'req-477de655-3920-4ed4-922f-6e3b00210b45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.227111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] The token cache is being invalidate because project ccc4f0d845ce4759bce20484724b3a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:30.227393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.228043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.230252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3651/7389] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:29 2021] DELETE /identity/v3/projects/ccc4f0d845ce4759bce20484724b3a13 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:30.234265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:30.235619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:30.244332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301fac4-473c-4da7-90d7-5bea400b8c28 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:30.299343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de655-3920-4ed4-922f-6e3b00210b45 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:30.300134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38afe3220394af593efc5a689a2b9c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee81cdcbfc64f76acf668215524dc60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:30.301084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:30.301309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:30.301596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] PATH_INFO: `/v3/domains/387616e01aa347b3ba6f53b4c09d32a2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:30.304224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:30.305118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:30.305408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:30.305688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] PATH_INFO: `/v3/users/89f2dea2780f4936920a6aca4839cb05` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:30.306966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f2dea2780f4936920a6aca4839cb05)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:30.308955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:30.313085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=387616e01aa347b3ba6f53b4c09d32a2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:30.316424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:30.338392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.348700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.508777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f2dea2780f4936920a6aca4839cb05'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.509278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2', 'request_id': 'req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.516246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f2dea2780f4936920a6aca4839cb05'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.547271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f2dea2780f4936920a6aca4839cb05'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.548393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f2dea2780f4936920a6aca4839cb05'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.549186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d75867bd-9058-44a1-be7a-ea1ffbfa7fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f2dea2780f4936920a6aca4839cb05'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.564927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2', 'request_id': 'req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.572206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2', 'request_id': 'req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.583650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] The token cache is being invalidate because project 387616e01aa347b3ba6f53b4c09d32a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:30.583866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.584548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.592504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2', 'request_id': 'req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.593179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2', 'request_id': 'req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.593791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '387616e01aa347b3ba6f53b4c09d32a2', 'request_id': 'req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.601809 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3739/7390] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:36:30 2021] DELETE /identity/v3/domains/387616e01aa347b3ba6f53b4c09d32a2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:30.605664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:30.606986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:30.662031 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3652/7391] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:30 2021] DELETE /identity/v3/users/89f2dea2780f4936920a6aca4839cb05 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:30.675260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34aab67-23af-49b3-ab8f-fe92fa6a65a2 tempest-GroupsV3TestJSON-621043488 tempest-GroupsV3TestJSON-621043488-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:30.731866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:30.732550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:30.732843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:30.734573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] PATH_INFO: `/v3/users/02d999afe00544a8a0b30f7f8d43cedb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:30.734573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d999afe00544a8a0b30f7f8d43cedb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:30.736389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:30.931450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d999afe00544a8a0b30f7f8d43cedb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.939721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d999afe00544a8a0b30f7f8d43cedb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.954364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d999afe00544a8a0b30f7f8d43cedb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:30.955187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d999afe00544a8a0b30f7f8d43cedb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.016030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d999afe00544a8a0b30f7f8d43cedb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.022579 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3740/7392] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:30 2021] DELETE /identity/v3/users/02d999afe00544a8a0b30f7f8d43cedb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:31.027214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.027503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.027784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.044787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:31.046158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.083964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.085415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.108788 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3653/7393] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:31.118963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.120948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.163089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4970de-d319-4f66-aafe-67e1c313333e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.168190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.169071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.169349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.169617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] PATH_INFO: `/v3/projects/c6b83f9204bf4748ad1452b448e5e25f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.170799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b83f9204bf4748ad1452b448e5e25f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.172760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.180024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9cb5c-f849-4230-8def-f56978bf12cc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.184168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8dcbd-d776-4d75-a62b-74166748a59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.184977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8dcbd-d776-4d75-a62b-74166748a59f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.185259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8dcbd-d776-4d75-a62b-74166748a59f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.185539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8dcbd-d776-4d75-a62b-74166748a59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.199559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8dcbd-d776-4d75-a62b-74166748a59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.201293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8dcbd-d776-4d75-a62b-74166748a59f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.210902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3654/7394] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:31.312686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b83f9204bf4748ad1452b448e5e25f', 'request_id': 'req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.398451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b83f9204bf4748ad1452b448e5e25f', 'request_id': 'req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.405749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b83f9204bf4748ad1452b448e5e25f', 'request_id': 'req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.416239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] The token cache is being invalidate because project c6b83f9204bf4748ad1452b448e5e25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:31.416525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.417752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-56a9b5a0-a04e-490b-a5e4-6fc43fedc94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.424958 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3741/7395] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:31 2021] DELETE /identity/v3/projects/c6b83f9204bf4748ad1452b448e5e25f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:31.429135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9510-4cfe-4d4c-8ac1-3e2ca0bcfe7d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.429495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9510-4cfe-4d4c-8ac1-3e2ca0bcfe7d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.429855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9510-4cfe-4d4c-8ac1-3e2ca0bcfe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.449170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f70b9510-4cfe-4d4c-8ac1-3e2ca0bcfe7d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:31.450420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f70b9510-4cfe-4d4c-8ac1-3e2ca0bcfe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.512885 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3655/7396] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:31.520930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9862-4458-41de-949d-ace29aa7b61c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.521287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9862-4458-41de-949d-ace29aa7b61c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.521567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9862-4458-41de-949d-ace29aa7b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.539885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-087f9862-4458-41de-949d-ace29aa7b61c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:31.541116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-087f9862-4458-41de-949d-ace29aa7b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.549778 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3742/7397] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:31.553992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b9510-4cfe-4d4c-8ac1-3e2ca0bcfe7d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.564392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b9510-4cfe-4d4c-8ac1-3e2ca0bcfe7d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.568984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.569631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.569913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.570210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.570931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:31.572697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.573353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.589174 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3656/7398] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:31.591612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9862-4458-41de-949d-ace29aa7b61c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.605001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9862-4458-41de-949d-ace29aa7b61c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.614680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.614680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.614680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.614680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.617552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.617715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.620206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.621327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.644154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c5de8-dde2-4484-b327-07b16731e3fd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.649027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.649940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.650217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.650487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] PATH_INFO: `/v3/projects/1cbcd5810b554d29b718a6b114e479b3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.652258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbcd5810b554d29b718a6b114e479b3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.654662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.740524 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3743/7399] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:31 2021] POST /identity/v3/projects => generated 399 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:31.741666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.777155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbcd5810b554d29b718a6b114e479b3', 'request_id': 'req-c482bebd-05db-4d39-b8eb-8fd5797f5164'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.783939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbcd5810b554d29b718a6b114e479b3', 'request_id': 'req-c482bebd-05db-4d39-b8eb-8fd5797f5164'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.803624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d289de9-8a45-4cdf-a684-6193bb63fa05 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.850175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbcd5810b554d29b718a6b114e479b3', 'request_id': 'req-c482bebd-05db-4d39-b8eb-8fd5797f5164'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.858413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.861250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.861250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.861250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.861250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.862294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.862963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] The token cache is being invalidate because project 1cbcd5810b554d29b718a6b114e479b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:31.863249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.863874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:31.865469 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3657/7400] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:31 2021] DELETE /identity/v3/projects/1cbcd5810b554d29b718a6b114e479b3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:31.869253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.870594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.883632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482bebd-05db-4d39-b8eb-8fd5797f5164 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.888673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.889584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.889868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.890143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] PATH_INFO: `/v3/users/f38afe3220394af593efc5a689a2b9c9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.891359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38afe3220394af593efc5a689a2b9c9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.893430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.950624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3744/7401] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:31 2021] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:31.952003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.953668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:31.966373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23523cbb-f0bf-442e-b393-4a6e37db9518 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:31.971054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:31.971702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:31.971982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:31.972252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:31.973009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:31.974573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:31.984272 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3745/7402] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:31.988015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:31.997141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee71d7-51c5-41d5-9e7f-9d7d1d93b9b5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.003748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.003748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.003748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.003748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.004162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.005136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.017714 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3746/7403] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:32.021611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:32.032071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6de90-4358-4509-b74d-84b24f63582f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.037663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1da47-7e07-4496-a29a-9326e6fa572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.038677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1da47-7e07-4496-a29a-9326e6fa572e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.038986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1da47-7e07-4496-a29a-9326e6fa572e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.039320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1da47-7e07-4496-a29a-9326e6fa572e admin admin] PATH_INFO: `/v3/projects/86b8877084634b8da7fbff8c88e8621f/users/785ab23935ec489fb8e8563e95f38caf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.054216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1da47-7e07-4496-a29a-9326e6fa572e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b8877084634b8da7fbff8c88e8621f, user_id=785ab23935ec489fb8e8563e95f38caf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.056807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1da47-7e07-4496-a29a-9326e6fa572e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.078061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38afe3220394af593efc5a689a2b9c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:32.084900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38afe3220394af593efc5a689a2b9c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:32.098603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38afe3220394af593efc5a689a2b9c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:32.099573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38afe3220394af593efc5a689a2b9c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:32.100645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38afe3220394af593efc5a689a2b9c9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:32.124695 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3747/7404] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:32 2021] PUT /identity/v3/projects/86b8877084634b8da7fbff8c88e8621f/users/785ab23935ec489fb8e8563e95f38caf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:32.135836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82dc0-2f07-429d-9285-62c01375bf06 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.136123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82dc0-2f07-429d-9285-62c01375bf06 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.138265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82dc0-2f07-429d-9285-62c01375bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.164164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-44b82dc0-2f07-429d-9285-62c01375bf06 None None] MFA Rules not processed for user `785ab23935ec489fb8e8563e95f38caf`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:32.165431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-44b82dc0-2f07-429d-9285-62c01375bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:32.180965 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3658/7405] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:31 2021] DELETE /identity/v3/users/f38afe3220394af593efc5a689a2b9c9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:32.233988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3748/7406] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:32 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:32.238755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:32.240168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:32.314645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31d93-24bc-40b6-9685-fa2278227dc8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.319354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.320010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.320307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.320561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.321368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.323309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.443198 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3659/7407] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:32 2021] POST /identity/v3/projects => generated 401 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:32.444606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82dc0-2f07-429d-9285-62c01375bf06 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:32.509108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82dc0-2f07-429d-9285-62c01375bf06 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.563903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.564565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.564941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.565149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.565888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.567794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.611819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:32.613594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:32.639985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42279865-a30d-4435-84b6-1c7c74cf06f3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.645500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.646412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.646653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.646921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] PATH_INFO: `/v3/projects/7ee81cdcbfc64f76acf668215524dc60` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.648206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee81cdcbfc64f76acf668215524dc60)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.650292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.657341 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3749/7408] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:32 2021] POST /identity/v3/users => generated 307 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:32.660145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:32.671975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6b4f8-2f21-4e80-884b-6e61c06f543a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.677958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.678691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.678978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.679245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.680054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.681790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.693152 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3750/7409] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:32.697458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:32.707367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306baf5-e05e-4a80-8b92-3e2580c313de admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.716486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.717599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.717761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.717917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] PATH_INFO: `/v3/projects/6c0a83d39cba4d55a5d03a51601c9b5a/users/e6d94582f8e3484c86a5c8a6073e908e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.734551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0a83d39cba4d55a5d03a51601c9b5a, user_id=e6d94582f8e3484c86a5c8a6073e908e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.736956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.862647 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3751/7410] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:32 2021] PUT /identity/v3/projects/6c0a83d39cba4d55a5d03a51601c9b5a/users/e6d94582f8e3484c86a5c8a6073e908e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:32.866637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:32.870544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee81cdcbfc64f76acf668215524dc60', 'request_id': 'req-2c905a2a-7233-406f-a6ae-a5f843afe5bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:32.878655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee81cdcbfc64f76acf668215524dc60', 'request_id': 'req-2c905a2a-7233-406f-a6ae-a5f843afe5bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:32.927411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce562-f78d-4ffd-91e2-f5847b689b97 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:32.986141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:32.986807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:32.987090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:32.987367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:32.988100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:32.989719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:32.998589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee81cdcbfc64f76acf668215524dc60', 'request_id': 'req-2c905a2a-7233-406f-a6ae-a5f843afe5bd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:33.000251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3752/7411] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:32 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:33.004401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.010687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] The token cache is being invalidate because project 7ee81cdcbfc64f76acf668215524dc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:33.011006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:33.011655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2c905a2a-7233-406f-a6ae-a5f843afe5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:33.013711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3660/7412] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:32 2021] DELETE /identity/v3/projects/7ee81cdcbfc64f76acf668215524dc60 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:33.018085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88eb1-a697-414a-bd43-d91475c63776 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.020216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d4de-30ab-40a6-889c-84a11ab281dd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.020515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d4de-30ab-40a6-889c-84a11ab281dd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.024099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d4de-30ab-40a6-889c-84a11ab281dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.037568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdcdad-c80d-49ef-b089-11a1f1ccb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.038225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdcdad-c80d-49ef-b089-11a1f1ccb59b admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.039011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdcdad-c80d-49ef-b089-11a1f1ccb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.039011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdcdad-c80d-49ef-b089-11a1f1ccb59b admin admin] PATH_INFO: `/v3/projects/6c0a83d39cba4d55a5d03a51601c9b5a/users/e6d94582f8e3484c86a5c8a6073e908e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.041039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdcdad-c80d-49ef-b089-11a1f1ccb59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0a83d39cba4d55a5d03a51601c9b5a, user_id=e6d94582f8e3484c86a5c8a6073e908e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.043733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f2c8d4de-30ab-40a6-889c-84a11ab281dd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:33.045108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2c8d4de-30ab-40a6-889c-84a11ab281dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:33.045395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdcdad-c80d-49ef-b089-11a1f1ccb59b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.054031 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3661/7413] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:33.061200 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3753/7414] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:33 2021] PUT /identity/v3/projects/6c0a83d39cba4d55a5d03a51601c9b5a/users/e6d94582f8e3484c86a5c8a6073e908e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:33.062189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c6f0-3b7b-4fe5-84b8-9bd0fc680dfd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.062573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c6f0-3b7b-4fe5-84b8-9bd0fc680dfd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.062948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c6f0-3b7b-4fe5-84b8-9bd0fc680dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.075971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db86c-15d7-428a-8c08-f245203aa237 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.075971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db86c-15d7-428a-8c08-f245203aa237 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.075971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db86c-15d7-428a-8c08-f245203aa237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.085047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6c72c6f0-3b7b-4fe5-84b8-9bd0fc680dfd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:33.086377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6c72c6f0-3b7b-4fe5-84b8-9bd0fc680dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:33.109036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-932db86c-15d7-428a-8c08-f245203aa237 None None] MFA Rules not processed for user `e6d94582f8e3484c86a5c8a6073e908e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:33.110241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-932db86c-15d7-428a-8c08-f245203aa237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:33.148574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3662/7415] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:33.153404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72c6f0-3b7b-4fe5-84b8-9bd0fc680dfd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.163141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72c6f0-3b7b-4fe5-84b8-9bd0fc680dfd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.169544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.173935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.173935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.173935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.173935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:33.173935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.173935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.184783 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3754/7416] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:33 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:33.188914 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3663/7417] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:36:33.191021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db86c-15d7-428a-8c08-f245203aa237 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.195880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.197566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:33.203132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db86c-15d7-428a-8c08-f245203aa237 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.207733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.209235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.209616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.209896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.210589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.212505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.256884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec49309-2dd6-483f-89e5-f12bcad807ad admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.260733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.261404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.261684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.261980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.271102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.272512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.287413 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3664/7418] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:33 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:33.314365 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3755/7419] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:33 2021] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:33.318516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.328580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788669-bbad-4833-a583-611b86449b3e service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.382849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.383623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.383913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.384191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.384920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.386820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.502015 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3665/7420] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:33 2021] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:33.506115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.517398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129ee3e-660e-4b1b-830b-c8a2ffb40cee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.522433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.523186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.523537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.523821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.524582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.526404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.534962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.538255 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3756/7421] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:33 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:33.541986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.553270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4af56-c9f7-45c2-924f-f22ae9af22e4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.555947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.556573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.556850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.557158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.557865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.559430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.573966 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3757/7422] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:33.575357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.585590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4847-9ff8-4a1c-99a3-468a86091af9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.591410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.592291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.592605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.592893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] PATH_INFO: `/v3/projects/4ef8cddf93134a2aa107f9f0027981a2/users/f46b641005334046a45666e0238b8b99/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.597116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc77fdf-14fa-41e6-b49f-04e830a3c002 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.600729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21117c3-082b-480c-ac21-12d8965a9011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.601405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21117c3-082b-480c-ac21-12d8965a9011 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.601683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21117c3-082b-480c-ac21-12d8965a9011 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.601952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21117c3-082b-480c-ac21-12d8965a9011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.604128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c21117c3-082b-480c-ac21-12d8965a9011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:33.609937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef8cddf93134a2aa107f9f0027981a2, user_id=f46b641005334046a45666e0238b8b99, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.613381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.663091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21117c3-082b-480c-ac21-12d8965a9011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.664450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21117c3-082b-480c-ac21-12d8965a9011 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:33.673397 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3666/7423] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:33 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:33.708072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3758/7424] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:33 2021] PUT /identity/v3/projects/4ef8cddf93134a2aa107f9f0027981a2/users/f46b641005334046a45666e0238b8b99/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:33.720379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81ed2-e9a2-4c78-8986-9f1e38fe0c3e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.720795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81ed2-e9a2-4c78-8986-9f1e38fe0c3e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.721251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81ed2-e9a2-4c78-8986-9f1e38fe0c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.750958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8bb81ed2-e9a2-4c78-8986-9f1e38fe0c3e None None] MFA Rules not processed for user `f46b641005334046a45666e0238b8b99`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:33.752250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8bb81ed2-e9a2-4c78-8986-9f1e38fe0c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:33.824288 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3667/7425] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:33 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:33.829731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:33.839864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7317-3dde-46b7-b2a8-23db9bad7640 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:33.844146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:33.845095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:33.845398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:33.847474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/application_credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:33.847474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:create_application_credential(user_id=f46b641005334046a45666e0238b8b99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:33.847692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.002545 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3759/7426] 10.222.0.32 () {60 vars in 1314 bytes} [Sat Dec 25 21:36:33 2021] POST /identity/v3/users/f46b641005334046a45666e0238b8b99/application_credentials => generated 920 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:34.004667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb81ed2-e9a2-4c78-8986-9f1e38fe0c3e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.013986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb81ed2-e9a2-4c78-8986-9f1e38fe0c3e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.018293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.019219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.019484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.019826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/access_rules/cf5f22fa483047f08ee19b86eafb6f5e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.021058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:delete_access_rule(user_id=f46b641005334046a45666e0238b8b99, access_rule_id=cf5f22fa483047f08ee19b86eafb6f5e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.022406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.077646 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Dec 25 21:36:34.081764 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3668/7427] 10.222.0.32 () {58 vars in 1361 bytes} [Sat Dec 25 21:36:34 2021] DELETE /identity/v3/users/f46b641005334046a45666e0238b8b99/access_rules/cf5f22fa483047f08ee19b86eafb6f5e => generated 89 bytes in 75 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Dec 25 21:36:34.083359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.095405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06928238-be82-4596-bb7e-5b30bb3a6974 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.100642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.101717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.102298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.102298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/application_credentials/eeabac3426ae407e95ac0b4b3fc64476` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.114440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f46b641005334046a45666e0238b8b99, application_credential_id=eeabac3426ae407e95ac0b4b3fc64476)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.115999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.244506 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3760/7428] 10.222.0.32 () {58 vars in 1394 bytes} [Sat Dec 25 21:36:34 2021] DELETE /identity/v3/users/f46b641005334046a45666e0238b8b99/application_credentials/eeabac3426ae407e95ac0b4b3fc64476 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:34.249174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.259088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9e010-abfa-4c14-beb4-a99af68dfb26 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.263716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.264735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.264959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.265246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/access_rules` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.266513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:list_access_rules(user_id=f46b641005334046a45666e0238b8b99)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.268110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.284464 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3669/7429] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:36:34 2021] GET /identity/v3/users/f46b641005334046a45666e0238b8b99/access_rules => generated 369 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:34.284597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.287826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f987a6-d2a1-4616-9f70-a21fafc09790 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.292214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.293689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.294045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.294325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/access_rules/cf5f22fa483047f08ee19b86eafb6f5e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.295559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:delete_access_rule(user_id=f46b641005334046a45666e0238b8b99, access_rule_id=cf5f22fa483047f08ee19b86eafb6f5e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.296944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.386147 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3761/7430] 10.222.0.32 () {58 vars in 1361 bytes} [Sat Dec 25 21:36:34 2021] DELETE /identity/v3/users/f46b641005334046a45666e0238b8b99/access_rules/cf5f22fa483047f08ee19b86eafb6f5e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:34.387943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.397410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93aa3a-e42d-4f52-93a7-0d24fdddd2cc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.401582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.402524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.402816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.403366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/access_rules` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.404715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:list_access_rules(user_id=f46b641005334046a45666e0238b8b99)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.406132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.410902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3670/7431] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:36:34 2021] GET /identity/v3/users/f46b641005334046a45666e0238b8b99/access_rules => generated 158 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:36:34.415971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.426112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cec175-152c-4c71-a17f-6cce3e216632 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.430299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.431181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.431515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.431777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/application_credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.432552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:create_application_credential(user_id=f46b641005334046a45666e0238b8b99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.434505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.617650 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3762/7432] 10.222.0.32 () {60 vars in 1314 bytes} [Sat Dec 25 21:36:34 2021] POST /identity/v3/users/f46b641005334046a45666e0238b8b99/application_credentials => generated 920 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:34.621618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.630925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e49b1b-f862-4c4a-98c5-fdc630de816f tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.635195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.636068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.636352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.636677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/access_rules` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.638292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:list_access_rules(user_id=f46b641005334046a45666e0238b8b99)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.639766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.645377 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3671/7433] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:36:34 2021] GET /identity/v3/users/f46b641005334046a45666e0238b8b99/access_rules => generated 369 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:34.657947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.667957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499936b8-62cd-43f0-bdcd-b98a84f45d04 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.683311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.688522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.688522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.688522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/application_credentials` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.688522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:create_application_credential(user_id=f46b641005334046a45666e0238b8b99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.688522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.873726 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3763/7434] 10.222.0.32 () {60 vars in 1314 bytes} [Sat Dec 25 21:36:34 2021] POST /identity/v3/users/f46b641005334046a45666e0238b8b99/application_credentials => generated 920 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:34.877907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.887566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6647d2-1a5a-43ed-9be2-0a752594699d tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.892035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b575c32-f81d-4550-a517-84cfac3c2afc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f46b641005334046a45666e0238b8b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ef8cddf93134a2aa107f9f0027981a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.893858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b575c32-f81d-4550-a517-84cfac3c2afc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.893858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b575c32-f81d-4550-a517-84cfac3c2afc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.893858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b575c32-f81d-4550-a517-84cfac3c2afc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99/access_rules/457a0448ad1143a3ab0473eb585da14b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.894889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b575c32-f81d-4550-a517-84cfac3c2afc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorizing `identity:get_access_rule(user_id=f46b641005334046a45666e0238b8b99, access_rule_id=457a0448ad1143a3ab0473eb585da14b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.896446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b575c32-f81d-4550-a517-84cfac3c2afc tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:34.902338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3672/7435] 10.222.0.32 () {58 vars in 1358 bytes} [Sat Dec 25 21:36:34 2021] GET /identity/v3/users/f46b641005334046a45666e0238b8b99/access_rules/457a0448ad1143a3ab0473eb585da14b => generated 229 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:34.907279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:34.969952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdef004-5c6f-40c0-afb6-51b013b24088 tempest-AccessRulesV3Test-55660329 tempest-AccessRulesV3Test-55660329-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:34.974855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:34.975720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:34.976050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:34.976456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] PATH_INFO: `/v3/users/f46b641005334046a45666e0238b8b99` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:34.977764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46b641005334046a45666e0238b8b99)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:34.979669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:35.179081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46b641005334046a45666e0238b8b99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:35.185999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46b641005334046a45666e0238b8b99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:35.328837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46b641005334046a45666e0238b8b99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:35.330989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46b641005334046a45666e0238b8b99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:35.404948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46b641005334046a45666e0238b8b99'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:35.411469 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3764/7436] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:34 2021] DELETE /identity/v3/users/f46b641005334046a45666e0238b8b99 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:35.416160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:35.416677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:35.416800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:35.434696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:35.436545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:35.495262 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3673/7437] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:35.507466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:35.508919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:35.569345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8afaa0-490e-4f5d-93af-1a470654626f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:35.573219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7e601-50e8-4d18-8904-2c868c044e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:35.573682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e601-50e8-4d18-8904-2c868c044e58 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:35.573963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e601-50e8-4d18-8904-2c868c044e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:35.574240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7e601-50e8-4d18-8904-2c868c044e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:35.588159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7e601-50e8-4d18-8904-2c868c044e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:35.589587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7e601-50e8-4d18-8904-2c868c044e58 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:35.599569 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3765/7438] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:36.257247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:36.263678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:36.274360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c4cf-c954-4817-8f03-8280b31f8ab0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:36.279788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:36.280672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:36.280990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:36.281272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] PATH_INFO: `/v3/projects/4ef8cddf93134a2aa107f9f0027981a2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:36.282587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef8cddf93134a2aa107f9f0027981a2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:36.284911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:36.405943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef8cddf93134a2aa107f9f0027981a2', 'request_id': 'req-fdac2e17-1e9f-4979-a650-0539fb422019'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:36.415119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef8cddf93134a2aa107f9f0027981a2', 'request_id': 'req-fdac2e17-1e9f-4979-a650-0539fb422019'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:36.490549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef8cddf93134a2aa107f9f0027981a2', 'request_id': 'req-fdac2e17-1e9f-4979-a650-0539fb422019'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:36.501548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] The token cache is being invalidate because project 4ef8cddf93134a2aa107f9f0027981a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:36.501833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:36.502454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fdac2e17-1e9f-4979-a650-0539fb422019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:36.503977 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3674/7439] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:36 2021] DELETE /identity/v3/projects/4ef8cddf93134a2aa107f9f0027981a2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:36.509860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cfc45-f594-4ab0-944a-581fcb713d88 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:36.510334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cfc45-f594-4ab0-944a-581fcb713d88 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:36.510464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cfc45-f594-4ab0-944a-581fcb713d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:36.530458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-350cfc45-f594-4ab0-944a-581fcb713d88 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:36.531891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-350cfc45-f594-4ab0-944a-581fcb713d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:36.593024 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3766/7440] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:36.600971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe925f6-9de1-4519-8acc-fd99e597f0f0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:36.601291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe925f6-9de1-4519-8acc-fd99e597f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:36.601566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe925f6-9de1-4519-8acc-fd99e597f0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:36.622035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2fe925f6-9de1-4519-8acc-fd99e597f0f0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:36.623849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2fe925f6-9de1-4519-8acc-fd99e597f0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:36.632619 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3675/7441] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:36.636589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cfc45-f594-4ab0-944a-581fcb713d88 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:36.647725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cfc45-f594-4ab0-944a-581fcb713d88 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:36.652788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:36.653506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:36.655802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:36.655802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:36.655802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:36.655802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:36.656627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:36.668690 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3767/7442] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:36.673080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe925f6-9de1-4519-8acc-fd99e597f0f0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:36.682267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe925f6-9de1-4519-8acc-fd99e597f0f0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:36.687541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:36.688177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:36.688454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:36.688722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:36.689450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:36.691425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:36.760322 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3676/7443] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:36 2021] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:36.765733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:36.776430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee6d7b-853e-45dd-b55a-00e48a34f192 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:36.843333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:36.843992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:36.844275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:36.844549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:36.845315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:36.847327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:36.964982 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3768/7444] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:36 2021] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:36.969672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:36.980278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af38ca-a30a-4a17-b71a-d9864cefa379 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:36.985264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:36.985969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:36.986282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:36.990884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:36.990884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:36.990884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:36.999535 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3677/7445] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:37.003526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:37.017244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07e8c-944f-433d-b504-df68483f712f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:37.022335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1e753-df33-411d-aee2-459f8d290504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:37.023005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1e753-df33-411d-aee2-459f8d290504 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.023286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1e753-df33-411d-aee2-459f8d290504 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.023563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1e753-df33-411d-aee2-459f8d290504 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.024328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1e753-df33-411d-aee2-459f8d290504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:37.025992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1e753-df33-411d-aee2-459f8d290504 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:37.037112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3769/7446] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:37.041196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:37.051486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c570b-eda8-49b4-9069-aa3005cedd5a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:37.056160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:37.057068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.057346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.057620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] PATH_INFO: `/v3/projects/0677d7d0084649bd9bebdeb017a3ccd6/users/127b77f768d04b518252822d36f2453d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.072210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0677d7d0084649bd9bebdeb017a3ccd6, user_id=127b77f768d04b518252822d36f2453d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:37.075401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:37.169924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3678/7447] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:37 2021] PUT /identity/v3/projects/0677d7d0084649bd9bebdeb017a3ccd6/users/127b77f768d04b518252822d36f2453d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:37.180272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1f1c-70a3-409b-9796-46411a0955c5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.180572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1f1c-70a3-409b-9796-46411a0955c5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.180850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c1f1c-70a3-409b-9796-46411a0955c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.207930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-332c1f1c-70a3-409b-9796-46411a0955c5 None None] MFA Rules not processed for user `127b77f768d04b518252822d36f2453d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:37.209252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-332c1f1c-70a3-409b-9796-46411a0955c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:37.275246 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3770/7448] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:37 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:37.280480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:37.292860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ba74d-8e8e-4c05-8479-cc82b242893b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:37.297917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361b76a-6b17-432f-9b89-21b52f5b0402 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '127b77f768d04b518252822d36f2453d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0677d7d0084649bd9bebdeb017a3ccd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:37.298586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b76a-6b17-432f-9b89-21b52f5b0402 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.298870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b76a-6b17-432f-9b89-21b52f5b0402 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.299146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b76a-6b17-432f-9b89-21b52f5b0402 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] PATH_INFO: `/v3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.300514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3679/7449] 10.222.0.32 () {58 vars in 1103 bytes} [Sat Dec 25 21:36:37 2021] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:37.305218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1f1c-70a3-409b-9796-46411a0955c5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:37.313864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c1f1c-70a3-409b-9796-46411a0955c5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:37.318406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f28bf3-4c58-494e-969e-07d5cc0af3d5 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '127b77f768d04b518252822d36f2453d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0677d7d0084649bd9bebdeb017a3ccd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:37.319117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28bf3-4c58-494e-969e-07d5cc0af3d5 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.319405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28bf3-4c58-494e-969e-07d5cc0af3d5 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.319687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28bf3-4c58-494e-969e-07d5cc0af3d5 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] PATH_INFO: `/v3` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.321108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3771/7450] 10.222.0.32 () {58 vars in 1103 bytes} [Sat Dec 25 21:36:37 2021] GET /identity/v3 => generated 255 bytes in 16 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:37.325627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361b76a-6b17-432f-9b89-21b52f5b0402 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:37.335088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361b76a-6b17-432f-9b89-21b52f5b0402 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:37.339232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d9d75-7dfc-4cd9-805d-2d71892c6f34 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '127b77f768d04b518252822d36f2453d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0677d7d0084649bd9bebdeb017a3ccd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:37.339878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9d75-7dfc-4cd9-805d-2d71892c6f34 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.340162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9d75-7dfc-4cd9-805d-2d71892c6f34 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.340438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9d75-7dfc-4cd9-805d-2d71892c6f34 tempest-TestApiDiscovery-487776822 tempest-TestApiDiscovery-487776822-project] PATH_INFO: `/v3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.342313 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3680/7451] 10.222.0.32 () {58 vars in 1103 bytes} [Sat Dec 25 21:36:37 2021] GET /identity/v3 => generated 255 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:37.350173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b90b-ac55-4a66-bc6a-f973aee071a3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.350469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b90b-ac55-4a66-bc6a-f973aee071a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.350748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b90b-ac55-4a66-bc6a-f973aee071a3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.352600 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3772/7452] 10.222.0.32 () {56 vars in 894 bytes} [Sat Dec 25 21:36:37 2021] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:36:37.357025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217981b-fdac-4140-8793-4318ac39bffd None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.357323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217981b-fdac-4140-8793-4318ac39bffd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.357633 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217981b-fdac-4140-8793-4318ac39bffd None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.359358 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3681/7453] 10.222.0.32 () {56 vars in 894 bytes} [Sat Dec 25 21:36:37 2021] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:36:37.363855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b90b-ac55-4a66-bc6a-f973aee071a3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:37.426880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b90b-ac55-4a66-bc6a-f973aee071a3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:37.431581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:37.432434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.432721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.433034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] PATH_INFO: `/v3/users/127b77f768d04b518252822d36f2453d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.434245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127b77f768d04b518252822d36f2453d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:37.436153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:37.612375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127b77f768d04b518252822d36f2453d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:37.619014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127b77f768d04b518252822d36f2453d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:37.630936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127b77f768d04b518252822d36f2453d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:37.631717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127b77f768d04b518252822d36f2453d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:37.678065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127b77f768d04b518252822d36f2453d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:37.684176 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3773/7454] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:37 2021] DELETE /identity/v3/users/127b77f768d04b518252822d36f2453d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:37.689390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.695781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.695781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.707503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:37.708679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:37.765217 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3682/7455] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:37.775072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:37.776463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:37.838506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d7b60-bf1e-40d9-ba7c-4ab80031d5a5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:37.842854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fb6b9-de9c-4af1-a831-88e2af3cef1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:37.843491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb6b9-de9c-4af1-a831-88e2af3cef1d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:37.843770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb6b9-de9c-4af1-a831-88e2af3cef1d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:37.844041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb6b9-de9c-4af1-a831-88e2af3cef1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:37.853036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fb6b9-de9c-4af1-a831-88e2af3cef1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:37.854481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fb6b9-de9c-4af1-a831-88e2af3cef1d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:37.865563 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3774/7456] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:38.282264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:38.283962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:38.297800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18d1d-f168-420a-b6ac-5c2aea6da011 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:38.308085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:38.309094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:38.309228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:38.309530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] PATH_INFO: `/v3/projects/0677d7d0084649bd9bebdeb017a3ccd6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:38.318965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0677d7d0084649bd9bebdeb017a3ccd6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:38.318965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:38.456138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0677d7d0084649bd9bebdeb017a3ccd6', 'request_id': 'req-a6909af4-b661-4685-a833-8f3cd3c57bf4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:38.462045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0677d7d0084649bd9bebdeb017a3ccd6', 'request_id': 'req-a6909af4-b661-4685-a833-8f3cd3c57bf4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:38.575750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0677d7d0084649bd9bebdeb017a3ccd6', 'request_id': 'req-a6909af4-b661-4685-a833-8f3cd3c57bf4'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:38.586816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] The token cache is being invalidate because project 0677d7d0084649bd9bebdeb017a3ccd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:38.587104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:38.587760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a6909af4-b661-4685-a833-8f3cd3c57bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:38.589345 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3683/7457] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:38 2021] DELETE /identity/v3/projects/0677d7d0084649bd9bebdeb017a3ccd6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:38.595026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e60e0-6ef0-4170-a3d8-161005e18033 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:38.595312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e60e0-6ef0-4170-a3d8-161005e18033 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:38.595589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e60e0-6ef0-4170-a3d8-161005e18033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:38.614095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d94e60e0-6ef0-4170-a3d8-161005e18033 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:38.615348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d94e60e0-6ef0-4170-a3d8-161005e18033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:38.674057 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3775/7458] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:38.742057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c054d-3d8f-4566-8296-c6460477cc6a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:38.742621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c054d-3d8f-4566-8296-c6460477cc6a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:38.742621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c054d-3d8f-4566-8296-c6460477cc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:38.760992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-989c054d-3d8f-4566-8296-c6460477cc6a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:38.762172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-989c054d-3d8f-4566-8296-c6460477cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:38.772254 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3684/7459] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:38.776513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e60e0-6ef0-4170-a3d8-161005e18033 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:38.786875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e60e0-6ef0-4170-a3d8-161005e18033 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:38.791458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:38.796999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:38.796999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:38.796999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:38.796999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:38.796999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:38.796999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:38.807618 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3776/7460] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:36:38.812333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c054d-3d8f-4566-8296-c6460477cc6a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:38.821990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c054d-3d8f-4566-8296-c6460477cc6a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:38.827326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:38.827969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:38.828251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:38.828527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:38.829268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:38.831206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:38.961105 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3685/7461] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:38 2021] POST /identity/v3/projects => generated 359 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:38.965355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:38.976085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c116c-8d03-4cb1-a02d-2c55fd541e18 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.031541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.032128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.032408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.032682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.033433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.035410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.108749 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3777/7462] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:38 2021] POST /identity/v3/users => generated 280 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:39.112861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.123265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13b897-8e6a-4aa1-989e-1a878316a472 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.128041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.128765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.129089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.129365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.130087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.131662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.143201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3686/7463] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:39.147223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.158012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8af67-d483-43a4-983b-d4ab7ab09398 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.162666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72791e55-c480-48c6-a8c5-889ef5a6ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.163310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72791e55-c480-48c6-a8c5-889ef5a6ab76 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.163594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72791e55-c480-48c6-a8c5-889ef5a6ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.163871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72791e55-c480-48c6-a8c5-889ef5a6ab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.164593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72791e55-c480-48c6-a8c5-889ef5a6ab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.166251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72791e55-c480-48c6-a8c5-889ef5a6ab76 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.175871 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3778/7464] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:39 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:39.179837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.189797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ade84-4333-44a3-bb54-e06e4d2e9b02 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.194600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c0921-0815-4f69-a9f0-794c928809e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.195473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c0921-0815-4f69-a9f0-794c928809e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.195824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c0921-0815-4f69-a9f0-794c928809e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.196102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c0921-0815-4f69-a9f0-794c928809e1 admin admin] PATH_INFO: `/v3/projects/e220e2c6803c423eaeefa609d3030f9d/users/cbc3be2dbcbb4bc08eae2ac2e5e476b3/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.211788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c0921-0815-4f69-a9f0-794c928809e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e220e2c6803c423eaeefa609d3030f9d, user_id=cbc3be2dbcbb4bc08eae2ac2e5e476b3, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.214451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c0921-0815-4f69-a9f0-794c928809e1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.284625 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3687/7465] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:39 2021] PUT /identity/v3/projects/e220e2c6803c423eaeefa609d3030f9d/users/cbc3be2dbcbb4bc08eae2ac2e5e476b3/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:39.294633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350e5e9-f6c1-4101-8a06-1d5b8fe30c69 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.294950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350e5e9-f6c1-4101-8a06-1d5b8fe30c69 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.296750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350e5e9-f6c1-4101-8a06-1d5b8fe30c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.321697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a350e5e9-f6c1-4101-8a06-1d5b8fe30c69 None None] MFA Rules not processed for user `cbc3be2dbcbb4bc08eae2ac2e5e476b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:39.322973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a350e5e9-f6c1-4101-8a06-1d5b8fe30c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:39.390328 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3779/7466] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:39 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:39.395874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cff3-b788-4b1d-8c7e-1522869d0511 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.396159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cff3-b788-4b1d-8c7e-1522869d0511 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.396436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cff3-b788-4b1d-8c7e-1522869d0511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.414283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b1f1cff3-b788-4b1d-8c7e-1522869d0511 None None] MFA Rules not processed for user `cbc3be2dbcbb4bc08eae2ac2e5e476b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:39.416048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1f1cff3-b788-4b1d-8c7e-1522869d0511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:39.418860 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3688/7467] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:39 2021] POST /identity/v3/auth/tokens => generated 345 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Dec 25 21:36:39.425212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a3a8-2701-4bc9-a5b5-081c0fc7c142 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.425581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a3a8-2701-4bc9-a5b5-081c0fc7c142 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.425994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5a3a8-2701-4bc9-a5b5-081c0fc7c142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.443366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d9b5a3a8-2701-4bc9-a5b5-081c0fc7c142 None None] MFA Rules not processed for user `cbc3be2dbcbb4bc08eae2ac2e5e476b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:39.444606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d9b5a3a8-2701-4bc9-a5b5-081c0fc7c142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:39.447733 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3780/7468] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:39 2021] POST /identity/v3/auth/tokens => generated 345 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:36:39.451812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1cff3-b788-4b1d-8c7e-1522869d0511 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.462459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1cff3-b788-4b1d-8c7e-1522869d0511 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.467046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e220e2c6803c423eaeefa609d3030f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.468014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.468014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.468246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.474122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorizing `identity:check_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.475705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.483270 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3689/7469] 10.222.0.32 () {56 vars in 1263 bytes} [Sat Dec 25 21:36:39 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Dec 25 21:36:39.487482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a3a8-2701-4bc9-a5b5-081c0fc7c142 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.500339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5a3a8-2701-4bc9-a5b5-081c0fc7c142 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.504648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e220e2c6803c423eaeefa609d3030f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.505358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.505640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.505939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.519928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.519928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.525643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3781/7470] 10.222.0.32 () {56 vars in 1262 bytes} [Sat Dec 25 21:36:39 2021] GET /identity/v3/auth/tokens => generated 345 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:39.526769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.536897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d100-3563-40af-b51e-35c6ec985edc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.541829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f32ce9-9e8b-4b83-ae89-256e2ecb457c tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e220e2c6803c423eaeefa609d3030f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.542476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f32ce9-9e8b-4b83-ae89-256e2ecb457c tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.558579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f32ce9-9e8b-4b83-ae89-256e2ecb457c tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.558579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f32ce9-9e8b-4b83-ae89-256e2ecb457c tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.558579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f32ce9-9e8b-4b83-ae89-256e2ecb457c tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.558579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f32ce9-9e8b-4b83-ae89-256e2ecb457c tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.657420 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3690/7471] 10.222.0.32 () {56 vars in 1265 bytes} [Sat Dec 25 21:36:39 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:39.661514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.670627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7dd77-3cdb-4452-9046-c7930d66d95b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.675172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e220e2c6803c423eaeefa609d3030f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.675834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] REQUEST_METHOD: `HEAD` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.676112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.676384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.678175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:39.689511 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Dec 25 21:36:39.690673 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3782/7472] 10.222.0.32 () {56 vars in 1263 bytes} [Sat Dec 25 21:36:39 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Dec 25 21:36:39.696332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643264-8195-444f-a1c8-dd5428a70cd1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.696623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643264-8195-444f-a1c8-dd5428a70cd1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.696939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643264-8195-444f-a1c8-dd5428a70cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.714252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-52643264-8195-444f-a1c8-dd5428a70cd1 None None] MFA Rules not processed for user `cbc3be2dbcbb4bc08eae2ac2e5e476b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:39.715427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-52643264-8195-444f-a1c8-dd5428a70cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:39.718523 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3691/7473] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:39 2021] POST /identity/v3/auth/tokens => generated 345 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:36:39.723738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.732756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d5c08-dcec-4078-a647-06705cfea58b tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.737031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e220e2c6803c423eaeefa609d3030f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.737651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.737931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.738202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.743958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.745724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.752234 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3783/7474] 10.222.0.32 () {56 vars in 1262 bytes} [Sat Dec 25 21:36:39 2021] GET /identity/v3/auth/tokens => generated 345 bytes in 29 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:39.755767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52643264-8195-444f-a1c8-dd5428a70cd1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.768038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52643264-8195-444f-a1c8-dd5428a70cd1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.772144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e220e2c6803c423eaeefa609d3030f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.772777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.773084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.773357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.779335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:39.780812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:39.874754 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3692/7475] 10.222.0.32 () {56 vars in 1265 bytes} [Sat Dec 25 21:36:39 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:39.879006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:39.889163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ff80-3554-46de-a26f-1edf0c24fecc tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:39.893321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa5eeb-08ab-4ed0-8680-8422286412b4 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e220e2c6803c423eaeefa609d3030f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:39.894007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5eeb-08ab-4ed0-8680-8422286412b4 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:39.894219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5eeb-08ab-4ed0-8680-8422286412b4 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:39.894491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5eeb-08ab-4ed0-8680-8422286412b4 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:39.896299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3afa5eeb-08ab-4ed0-8680-8422286412b4 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:39.910749 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3afa5eeb-08ab-4ed0-8680-8422286412b4 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Dec 25 21:36:39.915885 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3784/7476] 10.222.0.32 () {56 vars in 1262 bytes} [Sat Dec 25 21:36:39 2021] GET /identity/v3/auth/tokens => generated 80 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 21:36:39.917709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:40.014281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd7ee8-931e-4927-bcfd-294318e1dd37 tempest-TokensV3Test-753646734 tempest-TokensV3Test-753646734-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:40.020479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:40.021384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:40.021670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:40.021942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] PATH_INFO: `/v3/users/cbc3be2dbcbb4bc08eae2ac2e5e476b3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:40.023268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc3be2dbcbb4bc08eae2ac2e5e476b3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:40.025244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:40.259639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:40.267272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:40.281072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:40.281814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:40.282424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc3be2dbcbb4bc08eae2ac2e5e476b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:40.376811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3693/7477] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:39 2021] DELETE /identity/v3/users/cbc3be2dbcbb4bc08eae2ac2e5e476b3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:40.386960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:40.387280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:40.388061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:40.407819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:40.409191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:40.476162 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3785/7478] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:40.491711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:40.493169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:40.560012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afd920-95b9-4cf7-87b1-af8bac28c659 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:40.563939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47aa2d-1f20-4cb3-9298-d48c7d9287a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:40.564650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aa2d-1f20-4cb3-9298-d48c7d9287a0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:40.564965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aa2d-1f20-4cb3-9298-d48c7d9287a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:40.565296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47aa2d-1f20-4cb3-9298-d48c7d9287a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:40.574695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47aa2d-1f20-4cb3-9298-d48c7d9287a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:40.577032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47aa2d-1f20-4cb3-9298-d48c7d9287a0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:40.587078 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3694/7479] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:41.069895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:41.071385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:41.085098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f2977-acc9-4532-8d4c-fcde94ce0b48 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:41.093896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:41.095169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.100351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.100351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] PATH_INFO: `/v3/projects/e220e2c6803c423eaeefa609d3030f9d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.100351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e220e2c6803c423eaeefa609d3030f9d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:41.100351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:41.227061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e220e2c6803c423eaeefa609d3030f9d', 'request_id': 'req-d5432954-b599-44be-a760-396e9bb94ef2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:41.286610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e220e2c6803c423eaeefa609d3030f9d', 'request_id': 'req-d5432954-b599-44be-a760-396e9bb94ef2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:41.292533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e220e2c6803c423eaeefa609d3030f9d', 'request_id': 'req-d5432954-b599-44be-a760-396e9bb94ef2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:41.303642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] The token cache is being invalidate because project e220e2c6803c423eaeefa609d3030f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:41.303934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:41.304638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5432954-b599-44be-a760-396e9bb94ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:41.309632 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3786/7480] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:41 2021] DELETE /identity/v3/projects/e220e2c6803c423eaeefa609d3030f9d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:41.315529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213d12-6b24-4ea0-bc2b-8c379191dfaf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.315971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213d12-6b24-4ea0-bc2b-8c379191dfaf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.316087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213d12-6b24-4ea0-bc2b-8c379191dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.335138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3d213d12-6b24-4ea0-bc2b-8c379191dfaf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:41.336387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3d213d12-6b24-4ea0-bc2b-8c379191dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:41.544201 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3695/7481] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:41.552804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efaec0-7c90-4918-bf72-82786538bac1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.553135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efaec0-7c90-4918-bf72-82786538bac1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.553415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efaec0-7c90-4918-bf72-82786538bac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.572573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-05efaec0-7c90-4918-bf72-82786538bac1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:41.573864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-05efaec0-7c90-4918-bf72-82786538bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:41.581863 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3787/7482] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:41.586425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213d12-6b24-4ea0-bc2b-8c379191dfaf None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:41.596272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213d12-6b24-4ea0-bc2b-8c379191dfaf None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:41.601008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:41.601659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.601946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.602224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.602952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:41.603259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:41.604830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:41.616918 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3696/7483] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:41.621266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efaec0-7c90-4918-bf72-82786538bac1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:41.631259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efaec0-7c90-4918-bf72-82786538bac1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:41.636086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:41.636670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.636986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.637569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.638386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:41.640283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:41.714452 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3788/7484] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:41 2021] POST /identity/v3/projects => generated 395 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:41.719007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:41.728778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be2077-0e22-45fb-9e61-27e1dc7097e5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:41.784611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:41.785351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.785644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.785921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.786607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:41.788506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:41.862447 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3697/7485] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:41 2021] POST /identity/v3/users => generated 304 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:41.866623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:41.877489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbff47-5999-4da8-a5da-5a0548fdae03 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:41.882092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:41.883328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.883613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.883920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.884645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:41.886272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:41.897354 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3789/7486] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:41.901512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:41.911915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dad46-4565-4052-8cd2-c32bf04b0029 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:41.916571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:41.917478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:41.917748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:41.918014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] PATH_INFO: `/v3/projects/01aadf799fca4dc9aab25ba54af3820b/users/a718edc1bf5d406a9064e0dfa564a343/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:41.932898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01aadf799fca4dc9aab25ba54af3820b, user_id=a718edc1bf5d406a9064e0dfa564a343, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:41.938588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.055792 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3698/7487] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:41 2021] PUT /identity/v3/projects/01aadf799fca4dc9aab25ba54af3820b/users/a718edc1bf5d406a9064e0dfa564a343/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:42.060642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.071079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a986-db7c-46ae-b771-5e3f4dc8056a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.126496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d198c6-9335-4981-98ca-688305eb61f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.127153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d198c6-9335-4981-98ca-688305eb61f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.127433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d198c6-9335-4981-98ca-688305eb61f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.127705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d198c6-9335-4981-98ca-688305eb61f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.128424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d198c6-9335-4981-98ca-688305eb61f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:42.130066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d198c6-9335-4981-98ca-688305eb61f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.140001 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3790/7488] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:42 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:42.144388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.154831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3afe6f-3ebe-4fc1-9520-a11af21552b9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.159449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.160318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.160593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.160863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] PATH_INFO: `/v3/projects/01aadf799fca4dc9aab25ba54af3820b/users/a718edc1bf5d406a9064e0dfa564a343/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.162843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01aadf799fca4dc9aab25ba54af3820b, user_id=a718edc1bf5d406a9064e0dfa564a343, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:42.165447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.176641 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3699/7489] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:42 2021] PUT /identity/v3/projects/01aadf799fca4dc9aab25ba54af3820b/users/a718edc1bf5d406a9064e0dfa564a343/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:42.188364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e497a2-d5af-45cb-a322-a94da69a7c4e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.188657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e497a2-d5af-45cb-a322-a94da69a7c4e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.188980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e497a2-d5af-45cb-a322-a94da69a7c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.217056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c5e497a2-d5af-45cb-a322-a94da69a7c4e None None] MFA Rules not processed for user `a718edc1bf5d406a9064e0dfa564a343`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:42.218177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c5e497a2-d5af-45cb-a322-a94da69a7c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:42.284357 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3791/7490] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:42 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:42.288915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.351295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98169616-1fe7-481d-be51-f12ea8474a2c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.356242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.356951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.357245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.357568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.358268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:42.360213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.417277 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3700/7491] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:42 2021] POST /identity/v3/projects => generated 395 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:42.421905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e497a2-d5af-45cb-a322-a94da69a7c4e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.437584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e497a2-d5af-45cb-a322-a94da69a7c4e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.497436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.499410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.499410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.499410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.500004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:42.501960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.577086 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3792/7492] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:42 2021] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:42.581284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.591936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24d286-133f-4cfe-9668-7cabeaa59a56 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.596643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.597470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.597834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.598153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.598943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:42.600587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.611048 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3701/7493] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:42.619787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.630616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802168e-3134-4427-b1da-a2beecaf48a8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.635498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc66648-f3d8-40af-bbd3-bed15e268654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.636154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66648-f3d8-40af-bbd3-bed15e268654 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.636439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66648-f3d8-40af-bbd3-bed15e268654 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.636719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66648-f3d8-40af-bbd3-bed15e268654 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.637769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc66648-f3d8-40af-bbd3-bed15e268654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:42.639845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc66648-f3d8-40af-bbd3-bed15e268654 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.650031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3793/7494] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:42.654851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.664824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c03f43-60ff-4d80-ad55-95135c84aed3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.669602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.670471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.670778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.671059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] PATH_INFO: `/v3/projects/c1c01005fdde4d1bbe1b588556a1d23e/users/4e33bcd2cf074450b2c8d879d2845063/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.685372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c01005fdde4d1bbe1b588556a1d23e, user_id=4e33bcd2cf074450b2c8d879d2845063, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:42.688083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:42.765753 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3702/7495] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:42 2021] PUT /identity/v3/projects/c1c01005fdde4d1bbe1b588556a1d23e/users/4e33bcd2cf074450b2c8d879d2845063/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:42.776096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02afdb6-7b17-4421-83fd-292d9d65d5b3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.776392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02afdb6-7b17-4421-83fd-292d9d65d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.776700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02afdb6-7b17-4421-83fd-292d9d65d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:42.803947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c02afdb6-7b17-4421-83fd-292d9d65d5b3 None None] MFA Rules not processed for user `4e33bcd2cf074450b2c8d879d2845063`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:42.805198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c02afdb6-7b17-4421-83fd-292d9d65d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:42.867124 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3794/7496] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:42 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:42.879474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:42.881202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:42.938249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de5870-4074-4d95-9ed2-36d314852319 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:42.941899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:42.942533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:42.942811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:42.943088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:43.003237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:43.004670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:43.014726 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3703/7497] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:42 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:43.257422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a448e-d6e3-4b6f-b2d4-5885985d7165 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:43.257976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a448e-d6e3-4b6f-b2d4-5885985d7165 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:43.257976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a448e-d6e3-4b6f-b2d4-5885985d7165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:43.276156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f42a448e-d6e3-4b6f-b2d4-5885985d7165 None None] MFA Rules not processed for user `c3a55c151bef4387a4fef00ab6687a20`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:43.277443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f42a448e-d6e3-4b6f-b2d4-5885985d7165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:43.338307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3795/7498] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:43 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:43.583044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:43.584651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:43.645684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee350e0-cef5-4f03-a60d-6237aeb3feec service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:43.649457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11df120-db0b-4677-a7b8-860a27fc168b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:43.650099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11df120-db0b-4677-a7b8-860a27fc168b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:43.650380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11df120-db0b-4677-a7b8-860a27fc168b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:43.650654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11df120-db0b-4677-a7b8-860a27fc168b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:43.652423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a11df120-db0b-4677-a7b8-860a27fc168b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:43.664018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11df120-db0b-4677-a7b8-860a27fc168b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:43.665529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11df120-db0b-4677-a7b8-860a27fc168b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:43.675478 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3704/7499] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:43.909239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a448e-d6e3-4b6f-b2d4-5885985d7165 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:43.971624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a448e-d6e3-4b6f-b2d4-5885985d7165 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:43.976498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:43.977412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:43.977716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:43.978008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] PATH_INFO: `/v3/users/a718edc1bf5d406a9064e0dfa564a343` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:43.979220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a718edc1bf5d406a9064e0dfa564a343)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:43.981159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:44.189810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a718edc1bf5d406a9064e0dfa564a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:44.197283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a718edc1bf5d406a9064e0dfa564a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:44.211800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a718edc1bf5d406a9064e0dfa564a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:44.212522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a718edc1bf5d406a9064e0dfa564a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:44.313206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a718edc1bf5d406a9064e0dfa564a343'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:44.319390 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3796/7500] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:43 2021] DELETE /identity/v3/users/a718edc1bf5d406a9064e0dfa564a343 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:44.324255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:44.324545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:44.324891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:44.343412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:44.344660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:44.409379 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3705/7501] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:44.419496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:44.421070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:44.489945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a6fcf-c633-449d-926b-166c27e97d57 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:44.493688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:44.494335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:44.494658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:44.494943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:44.504942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:44.506404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:44.517695 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3797/7502] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:45.046920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:45.048456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:45.065553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aa1f6-e585-4f1a-9d93-58a9e191999e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:45.070351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:45.071219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:45.071530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:45.071806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] PATH_INFO: `/v3/projects/01aadf799fca4dc9aab25ba54af3820b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:45.073205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01aadf799fca4dc9aab25ba54af3820b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:45.075073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:45.272983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01aadf799fca4dc9aab25ba54af3820b', 'request_id': 'req-04f5e471-5059-4932-b6a1-9628aca9009a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.279511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01aadf799fca4dc9aab25ba54af3820b', 'request_id': 'req-04f5e471-5059-4932-b6a1-9628aca9009a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.359040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01aadf799fca4dc9aab25ba54af3820b', 'request_id': 'req-04f5e471-5059-4932-b6a1-9628aca9009a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.370636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] The token cache is being invalidate because project 01aadf799fca4dc9aab25ba54af3820b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:45.371162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.371887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.373588 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3706/7503] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:45 2021] DELETE /identity/v3/projects/01aadf799fca4dc9aab25ba54af3820b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:45.380814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:45.388506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2e838-0fdc-42b2-93ba-e6b1e49a4e82 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:45.455118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:45.456082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:45.456362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:45.456639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] PATH_INFO: `/v3/users/4e33bcd2cf074450b2c8d879d2845063` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:45.457870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e33bcd2cf074450b2c8d879d2845063)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:45.459783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:45.670817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:45.672256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:45.684773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e471-5059-4932-b6a1-9628aca9009a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:45.687119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e33bcd2cf074450b2c8d879d2845063'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.690559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:45.691466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:45.691752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:45.692032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] PATH_INFO: `/v3/users/d5401ab34b3b4de1b516d5d367b9748b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:45.693390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5401ab34b3b4de1b516d5d367b9748b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:45.694394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e33bcd2cf074450b2c8d879d2845063'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.695467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:45.707043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e33bcd2cf074450b2c8d879d2845063'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.707828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e33bcd2cf074450b2c8d879d2845063'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.821386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-336e423f-57c4-461d-923e-692219ca7deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e33bcd2cf074450b2c8d879d2845063'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.827834 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3798/7504] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:45 2021] DELETE /identity/v3/users/4e33bcd2cf074450b2c8d879d2845063 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:45.957024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5401ab34b3b4de1b516d5d367b9748b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.963696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5401ab34b3b4de1b516d5d367b9748b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.974951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5401ab34b3b4de1b516d5d367b9748b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.975631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5401ab34b3b4de1b516d5d367b9748b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:45.976245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5401ab34b3b4de1b516d5d367b9748b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:46.039217 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3707/7505] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:45 2021] DELETE /identity/v3/users/d5401ab34b3b4de1b516d5d367b9748b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:46.043735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.044161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.044450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.081415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:46.083155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:46.145580 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3799/7506] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:46.156259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:46.158565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:46.220837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da79dbf-b6b9-4f7f-a057-e3064d7cf85f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:46.225086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663db2b-e0c2-4a1b-8359-a3673617453b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:46.225727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663db2b-e0c2-4a1b-8359-a3673617453b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.226005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663db2b-e0c2-4a1b-8359-a3673617453b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.226389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663db2b-e0c2-4a1b-8359-a3673617453b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.236510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663db2b-e0c2-4a1b-8359-a3673617453b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:46.237983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663db2b-e0c2-4a1b-8359-a3673617453b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:46.248172 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3708/7507] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:46.322992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:46.322992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:46.329923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bb014-8982-489a-a46a-550613a50bb4 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:46.341306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:46.342815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.343174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.343518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] PATH_INFO: `/v3/projects/c1c01005fdde4d1bbe1b588556a1d23e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.345641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c01005fdde4d1bbe1b588556a1d23e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:46.347128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:46.470036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c01005fdde4d1bbe1b588556a1d23e', 'request_id': 'req-a5649ceb-ae94-426f-8f40-ae94c31795cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:46.536778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c01005fdde4d1bbe1b588556a1d23e', 'request_id': 'req-a5649ceb-ae94-426f-8f40-ae94c31795cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:46.543804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c01005fdde4d1bbe1b588556a1d23e', 'request_id': 'req-a5649ceb-ae94-426f-8f40-ae94c31795cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:46.554926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] The token cache is being invalidate because project c1c01005fdde4d1bbe1b588556a1d23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:46.555217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:46.555880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5649ceb-ae94-426f-8f40-ae94c31795cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:46.557474 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3800/7508] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:46 2021] DELETE /identity/v3/projects/c1c01005fdde4d1bbe1b588556a1d23e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:46.564408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791539c3-18d9-4016-a489-0bf14b8b5e7e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.564703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791539c3-18d9-4016-a489-0bf14b8b5e7e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.565031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791539c3-18d9-4016-a489-0bf14b8b5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.583630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-791539c3-18d9-4016-a489-0bf14b8b5e7e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:46.584843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-791539c3-18d9-4016-a489-0bf14b8b5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:46.649548 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3709/7509] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:46.658563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c69aa-3434-4b97-9dfd-e6940a106c88 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.659366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c69aa-3434-4b97-9dfd-e6940a106c88 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.659366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c69aa-3434-4b97-9dfd-e6940a106c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.686130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4a4c69aa-3434-4b97-9dfd-e6940a106c88 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:46.688095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4a4c69aa-3434-4b97-9dfd-e6940a106c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:46.708461 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3801/7510] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:46.713213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791539c3-18d9-4016-a489-0bf14b8b5e7e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:46.723997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791539c3-18d9-4016-a489-0bf14b8b5e7e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:46.729658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:46.730307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.730585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.730859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.731616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:46.732547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:46.734241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:46.745995 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3710/7511] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:36:46.750601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c69aa-3434-4b97-9dfd-e6940a106c88 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:46.761244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c69aa-3434-4b97-9dfd-e6940a106c88 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:46.766365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:46.767015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.767296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.767566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.768265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:46.770180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:46.823732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:46.827610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:46.852560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63536a-759b-4f6a-84d7-8d1ef4ff912f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:46.858120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:46.858987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.859268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.859537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] PATH_INFO: `/v3/projects/be78166c9f60433db2d55212d563610b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.860822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be78166c9f60433db2d55212d563610b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:46.862736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:46.880996 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3802/7512] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:46 2021] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:46.887050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:46.953812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6df8-32a4-4e4e-ab07-ec25f83b7ae4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:46.964706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:46.965649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:46.965902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:46.966312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:46.967642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:46.969933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:47.053754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be78166c9f60433db2d55212d563610b', 'request_id': 'req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.064707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be78166c9f60433db2d55212d563610b', 'request_id': 'req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.068636 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3803/7513] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:46 2021] POST /identity/v3/users => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:47.072396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.083056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324870f-b584-4d9e-930d-834c8e9b4c4c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:47.140592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:47.141352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.141677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.141953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.142687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:47.144582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:47.155674 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3804/7514] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:47 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:47.158652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be78166c9f60433db2d55212d563610b', 'request_id': 'req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.160071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.170335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e619ca2-ae73-4206-a9fc-e48d446bb001 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:47.171622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] The token cache is being invalidate because project be78166c9f60433db2d55212d563610b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:47.171922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.172761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.174785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3711/7515] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:46 2021] DELETE /identity/v3/projects/be78166c9f60433db2d55212d563610b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:47.178480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:47.178665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.179585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.179802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:47.179929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.180138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] PATH_INFO: `/v3/projects/424db5b6892e47e5aeca9a6edf5d1fb7/users/7436851523404d78becfdff675095346/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.192650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cdf42-1864-444b-a4be-e5d4c9fb3b62 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:47.197953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=424db5b6892e47e5aeca9a6edf5d1fb7, user_id=7436851523404d78becfdff675095346, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:47.198121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:47.199004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.199465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.199465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] PATH_INFO: `/v3/users/d93d062139bf48e49eabc47952422ad3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.201269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:47.201429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93d062139bf48e49eabc47952422ad3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:47.203378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:47.278489 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3805/7516] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:47 2021] PUT /identity/v3/projects/424db5b6892e47e5aeca9a6edf5d1fb7/users/7436851523404d78becfdff675095346/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:47.282321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.284021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:47.355932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ef89c-ce1e-461b-aa61-da61912f5d4d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:47.363518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:47.364204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.364489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.365355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.366167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:47.367828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:47.378767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3806/7517] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:47 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:47.391200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.401430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46634-f047-4533-b641-a7022faa6dea admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:47.407063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37575767-bacd-437d-8e14-530f38e5945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:47.407937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37575767-bacd-437d-8e14-530f38e5945d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.408215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37575767-bacd-437d-8e14-530f38e5945d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.408503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37575767-bacd-437d-8e14-530f38e5945d admin admin] PATH_INFO: `/v3/projects/424db5b6892e47e5aeca9a6edf5d1fb7/users/7436851523404d78becfdff675095346/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.410620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37575767-bacd-437d-8e14-530f38e5945d admin admin] RBAC: Authorizing `identity:create_grant(project_id=424db5b6892e47e5aeca9a6edf5d1fb7, user_id=7436851523404d78becfdff675095346, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:47.413529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37575767-bacd-437d-8e14-530f38e5945d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:47.433645 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3807/7518] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:47 2021] PUT /identity/v3/projects/424db5b6892e47e5aeca9a6edf5d1fb7/users/7436851523404d78becfdff675095346/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:47.435972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93d062139bf48e49eabc47952422ad3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.437007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c65dc-30bb-49ad-8e31-0c81172d4384 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.437223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c65dc-30bb-49ad-8e31-0c81172d4384 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.437556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c65dc-30bb-49ad-8e31-0c81172d4384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.443274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93d062139bf48e49eabc47952422ad3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.458437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93d062139bf48e49eabc47952422ad3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.459713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93d062139bf48e49eabc47952422ad3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.461556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93d062139bf48e49eabc47952422ad3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:47.469079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-317c65dc-30bb-49ad-8e31-0c81172d4384 None None] MFA Rules not processed for user `7436851523404d78becfdff675095346`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:47.470295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-317c65dc-30bb-49ad-8e31-0c81172d4384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:47.532290 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3712/7519] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:47 2021] DELETE /identity/v3/users/d93d062139bf48e49eabc47952422ad3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:47.545343 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3808/7520] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:47 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:47.549935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.551555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:47.644498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb86253-688a-4336-8221-7b1e1a871902 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:47.649315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:47.649976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.650270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.650546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.651253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:47.653164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:47.822245 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3713/7521] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:47 2021] POST /identity/v3/projects => generated 393 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:47.823872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c65dc-30bb-49ad-8e31-0c81172d4384 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.889535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c65dc-30bb-49ad-8e31-0c81172d4384 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:47.932026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:47.934246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:47.956748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:47.957574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:47.958474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:47.958474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:47.958795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:47.960907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.021792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93266932-3b5f-49e5-a16e-197cc1f1e500 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.027489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.028514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.029665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.030008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] PATH_INFO: `/v3/projects/187abdf716bc49d8bb8d23f5bf25d1b4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.034935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187abdf716bc49d8bb8d23f5bf25d1b4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.034935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.057853 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3809/7522] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:47 2021] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:48.058731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.070574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac26aa6-3736-4932-8ce0-b306119a71ff admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.076956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.077723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.078010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.078284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.081908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.081908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.092999 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3810/7523] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:48.096858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.107557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc083f-e997-4f12-b958-853e4063a6cc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.112415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.113097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.113378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.113652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.114373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.115955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.128634 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3811/7524] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:48.132999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.145170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13500221-81b8-4563-917a-56f61fc5ecea admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.150149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849d12-bfad-4439-8374-79b16e908b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.151304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849d12-bfad-4439-8374-79b16e908b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.151577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849d12-bfad-4439-8374-79b16e908b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.151849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849d12-bfad-4439-8374-79b16e908b71 admin admin] PATH_INFO: `/v3/projects/5987b3b49cf244dc84293ee8e31f8b40/users/9ef98e486153421c94aa9347ec5d7a96/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.173803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849d12-bfad-4439-8374-79b16e908b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5987b3b49cf244dc84293ee8e31f8b40, user_id=9ef98e486153421c94aa9347ec5d7a96, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.174025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187abdf716bc49d8bb8d23f5bf25d1b4', 'request_id': 'req-654c04e1-00c2-4865-a739-1b92d55fb7b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:48.176896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849d12-bfad-4439-8374-79b16e908b71 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.183313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187abdf716bc49d8bb8d23f5bf25d1b4', 'request_id': 'req-654c04e1-00c2-4865-a739-1b92d55fb7b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:48.313280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187abdf716bc49d8bb8d23f5bf25d1b4', 'request_id': 'req-654c04e1-00c2-4865-a739-1b92d55fb7b7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:48.319408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3812/7525] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:48 2021] PUT /identity/v3/projects/5987b3b49cf244dc84293ee8e31f8b40/users/9ef98e486153421c94aa9347ec5d7a96/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:48.324388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] The token cache is being invalidate because project 187abdf716bc49d8bb8d23f5bf25d1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:48.324656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:48.325601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-654c04e1-00c2-4865-a739-1b92d55fb7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:48.327283 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3714/7526] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:47 2021] DELETE /identity/v3/projects/187abdf716bc49d8bb8d23f5bf25d1b4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:48.333031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8adf18-c042-4752-8c11-139033d8e5f5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.333403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8adf18-c042-4752-8c11-139033d8e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.333743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8adf18-c042-4752-8c11-139033d8e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.335757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.336056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.336372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.354604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0e8adf18-c042-4752-8c11-139033d8e5f5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:48.358923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0e8adf18-c042-4752-8c11-139033d8e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:48.364564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] MFA Rules not processed for user `9ef98e486153421c94aa9347ec5d7a96`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:48.366354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:48.441009 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3813/7527] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:48.453533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7890-34e0-465c-b502-617ff1aca99b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.453533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7890-34e0-465c-b502-617ff1aca99b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.453533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7890-34e0-465c-b502-617ff1aca99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.456960 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3715/7528] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:48 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:48.467736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.469565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:48.474991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e64e7890-34e0-465c-b502-617ff1aca99b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:48.476178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e64e7890-34e0-465c-b502-617ff1aca99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:48.485429 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3814/7529] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:48.489772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7890-34e0-465c-b502-617ff1aca99b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.500915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7890-34e0-465c-b502-617ff1aca99b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.506838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.507498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.507836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.508138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.508867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:48.509201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.510799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.527884 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3815/7530] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:48.533386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.543085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb2d34-ef67-42da-b5de-6a62a655f050 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.552298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.552298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.552298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.552670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d81c4b-2539-465d-885e-23af0566e782 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.552794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.552794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.553697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.555803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.556623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.557309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.557789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.560825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:48.639034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.640619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.645214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3816/7531] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:48 2021] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:48.648271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.652481 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3716/7532] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:48 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:48.711603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c6a8e-c4c7-41ab-aa6f-361dbb554d96 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.722762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.723032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.723321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.723555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.724341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.726381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.811681 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3817/7533] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:48 2021] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:48.815829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.827068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d21dd-f362-4aa4-86e3-7f41eb4a1154 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.836256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.836256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.836256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.836256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.839867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.839867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.851354 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3717/7534] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:48.855911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.867121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01647c4a-1442-4e5a-8e70-165244a3508c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.885836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210d86-0190-47bd-a9d3-fee882441ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.886570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210d86-0190-47bd-a9d3-fee882441ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.886917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210d86-0190-47bd-a9d3-fee882441ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.887063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210d86-0190-47bd-a9d3-fee882441ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.888072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82210d86-0190-47bd-a9d3-fee882441ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.890573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82210d86-0190-47bd-a9d3-fee882441ce2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:48.901718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3818/7535] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:48 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:48.906115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:48.918562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d191-b693-4322-81f6-d64cf7c3e95a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:48.925668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:48.926825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:48.927257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:48.927710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] PATH_INFO: `/v3/projects/803653fa8681491b916c0b57c57c3f29/users/d908fbffef7047db86b4d40f70973397/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:48.951436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] RBAC: Authorizing `identity:create_grant(project_id=803653fa8681491b916c0b57c57c3f29, user_id=d908fbffef7047db86b4d40f70973397, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:48.955639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:49.166539 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3718/7536] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:48 2021] PUT /identity/v3/projects/803653fa8681491b916c0b57c57c3f29/users/d908fbffef7047db86b4d40f70973397/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:49.177522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ba360-c5b7-4623-b612-850a69a0adfc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:49.177894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ba360-c5b7-4623-b612-850a69a0adfc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:49.178258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ba360-c5b7-4623-b612-850a69a0adfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:49.205266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-392ba360-c5b7-4623-b612-850a69a0adfc None None] MFA Rules not processed for user `d908fbffef7047db86b4d40f70973397`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:49.206482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-392ba360-c5b7-4623-b612-850a69a0adfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:49.272647 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3819/7537] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:49.282601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:49.346528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8f4f-bba5-434c-ba21-34ad4d87439b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:49.351462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:49.353369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:49.353655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:49.353935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:49.354885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:49.356767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:49.480432 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3719/7538] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:49 2021] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:49.484977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ba360-c5b7-4623-b612-850a69a0adfc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:49.496255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ba360-c5b7-4623-b612-850a69a0adfc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:49.558575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:49.559171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:49.559455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:49.559729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:49.561041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:49.562991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:49.692927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3820/7539] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:49 2021] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:49.695821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:49.707324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c01bf-920b-4058-9d6b-dd3b3a806820 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:49.712168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:49.713082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:49.713361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:49.713634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:49.714499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:49.718203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:49.737547 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3720/7540] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:49 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:49.738837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:49.751673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3456cdb-4f64-4522-8eda-963fdd5f7c19 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:49.758012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0728f5-7fd6-43b6-96e3-9bbaabb6641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:49.762854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0728f5-7fd6-43b6-96e3-9bbaabb6641e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:49.762854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0728f5-7fd6-43b6-96e3-9bbaabb6641e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:49.762854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0728f5-7fd6-43b6-96e3-9bbaabb6641e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:49.762854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0728f5-7fd6-43b6-96e3-9bbaabb6641e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:49.763867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0728f5-7fd6-43b6-96e3-9bbaabb6641e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:49.779543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:49.780138 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3821/7541] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:49 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:49.793842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27851-9322-4d72-9211-979503b4be57 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:49.798637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:49.799528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:49.799815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:49.800095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] PATH_INFO: `/v3/projects/73562d54f24a42f5a3cc9824c27632f9/users/c30cd145f3fd46f899c9cf24ecdd638b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:49.819738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73562d54f24a42f5a3cc9824c27632f9, user_id=c30cd145f3fd46f899c9cf24ecdd638b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:49.819738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:49.985042 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3721/7542] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:49 2021] PUT /identity/v3/projects/73562d54f24a42f5a3cc9824c27632f9/users/c30cd145f3fd46f899c9cf24ecdd638b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:49.996289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:49.997276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:49.998574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.035839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] MFA Rules not processed for user `c30cd145f3fd46f899c9cf24ecdd638b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:50.042942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:50.106643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3822/7543] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:50.109915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.172093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.173433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:50.173647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281e924-5b18-438b-a4e7-900a4e52513c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.179087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.181494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.181494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.181494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.181494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.182959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.186870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8f7a8-93ef-490b-bb90-d97a00f7b504 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.191853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.192722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.193039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.193316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] PATH_INFO: `/v3/users/785ab23935ec489fb8e8563e95f38caf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.194521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785ab23935ec489fb8e8563e95f38caf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.196408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.301941 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3722/7544] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:50 2021] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:50.305961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.366208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d25fa-2cc2-440c-bee2-cc51afd6cb03 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.371081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.371660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.371940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.372212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.372934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.374831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.447193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785ab23935ec489fb8e8563e95f38caf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.458264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785ab23935ec489fb8e8563e95f38caf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.477904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785ab23935ec489fb8e8563e95f38caf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.477904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785ab23935ec489fb8e8563e95f38caf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.482513 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3723/7545] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:50 2021] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:50.483563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.493330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8636de-5c33-4ed7-858c-8115876b0f91 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.498605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.499248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.499527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.499800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.500547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.502165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.511710 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3724/7546] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:50.516414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.525630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10aa8-2f5a-4452-a017-e24b1bcf41be admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.531257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faf4ad-40df-4329-a74b-cf11d4088202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.532115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf4ad-40df-4329-a74b-cf11d4088202 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.532398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf4ad-40df-4329-a74b-cf11d4088202 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.535123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faf4ad-40df-4329-a74b-cf11d4088202 admin admin] PATH_INFO: `/v3/projects/af196f8af15f4f7ca1802c701ec7cd9e/users/1c4974bb5e354cd1bb1920b7bd6836c7/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.548084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faf4ad-40df-4329-a74b-cf11d4088202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af196f8af15f4f7ca1802c701ec7cd9e, user_id=1c4974bb5e354cd1bb1920b7bd6836c7, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.550755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faf4ad-40df-4329-a74b-cf11d4088202 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.556164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785ab23935ec489fb8e8563e95f38caf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.563221 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3823/7547] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:50 2021] DELETE /identity/v3/users/785ab23935ec489fb8e8563e95f38caf => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:50.564027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.565411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:50.632160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ac45f-4668-4bfe-a3a8-483e4fbc3fd7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.640818 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3725/7548] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:50 2021] PUT /identity/v3/projects/af196f8af15f4f7ca1802c701ec7cd9e/users/1c4974bb5e354cd1bb1920b7bd6836c7/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:50.645466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.645751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.646030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.664472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:50.665746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:50.691259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.692210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.692564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.692928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] PATH_INFO: `/v3/users/7436851523404d78becfdff675095346` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.694276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7436851523404d78becfdff675095346)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.696185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.725566 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3726/7549] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:50.726429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.727720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:50.740865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0131a0a-55ae-43b0-a14e-f26d3d68c5b6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.749154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.753165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.753165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.753165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.753165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.753165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.763233 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3727/7550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:50.764225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.765916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:50.824150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b36a4-a82c-4b97-994d-63b7799dc97b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.827912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.828558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.828839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.829148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.838248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.839663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.849907 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3728/7551] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:50.850743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:50.861004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45098f-9e3c-4996-815d-e13b966c36d7 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:50.865495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a8be6-37b5-403d-8e8b-d8a537fab602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:50.866376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a8be6-37b5-403d-8e8b-d8a537fab602 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.866641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a8be6-37b5-403d-8e8b-d8a537fab602 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.866939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a8be6-37b5-403d-8e8b-d8a537fab602 admin admin] PATH_INFO: `/v3/projects/af196f8af15f4f7ca1802c701ec7cd9e/users/1c4974bb5e354cd1bb1920b7bd6836c7/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.868945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a8be6-37b5-403d-8e8b-d8a537fab602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af196f8af15f4f7ca1802c701ec7cd9e, user_id=1c4974bb5e354cd1bb1920b7bd6836c7, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:50.871539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a8be6-37b5-403d-8e8b-d8a537fab602 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:50.883333 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3729/7552] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:50 2021] PUT /identity/v3/projects/af196f8af15f4f7ca1802c701ec7cd9e/users/1c4974bb5e354cd1bb1920b7bd6836c7/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:50.898661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:50.898954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:50.899231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:50.900486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7436851523404d78becfdff675095346'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.908282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7436851523404d78becfdff675095346'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.923051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7436851523404d78becfdff675095346'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.925141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7436851523404d78becfdff675095346'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:50.931568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] MFA Rules not processed for user `1c4974bb5e354cd1bb1920b7bd6836c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:50.932899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.003763 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3730/7553] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:50 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:51.005152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1ac08691-dfab-4259-a915-a16aa934baa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7436851523404d78becfdff675095346'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.012980 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3824/7554] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:50 2021] DELETE /identity/v3/users/7436851523404d78becfdff675095346 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:51.015973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:51.016185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.019228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:51.019521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:51.019819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:51.037968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:51.039163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.118772 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3825/7555] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:51.126808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf6295-a2fd-48c5-93b7-1fc17de548f5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:51.131142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:51.133309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.184357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:51.185908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:51.186287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:51.186567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:51.188595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.206027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42714-abde-4380-b31a-f34570c57b22 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:51.210003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:51.210649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:51.210933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:51.211220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:51.221060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:51.222519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:51.233444 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3826/7556] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:51.257086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:51.258657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:51.271455 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3731/7557] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:51 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:51.400604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:51.402049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.416673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296120fe-fc89-40e2-826a-3ee33874374e service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:51.422846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:51.423868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:51.424255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:51.424581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] PATH_INFO: `/v3/projects/86b8877084634b8da7fbff8c88e8621f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:51.429720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b8877084634b8da7fbff8c88e8621f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:51.429720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:51.589953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b8877084634b8da7fbff8c88e8621f', 'request_id': 'req-c8100f35-9a4f-4586-8cb0-420163e3504f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.650823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b8877084634b8da7fbff8c88e8621f', 'request_id': 'req-c8100f35-9a4f-4586-8cb0-420163e3504f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.674290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b8877084634b8da7fbff8c88e8621f', 'request_id': 'req-c8100f35-9a4f-4586-8cb0-420163e3504f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.674419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:51.674419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.675182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] The token cache is being invalidate because project 86b8877084634b8da7fbff8c88e8621f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:51.675547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.676505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.678693 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3827/7558] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:51 2021] DELETE /identity/v3/projects/86b8877084634b8da7fbff8c88e8621f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:51.681597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908bab1-effb-488e-836c-93dc43a0c75d service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:51.682621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:51.684296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:51.743295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:51.744248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:51.744609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:51.745019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] PATH_INFO: `/v3/projects/424db5b6892e47e5aeca9a6edf5d1fb7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:51.746347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=424db5b6892e47e5aeca9a6edf5d1fb7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:51.748949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:51.759661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8100f35-9a4f-4586-8cb0-420163e3504f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:51.764758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:51.765678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:51.765961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:51.766382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] PATH_INFO: `/v3/users/e6d94582f8e3484c86a5c8a6073e908e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:51.767607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d94582f8e3484c86a5c8a6073e908e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:51.769551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:51.884765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424db5b6892e47e5aeca9a6edf5d1fb7', 'request_id': 'req-231de769-94e9-4163-bbd1-1a0ca8a95857'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.891168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424db5b6892e47e5aeca9a6edf5d1fb7', 'request_id': 'req-231de769-94e9-4163-bbd1-1a0ca8a95857'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.970930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424db5b6892e47e5aeca9a6edf5d1fb7', 'request_id': 'req-231de769-94e9-4163-bbd1-1a0ca8a95857'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.985433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] The token cache is being invalidate because project 424db5b6892e47e5aeca9a6edf5d1fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:51.985720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.986413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:51.988034 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3732/7559] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:51 2021] DELETE /identity/v3/projects/424db5b6892e47e5aeca9a6edf5d1fb7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:51.991966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:51.993334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:52.041289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d94582f8e3484c86a5c8a6073e908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.049231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d94582f8e3484c86a5c8a6073e908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.059093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de769-94e9-4163-bbd1-1a0ca8a95857 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:52.061874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d94582f8e3484c86a5c8a6073e908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.062564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d94582f8e3484c86a5c8a6073e908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.065462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:52.066407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:52.066742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:52.066874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] PATH_INFO: `/v3/users/9ef98e486153421c94aa9347ec5d7a96` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:52.068112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef98e486153421c94aa9347ec5d7a96)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:52.070169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:52.135958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d94582f8e3484c86a5c8a6073e908e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.143235 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3828/7560] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:51 2021] DELETE /identity/v3/users/e6d94582f8e3484c86a5c8a6073e908e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:52.298430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef98e486153421c94aa9347ec5d7a96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.304986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef98e486153421c94aa9347ec5d7a96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.338859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef98e486153421c94aa9347ec5d7a96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.340610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef98e486153421c94aa9347ec5d7a96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.341362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef98e486153421c94aa9347ec5d7a96'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:52.441506 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3733/7561] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:51 2021] DELETE /identity/v3/users/9ef98e486153421c94aa9347ec5d7a96 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:52.667293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:52.667293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:52.744333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0be3fe-aefe-40a1-b528-cba44dedcf58 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:52.809524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:52.810161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:52.810439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:52.810774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] PATH_INFO: `/v3/projects/6c0a83d39cba4d55a5d03a51601c9b5a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:52.812079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0a83d39cba4d55a5d03a51601c9b5a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:52.814093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:52.902954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:52.904959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:52.920845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7410c-c02d-4379-9f26-b71381e64be4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:52.926256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:52.927216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:52.927572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:52.928616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] PATH_INFO: `/v3/projects/5987b3b49cf244dc84293ee8e31f8b40` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:52.930379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5987b3b49cf244dc84293ee8e31f8b40)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:52.932839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:52.949953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0a83d39cba4d55a5d03a51601c9b5a', 'request_id': 'req-7e100a6b-4fdb-419c-b450-34333d14bb08'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.015980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0a83d39cba4d55a5d03a51601c9b5a', 'request_id': 'req-7e100a6b-4fdb-419c-b450-34333d14bb08'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.023180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0a83d39cba4d55a5d03a51601c9b5a', 'request_id': 'req-7e100a6b-4fdb-419c-b450-34333d14bb08'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.034301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] The token cache is being invalidate because project 6c0a83d39cba4d55a5d03a51601c9b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:53.034629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.035306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7e100a6b-4fdb-419c-b450-34333d14bb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.036850 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3829/7562] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:52 2021] DELETE /identity/v3/projects/6c0a83d39cba4d55a5d03a51601c9b5a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:53.042510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0cad-7ec3-4275-9eef-4a4cc74e0366 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.042799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0cad-7ec3-4275-9eef-4a4cc74e0366 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.043079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0cad-7ec3-4275-9eef-4a4cc74e0366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.056355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5987b3b49cf244dc84293ee8e31f8b40', 'request_id': 'req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.060977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-634e0cad-7ec3-4275-9eef-4a4cc74e0366 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:53.062166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-634e0cad-7ec3-4275-9eef-4a4cc74e0366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:53.062439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5987b3b49cf244dc84293ee8e31f8b40', 'request_id': 'req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.122039 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3830/7563] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:53.124731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5987b3b49cf244dc84293ee8e31f8b40', 'request_id': 'req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.130495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1879-eaf5-4b96-8307-a211e0b8361d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.130788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1879-eaf5-4b96-8307-a211e0b8361d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.131061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1879-eaf5-4b96-8307-a211e0b8361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.135468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] The token cache is being invalidate because project 5987b3b49cf244dc84293ee8e31f8b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:53.135757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.136391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-647dcb3b-f322-4e3c-a2a1-4b404a3e0c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:53.138253 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3734/7564] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:52 2021] DELETE /identity/v3/projects/5987b3b49cf244dc84293ee8e31f8b40 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:53.143590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722930f6-ff64-4d03-bc5f-0f85cc2476d7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.143949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722930f6-ff64-4d03-bc5f-0f85cc2476d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.144235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722930f6-ff64-4d03-bc5f-0f85cc2476d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.149316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5b8f1879-eaf5-4b96-8307-a211e0b8361d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:53.150821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5b8f1879-eaf5-4b96-8307-a211e0b8361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:53.158964 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3831/7565] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:53.162453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-722930f6-ff64-4d03-bc5f-0f85cc2476d7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:53.163173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f1879-eaf5-4b96-8307-a211e0b8361d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.163683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-722930f6-ff64-4d03-bc5f-0f85cc2476d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:53.172734 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3735/7566] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:53.173099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f1879-eaf5-4b96-8307-a211e0b8361d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.177947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.178669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.178953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.179234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.179992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:53.180304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.182159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.186138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23decd94-0887-4eac-ab32-2795ca954354 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.186419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23decd94-0887-4eac-ab32-2795ca954354 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.186690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23decd94-0887-4eac-ab32-2795ca954354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.195849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3832/7567] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:36:53.202492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.204538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-23decd94-0887-4eac-ab32-2795ca954354 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:53.205788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23decd94-0887-4eac-ab32-2795ca954354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:53.214011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3736/7568] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:53.214376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b982faa-6c49-4bd2-a269-9b0914d71b38 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.218243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23decd94-0887-4eac-ab32-2795ca954354 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.219365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.220027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.220421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.220631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.221366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.223280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.228353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23decd94-0887-4eac-ab32-2795ca954354 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.233627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.234278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.234589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.234865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.235588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:53.235898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.237514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.252610 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3737/7569] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:36:53.259951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.264531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5a87e-8d74-4450-b061-e26bcc9fdffe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.269338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.269970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.270251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.270859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.271583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.273472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.315355 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3833/7570] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:53.319368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.378929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630bcd-b4cd-4e23-bd93-9659f9aead17 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.383593 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3738/7571] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:53.385905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.385905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.386152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.386417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.387347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.388817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.390150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.447359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca920-8bfd-4d9a-8f8f-12ee92e9aced admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.458983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.458983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.458983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.458983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.459509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.459509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.485400 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3834/7572] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:53.489877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.501520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ccebe-7749-4cdd-9124-14c9970e9d28 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.506987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.507998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.508439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.508898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.509778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.511558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.523471 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3835/7573] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:53.527340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.532891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3739/7574] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:53.535475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.537334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8d5a0-f4fe-4c93-bd01-4c45adfd57dd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.542020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.542663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.542947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.543223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.543945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.545230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c8a4b-3783-4f9f-8a08-c0ca38ed7b83 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.545727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.552460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.553171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.553658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.554119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.555070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.556860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.561245 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3836/7575] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:53.564019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.577964 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3740/7576] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:53.578201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ac7d-4e88-4fcc-8e5a-46cf6992c0af admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.579052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.582678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307a509-dbe8-4b79-85c8-88359d4f45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.583687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a509-dbe8-4b79-85c8-88359d4f45b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.585013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a509-dbe8-4b79-85c8-88359d4f45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.585013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a509-dbe8-4b79-85c8-88359d4f45b1 admin admin] PATH_INFO: `/v3/projects/01ef7c196a2a435992fa90e41bf876ac/users/8fc6f76b2d574cdba191d9767b724db0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.589565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98e4b0-f918-489f-95a9-fd204ca21203 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.595283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.595642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.595936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.596346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.597050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.598642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.601117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307a509-dbe8-4b79-85c8-88359d4f45b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ef7c196a2a435992fa90e41bf876ac, user_id=8fc6f76b2d574cdba191d9767b724db0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.604052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307a509-dbe8-4b79-85c8-88359d4f45b1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.613085 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3741/7577] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:53.614213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.623966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e7b19-72ee-4b71-b943-d41217ca57ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.628671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa707e0-a6e7-48bb-a109-42539b5a3267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.629577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa707e0-a6e7-48bb-a109-42539b5a3267 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.629863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa707e0-a6e7-48bb-a109-42539b5a3267 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.630138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa707e0-a6e7-48bb-a109-42539b5a3267 admin admin] PATH_INFO: `/v3/projects/8dfc54f3235c4dab9929020accad5eff/users/84c782bbd1184561af8fb1fdf9700c1b/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.647008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa707e0-a6e7-48bb-a109-42539b5a3267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfc54f3235c4dab9929020accad5eff, user_id=84c782bbd1184561af8fb1fdf9700c1b, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.649711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa707e0-a6e7-48bb-a109-42539b5a3267 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.708524 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3837/7578] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:53 2021] PUT /identity/v3/projects/01ef7c196a2a435992fa90e41bf876ac/users/8fc6f76b2d574cdba191d9767b724db0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:53.719717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88536-ec67-4e47-9275-8a8d531d545d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.720120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88536-ec67-4e47-9275-8a8d531d545d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.720406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88536-ec67-4e47-9275-8a8d531d545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.747296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-42e88536-ec67-4e47-9275-8a8d531d545d None None] MFA Rules not processed for user `8fc6f76b2d574cdba191d9767b724db0`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:53.750441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-42e88536-ec67-4e47-9275-8a8d531d545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:53.753625 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3742/7579] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:53 2021] PUT /identity/v3/projects/8dfc54f3235c4dab9929020accad5eff/users/84c782bbd1184561af8fb1fdf9700c1b/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:53.764685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.765022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.765307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.792966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] MFA Rules not processed for user `84c782bbd1184561af8fb1fdf9700c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:53.794192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:53.818293 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3838/7580] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:53.827509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e88536-ec67-4e47-9275-8a8d531d545d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.865123 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3743/7581] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:53.877898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:53.879532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:53.892723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e88536-ec67-4e47-9275-8a8d531d545d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.897787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.898506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.900793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.900793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.900793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.901938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.943524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d51fed-ef08-4bca-9e82-4dcce25d5a10 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:53.947452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:53.948399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:53.948944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:53.949338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:53.959204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:53.960833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:53.971680 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3744/7582] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:53 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:54.043632 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3839/7583] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:53 2021] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:54.048275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.074022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd299eb-dd77-4136-aeab-5837b9371d24 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.101274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.145367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.146465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.146748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.147021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.147704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.149669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.168118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20596e5-bb32-4096-ae39-2ae955adce18 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.172827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.173715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.173991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.174261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] PATH_INFO: `/v3/users/84c782bbd1184561af8fb1fdf9700c1b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.175561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c782bbd1184561af8fb1fdf9700c1b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.177487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.249636 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3745/7584] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:54 2021] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:54.250658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.260168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef92a-bd4f-48f6-a05b-66e0c52709b3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.265697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.266362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.266692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.266904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.267691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.269199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.281174 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3746/7585] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:54.285171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.294760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ccac4-f9cd-4a46-acea-28c9af6b4c1e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.300352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.300552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.300833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.301173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] PATH_INFO: `/v3/projects/06dbe1300f454f17a89abb4c804755f8/users/013c354a753342489256c030b35265f7/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.315971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dbe1300f454f17a89abb4c804755f8, user_id=013c354a753342489256c030b35265f7, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.318628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.428439 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3747/7586] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:54 2021] PUT /identity/v3/projects/06dbe1300f454f17a89abb4c804755f8/users/013c354a753342489256c030b35265f7/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:54.429277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.431194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.432457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c782bbd1184561af8fb1fdf9700c1b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:54.440169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c782bbd1184561af8fb1fdf9700c1b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:54.453553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c782bbd1184561af8fb1fdf9700c1b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:54.454378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c782bbd1184561af8fb1fdf9700c1b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:54.491468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e6bb4-b04c-441e-8603-30bb5b1a8898 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.495285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd244f-4fc2-4fc4-b0ee-6d790718ffb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.495961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd244f-4fc2-4fc4-b0ee-6d790718ffb8 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.496245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd244f-4fc2-4fc4-b0ee-6d790718ffb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.496523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd244f-4fc2-4fc4-b0ee-6d790718ffb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.498407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c4dd244f-4fc2-4fc4-b0ee-6d790718ffb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.502217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c782bbd1184561af8fb1fdf9700c1b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:54.509720 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3840/7587] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:36:54 2021] DELETE /identity/v3/users/84c782bbd1184561af8fb1fdf9700c1b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:54.510600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.511994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.562647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd244f-4fc2-4fc4-b0ee-6d790718ffb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.564262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd244f-4fc2-4fc4-b0ee-6d790718ffb8 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.574252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3748/7588] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:54 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:54.575549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.576827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.577128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.587865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48930b-633a-4c77-8a4d-9910f6f48f33 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.594892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:54.595191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.595962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.596101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.596577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.597507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.598448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.600153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.605472 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3749/7589] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:54.611487 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3841/7590] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:54 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:54.615838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.616024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.618615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.630014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc4f6-584c-4f0e-a04b-8c45b15ef2ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.636601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096038-bce4-4daf-8308-c602695c6806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.638082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096038-bce4-4daf-8308-c602695c6806 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.638881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096038-bce4-4daf-8308-c602695c6806 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.639203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096038-bce4-4daf-8308-c602695c6806 admin admin] PATH_INFO: `/v3/projects/06dbe1300f454f17a89abb4c804755f8/users/013c354a753342489256c030b35265f7/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.641303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096038-bce4-4daf-8308-c602695c6806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dbe1300f454f17a89abb4c804755f8, user_id=013c354a753342489256c030b35265f7, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.643903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096038-bce4-4daf-8308-c602695c6806 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.655539 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3842/7591] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:54 2021] PUT /identity/v3/projects/06dbe1300f454f17a89abb4c804755f8/users/013c354a753342489256c030b35265f7/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:36:54.666826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.667142 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.667378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.687284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2069564-739e-4577-9bc6-fd1e4d2030d5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.706397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] MFA Rules not processed for user `013c354a753342489256c030b35265f7`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:54.706397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.733963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.734607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.734904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.735178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.763511 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3843/7592] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:54 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:54.773482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:54.774953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.797264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.798719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.817285 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3750/7593] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:36:54.850571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3f8a-65a9-423f-a20f-b431149b62ae None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:54.854440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a800d8-f179-4b2b-ab36-4a1bbb66c8ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:54.855092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a800d8-f179-4b2b-ab36-4a1bbb66c8ba service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:54.855378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a800d8-f179-4b2b-ab36-4a1bbb66c8ba service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:54.855657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a800d8-f179-4b2b-ab36-4a1bbb66c8ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:54.858086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-29a800d8-f179-4b2b-ab36-4a1bbb66c8ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:54.922508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a800d8-f179-4b2b-ab36-4a1bbb66c8ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:54.924183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a800d8-f179-4b2b-ab36-4a1bbb66c8ba service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:54.933947 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3844/7594] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:54 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:55.309281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:55.311371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:55.326609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6d2fa-d97a-499d-8e9e-cb535e8973f0 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:55.331506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:55.333582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:55.333867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:55.334145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] PATH_INFO: `/v3/projects/8dfc54f3235c4dab9929020accad5eff` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:55.335394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfc54f3235c4dab9929020accad5eff)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:55.337338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:55.479754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfc54f3235c4dab9929020accad5eff', 'request_id': 'req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:55.486366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfc54f3235c4dab9929020accad5eff', 'request_id': 'req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:55.644839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfc54f3235c4dab9929020accad5eff', 'request_id': 'req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:55.656475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] The token cache is being invalidate because project 8dfc54f3235c4dab9929020accad5eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:36:55.656755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:55.657413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5c38d9d7-1a11-4a33-be5b-dd787a792f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:36:55.658945 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3751/7595] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:36:55 2021] DELETE /identity/v3/projects/8dfc54f3235c4dab9929020accad5eff => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:55.665497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dfa52-f02b-4a21-87bc-11506507d24d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:55.665789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dfa52-f02b-4a21-87bc-11506507d24d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:55.666102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dfa52-f02b-4a21-87bc-11506507d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:55.685362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4e6dfa52-f02b-4a21-87bc-11506507d24d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:55.686553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4e6dfa52-f02b-4a21-87bc-11506507d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:55.747246 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3845/7596] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:55.760466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639398-56d7-49a5-9c9e-3af2906ff138 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:55.760752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639398-56d7-49a5-9c9e-3af2906ff138 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:55.761066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c639398-56d7-49a5-9c9e-3af2906ff138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:55.781118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1c639398-56d7-49a5-9c9e-3af2906ff138 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:55.782321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1c639398-56d7-49a5-9c9e-3af2906ff138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:55.790740 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3752/7597] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:55.797506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dfa52-f02b-4a21-87bc-11506507d24d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:55.806400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dfa52-f02b-4a21-87bc-11506507d24d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:55.819323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:55.820277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:55.820644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:55.821020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:55.826231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:36:55.826231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:55.826231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:55.839664 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3846/7598] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:36:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:36:55.841100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639398-56d7-49a5-9c9e-3af2906ff138 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:55.853288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c639398-56d7-49a5-9c9e-3af2906ff138 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:55.859261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:55.860011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:55.860327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:55.860692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:55.861363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:55.863225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:55.959730 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3753/7599] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:55 2021] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:55.964017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:55.974890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c886b-93de-479b-b77c-85208f42f3bb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.034434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.035103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.035391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.035660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.037543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.038413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.145486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3847/7600] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:55 2021] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:56.149831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.165241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134c996-97bc-459e-86f1-9df9964df453 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.171879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.172685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.173127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.173495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.174313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.177772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.201513 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3754/7601] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:56.206076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.218063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c1e3-7e97-4cf3-bbd5-b5f0af5b7c5a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.223388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.224251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.225024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.225579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.226236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.228139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.240918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3848/7602] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:36:56.244258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.254674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746dbd-c002-4487-9ac8-f4a48d7b7707 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.259961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00e107-a226-4cac-8e7e-6734b6d5c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.260857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e107-a226-4cac-8e7e-6734b6d5c753 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.261147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e107-a226-4cac-8e7e-6734b6d5c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.261451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e107-a226-4cac-8e7e-6734b6d5c753 admin admin] PATH_INFO: `/v3/projects/a498fd2c1ac8477bafc3e115400efd70/users/a44db6ff8faa485d8c73935183c3c0dc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.288060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00e107-a226-4cac-8e7e-6734b6d5c753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a498fd2c1ac8477bafc3e115400efd70, user_id=a44db6ff8faa485d8c73935183c3c0dc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.289610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.291427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:56.291887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00e107-a226-4cac-8e7e-6734b6d5c753 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.368170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9bf0-e832-4cc4-82eb-618ec4f9da2d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.373713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.374476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.375231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.375231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.377412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:56.383005 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3755/7603] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:56 2021] PUT /identity/v3/projects/a498fd2c1ac8477bafc3e115400efd70/users/a44db6ff8faa485d8c73935183c3c0dc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:56.394836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4ee8-d5a5-4b14-84d2-2842bb83e737 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.395208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4ee8-d5a5-4b14-84d2-2842bb83e737 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.395557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4ee8-d5a5-4b14-84d2-2842bb83e737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.437218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eb4d4ee8-d5a5-4b14-84d2-2842bb83e737 None None] MFA Rules not processed for user `a44db6ff8faa485d8c73935183c3c0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:56.438611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eb4d4ee8-d5a5-4b14-84d2-2842bb83e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:56.450467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.453242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.466198 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3849/7604] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:56 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:36:56.502409 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3756/7605] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:56 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:36:56.507233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.518677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ba16-40f6-48d9-8a3a-b01414d9015e service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.574322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.575032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.575321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.575623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.576370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.578298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.705383 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3850/7606] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:36:56 2021] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:36:56.709534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4ee8-d5a5-4b14-84d2-2842bb83e737 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.723605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4ee8-d5a5-4b14-84d2-2842bb83e737 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.777207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.777841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.778120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.778394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.779678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.781595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.905973 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3757/7607] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:36:56 2021] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:36:56.907223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.918018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab53e-c795-453e-a9a6-3132785bfc95 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.922801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.923602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.923884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.924163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.924922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.926532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:56.937113 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3851/7608] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:56.944612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:56.951977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b34bec-1e85-43e5-adec-c0d081a63c31 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:56.956688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:56.957616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:56.957901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:56.958176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] PATH_INFO: `/v3/projects/5c26379097bd47e58e5ec3d0710abc25/users/3407df4cb5b343eaba1da9c9f87c06b0/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:56.973973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c26379097bd47e58e5ec3d0710abc25, user_id=3407df4cb5b343eaba1da9c9f87c06b0, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:56.976642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:57.073116 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3758/7609] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:56 2021] PUT /identity/v3/projects/5c26379097bd47e58e5ec3d0710abc25/users/3407df4cb5b343eaba1da9c9f87c06b0/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:57.077124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:57.087003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4266e7-7780-4dac-b24d-b6632bee0929 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:57.147487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735a75-8d70-459d-bff9-c73e440904e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:57.148154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735a75-8d70-459d-bff9-c73e440904e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:57.148446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735a75-8d70-459d-bff9-c73e440904e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:57.148706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735a75-8d70-459d-bff9-c73e440904e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:57.149471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735a75-8d70-459d-bff9-c73e440904e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:57.151055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735a75-8d70-459d-bff9-c73e440904e3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:57.161308 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3852/7610] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:36:57.165517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:57.176261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13c41-06fd-4a6a-9410-3ecfba02800b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:57.180980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:57.181851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:57.182133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:57.182405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] PATH_INFO: `/v3/projects/5c26379097bd47e58e5ec3d0710abc25/users/3407df4cb5b343eaba1da9c9f87c06b0/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:57.184409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c26379097bd47e58e5ec3d0710abc25, user_id=3407df4cb5b343eaba1da9c9f87c06b0, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:57.187133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:57.199462 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3759/7611] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:36:57 2021] PUT /identity/v3/projects/5c26379097bd47e58e5ec3d0710abc25/users/3407df4cb5b343eaba1da9c9f87c06b0/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:36:57.209533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b08984-790b-45ea-b806-8236659c6bfa None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:57.209925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b08984-790b-45ea-b806-8236659c6bfa None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:57.210270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b08984-790b-45ea-b806-8236659c6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:57.237548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-81b08984-790b-45ea-b806-8236659c6bfa None None] MFA Rules not processed for user `3407df4cb5b343eaba1da9c9f87c06b0`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:36:57.238742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-81b08984-790b-45ea-b806-8236659c6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:57.305826 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3853/7612] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:36:57 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:36:57.316137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:36:57.318444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:36:57.381620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad44b1-98cd-4afd-b8be-1f34ba5f8ed1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:36:57.385379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:36:57.386032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:36:57.386316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:36:57.386620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:36:57.447585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:36:57.449124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:36:57.459453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3760/7613] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:36:57 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:01.083289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b08984-790b-45ea-b806-8236659c6bfa None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:01.095999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b08984-790b-45ea-b806-8236659c6bfa None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:01.099992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45ef78-69c8-4d7e-baae-686c28e7d38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:01.100747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45ef78-69c8-4d7e-baae-686c28e7d38e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:01.101061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45ef78-69c8-4d7e-baae-686c28e7d38e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:01.101332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45ef78-69c8-4d7e-baae-686c28e7d38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:01.111185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45ef78-69c8-4d7e-baae-686c28e7d38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:01.112675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45ef78-69c8-4d7e-baae-686c28e7d38e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:01.135976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3854/7614] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:01 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:37:04.151166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:04.212497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda8aa-5337-4f3f-aaba-dcf108270965 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:04.217192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:04.218102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:04.218324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:04.218602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] PATH_INFO: `/v3/users/a44db6ff8faa485d8c73935183c3c0dc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:04.219796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44db6ff8faa485d8c73935183c3c0dc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:04.221894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:04.412758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44db6ff8faa485d8c73935183c3c0dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:04.419870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44db6ff8faa485d8c73935183c3c0dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:04.439040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44db6ff8faa485d8c73935183c3c0dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:04.439040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44db6ff8faa485d8c73935183c3c0dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:04.439040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44db6ff8faa485d8c73935183c3c0dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:04.520459 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3761/7615] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:04 2021] DELETE /identity/v3/users/a44db6ff8faa485d8c73935183c3c0dc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:04.524217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:04.524710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:04.525185 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:04.542925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:04.544124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:04.603220 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3855/7616] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:04.614645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:04.616121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:04.674700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d872-8c98-40c4-ac2a-a3c8dc213b36 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:04.680193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:04.680958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:04.681308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:04.681651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:04.692243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:04.693710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:04.713716 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3762/7617] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:04.972728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:04.974672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:04.987969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cb7e-113e-4134-9ebf-1ecb446c2d03 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:04.992614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:04.993788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:04.994071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:04.994347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] PATH_INFO: `/v3/projects/a498fd2c1ac8477bafc3e115400efd70` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:04.995567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a498fd2c1ac8477bafc3e115400efd70)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:04.997519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:05.160561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a498fd2c1ac8477bafc3e115400efd70', 'request_id': 'req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.245085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a498fd2c1ac8477bafc3e115400efd70', 'request_id': 'req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.252484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a498fd2c1ac8477bafc3e115400efd70', 'request_id': 'req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.262405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] The token cache is being invalidate because project a498fd2c1ac8477bafc3e115400efd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:05.262944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.263637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.265319 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3856/7618] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:04 2021] DELETE /identity/v3/projects/a498fd2c1ac8477bafc3e115400efd70 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:05.269341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:05.279215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5281db-954c-40f6-9f3c-f9b88fcfa84f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:05.333556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:05.334424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:05.334706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:05.334980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] PATH_INFO: `/v3/users/3407df4cb5b343eaba1da9c9f87c06b0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:05.336156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3407df4cb5b343eaba1da9c9f87c06b0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:05.338074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:05.494206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3407df4cb5b343eaba1da9c9f87c06b0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.501646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3407df4cb5b343eaba1da9c9f87c06b0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.514496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3407df4cb5b343eaba1da9c9f87c06b0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.515167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3407df4cb5b343eaba1da9c9f87c06b0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.515868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3407df4cb5b343eaba1da9c9f87c06b0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:05.625532 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3763/7619] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:05 2021] DELETE /identity/v3/users/3407df4cb5b343eaba1da9c9f87c06b0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:37:05.647954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:05.649474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:05.709642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0bc4-24af-4d29-85e1-f8f2047c918b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:05.760205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc7847-a4e0-4472-923e-94f702e71fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:05.760858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7847-a4e0-4472-923e-94f702e71fad service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:05.761171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7847-a4e0-4472-923e-94f702e71fad service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:05.771004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc7847-a4e0-4472-923e-94f702e71fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:05.771004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-72fc7847-a4e0-4472-923e-94f702e71fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:05.842929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc7847-a4e0-4472-923e-94f702e71fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:05.844013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc7847-a4e0-4472-923e-94f702e71fad service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:05.854946 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3857/7620] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:05 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:06.041352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:06.043098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:06.112750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51a6ec-1238-4ac8-967a-eede55a4b7c9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:06.117377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:06.118245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.118500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.118769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] PATH_INFO: `/v3/projects/5c26379097bd47e58e5ec3d0710abc25` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.119937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c26379097bd47e58e5ec3d0710abc25)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:06.121888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:06.234531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c26379097bd47e58e5ec3d0710abc25', 'request_id': 'req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:06.240599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c26379097bd47e58e5ec3d0710abc25', 'request_id': 'req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:06.330747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c26379097bd47e58e5ec3d0710abc25', 'request_id': 'req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:06.341842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] The token cache is being invalidate because project 5c26379097bd47e58e5ec3d0710abc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:06.342126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:06.342777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5281f9d4-7f0b-4acf-b1d9-fa3c502bed02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:06.344296 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3764/7621] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:06 2021] DELETE /identity/v3/projects/5c26379097bd47e58e5ec3d0710abc25 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:06.349991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ddf7-732d-474a-9b47-07af12aa4b9a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.350280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ddf7-732d-474a-9b47-07af12aa4b9a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.350554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ddf7-732d-474a-9b47-07af12aa4b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.368859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e624ddf7-732d-474a-9b47-07af12aa4b9a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:06.370134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e624ddf7-732d-474a-9b47-07af12aa4b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:06.429685 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3858/7622] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:06.438662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc153-3860-476c-8afc-758839409c19 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.443241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc153-3860-476c-8afc-758839409c19 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.443241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc153-3860-476c-8afc-758839409c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.458103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-eeacc153-3860-476c-8afc-758839409c19 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:06.459311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eeacc153-3860-476c-8afc-758839409c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:06.467690 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3765/7623] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:06.471964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624ddf7-732d-474a-9b47-07af12aa4b9a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:06.481734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624ddf7-732d-474a-9b47-07af12aa4b9a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:06.487233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:06.487901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.491232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.491232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.491232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:37:06.491232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:06.491232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:06.503457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3859/7624] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:37:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:37:06.508089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacc153-3860-476c-8afc-758839409c19 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:06.518670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacc153-3860-476c-8afc-758839409c19 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:06.523589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:06.524248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.524510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.524907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.525519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:06.527885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:06.625435 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3766/7625] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:06 2021] POST /identity/v3/projects => generated 411 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:06.628898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:06.639775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4201-d8ec-45ba-8030-1ec32e13aa44 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:06.696674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:06.697386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.697666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.697937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.698638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:06.700541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:06.800297 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3860/7626] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:06 2021] POST /identity/v3/users => generated 306 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:06.804653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:06.815763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda255f1-7cd5-49a3-8c9c-348bfe6eb960 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:06.821776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:06.822441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.822725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.822997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.823838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:06.825560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:06.838144 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3767/7627] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:06 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:06.842668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:06.853786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbcc71-2733-4040-ab91-92c57c23a2cf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:06.866107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0157f-6212-4e8e-9a93-6db2234cbbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:06.866107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0157f-6212-4e8e-9a93-6db2234cbbbc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.866107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0157f-6212-4e8e-9a93-6db2234cbbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.866107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0157f-6212-4e8e-9a93-6db2234cbbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.866775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0157f-6212-4e8e-9a93-6db2234cbbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:06.866775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0157f-6212-4e8e-9a93-6db2234cbbbc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:06.874819 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3861/7628] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:06.879445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:06.890685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba9f12-8582-49ef-8d5d-0b9ca9eef7b6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:06.895896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:06.896820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:06.897135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:06.905115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] PATH_INFO: `/v3/projects/6d00401cb65244fc9509205685b6133d/users/91e7e22732694d77a241a4d4f7b3b013/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:06.914148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d00401cb65244fc9509205685b6133d, user_id=91e7e22732694d77a241a4d4f7b3b013, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:06.917103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:07.022914 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3768/7629] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:06 2021] PUT /identity/v3/projects/6d00401cb65244fc9509205685b6133d/users/91e7e22732694d77a241a4d4f7b3b013/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:37:07.034384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ba59-fd6a-4b07-8912-91ebfa4ca57b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.034673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ba59-fd6a-4b07-8912-91ebfa4ca57b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.034959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ba59-fd6a-4b07-8912-91ebfa4ca57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.061170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9854ba59-fd6a-4b07-8912-91ebfa4ca57b None None] MFA Rules not processed for user `91e7e22732694d77a241a4d4f7b3b013`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:07.062376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9854ba59-fd6a-4b07-8912-91ebfa4ca57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:07.125438 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3862/7630] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:07 2021] POST /identity/v3/auth/tokens => generated 3278 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:07.130231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:07.195716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7817-a742-4799-80d2-8437f7366d7d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:07.203928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:07.204639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.205023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.205513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.206253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:07.210237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:07.338296 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3769/7631] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:07 2021] POST /identity/v3/projects => generated 409 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:07.342827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ba59-fd6a-4b07-8912-91ebfa4ca57b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:07.353485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ba59-fd6a-4b07-8912-91ebfa4ca57b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:07.409946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:07.411632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.411632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.411632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.411940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:07.413847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:07.491731 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3863/7632] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:07 2021] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:07.495594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:07.506655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a11d-8b1d-426b-ab3e-a0e0a07ae798 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:07.511374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:07.512031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.512316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.512600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.513624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:07.515252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:07.526066 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3770/7633] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:07.530321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:07.540459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06818a49-99cc-4b0d-af55-e666798cf15a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:07.545673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:07.546675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.546903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.547180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] PATH_INFO: `/v3/projects/3d736ca73abd45c6ab9efc21ec35bf70/users/5e33be108370456ebf5cb74629bd2a42/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.562432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d736ca73abd45c6ab9efc21ec35bf70, user_id=5e33be108370456ebf5cb74629bd2a42, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:07.565138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:07.668506 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3864/7634] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:07 2021] PUT /identity/v3/projects/3d736ca73abd45c6ab9efc21ec35bf70/users/5e33be108370456ebf5cb74629bd2a42/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:37:07.673062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:07.684038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa0bc6-3ebb-4f1e-bef0-4505f7aaa1ae admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:07.775083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f215a-898d-4cd4-989d-9bbaf8d47dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:07.775862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f215a-898d-4cd4-989d-9bbaf8d47dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.776215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f215a-898d-4cd4-989d-9bbaf8d47dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.776564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f215a-898d-4cd4-989d-9bbaf8d47dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.777594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f215a-898d-4cd4-989d-9bbaf8d47dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:07.779845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f215a-898d-4cd4-989d-9bbaf8d47dc6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:07.793813 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3771/7635] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:07.796286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:07.808479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1882370-8363-45a3-8a1a-8d3fceee60c2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:07.818375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:07.818375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.818375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.818375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] PATH_INFO: `/v3/projects/3d736ca73abd45c6ab9efc21ec35bf70/users/5e33be108370456ebf5cb74629bd2a42/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.818968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d736ca73abd45c6ab9efc21ec35bf70, user_id=5e33be108370456ebf5cb74629bd2a42, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:07.821244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:07.833895 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3865/7636] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:07 2021] PUT /identity/v3/projects/3d736ca73abd45c6ab9efc21ec35bf70/users/5e33be108370456ebf5cb74629bd2a42/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:37:07.844285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31d211-72ff-4e2a-926e-603d572beec0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:07.844578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31d211-72ff-4e2a-926e-603d572beec0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:07.844857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31d211-72ff-4e2a-926e-603d572beec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:07.881198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ad31d211-72ff-4e2a-926e-603d572beec0 None None] MFA Rules not processed for user `5e33be108370456ebf5cb74629bd2a42`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:07.883094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ad31d211-72ff-4e2a-926e-603d572beec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:07.963324 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3772/7637] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:07 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:07.974916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:07.976650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:08.046267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb64f-1adc-4ebb-8b84-a305157fb7f2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:08.050163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777519be-7cb7-4c53-b7b8-bfbb4497e694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:08.050941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777519be-7cb7-4c53-b7b8-bfbb4497e694 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:08.051247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777519be-7cb7-4c53-b7b8-bfbb4497e694 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:08.051649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777519be-7cb7-4c53-b7b8-bfbb4497e694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:08.062864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777519be-7cb7-4c53-b7b8-bfbb4497e694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:08.064431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777519be-7cb7-4c53-b7b8-bfbb4497e694 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:08.075456 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3866/7638] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:07 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:11.893118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31d211-72ff-4e2a-926e-603d572beec0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:12.014937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31d211-72ff-4e2a-926e-603d572beec0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:12.019704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:12.020665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:12.021083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:12.021432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] PATH_INFO: `/v3/users/91e7e22732694d77a241a4d4f7b3b013` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:12.022752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e7e22732694d77a241a4d4f7b3b013)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:12.024766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:12.305136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e7e22732694d77a241a4d4f7b3b013'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:12.311814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e7e22732694d77a241a4d4f7b3b013'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:12.323288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e7e22732694d77a241a4d4f7b3b013'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:12.324043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e7e22732694d77a241a4d4f7b3b013'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:12.324705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e7e22732694d77a241a4d4f7b3b013'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:12.406026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3773/7639] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:11 2021] DELETE /identity/v3/users/91e7e22732694d77a241a4d4f7b3b013 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:12.410793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:12.411297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:12.411433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:12.456532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:12.456532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:12.511216 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3867/7640] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:12.522153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:12.523733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:12.610332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab4f7-f160-4380-8a68-5024a4a53bb8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:12.613975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:12.614620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:12.614901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:12.615177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:12.624793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:12.626238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:12.636523 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3774/7641] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:13.057964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:13.059331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:13.071947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bc194-c64f-4137-9f60-1906cbbc128f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:13.077197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:13.078065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:13.078350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:13.078621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] PATH_INFO: `/v3/projects/6d00401cb65244fc9509205685b6133d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:13.079823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d00401cb65244fc9509205685b6133d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:13.081759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:13.216819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d00401cb65244fc9509205685b6133d', 'request_id': 'req-fb7332f5-728f-4bc4-8225-9925726709e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.283922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d00401cb65244fc9509205685b6133d', 'request_id': 'req-fb7332f5-728f-4bc4-8225-9925726709e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.290610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d00401cb65244fc9509205685b6133d', 'request_id': 'req-fb7332f5-728f-4bc4-8225-9925726709e5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.301089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] The token cache is being invalidate because project 6d00401cb65244fc9509205685b6133d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:13.301319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.302017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.303535 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3868/7642] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:13 2021] DELETE /identity/v3/projects/6d00401cb65244fc9509205685b6133d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:13.307450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:13.317101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4fd89-9382-4446-b2d0-e93257161b60 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:13.373144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:13.374155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:13.374442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:13.374719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] PATH_INFO: `/v3/users/5e33be108370456ebf5cb74629bd2a42` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:13.375951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e33be108370456ebf5cb74629bd2a42)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:13.377965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:13.518031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e33be108370456ebf5cb74629bd2a42'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.525807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e33be108370456ebf5cb74629bd2a42'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.540451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e33be108370456ebf5cb74629bd2a42'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.541235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e33be108370456ebf5cb74629bd2a42'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.541850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48fdf759-6c51-45fa-a4ff-218809c76361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e33be108370456ebf5cb74629bd2a42'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:13.616238 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3775/7643] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:13 2021] DELETE /identity/v3/users/5e33be108370456ebf5cb74629bd2a42 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:13.903881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:13.905374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:13.922072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7332f5-728f-4bc4-8225-9925726709e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:13.981042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:13.982408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:13.982698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:13.982972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] PATH_INFO: `/v3/projects/3d736ca73abd45c6ab9efc21ec35bf70` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:13.984177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d736ca73abd45c6ab9efc21ec35bf70)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:13.986089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:14.074594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d736ca73abd45c6ab9efc21ec35bf70', 'request_id': 'req-4598fbb0-9352-4e55-a04d-a167c6de18bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:14.164152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d736ca73abd45c6ab9efc21ec35bf70', 'request_id': 'req-4598fbb0-9352-4e55-a04d-a167c6de18bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:14.170885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d736ca73abd45c6ab9efc21ec35bf70', 'request_id': 'req-4598fbb0-9352-4e55-a04d-a167c6de18bd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:14.181576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] The token cache is being invalidate because project 3d736ca73abd45c6ab9efc21ec35bf70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:14.181866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:14.182524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4598fbb0-9352-4e55-a04d-a167c6de18bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:14.184234 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3869/7644] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:13 2021] DELETE /identity/v3/projects/3d736ca73abd45c6ab9efc21ec35bf70 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:14.192411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8ff9-a842-4e30-965b-50067b8bd7fd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.192819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8ff9-a842-4e30-965b-50067b8bd7fd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.193306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8ff9-a842-4e30-965b-50067b8bd7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.217449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cb3f8ff9-a842-4e30-965b-50067b8bd7fd None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:14.218639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cb3f8ff9-a842-4e30-965b-50067b8bd7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:14.276718 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3776/7645] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:14.285630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5cb12-2ab6-4033-872a-f49d5a47f51f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.285630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5cb12-2ab6-4033-872a-f49d5a47f51f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.285853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5cb12-2ab6-4033-872a-f49d5a47f51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.304342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-63d5cb12-2ab6-4033-872a-f49d5a47f51f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:14.305793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-63d5cb12-2ab6-4033-872a-f49d5a47f51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:14.314578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3870/7646] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:14.318829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8ff9-a842-4e30-965b-50067b8bd7fd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:14.330201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8ff9-a842-4e30-965b-50067b8bd7fd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:14.334808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:14.335498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.335782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.336056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.336779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:37:14.337131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:14.339091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:14.350782 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3777/7647] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:37:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:37:14.355182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5cb12-2ab6-4033-872a-f49d5a47f51f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:14.364635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5cb12-2ab6-4033-872a-f49d5a47f51f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:14.369475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:14.370116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.370400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.370675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.371374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:14.373812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:14.455478 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3871/7648] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:14 2021] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:14.456651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:14.468327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453bd8b-17b6-438b-a43c-83d35aa58a7d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:14.527699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:14.528380 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.528660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.529501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.530200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:14.532103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:14.622532 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3778/7649] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:14 2021] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:14.626444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:14.638247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09a0d-33a2-405a-a94a-7a6d6855fb78 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:14.642994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:14.644203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.644203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.644417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.644996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:14.646597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:14.657605 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3872/7650] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:14.661611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:14.672375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93d296-bb18-433b-8028-37692d41155b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:14.677381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e54f9-52cd-4bb1-b684-7754face15c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:14.678135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e54f9-52cd-4bb1-b684-7754face15c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.678415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e54f9-52cd-4bb1-b684-7754face15c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.678686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e54f9-52cd-4bb1-b684-7754face15c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.679408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e54f9-52cd-4bb1-b684-7754face15c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:14.681034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e54f9-52cd-4bb1-b684-7754face15c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:14.690913 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3779/7651] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:14.695087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:14.705740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c583d4-06ca-439f-aec9-64cfb1661684 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:14.710408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:14.711262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.711543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.711811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] PATH_INFO: `/v3/projects/7cfe20eec8944fc49a985abc7d576119/users/4104ff31c6b04a09baf0426afa4971d7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.726836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfe20eec8944fc49a985abc7d576119, user_id=4104ff31c6b04a09baf0426afa4971d7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:14.729560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:14.832442 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3873/7652] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:14 2021] PUT /identity/v3/projects/7cfe20eec8944fc49a985abc7d576119/users/4104ff31c6b04a09baf0426afa4971d7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:37:14.844102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:14.844391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:14.844693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:14.871994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] MFA Rules not processed for user `4104ff31c6b04a09baf0426afa4971d7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:14.873792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:14.934984 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3780/7653] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:14 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:14.946189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:14.950928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:15.006959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f65f-dc86-4bce-ae95-3cb3525180fe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:15.010742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0cefa-28a2-45a9-a4b6-c3196ae2ef30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:15.011381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0cefa-28a2-45a9-a4b6-c3196ae2ef30 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:15.011663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0cefa-28a2-45a9-a4b6-c3196ae2ef30 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:15.011943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0cefa-28a2-45a9-a4b6-c3196ae2ef30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:15.021064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0cefa-28a2-45a9-a4b6-c3196ae2ef30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:15.022481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0cefa-28a2-45a9-a4b6-c3196ae2ef30 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:15.031791 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3874/7654] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:14 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:20.541771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:20.543290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:20.624745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410e811-bc5c-4aae-9a69-2fb20265a90a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:20.635484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:20.636434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:20.636711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:20.637217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] PATH_INFO: `/v3/users/d908fbffef7047db86b4d40f70973397` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:20.639271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d908fbffef7047db86b4d40f70973397)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:20.643138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:20.888682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd908fbffef7047db86b4d40f70973397'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:20.897917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd908fbffef7047db86b4d40f70973397'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:20.911413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd908fbffef7047db86b4d40f70973397'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:20.912220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd908fbffef7047db86b4d40f70973397'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:20.912887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd908fbffef7047db86b4d40f70973397'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:21.010335 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3781/7655] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:20 2021] DELETE /identity/v3/users/d908fbffef7047db86b4d40f70973397 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:21.015269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:21.015911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:21.015911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:21.035087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:21.036406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:21.098404 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3875/7656] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:21.108309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:21.109817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:21.178658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d348a-1762-41f0-95ce-9e5b32fdb5b8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:21.182418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:21.183071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:21.183355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:21.183634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:21.194058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:21.195541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:21.206925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3782/7657] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:21.670913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:21.670913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:21.694795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78d82b-71c6-45bd-a43f-ed99141f2733 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:21.704965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:21.704965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:21.704965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:21.704965 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] PATH_INFO: `/v3/projects/803653fa8681491b916c0b57c57c3f29` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:21.705410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803653fa8681491b916c0b57c57c3f29)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:21.706323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:21.834768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803653fa8681491b916c0b57c57c3f29', 'request_id': 'req-2648c8b2-1cd9-4a23-b582-171c44a8f500'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:21.920098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803653fa8681491b916c0b57c57c3f29', 'request_id': 'req-2648c8b2-1cd9-4a23-b582-171c44a8f500'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:21.927286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803653fa8681491b916c0b57c57c3f29', 'request_id': 'req-2648c8b2-1cd9-4a23-b582-171c44a8f500'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:21.937552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] The token cache is being invalidate because project 803653fa8681491b916c0b57c57c3f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:21.937839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:21.938496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:21.940227 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3876/7658] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:21 2021] DELETE /identity/v3/projects/803653fa8681491b916c0b57c57c3f29 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:21.945425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:21.960821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653706-348b-456b-8dc8-b6911e10a855 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:22.022728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:22.023877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:22.024005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:22.024201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] PATH_INFO: `/v3/users/c30cd145f3fd46f899c9cf24ecdd638b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:22.025427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30cd145f3fd46f899c9cf24ecdd638b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:22.027529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:22.213908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30cd145f3fd46f899c9cf24ecdd638b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:22.222671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30cd145f3fd46f899c9cf24ecdd638b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:22.237097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30cd145f3fd46f899c9cf24ecdd638b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:22.237884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30cd145f3fd46f899c9cf24ecdd638b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:22.238495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30cd145f3fd46f899c9cf24ecdd638b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:22.394664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3783/7659] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:21 2021] DELETE /identity/v3/users/c30cd145f3fd46f899c9cf24ecdd638b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:22.802988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:22.804626 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:22.819125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648c8b2-1cd9-4a23-b582-171c44a8f500 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:22.899126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:22.900003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:22.900291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:22.900571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] PATH_INFO: `/v3/projects/73562d54f24a42f5a3cc9824c27632f9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:22.901841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73562d54f24a42f5a3cc9824c27632f9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:22.908915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:23.037495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73562d54f24a42f5a3cc9824c27632f9', 'request_id': 'req-1117ea60-87e5-432c-93a7-837a2cff3b52'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.101184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73562d54f24a42f5a3cc9824c27632f9', 'request_id': 'req-1117ea60-87e5-432c-93a7-837a2cff3b52'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.108621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73562d54f24a42f5a3cc9824c27632f9', 'request_id': 'req-1117ea60-87e5-432c-93a7-837a2cff3b52'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.120338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] The token cache is being invalidate because project 73562d54f24a42f5a3cc9824c27632f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:23.120963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.121722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.126557 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3877/7660] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:22 2021] DELETE /identity/v3/projects/73562d54f24a42f5a3cc9824c27632f9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:23.127813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:23.129346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:23.143233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7653f5-e8ad-4e0a-94e1-220469c95a9b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:23.200689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:23.202201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:23.202668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:23.203101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] PATH_INFO: `/v3/users/1c4974bb5e354cd1bb1920b7bd6836c7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:23.205134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4974bb5e354cd1bb1920b7bd6836c7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:23.207283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:23.422157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4974bb5e354cd1bb1920b7bd6836c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.429848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4974bb5e354cd1bb1920b7bd6836c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.448230 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4974bb5e354cd1bb1920b7bd6836c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.449068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4974bb5e354cd1bb1920b7bd6836c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.449663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-76a2fae2-7216-451b-bfea-f42e46ed3af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4974bb5e354cd1bb1920b7bd6836c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:23.552940 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3784/7661] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:23 2021] DELETE /identity/v3/users/1c4974bb5e354cd1bb1920b7bd6836c7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:24.037008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:24.038991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:24.059925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ea60-87e5-432c-93a7-837a2cff3b52 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:24.122852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:24.123940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.124224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.124496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] PATH_INFO: `/v3/projects/af196f8af15f4f7ca1802c701ec7cd9e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.126386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af196f8af15f4f7ca1802c701ec7cd9e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:24.128283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:24.237066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af196f8af15f4f7ca1802c701ec7cd9e', 'request_id': 'req-34910457-c72f-440c-ac83-77de14389c0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:24.314856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af196f8af15f4f7ca1802c701ec7cd9e', 'request_id': 'req-34910457-c72f-440c-ac83-77de14389c0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:24.321713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af196f8af15f4f7ca1802c701ec7cd9e', 'request_id': 'req-34910457-c72f-440c-ac83-77de14389c0b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:24.333147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] The token cache is being invalidate because project af196f8af15f4f7ca1802c701ec7cd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:24.333437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:24.334099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-34910457-c72f-440c-ac83-77de14389c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:24.335702 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3878/7662] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:24 2021] DELETE /identity/v3/projects/af196f8af15f4f7ca1802c701ec7cd9e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:24.341487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85bd3-21f8-4dc8-a675-b13b910591b1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.342007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85bd3-21f8-4dc8-a675-b13b910591b1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.342120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85bd3-21f8-4dc8-a675-b13b910591b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.392154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2aa85bd3-21f8-4dc8-a675-b13b910591b1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:24.393491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2aa85bd3-21f8-4dc8-a675-b13b910591b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:24.458858 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3785/7663] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:37:24.466966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcd930-86e9-4ff5-b3f6-e47b9ee21903 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.467294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcd930-86e9-4ff5-b3f6-e47b9ee21903 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.467557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcd930-86e9-4ff5-b3f6-e47b9ee21903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.487417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0cbcd930-86e9-4ff5-b3f6-e47b9ee21903 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:24.488712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0cbcd930-86e9-4ff5-b3f6-e47b9ee21903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:24.497050 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3879/7664] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:37:24.501941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85bd3-21f8-4dc8-a675-b13b910591b1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:24.515543 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85bd3-21f8-4dc8-a675-b13b910591b1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:24.520407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:24.521142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.521424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.521699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.522427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:37:24.522757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:24.524342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:24.536216 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3786/7665] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:37:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:37:24.541415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcd930-86e9-4ff5-b3f6-e47b9ee21903 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:24.550645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcd930-86e9-4ff5-b3f6-e47b9ee21903 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:24.555266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:24.555978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.556256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.556526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.557245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:24.559114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:24.654214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3880/7666] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:24 2021] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:24.659106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:24.669438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682387e6-f0cd-4a2c-a859-5aff0fde8bc4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:24.737229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416734-c390-4979-8058-c227854203cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:24.738282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416734-c390-4979-8058-c227854203cb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.738572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416734-c390-4979-8058-c227854203cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.738852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416734-c390-4979-8058-c227854203cb admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.739642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416734-c390-4979-8058-c227854203cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:24.741695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416734-c390-4979-8058-c227854203cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:24.850537 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3787/7667] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:24 2021] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:24.850767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:24.855775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4adde-ea96-47b4-9218-2e7a77fd6422 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:24.860863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:24.861555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.861837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.862110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.862862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:24.864447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:24.874901 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3881/7668] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:24.879731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416734-c390-4979-8058-c227854203cb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:24.890213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416734-c390-4979-8058-c227854203cb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:24.896223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf609bee-1a36-4dcd-80af-1267801ce8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:24.896912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf609bee-1a36-4dcd-80af-1267801ce8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.897201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf609bee-1a36-4dcd-80af-1267801ce8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.897482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf609bee-1a36-4dcd-80af-1267801ce8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.898223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf609bee-1a36-4dcd-80af-1267801ce8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:24.899809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf609bee-1a36-4dcd-80af-1267801ce8c0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:24.912701 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3788/7669] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:24.915192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:24.925621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556187-851d-443c-96c4-146f5cdd8d4b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:24.930586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:24.931458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:24.931749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:24.932023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] PATH_INFO: `/v3/projects/b04ad82620434ef5aea1d04bbca6bfab/users/4848cbb7b58c4f339ab5352e3f1919cf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:24.952026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04ad82620434ef5aea1d04bbca6bfab, user_id=4848cbb7b58c4f339ab5352e3f1919cf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:24.955476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:25.051642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3882/7670] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:24 2021] PUT /identity/v3/projects/b04ad82620434ef5aea1d04bbca6bfab/users/4848cbb7b58c4f339ab5352e3f1919cf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:25.063294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:25.063800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:25.064184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:25.093352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] MFA Rules not processed for user `4848cbb7b58c4f339ab5352e3f1919cf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:25.094284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:25.174286 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3789/7671] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:25 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:25.183835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:25.185545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:25.245995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73fe7a-2379-4691-8ce7-456a71ba7637 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:25.250244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c97304-0891-4472-bb7c-5745b6ee4292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:25.251728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c97304-0891-4472-bb7c-5745b6ee4292 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:25.252091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c97304-0891-4472-bb7c-5745b6ee4292 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:25.252517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c97304-0891-4472-bb7c-5745b6ee4292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:25.261572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c97304-0891-4472-bb7c-5745b6ee4292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:25.263346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c97304-0891-4472-bb7c-5745b6ee4292 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:25.281214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3883/7672] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:25 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:27.226140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:27.228165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:27.311760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4bce0-8d87-4cd1-be4d-7d3a0f7b1159 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:27.316634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:27.317701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:27.317987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:27.318684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] PATH_INFO: `/v3/users/322d719e1dbd4014b58f2f7ed9641f2f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:27.319966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=322d719e1dbd4014b58f2f7ed9641f2f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:27.321999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:27.493817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322d719e1dbd4014b58f2f7ed9641f2f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:27.500654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322d719e1dbd4014b58f2f7ed9641f2f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:27.512201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322d719e1dbd4014b58f2f7ed9641f2f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:27.513233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322d719e1dbd4014b58f2f7ed9641f2f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:27.513837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322d719e1dbd4014b58f2f7ed9641f2f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:27.600612 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3790/7673] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:27 2021] DELETE /identity/v3/users/322d719e1dbd4014b58f2f7ed9641f2f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:27.605184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:27.605694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:27.605806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:27.624300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:27.625727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:27.690504 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3884/7674] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:27.732814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:27.734483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:27.826402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a977d58-5265-4c60-9c1e-ece0849f6e5d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:27.832763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580f4d9-37f5-48bf-9621-0a80500d4548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:27.833488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f4d9-37f5-48bf-9621-0a80500d4548 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:27.833924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f4d9-37f5-48bf-9621-0a80500d4548 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:27.834203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f4d9-37f5-48bf-9621-0a80500d4548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:27.848967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580f4d9-37f5-48bf-9621-0a80500d4548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:27.857638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580f4d9-37f5-48bf-9621-0a80500d4548 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:27.863104 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3791/7675] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:28.442962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:28.442962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:28.456253 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f26da5-e4a3-4cf9-9797-6d3f6f7d75ca None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:28.461459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:28.465494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:28.465494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:28.465494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] PATH_INFO: `/v3/projects/609b19a4efc34c8fa016adb3a5fdb23b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:28.465494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609b19a4efc34c8fa016adb3a5fdb23b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:28.467848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:28.612601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609b19a4efc34c8fa016adb3a5fdb23b', 'request_id': 'req-089881ac-6eac-47da-8668-cb6d8e6824c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:28.705700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609b19a4efc34c8fa016adb3a5fdb23b', 'request_id': 'req-089881ac-6eac-47da-8668-cb6d8e6824c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:28.715182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609b19a4efc34c8fa016adb3a5fdb23b', 'request_id': 'req-089881ac-6eac-47da-8668-cb6d8e6824c1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:28.728054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] The token cache is being invalidate because project 609b19a4efc34c8fa016adb3a5fdb23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:28.728956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:28.729236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-089881ac-6eac-47da-8668-cb6d8e6824c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:28.730830 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3885/7676] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:28 2021] DELETE /identity/v3/projects/609b19a4efc34c8fa016adb3a5fdb23b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:28.738117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42fc97-9e25-4636-b30e-ecb855b2eaa8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:28.738625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42fc97-9e25-4636-b30e-ecb855b2eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:28.738816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42fc97-9e25-4636-b30e-ecb855b2eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:28.758631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-aa42fc97-9e25-4636-b30e-ecb855b2eaa8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:28.759925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aa42fc97-9e25-4636-b30e-ecb855b2eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:28.820528 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3792/7677] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:28.832915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484e01-08ea-4858-a431-e1f9d5149bf1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:28.832915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484e01-08ea-4858-a431-e1f9d5149bf1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:28.832915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484e01-08ea-4858-a431-e1f9d5149bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:28.867359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-cc484e01-08ea-4858-a431-e1f9d5149bf1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:28.867359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cc484e01-08ea-4858-a431-e1f9d5149bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:28.871453 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3886/7678] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:28.880116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42fc97-9e25-4636-b30e-ecb855b2eaa8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:28.899692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42fc97-9e25-4636-b30e-ecb855b2eaa8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:28.904066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:28.904774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:28.905081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:28.905361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:28.906099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:37:28.906407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:28.908710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:28.924804 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3793/7679] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:37:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:37:28.928103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc484e01-08ea-4858-a431-e1f9d5149bf1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:28.940470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc484e01-08ea-4858-a431-e1f9d5149bf1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:28.954790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:28.954790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:28.954790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:28.954790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:28.955819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:28.958326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.095595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:29.098957 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3887/7680] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:28 2021] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:29.099246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:29.100296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:29.118032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23600138-2e56-4279-af4d-0c074a52fd92 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:29.182527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4052c4-a1dd-4b19-89ea-a993b32e657f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:29.183449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:29.184353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.184626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.184919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] PATH_INFO: `/v3/users/4104ff31c6b04a09baf0426afa4971d7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.186125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4104ff31c6b04a09baf0426afa4971d7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:29.187388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:29.188112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.188238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.188396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.188678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.189410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:29.191317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.317701 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3888/7681] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:29 2021] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:29.318816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:29.329714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d462e7-c510-4d7e-9138-a48ce03b43cf admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:29.334651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:29.335307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.335592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.335870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.336672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:29.338247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.349207 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3889/7682] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:37:29.352925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:29.362671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8fdcd-4f6f-41fb-8f99-1d7d634d4279 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:29.367406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:29.368058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.368649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.368649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.369389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:29.370988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.386059 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3890/7683] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:37:29.388540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:29.399016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e1282-a832-4a8d-be94-7984158c7910 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:29.404746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb170-0d16-41af-b4c0-4c99e29a4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:29.405617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb170-0d16-41af-b4c0-4c99e29a4b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.406031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb170-0d16-41af-b4c0-4c99e29a4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.406146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb170-0d16-41af-b4c0-4c99e29a4b66 admin admin] PATH_INFO: `/v3/projects/8e19dddb9aa840e3a2b96637a3960524/users/41daab3c9ebb4f5295bf646ad489e4fc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.425667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb170-0d16-41af-b4c0-4c99e29a4b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e19dddb9aa840e3a2b96637a3960524, user_id=41daab3c9ebb4f5295bf646ad489e4fc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:29.426259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb170-0d16-41af-b4c0-4c99e29a4b66 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.431475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4104ff31c6b04a09baf0426afa4971d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:29.440254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4104ff31c6b04a09baf0426afa4971d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:29.458646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4104ff31c6b04a09baf0426afa4971d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:29.459620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4104ff31c6b04a09baf0426afa4971d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:29.460263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d7b2651c-9e71-43c0-8332-6b380158f2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4104ff31c6b04a09baf0426afa4971d7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:29.518886 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3891/7684] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:29 2021] PUT /identity/v3/projects/8e19dddb9aa840e3a2b96637a3960524/users/41daab3c9ebb4f5295bf646ad489e4fc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:29.529913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.530194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.530461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.544745 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3794/7685] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:29 2021] DELETE /identity/v3/users/4104ff31c6b04a09baf0426afa4971d7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:29.555484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.556222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.556664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.575982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] MFA Rules not processed for user `41daab3c9ebb4f5295bf646ad489e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:29.577464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:29.580739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:29.582552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:29.646959 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3795/7686] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:37:29.652773 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3892/7687] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:29 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:37:29.657279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:29.658672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:29.668442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:29.669807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:29.719613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305450-64ab-4ab9-a04f-d83a7d42ef3d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:29.723388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:29.726364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.726364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.726364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.731569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353c497-8654-406d-a9ec-5c6602238e9d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:29.733818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:29.735794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.735950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bc9c8-1809-4811-a9d3-37be65e8227b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:29.736548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc9c8-1809-4811-a9d3-37be65e8227b service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:29.736833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc9c8-1809-4811-a9d3-37be65e8227b service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:29.737148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc9c8-1809-4811-a9d3-37be65e8227b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:29.745561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3796/7688] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:37:29.746078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bc9c8-1809-4811-a9d3-37be65e8227b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:29.747494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bc9c8-1809-4811-a9d3-37be65e8227b service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:29.757814 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3893/7689] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:29 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:37:30.077448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:30.079225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:30.096538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8b1b-5b10-4ced-af36-91f257acdacf service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:30.101699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:30.102619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:30.102905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:30.103168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] PATH_INFO: `/v3/projects/7cfe20eec8944fc49a985abc7d576119` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:30.104418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfe20eec8944fc49a985abc7d576119)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:30.106310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:30.233499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfe20eec8944fc49a985abc7d576119', 'request_id': 'req-d5d9ff51-607c-46ba-bb68-157155d89435'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:30.247157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfe20eec8944fc49a985abc7d576119', 'request_id': 'req-d5d9ff51-607c-46ba-bb68-157155d89435'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:30.394477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfe20eec8944fc49a985abc7d576119', 'request_id': 'req-d5d9ff51-607c-46ba-bb68-157155d89435'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:30.405696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] The token cache is being invalidate because project 7cfe20eec8944fc49a985abc7d576119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:30.405981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:30.406653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5d9ff51-607c-46ba-bb68-157155d89435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:30.408835 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3797/7690] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:30 2021] DELETE /identity/v3/projects/7cfe20eec8944fc49a985abc7d576119 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:30.414527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61675-a91b-49b0-ac94-2e9758178731 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:30.414809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61675-a91b-49b0-ac94-2e9758178731 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:30.415085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61675-a91b-49b0-ac94-2e9758178731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:30.435522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4ca61675-a91b-49b0-ac94-2e9758178731 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:30.436901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4ca61675-a91b-49b0-ac94-2e9758178731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:30.507330 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3894/7691] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:30.515501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895a2d-5435-4f42-9cbf-a3d895484df0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:30.515788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895a2d-5435-4f42-9cbf-a3d895484df0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:30.516091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895a2d-5435-4f42-9cbf-a3d895484df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:30.535748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-04895a2d-5435-4f42-9cbf-a3d895484df0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:30.536987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-04895a2d-5435-4f42-9cbf-a3d895484df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:30.546169 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3798/7692] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:30.550352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca61675-a91b-49b0-ac94-2e9758178731 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:30.567791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca61675-a91b-49b0-ac94-2e9758178731 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:30.572625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:30.573560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:30.573686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:30.573953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:30.574682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:37:30.575015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:30.576732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:30.599604 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3895/7693] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:37:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:37:30.599723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895a2d-5435-4f42-9cbf-a3d895484df0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:30.607703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895a2d-5435-4f42-9cbf-a3d895484df0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:30.612825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:30.613503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:30.613783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:30.614074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:30.614736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:30.616706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:30.699385 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3799/7694] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:30 2021] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:30.703557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:30.714050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a49147-9ec5-49b7-b0a2-554c893c1936 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:30.776071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:30.776663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:30.777161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:30.777440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:30.778148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:30.780774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:31.067584 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3896/7695] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:30 2021] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:31.071594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:31.082716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98a7e4-cf1d-44f1-844c-118ff8f925f1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:31.087331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:31.087980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:31.088254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:31.088525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:31.089272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:31.091053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:31.102830 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3800/7696] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:31.106923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:31.117058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdc249-8280-4ba3-b633-a36fda9b1d54 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:31.121704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4614fe-58c4-4651-a160-64cbd643a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:31.122354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4614fe-58c4-4651-a160-64cbd643a2fc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:31.122642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4614fe-58c4-4651-a160-64cbd643a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:31.122917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4614fe-58c4-4651-a160-64cbd643a2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:31.123654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4614fe-58c4-4651-a160-64cbd643a2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:31.125328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4614fe-58c4-4651-a160-64cbd643a2fc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:31.135486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3897/7697] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:31.139781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:31.150430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbbcf-eab9-48a4-ad2d-8f1b7f161403 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:31.155060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:31.155933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:31.156215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:31.156519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] PATH_INFO: `/v3/projects/755ec677849b45beada7922dc5a9f6b5/users/083978152102458ea57b5d6072640077/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:31.171648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755ec677849b45beada7922dc5a9f6b5, user_id=083978152102458ea57b5d6072640077, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:31.174376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:31.264125 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3801/7698] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:31 2021] PUT /identity/v3/projects/755ec677849b45beada7922dc5a9f6b5/users/083978152102458ea57b5d6072640077/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:31.275298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:31.275588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:31.275900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:31.305060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] MFA Rules not processed for user `083978152102458ea57b5d6072640077`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:31.306270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:31.372214 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3898/7699] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:31 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:31.383150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:31.384842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:31.446931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7191cf6-8dae-4043-9b78-1eca95e745d5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:31.450665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda7f27-93e8-4eec-89ec-0a0cdaccfb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:31.451308 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda7f27-93e8-4eec-89ec-0a0cdaccfb09 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:31.451588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda7f27-93e8-4eec-89ec-0a0cdaccfb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:31.451863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda7f27-93e8-4eec-89ec-0a0cdaccfb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:31.460982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda7f27-93e8-4eec-89ec-0a0cdaccfb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:31.462464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda7f27-93e8-4eec-89ec-0a0cdaccfb09 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:31.471944 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3802/7700] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:31 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:39.757974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:39.759466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:39.843158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abcf53-4516-4ef0-a1bf-1ddf437832a8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:39.849188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:39.850144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:39.850424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:39.850700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] PATH_INFO: `/v3/users/8fc6f76b2d574cdba191d9767b724db0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:39.851986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc6f76b2d574cdba191d9767b724db0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:39.853992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:40.099180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc6f76b2d574cdba191d9767b724db0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:40.106234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc6f76b2d574cdba191d9767b724db0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:40.120437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc6f76b2d574cdba191d9767b724db0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:40.121991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc6f76b2d574cdba191d9767b724db0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:40.181435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc6f76b2d574cdba191d9767b724db0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:40.192589 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3899/7701] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:39 2021] DELETE /identity/v3/users/8fc6f76b2d574cdba191d9767b724db0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:40.198691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:40.199153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:40.199390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:40.224365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:40.225880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:40.303393 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3803/7702] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:40.315223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:40.316674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:40.381428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea429a-f45b-491a-9368-75e77a0cc383 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:40.385425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:40.386182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:40.386463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:40.386738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:40.397362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:40.398795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:40.408869 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3900/7703] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:40.943178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:40.944899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:40.966071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd173a-6662-4871-87ce-302dfaea5a0a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:40.971518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:40.972290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:40.972662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:40.972818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] PATH_INFO: `/v3/projects/01ef7c196a2a435992fa90e41bf876ac` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:40.974051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ef7c196a2a435992fa90e41bf876ac)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:40.975975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:41.147432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ef7c196a2a435992fa90e41bf876ac', 'request_id': 'req-2eed1cd7-d819-4ef8-907c-fdbb928019af'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.151470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ef7c196a2a435992fa90e41bf876ac', 'request_id': 'req-2eed1cd7-d819-4ef8-907c-fdbb928019af'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.217189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ef7c196a2a435992fa90e41bf876ac', 'request_id': 'req-2eed1cd7-d819-4ef8-907c-fdbb928019af'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.230131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] The token cache is being invalidate because project 01ef7c196a2a435992fa90e41bf876ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:41.230541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.231195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.232729 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3804/7704] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:40 2021] DELETE /identity/v3/projects/01ef7c196a2a435992fa90e41bf876ac => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:41.237252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:41.246873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427aebe-8a66-4c1e-8627-da2b64bb7e1b service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:41.312675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:41.313696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:41.314057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:41.314393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] PATH_INFO: `/v3/users/013c354a753342489256c030b35265f7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:41.315816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=013c354a753342489256c030b35265f7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:41.318263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:41.545737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013c354a753342489256c030b35265f7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.558863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013c354a753342489256c030b35265f7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.574514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013c354a753342489256c030b35265f7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.575222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013c354a753342489256c030b35265f7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.661784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8e68f319-45da-457b-85a9-021011038f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013c354a753342489256c030b35265f7'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:41.669159 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3901/7705] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:41 2021] DELETE /identity/v3/users/013c354a753342489256c030b35265f7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:42.174113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:42.176256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:42.207823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1cd7-d819-4ef8-907c-fdbb928019af admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:42.280185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:42.281202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:42.281484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:42.281759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] PATH_INFO: `/v3/projects/06dbe1300f454f17a89abb4c804755f8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:42.283115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dbe1300f454f17a89abb4c804755f8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:42.285203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:42.424224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dbe1300f454f17a89abb4c804755f8', 'request_id': 'req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:42.430746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dbe1300f454f17a89abb4c804755f8', 'request_id': 'req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:42.503897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dbe1300f454f17a89abb4c804755f8', 'request_id': 'req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:42.517931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] The token cache is being invalidate because project 06dbe1300f454f17a89abb4c804755f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:42.518546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:42.519358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0d6ff55-1b0b-415b-9a8f-20dced87dbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:42.521236 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3805/7706] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:42 2021] DELETE /identity/v3/projects/06dbe1300f454f17a89abb4c804755f8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:42.530724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4a9b-7891-4e8b-a09f-31c299f78c0d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:42.530724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4a9b-7891-4e8b-a09f-31c299f78c0d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:42.530724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e4a9b-7891-4e8b-a09f-31c299f78c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:42.552036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-794e4a9b-7891-4e8b-a09f-31c299f78c0d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:42.553308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-794e4a9b-7891-4e8b-a09f-31c299f78c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:42.625678 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3902/7707] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:37:42.634340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f44f2-e238-4bb4-a2df-bbf2601b441a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:42.634728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f44f2-e238-4bb4-a2df-bbf2601b441a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:42.635110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f44f2-e238-4bb4-a2df-bbf2601b441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:42.655481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-286f44f2-e238-4bb4-a2df-bbf2601b441a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:42.657861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-286f44f2-e238-4bb4-a2df-bbf2601b441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:42.668990 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3806/7708] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:42.673690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4a9b-7891-4e8b-a09f-31c299f78c0d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:42.685281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e4a9b-7891-4e8b-a09f-31c299f78c0d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:42.690293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:42.691047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:42.691408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:42.691755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:42.692573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:37:42.692999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:42.694731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:42.708538 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3903/7709] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:37:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:37:42.713399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f44f2-e238-4bb4-a2df-bbf2601b441a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:42.724362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f44f2-e238-4bb4-a2df-bbf2601b441a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:42.729450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:42.730208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:42.730565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:42.730908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:42.731952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:42.734246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:42.896561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3807/7710] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:42 2021] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:42.898299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:42.910857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db374f6-e510-4125-858a-27d7ad22ade4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:42.987331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:42.988982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:42.989270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:42.989732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:42.990438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:42.992569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:43.075808 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3904/7711] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:42 2021] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:37:43.081126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:43.092675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53b78-f18c-4243-b1a7-fbe55b8cdec9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:43.105757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:43.106481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:43.106766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:43.107044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:43.108139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:43.109439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:43.121192 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3808/7712] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:43.126748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:43.154175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4ce08-ff24-4fcd-aa44-9cec1e01b52d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:43.168218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc02f96-1459-4359-9bac-aef26bde5bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:43.171220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc02f96-1459-4359-9bac-aef26bde5bce admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:43.173238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc02f96-1459-4359-9bac-aef26bde5bce admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:43.173638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc02f96-1459-4359-9bac-aef26bde5bce admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:43.174710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc02f96-1459-4359-9bac-aef26bde5bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:43.176651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc02f96-1459-4359-9bac-aef26bde5bce admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:43.189573 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3905/7713] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:43 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:43.200212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:43.213907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a55d0-d883-4a2e-81a1-de2902f8c5b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:43.219342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:43.221453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:43.221748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:43.222030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] PATH_INFO: `/v3/projects/88c8770e11a746f38626f24c13414d1d/users/6be018c726b843e389dd61885c6d68f4/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:43.242398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c8770e11a746f38626f24c13414d1d, user_id=6be018c726b843e389dd61885c6d68f4, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:43.248728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:43.350735 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3809/7714] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:43 2021] PUT /identity/v3/projects/88c8770e11a746f38626f24c13414d1d/users/6be018c726b843e389dd61885c6d68f4/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:37:43.452465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1741807-2412-47d6-98cd-d43b0ef17fc6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:43.452764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1741807-2412-47d6-98cd-d43b0ef17fc6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:43.453074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1741807-2412-47d6-98cd-d43b0ef17fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:43.486670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b1741807-2412-47d6-98cd-d43b0ef17fc6 None None] MFA Rules not processed for user `6be018c726b843e389dd61885c6d68f4`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:43.489000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1741807-2412-47d6-98cd-d43b0ef17fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:43.571308 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3906/7715] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:43 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:43.584102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:43.589109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:43.695696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708ae01-a12c-473c-be99-93b3df850496 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:43.703671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684d03-6714-4ff9-9dfd-eb829dd35ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:43.704331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684d03-6714-4ff9-9dfd-eb829dd35ecd service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:43.704613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684d03-6714-4ff9-9dfd-eb829dd35ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:43.705521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684d03-6714-4ff9-9dfd-eb829dd35ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:43.714665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684d03-6714-4ff9-9dfd-eb829dd35ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:43.716094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684d03-6714-4ff9-9dfd-eb829dd35ecd service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:43.725465 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3810/7716] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:43 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:43.744095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1741807-2412-47d6-98cd-d43b0ef17fc6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:43.819412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1741807-2412-47d6-98cd-d43b0ef17fc6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:43.825707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:43.826612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:43.826895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:43.827177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] PATH_INFO: `/v3/users/6be018c726b843e389dd61885c6d68f4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:43.829483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be018c726b843e389dd61885c6d68f4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:43.832054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:44.069613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be018c726b843e389dd61885c6d68f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:44.076226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be018c726b843e389dd61885c6d68f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:44.088130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be018c726b843e389dd61885c6d68f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:44.088844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be018c726b843e389dd61885c6d68f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:44.166541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be018c726b843e389dd61885c6d68f4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:44.186748 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3907/7717] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:37:43 2021] DELETE /identity/v3/users/6be018c726b843e389dd61885c6d68f4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:44.192752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305f397-0879-4612-8e19-489603eb015d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:44.192752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305f397-0879-4612-8e19-489603eb015d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:44.192752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305f397-0879-4612-8e19-489603eb015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:44.211048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d305f397-0879-4612-8e19-489603eb015d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:44.212189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d305f397-0879-4612-8e19-489603eb015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:44.279191 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3811/7718] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:44.289955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:44.291393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:44.352460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a9b7-11af-4a1d-9b3c-da0070f9ae2d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:44.357758 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c75a4e-d64d-4970-98f9-26e1a8d8d05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:44.358532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75a4e-d64d-4970-98f9-26e1a8d8d05b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:44.358716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75a4e-d64d-4970-98f9-26e1a8d8d05b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:44.358975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c75a4e-d64d-4970-98f9-26e1a8d8d05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:44.371083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c75a4e-d64d-4970-98f9-26e1a8d8d05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:44.372531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c75a4e-d64d-4970-98f9-26e1a8d8d05b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:44.383914 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3908/7719] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:37:44.945340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305f397-0879-4612-8e19-489603eb015d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:44.948160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d305f397-0879-4612-8e19-489603eb015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:44.975255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305f397-0879-4612-8e19-489603eb015d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:44.982885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:44.984192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:44.984713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:44.985151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] PATH_INFO: `/v3/projects/88c8770e11a746f38626f24c13414d1d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:44.986389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c8770e11a746f38626f24c13414d1d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:44.988444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:45.091346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c8770e11a746f38626f24c13414d1d', 'request_id': 'req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:45.098595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c8770e11a746f38626f24c13414d1d', 'request_id': 'req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:45.198947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c8770e11a746f38626f24c13414d1d', 'request_id': 'req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:45.210615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] The token cache is being invalidate because project 88c8770e11a746f38626f24c13414d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:37:45.210906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:45.211555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b69a5d43-308c-4f86-907b-a52a9c8bc0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:37:45.213155 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3812/7720] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:37:44 2021] DELETE /identity/v3/projects/88c8770e11a746f38626f24c13414d1d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:45.218823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6082-6e67-4cf0-be2b-b5c696d1f63c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.219336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6082-6e67-4cf0-be2b-b5c696d1f63c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.219469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6082-6e67-4cf0-be2b-b5c696d1f63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.259683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ebde6082-6e67-4cf0-be2b-b5c696d1f63c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:45.260924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ebde6082-6e67-4cf0-be2b-b5c696d1f63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:45.324605 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3909/7721] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:45.332952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440416-ef2a-4ed0-ae87-24506816f53e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.333242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440416-ef2a-4ed0-ae87-24506816f53e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.333755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8440416-ef2a-4ed0-ae87-24506816f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.352015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a8440416-ef2a-4ed0-ae87-24506816f53e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:45.353325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a8440416-ef2a-4ed0-ae87-24506816f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:45.362633 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3813/7722] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:45.367044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde6082-6e67-4cf0-be2b-b5c696d1f63c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:45.377219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde6082-6e67-4cf0-be2b-b5c696d1f63c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:45.384800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:45.385496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.385779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.386286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.387084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:37:45.387391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:45.389296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:45.401809 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3910/7723] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:37:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:37:45.405910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440416-ef2a-4ed0-ae87-24506816f53e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:45.415372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8440416-ef2a-4ed0-ae87-24506816f53e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:45.427948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:45.428725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.429084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.429364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.430084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:45.432038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:45.552396 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3814/7724] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:37:45 2021] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:37:45.556409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:45.567443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290692a-31ac-44cc-bf89-390689927323 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:45.623704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:45.624394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.624672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.624970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.625671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:45.628371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:45.744931 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3911/7725] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:37:45 2021] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:37:45.750750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:45.758513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d3504-34a8-435f-a1b9-662d22784936 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:45.763776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:45.764428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.764713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.765035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.765769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:45.767996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:45.779611 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3815/7726] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:45.783834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:45.794215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa3a6b-788e-486a-a578-ed61a0c06719 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:45.798961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e9f0-e610-4042-9f0a-1a143d3a3c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:45.799616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e9f0-e610-4042-9f0a-1a143d3a3c74 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.799897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e9f0-e610-4042-9f0a-1a143d3a3c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.800171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e9f0-e610-4042-9f0a-1a143d3a3c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.800923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e9f0-e610-4042-9f0a-1a143d3a3c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:45.802513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e9f0-e610-4042-9f0a-1a143d3a3c74 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:45.812522 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3912/7727] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:37:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:37:45.817202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:45.827042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55f6f-e124-40bf-acf3-802a0e92a3f6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:45.832276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:45.833248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.838056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.838056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] PATH_INFO: `/v3/projects/1c1f1726595e424a9ca22ae3be711356/users/928809cb9ee04bd89c08405f2ad609ac/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:45.849401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1f1726595e424a9ca22ae3be711356, user_id=928809cb9ee04bd89c08405f2ad609ac, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:45.852651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:45.962385 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3816/7728] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:37:45 2021] PUT /identity/v3/projects/1c1f1726595e424a9ca22ae3be711356/users/928809cb9ee04bd89c08405f2ad609ac/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:37:45.973198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e43b1-7d44-47db-86ee-6e6b56f21ea3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:45.973713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e43b1-7d44-47db-86ee-6e6b56f21ea3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:45.974133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e43b1-7d44-47db-86ee-6e6b56f21ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:46.003183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d06e43b1-7d44-47db-86ee-6e6b56f21ea3 None None] MFA Rules not processed for user `928809cb9ee04bd89c08405f2ad609ac`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:37:46.004397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d06e43b1-7d44-47db-86ee-6e6b56f21ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:46.077090 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3913/7729] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:37:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:37:46.087996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:37:46.089780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:37:46.149239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43291125-ab12-4edb-a1cc-5e2ebf43d7e0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:37:46.153010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6abb5d-3138-416e-84be-bf69d083c240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:37:46.153656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6abb5d-3138-416e-84be-bf69d083c240 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:37:46.153942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6abb5d-3138-416e-84be-bf69d083c240 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:37:46.154221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6abb5d-3138-416e-84be-bf69d083c240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:37:46.173220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6abb5d-3138-416e-84be-bf69d083c240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:37:46.173220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6abb5d-3138-416e-84be-bf69d083c240 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:37:46.182572 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3817/7730] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:37:46 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:00.916271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e43b1-7d44-47db-86ee-6e6b56f21ea3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:00.984434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e43b1-7d44-47db-86ee-6e6b56f21ea3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:00.989382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:00.990373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:00.990656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:00.990986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] PATH_INFO: `/v3/users/928809cb9ee04bd89c08405f2ad609ac` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:00.992369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] RBAC: Authorizing `identity:delete_user(user_id=928809cb9ee04bd89c08405f2ad609ac)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:00.994382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:01.160624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928809cb9ee04bd89c08405f2ad609ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:01.167504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928809cb9ee04bd89c08405f2ad609ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:01.182808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928809cb9ee04bd89c08405f2ad609ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:01.182808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928809cb9ee04bd89c08405f2ad609ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:01.252660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928809cb9ee04bd89c08405f2ad609ac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:01.258909 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3914/7731] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:38:00 2021] DELETE /identity/v3/users/928809cb9ee04bd89c08405f2ad609ac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:01.263622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:01.264132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:01.264263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:01.281698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:01.283768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:01.347536 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3818/7732] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:01.357873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:01.362952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:01.428412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741355-5650-406c-8f20-ec7e643d890f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:01.433437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:01.434244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:01.434529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:01.434807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:01.445395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:01.446834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:01.458049 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3915/7733] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:38:02.047508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:02.049034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:02.061187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393a22a-109e-4a83-bee3-33d1ca57f4fe None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:02.066680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:02.067626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:02.067974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:02.068422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] PATH_INFO: `/v3/projects/1c1f1726595e424a9ca22ae3be711356` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:02.069752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1f1726595e424a9ca22ae3be711356)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:02.072256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:02.198474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1f1726595e424a9ca22ae3be711356', 'request_id': 'req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:02.204532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1f1726595e424a9ca22ae3be711356', 'request_id': 'req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:02.295650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1f1726595e424a9ca22ae3be711356', 'request_id': 'req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:02.309885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] The token cache is being invalidate because project 1c1f1726595e424a9ca22ae3be711356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:38:02.310309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:02.311002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:02.312760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3819/7734] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:38:02 2021] DELETE /identity/v3/projects/1c1f1726595e424a9ca22ae3be711356 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:02.529519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:02.529519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:02.552219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b2a9f-4a43-45b4-9236-a8e2d816732a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:02.617133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb958cd4-cf26-46c5-a0e3-28610f564dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:02.617789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958cd4-cf26-46c5-a0e3-28610f564dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:02.618082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958cd4-cf26-46c5-a0e3-28610f564dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:02.621214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958cd4-cf26-46c5-a0e3-28610f564dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:02.623631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eb958cd4-cf26-46c5-a0e3-28610f564dd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:02.637596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb958cd4-cf26-46c5-a0e3-28610f564dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:02.639923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb958cd4-cf26-46c5-a0e3-28610f564dd2 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:02.651370 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3916/7735] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:02 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:08.008626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:08.008626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:08.071753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f62f-4f5d-4811-b3fe-c5aeaef1719f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:08.076581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:08.077475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:08.077750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:08.078023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] PATH_INFO: `/v3/users/4848cbb7b58c4f339ab5352e3f1919cf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:08.079283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4848cbb7b58c4f339ab5352e3f1919cf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:08.081239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:08.295069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4848cbb7b58c4f339ab5352e3f1919cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:08.304098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4848cbb7b58c4f339ab5352e3f1919cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:08.316190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4848cbb7b58c4f339ab5352e3f1919cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:08.317076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4848cbb7b58c4f339ab5352e3f1919cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:08.317698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4848cbb7b58c4f339ab5352e3f1919cf'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:08.452835 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3820/7736] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:38:08 2021] DELETE /identity/v3/users/4848cbb7b58c4f339ab5352e3f1919cf => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:08.454336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:08.454860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:08.455176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:08.475811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:08.477405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:08.546512 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3917/7737] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:08.557365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:08.558808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:08.627180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1957-cee1-4eea-8abb-7434e7bfeb0b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:08.633655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a61104-d79a-43bd-9cab-cd172ed12610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:08.633655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a61104-d79a-43bd-9cab-cd172ed12610 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:08.633655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a61104-d79a-43bd-9cab-cd172ed12610 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:08.633655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a61104-d79a-43bd-9cab-cd172ed12610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:08.645818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a61104-d79a-43bd-9cab-cd172ed12610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:08.647783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a61104-d79a-43bd-9cab-cd172ed12610 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:08.659598 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3821/7738] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:09.117379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:09.118898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:09.134367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455e300-1f75-475e-b4ed-bbbf0127a161 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:09.146933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:09.146933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:09.146933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:09.146933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] PATH_INFO: `/v3/projects/b04ad82620434ef5aea1d04bbca6bfab` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:09.147558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04ad82620434ef5aea1d04bbca6bfab)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:09.147558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:09.266165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04ad82620434ef5aea1d04bbca6bfab', 'request_id': 'req-75bd9c6b-05be-4286-aba5-78dc27229d3a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:09.367030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04ad82620434ef5aea1d04bbca6bfab', 'request_id': 'req-75bd9c6b-05be-4286-aba5-78dc27229d3a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:09.380472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04ad82620434ef5aea1d04bbca6bfab', 'request_id': 'req-75bd9c6b-05be-4286-aba5-78dc27229d3a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:09.393054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] The token cache is being invalidate because project b04ad82620434ef5aea1d04bbca6bfab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:38:09.393624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:09.399849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-75bd9c6b-05be-4286-aba5-78dc27229d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:09.399849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3918/7739] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:38:09 2021] DELETE /identity/v3/projects/b04ad82620434ef5aea1d04bbca6bfab => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:09.402926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f849a-890c-424f-add0-7823c802cac4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:09.403424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f849a-890c-424f-add0-7823c802cac4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:09.403609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f849a-890c-424f-add0-7823c802cac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:09.459467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-636f849a-890c-424f-add0-7823c802cac4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:09.459467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-636f849a-890c-424f-add0-7823c802cac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:09.536458 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3822/7740] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:09.557272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73fe2-831c-42ce-b84c-b2c6fe3580cf None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:09.557272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73fe2-831c-42ce-b84c-b2c6fe3580cf None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:09.557272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73fe2-831c-42ce-b84c-b2c6fe3580cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:09.572382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3fd73fe2-831c-42ce-b84c-b2c6fe3580cf None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:09.574101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3fd73fe2-831c-42ce-b84c-b2c6fe3580cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:09.593727 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3919/7741] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:09.593893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f849a-890c-424f-add0-7823c802cac4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:09.609373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f849a-890c-424f-add0-7823c802cac4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:09.622327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:09.623025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:09.624329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:09.624329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:09.624814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:38:09.624814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:09.626570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:09.641629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3823/7742] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:38:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:38:09.650800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd73fe2-831c-42ce-b84c-b2c6fe3580cf None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:09.661535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd73fe2-831c-42ce-b84c-b2c6fe3580cf None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:09.666715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:09.667612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:09.668021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:09.668353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:09.669214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:09.671797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:09.769091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3920/7743] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:38:09 2021] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:09.770784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:09.787921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca183f-8e3d-4e99-909c-958e4d4cdc84 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:09.897841 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:09.910125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:09.910125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:09.910125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:09.910125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:09.914839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:10.091310 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3824/7744] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:38:09 2021] POST /identity/v3/users => generated 296 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:10.095418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:10.122786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0747b9-7a98-40fd-95a1-2e4c99dd36a9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:10.143853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:10.146667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:10.146962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:10.147243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:10.148026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:10.150292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:10.176675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:10.177246 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3921/7745] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:10 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:10.191801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2946e7-765f-4130-8ff7-7a07aa8031da admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:10.202819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc77db1-6299-4f8f-88d1-1c7dd9aa6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:10.203828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc77db1-6299-4f8f-88d1-1c7dd9aa6017 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:10.204304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc77db1-6299-4f8f-88d1-1c7dd9aa6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:10.204773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc77db1-6299-4f8f-88d1-1c7dd9aa6017 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:10.205758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc77db1-6299-4f8f-88d1-1c7dd9aa6017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:10.209102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc77db1-6299-4f8f-88d1-1c7dd9aa6017 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:10.231760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3825/7746] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:10 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:10.236168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:10.250753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a7bdb-bab5-4242-aad3-4ec9d3f1c524 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:10.266938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:10.268236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:10.268716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:10.269808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] PATH_INFO: `/v3/projects/4ff29c23c5844f45826a02b6ae6b65e7/users/01a07fc3a154483caea95cbd449f3970/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:10.297475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff29c23c5844f45826a02b6ae6b65e7, user_id=01a07fc3a154483caea95cbd449f3970, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:10.301897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:10.386514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3922/7747] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:10 2021] PUT /identity/v3/projects/4ff29c23c5844f45826a02b6ae6b65e7/users/01a07fc3a154483caea95cbd449f3970/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:10.397999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56399b-36c8-4af8-ab7d-8790b1c3e299 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:10.398567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56399b-36c8-4af8-ab7d-8790b1c3e299 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:10.398951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56399b-36c8-4af8-ab7d-8790b1c3e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:10.432017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fd56399b-36c8-4af8-ab7d-8790b1c3e299 None None] MFA Rules not processed for user `01a07fc3a154483caea95cbd449f3970`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:10.433517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd56399b-36c8-4af8-ab7d-8790b1c3e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:10.521578 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3826/7748] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:10 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:10.525366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:10.626519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a3a9b-6ffa-4489-8707-eb77ce11b25e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:10.634454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:10.635878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:10.636547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:10.637040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:10.638016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:10.640833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:10.780836 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3923/7749] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:38:10 2021] POST /identity/v3/projects => generated 393 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:10.784972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56399b-36c8-4af8-ab7d-8790b1c3e299 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:10.803134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56399b-36c8-4af8-ab7d-8790b1c3e299 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:10.880035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:10.881044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:10.881502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:10.881782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:10.882503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:10.884428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:11.042601 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3827/7750] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:38:10 2021] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:38:11.047006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:11.061986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79695ef4-c33d-42c5-92a1-31ee323ce9af admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:11.074367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:11.075111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:11.076566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:11.076861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:11.079912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:11.084644 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:11.114481 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3924/7751] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:11 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:11.115899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:11.129265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f636e-3f08-4925-9389-03323468f6f1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:11.138248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:11.139959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:11.140239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:11.140515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] PATH_INFO: `/v3/projects/852b86f977de452a989c0d5ab77e2f09/users/58358a2e96c94ea3b018b93c1aef29ac/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:11.159030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] RBAC: Authorizing `identity:create_grant(project_id=852b86f977de452a989c0d5ab77e2f09, user_id=58358a2e96c94ea3b018b93c1aef29ac, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:11.162535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:11.254827 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3828/7752] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:11 2021] PUT /identity/v3/projects/852b86f977de452a989c0d5ab77e2f09/users/58358a2e96c94ea3b018b93c1aef29ac/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:11.257995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:11.280334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139a05f-6a15-4fe2-b5d8-d34b47468b91 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:11.384153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b9cf-52ee-4983-a80a-bb2b2d5042e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:11.384847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b9cf-52ee-4983-a80a-bb2b2d5042e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:11.385160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b9cf-52ee-4983-a80a-bb2b2d5042e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:11.386755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b9cf-52ee-4983-a80a-bb2b2d5042e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:11.386755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b9cf-52ee-4983-a80a-bb2b2d5042e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:11.387760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b9cf-52ee-4983-a80a-bb2b2d5042e7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:11.406044 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3925/7753] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:11 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:11.410536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:11.423720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb150e-5643-4766-8a57-d7b95363862f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:11.430326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:11.431444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:11.432069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:11.433008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] PATH_INFO: `/v3/projects/852b86f977de452a989c0d5ab77e2f09/users/58358a2e96c94ea3b018b93c1aef29ac/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:11.435654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=852b86f977de452a989c0d5ab77e2f09, user_id=58358a2e96c94ea3b018b93c1aef29ac, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:11.438480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:11.452202 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3829/7754] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:11 2021] PUT /identity/v3/projects/852b86f977de452a989c0d5ab77e2f09/users/58358a2e96c94ea3b018b93c1aef29ac/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:11.462743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:11.463042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:11.463343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:11.498283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] MFA Rules not processed for user `58358a2e96c94ea3b018b93c1aef29ac`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:11.500898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:11.606195 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3926/7755] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:11 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:38:11.616474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:11.619460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:11.708346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4d74f-d611-474c-8f6d-2e9ceb49abbd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:11.715808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:11.716692 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:11.717053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:11.717359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:11.787313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:11.789356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:11.799605 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3830/7756] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:11 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:18.393211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:18.409735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:18.496234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0557ac-c63c-4a29-a8e2-53d87e97e90a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:18.502424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:18.503320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:18.507393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:18.507393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] PATH_INFO: `/v3/users/41daab3c9ebb4f5295bf646ad489e4fc` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:18.507393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41daab3c9ebb4f5295bf646ad489e4fc)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:18.507874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:18.747048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41daab3c9ebb4f5295bf646ad489e4fc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:18.759372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41daab3c9ebb4f5295bf646ad489e4fc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:18.775026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41daab3c9ebb4f5295bf646ad489e4fc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:18.776137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41daab3c9ebb4f5295bf646ad489e4fc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:18.803962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:18.805972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:18.856390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6cf158f2-9d77-4946-9a4b-abec4f1b3d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41daab3c9ebb4f5295bf646ad489e4fc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:18.866144 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3927/7757] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:38:18 2021] DELETE /identity/v3/users/41daab3c9ebb4f5295bf646ad489e4fc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:18.871165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:18.871844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:18.872302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:18.885427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09860d42-5dd0-472d-a93c-bab6873cffb6 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:18.896670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:18.898294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:18.974141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9d41c-71b1-4441-9f99-51e4e74311d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:18.974830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9d41c-71b1-4441-9f99-51e4e74311d5 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:18.975653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9d41c-71b1-4441-9f99-51e4e74311d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:18.975999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9d41c-71b1-4441-9f99-51e4e74311d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:18.978396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f5b9d41c-71b1-4441-9f99-51e4e74311d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:19.005927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3928/7758] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:38:19.016481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:19.018823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:19.045849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f030515-4dc2-40af-b465-fd8ccca5da70 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:19.054015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:19.055230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:19.056026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:19.057220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:19.070997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:19.074754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9d41c-71b1-4441-9f99-51e4e74311d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:19.075577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:19.076190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9d41c-71b1-4441-9f99-51e4e74311d5 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:19.089796 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3929/7759] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:38:19.093285 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3831/7760] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:18 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:38:19.785469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:19.787307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:19.808242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823c7f5-42ac-4a41-b949-b45ab3da3545 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:19.817556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:19.818427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:19.818757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:19.819042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] PATH_INFO: `/v3/projects/8e19dddb9aa840e3a2b96637a3960524` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:19.820464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e19dddb9aa840e3a2b96637a3960524)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:19.822748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:19.997331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e19dddb9aa840e3a2b96637a3960524', 'request_id': 'req-35c93860-da1a-4835-8a67-a8a7d4db27ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:20.079298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e19dddb9aa840e3a2b96637a3960524', 'request_id': 'req-35c93860-da1a-4835-8a67-a8a7d4db27ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:20.091506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e19dddb9aa840e3a2b96637a3960524', 'request_id': 'req-35c93860-da1a-4835-8a67-a8a7d4db27ff'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:20.106174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] The token cache is being invalidate because project 8e19dddb9aa840e3a2b96637a3960524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:38:20.106812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:20.107781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-35c93860-da1a-4835-8a67-a8a7d4db27ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:20.109372 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3930/7761] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:38:19 2021] DELETE /identity/v3/projects/8e19dddb9aa840e3a2b96637a3960524 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:20.116077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33066-9f83-47ad-ad4a-e9055f78d5a7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.116627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33066-9f83-47ad-ad4a-e9055f78d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.116822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33066-9f83-47ad-ad4a-e9055f78d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.146494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-beb33066-9f83-47ad-ad4a-e9055f78d5a7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:20.148080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-beb33066-9f83-47ad-ad4a-e9055f78d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:20.241681 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3832/7762] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:20.250258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaad14-aa4e-4b3b-9b8b-00c9cd44f67b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.250258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaad14-aa4e-4b3b-9b8b-00c9cd44f67b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.250469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaad14-aa4e-4b3b-9b8b-00c9cd44f67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.279668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-74aaad14-aa4e-4b3b-9b8b-00c9cd44f67b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:20.280795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-74aaad14-aa4e-4b3b-9b8b-00c9cd44f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:20.308692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3931/7763] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:38:20.312128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33066-9f83-47ad-ad4a-e9055f78d5a7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:20.323591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33066-9f83-47ad-ad4a-e9055f78d5a7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:20.333901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:20.333901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.333901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.333901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.334358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:38:20.334358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:20.336126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:20.348916 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3833/7764] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:38:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:38:20.352562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaad14-aa4e-4b3b-9b8b-00c9cd44f67b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:20.361734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaad14-aa4e-4b3b-9b8b-00c9cd44f67b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:20.366833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:20.367480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.367756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.368027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.368759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:20.370688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:20.494170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3932/7765] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:38:20 2021] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:20.498649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:20.510353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0ef10-3438-4059-ac79-11cbc183c96b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:20.574167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:20.576108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.576609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.577134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.578405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:20.580674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:20.703429 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3834/7766] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:38:20 2021] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:20.707882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:20.719567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ce835-0135-43a8-a8b0-6f6d8a88a922 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:20.725894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:20.726734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.727624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.727624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.728290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:20.730172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:20.748169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:20.751444 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3933/7767] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:20.759156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ca451-3f9f-4981-aae2-641575a4b42c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:20.764236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a661ab-483a-418c-a87c-1c5da1f6370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:20.764925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a661ab-483a-418c-a87c-1c5da1f6370b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.765451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a661ab-483a-418c-a87c-1c5da1f6370b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.765724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a661ab-483a-418c-a87c-1c5da1f6370b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.766617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a661ab-483a-418c-a87c-1c5da1f6370b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:20.768368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a661ab-483a-418c-a87c-1c5da1f6370b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:20.783986 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3835/7768] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:20.790222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:20.802932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6325a7a-ba97-4f47-bd0e-dcda280f83ca admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:20.808079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:20.809041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.809549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.810469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] PATH_INFO: `/v3/projects/621c8524f3664ecc90427a356a18ba13/users/54284bf093894f57ab5ed9b97c989450/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.829526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621c8524f3664ecc90427a356a18ba13, user_id=54284bf093894f57ab5ed9b97c989450, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:20.833589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:20.931405 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3934/7769] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:20 2021] PUT /identity/v3/projects/621c8524f3664ecc90427a356a18ba13/users/54284bf093894f57ab5ed9b97c989450/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:20.936753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9931-88f3-49f8-9d26-100afa0da6c6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:20.937283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9931-88f3-49f8-9d26-100afa0da6c6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:20.937858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9931-88f3-49f8-9d26-100afa0da6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:20.975571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e40d9931-88f3-49f8-9d26-100afa0da6c6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:20.976987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e40d9931-88f3-49f8-9d26-100afa0da6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:21.043272 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3836/7770] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:21.058401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:21.060147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:21.132002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea724-6e00-4791-baed-f7cc9921dd75 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:21.137334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:21.143496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:21.143496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:21.143496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:21.158166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:21.161368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:21.176511 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3935/7771] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:38:24.548520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:24.549430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:24.549882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:24.581242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] MFA Rules not processed for user `01a07fc3a154483caea95cbd449f3970`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:24.583303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:24.654808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3837/7772] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:24 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:24.710933 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:24.713560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:24.802765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aab49-e5dd-4000-8637-a3cb91824e4c service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:24.819394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:24.823909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:24.823909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:24.823909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:24.823909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:24.942246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:24.945109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:24.967542 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3936/7773] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:25.595536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:25.597858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:25.624622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135f0ba-3c25-4eb2-a243-7fc0207e19a7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:25.654815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:25.656393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:25.656856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:25.657671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:25.661825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:25.697930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:25.711861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:25.721399 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3838/7774] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:25 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:26.899461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:26.913829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327de12-25a9-4605-a320-0dbff9352476 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:26.924749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05fe3d-8d5a-4d21-89c2-b1ca3136344c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:26.925494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05fe3d-8d5a-4d21-89c2-b1ca3136344c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:26.925970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05fe3d-8d5a-4d21-89c2-b1ca3136344c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:26.930261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05fe3d-8d5a-4d21-89c2-b1ca3136344c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:26.961321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4d05fe3d-8d5a-4d21-89c2-b1ca3136344c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:26.997865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05fe3d-8d5a-4d21-89c2-b1ca3136344c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:26.999336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05fe3d-8d5a-4d21-89c2-b1ca3136344c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:27.027559 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3937/7775] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:27.860093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:27.861641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:28.002684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff6108-ba73-418f-b08b-5311adb22cfa service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:28.014895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:28.014895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:28.014895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:28.014895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:28.015446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:28.029804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:28.031554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:28.048587 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3839/7776] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:38:30.397697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09857c-c207-4766-a56a-121764702a87 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:30.398200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09857c-c207-4766-a56a-121764702a87 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:30.398312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09857c-c207-4766-a56a-121764702a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:30.457962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5d09857c-c207-4766-a56a-121764702a87 None None] MFA Rules not processed for user `54284bf093894f57ab5ed9b97c989450`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:30.457962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5d09857c-c207-4766-a56a-121764702a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:30.533822 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3938/7777] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:30 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:30.538482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:30.550195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d19c0-e8b3-437a-9e66-e1624a79447a service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:30.569307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:30.577716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:30.577716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:30.577716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:30.577716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:30.577716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:30.742747 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3840/7778] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:38:30 2021] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:30.747210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09857c-c207-4766-a56a-121764702a87 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:30.768116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09857c-c207-4766-a56a-121764702a87 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:30.864020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:30.865267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:30.865761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:30.866205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:30.867313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:30.869748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:31.006724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:31.008207 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3939/7779] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:38:30 2021] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:31.018360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81161f1d-ec4f-404e-b553-56df22576334 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:31.025485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:31.027496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:31.027496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:31.027496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:31.028336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:31.030421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:31.048634 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3841/7780] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:31.053214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:31.064315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d0c95-03e9-4f6a-a292-d4ceca723f7c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:31.071588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:31.072538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:31.073218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:31.073679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] PATH_INFO: `/v3/projects/2a1b39b2a3c94189a7b27e64ddaacac0/users/874343ee35e44b02a24c020c45ab5ee8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:31.092200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1b39b2a3c94189a7b27e64ddaacac0, user_id=874343ee35e44b02a24c020c45ab5ee8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:31.095661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:31.245931 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3940/7781] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:31 2021] PUT /identity/v3/projects/2a1b39b2a3c94189a7b27e64ddaacac0/users/874343ee35e44b02a24c020c45ab5ee8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:38:31.250351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:31.260678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10547c-778b-41bc-a60b-e83b6b495f73 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:31.339434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb03d0b-fcfc-4191-b9f6-f0b7019929ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:31.340105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb03d0b-fcfc-4191-b9f6-f0b7019929ae admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:31.340384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb03d0b-fcfc-4191-b9f6-f0b7019929ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:31.340861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb03d0b-fcfc-4191-b9f6-f0b7019929ae admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:31.345096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb03d0b-fcfc-4191-b9f6-f0b7019929ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:31.345096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb03d0b-fcfc-4191-b9f6-f0b7019929ae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:31.356470 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3842/7782] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:31 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:31.360345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:31.379994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d6783-1df0-4a14-9ee8-8a1bfac9ff26 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:31.382248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:31.383151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:31.383436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:31.383711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] PATH_INFO: `/v3/projects/2a1b39b2a3c94189a7b27e64ddaacac0/users/874343ee35e44b02a24c020c45ab5ee8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:31.386081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1b39b2a3c94189a7b27e64ddaacac0, user_id=874343ee35e44b02a24c020c45ab5ee8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:31.389515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:31.433486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3941/7783] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:31 2021] PUT /identity/v3/projects/2a1b39b2a3c94189a7b27e64ddaacac0/users/874343ee35e44b02a24c020c45ab5ee8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:40.430589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:40.431110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:40.431224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:40.463074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] MFA Rules not processed for user `874343ee35e44b02a24c020c45ab5ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:40.464333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:40.546060 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3843/7784] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:40 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:38:40.554504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:40.560773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:40.655095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d687e-ed9e-468b-a1e4-35ebb8dc85d9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:40.662267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:40.663040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:40.663387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:40.663733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:40.674921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:40.677322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:40.701767 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3942/7785] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:40 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:40.918489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:40.919700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:41.059597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e44b-6654-47a3-a9db-8d4bf1191810 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:41.065408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:41.067233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:41.080130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:41.080130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] PATH_INFO: `/v3/users/083978152102458ea57b5d6072640077` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:41.080130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083978152102458ea57b5d6072640077)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:41.080130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:41.182290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:41.254318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2b3a-fee9-4f7e-a215-268f42809693 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:41.259668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b293c3-c594-49ac-a432-ae58e5af4100 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:41.260393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b293c3-c594-49ac-a432-ae58e5af4100 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:41.260745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b293c3-c594-49ac-a432-ae58e5af4100 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:41.261128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b293c3-c594-49ac-a432-ae58e5af4100 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:41.263046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5b293c3-c594-49ac-a432-ae58e5af4100 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:41.280838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b293c3-c594-49ac-a432-ae58e5af4100 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:41.282676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b293c3-c594-49ac-a432-ae58e5af4100 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:41.291399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083978152102458ea57b5d6072640077'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:41.298948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083978152102458ea57b5d6072640077'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:41.308284 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3943/7786] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:41.317355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083978152102458ea57b5d6072640077'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:41.318290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083978152102458ea57b5d6072640077'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:41.319058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083978152102458ea57b5d6072640077'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:41.433235 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3844/7787] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:38:40 2021] DELETE /identity/v3/users/083978152102458ea57b5d6072640077 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:41.437943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:41.438966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:41.439324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:41.473711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:41.476677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:41.561263 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3944/7788] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:41.567714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:41.569452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:41.677160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc27c5-88a2-47f2-a7fd-19747b0abf71 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:41.682000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:41.682952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:41.683085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:41.683252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:41.697673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:41.701441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:41.713917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3845/7789] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:41.966559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:41.968165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:42.044938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:42.045240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:42.073764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be013fa5-2af9-4ae8-ad31-03a03ab87dbe None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:42.073941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae7d62-e727-480e-af46-e42220d62568 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:42.087576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:42.087960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb5273-f0ff-480e-b8e8-6f3ee1aa8974 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:42.088972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.089230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5273-f0ff-480e-b8e8-6f3ee1aa8974 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.089517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5273-f0ff-480e-b8e8-6f3ee1aa8974 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.090045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb5273-f0ff-480e-b8e8-6f3ee1aa8974 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.090224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.090662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] PATH_INFO: `/v3/projects/755ec677849b45beada7922dc5a9f6b5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.092149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755ec677849b45beada7922dc5a9f6b5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:42.093507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a2bb5273-f0ff-480e-b8e8-6f3ee1aa8974 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:42.095658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:42.126256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb5273-f0ff-480e-b8e8-6f3ee1aa8974 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:42.129605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb5273-f0ff-480e-b8e8-6f3ee1aa8974 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:42.154408 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3945/7790] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:42.266210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755ec677849b45beada7922dc5a9f6b5', 'request_id': 'req-737d3e66-757a-47c8-be42-bd9a814db2b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:42.274619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755ec677849b45beada7922dc5a9f6b5', 'request_id': 'req-737d3e66-757a-47c8-be42-bd9a814db2b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:42.387401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755ec677849b45beada7922dc5a9f6b5', 'request_id': 'req-737d3e66-757a-47c8-be42-bd9a814db2b3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:42.399036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] The token cache is being invalidate because project 755ec677849b45beada7922dc5a9f6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:38:42.399382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:42.400041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-737d3e66-757a-47c8-be42-bd9a814db2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:42.401670 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3846/7791] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:38:42 2021] DELETE /identity/v3/projects/755ec677849b45beada7922dc5a9f6b5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:38:42.407505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ff91-f2b6-4772-973c-88629f7f74d5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.407799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ff91-f2b6-4772-973c-88629f7f74d5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.408081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ff91-f2b6-4772-973c-88629f7f74d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.448579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fd48ff91-f2b6-4772-973c-88629f7f74d5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:42.453068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fd48ff91-f2b6-4772-973c-88629f7f74d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:42.523361 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3946/7792] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:42.534300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e3fd-afa0-4210-8429-522561e13377 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.535637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e3fd-afa0-4210-8429-522561e13377 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.536064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e3fd-afa0-4210-8429-522561e13377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.573500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-67e2e3fd-afa0-4210-8429-522561e13377 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:42.586851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-67e2e3fd-afa0-4210-8429-522561e13377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:42.586851 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3847/7793] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:42.589943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ff91-f2b6-4772-973c-88629f7f74d5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:42.604461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ff91-f2b6-4772-973c-88629f7f74d5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:42.611174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:42.616011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.616011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.616011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.616011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:38:42.616461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:42.618117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:42.637072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3947/7794] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:38:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:38:42.638170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e3fd-afa0-4210-8429-522561e13377 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:42.655169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e3fd-afa0-4210-8429-522561e13377 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:42.661562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:42.662299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.662650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.662994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.663907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:42.666086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:42.755202 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3848/7795] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:38:42 2021] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:42.756568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:42.769197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f3251-1f76-4250-88f5-088993719c40 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:42.834123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:42.834837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.835121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.835403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.836099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:42.838057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:42.956577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3948/7796] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:38:42 2021] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:38:42.957542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:42.968711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd532b-cc06-451a-96b8-26d24fb9f5d5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:42.974630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:42.975463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:42.975848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:42.976392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:42.977406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:42.979409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:42.994820 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3849/7797] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:42 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:38:42.996168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:43.006850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db14339-6c61-476a-915d-4db0ddecbe3c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:43.012256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ed848-d9f3-46cb-b3b1-b41ae87c5360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:43.017549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed848-d9f3-46cb-b3b1-b41ae87c5360 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:43.017549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed848-d9f3-46cb-b3b1-b41ae87c5360 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:43.017549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed848-d9f3-46cb-b3b1-b41ae87c5360 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:43.017549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ed848-d9f3-46cb-b3b1-b41ae87c5360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:43.017549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ed848-d9f3-46cb-b3b1-b41ae87c5360 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:43.027486 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3949/7798] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:43.031758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:43.043202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90b310-a48a-433a-9085-5590aceb9318 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:43.048146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:43.049068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:43.049349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:43.049616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] PATH_INFO: `/v3/projects/bc515949a1384b348ed3a4107a931ad0/users/a50b86c705cf4398aa6d626d4c57bb9c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:43.067192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc515949a1384b348ed3a4107a931ad0, user_id=a50b86c705cf4398aa6d626d4c57bb9c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:43.070012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:43.130563 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3850/7799] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:43 2021] PUT /identity/v3/projects/bc515949a1384b348ed3a4107a931ad0/users/a50b86c705cf4398aa6d626d4c57bb9c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:38:43.143197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:43.143197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:43.143197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:43.186489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] MFA Rules not processed for user `a50b86c705cf4398aa6d626d4c57bb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:43.187773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:43.278477 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3950/7800] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:43 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:38:43.291421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:43.293285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:43.367267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bbda8-24ad-4b3b-aafe-b39a128e5b2b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:43.374254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:43.374968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:43.375427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:43.375737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:43.385837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:43.387304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:43.398293 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3851/7801] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:43 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:38:49.470605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:49.472954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:49.646215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52420260-92d5-451f-8353-2d11eafccad2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:49.653069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:49.668499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:49.668982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:49.669900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:49.678181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:49.721081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:49.726826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:49.756374 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3951/7802] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:38:52.306682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:52.308173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:52.372413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81e89-a06b-44f1-bada-1b2fa14e8f02 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:52.378877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:52.379888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:52.380170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:52.380447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] PATH_INFO: `/v3/users/54284bf093894f57ab5ed9b97c989450` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:52.381844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54284bf093894f57ab5ed9b97c989450)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:52.383771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:52.596411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54284bf093894f57ab5ed9b97c989450'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:52.603952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54284bf093894f57ab5ed9b97c989450'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:52.616038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54284bf093894f57ab5ed9b97c989450'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:52.616836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54284bf093894f57ab5ed9b97c989450'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:52.617469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54284bf093894f57ab5ed9b97c989450'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:52.694379 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3852/7803] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:38:52 2021] DELETE /identity/v3/users/54284bf093894f57ab5ed9b97c989450 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:53.086633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:53.100247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f891c-c6bc-44e4-b266-a820146ca3bc service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:53.161671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:53.162550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:53.162878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:53.163103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] PATH_INFO: `/v3/projects/621c8524f3664ecc90427a356a18ba13` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:53.164350 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621c8524f3664ecc90427a356a18ba13)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:53.167493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:53.308377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621c8524f3664ecc90427a356a18ba13', 'request_id': 'req-c0cda3f5-975d-45b1-82a6-a7e635ce3907'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.396402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621c8524f3664ecc90427a356a18ba13', 'request_id': 'req-c0cda3f5-975d-45b1-82a6-a7e635ce3907'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.403184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621c8524f3664ecc90427a356a18ba13', 'request_id': 'req-c0cda3f5-975d-45b1-82a6-a7e635ce3907'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.413615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] The token cache is being invalidate because project 621c8524f3664ecc90427a356a18ba13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:38:53.413908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.414584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.416165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3952/7804] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:38:53 2021] DELETE /identity/v3/projects/621c8524f3664ecc90427a356a18ba13 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:53.420067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:53.421574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:53.435375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044a298-0a16-47ad-b0ed-0012120f29b4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:53.498104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:53.499090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:53.499280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:53.499559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] PATH_INFO: `/v3/users/874343ee35e44b02a24c020c45ab5ee8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:53.500986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=874343ee35e44b02a24c020c45ab5ee8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:53.503018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:53.764043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874343ee35e44b02a24c020c45ab5ee8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.771627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874343ee35e44b02a24c020c45ab5ee8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.783894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874343ee35e44b02a24c020c45ab5ee8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.785224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874343ee35e44b02a24c020c45ab5ee8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.785844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d5c047ff-8ecd-47cd-9180-905e775c8d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874343ee35e44b02a24c020c45ab5ee8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:53.924305 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3853/7805] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:38:53 2021] DELETE /identity/v3/users/874343ee35e44b02a24c020c45ab5ee8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:54.180534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:54.182008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:54.198614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cda3f5-975d-45b1-82a6-a7e635ce3907 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:54.272636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:54.273523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:54.273808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:54.274083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] PATH_INFO: `/v3/projects/2a1b39b2a3c94189a7b27e64ddaacac0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:54.275304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1b39b2a3c94189a7b27e64ddaacac0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:54.277243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:54.399258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1b39b2a3c94189a7b27e64ddaacac0', 'request_id': 'req-d82bc92a-5ab3-4985-b43b-1d833822c1ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:54.473457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1b39b2a3c94189a7b27e64ddaacac0', 'request_id': 'req-d82bc92a-5ab3-4985-b43b-1d833822c1ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:54.480689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1b39b2a3c94189a7b27e64ddaacac0', 'request_id': 'req-d82bc92a-5ab3-4985-b43b-1d833822c1ec'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:54.491167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] The token cache is being invalidate because project 2a1b39b2a3c94189a7b27e64ddaacac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:38:54.494472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:54.494472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d82bc92a-5ab3-4985-b43b-1d833822c1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:38:54.494472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3953/7806] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:38:54 2021] DELETE /identity/v3/projects/2a1b39b2a3c94189a7b27e64ddaacac0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:54.499270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148582e-8120-44ea-8589-651adb5f9173 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:54.499767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148582e-8120-44ea-8589-651adb5f9173 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:54.499882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148582e-8120-44ea-8589-651adb5f9173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:54.517603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0148582e-8120-44ea-8589-651adb5f9173 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:54.518800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0148582e-8120-44ea-8589-651adb5f9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:54.577700 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3854/7807] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:54.587058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f542-6df0-44b5-bd3a-42dd5c95553a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:54.587374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f542-6df0-44b5-bd3a-42dd5c95553a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:54.587653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27f542-6df0-44b5-bd3a-42dd5c95553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:54.608317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fa27f542-6df0-44b5-bd3a-42dd5c95553a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:54.609545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa27f542-6df0-44b5-bd3a-42dd5c95553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:54.617533 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3954/7808] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:54.621964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148582e-8120-44ea-8589-651adb5f9173 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:54.632290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148582e-8120-44ea-8589-651adb5f9173 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:54.637239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:54.642652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:54.642652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:54.642652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:54.642652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:38:54.642652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:54.642652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:54.657489 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3855/7809] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:38:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:38:54.658599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27f542-6df0-44b5-bd3a-42dd5c95553a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:54.670163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27f542-6df0-44b5-bd3a-42dd5c95553a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:54.674148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:54.674803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:54.675078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:54.675421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:54.676126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:54.678077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:54.806626 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3955/7810] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:38:54 2021] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:38:54.807839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:54.819820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696358be-bb1f-4161-b5c2-a2fa3379668a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:54.880868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:54.883010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:54.883010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:54.883010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:54.883300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:54.885205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:54.965242 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3856/7811] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:38:54 2021] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:38:54.969284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:54.980068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d5279-5064-4071-be6b-0e72ab2128d3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:54.984802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:54.985788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:54.986069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:54.986343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:54.987066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:54.988645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:54.999166 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3956/7812] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:55.002904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:55.013324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643b5ed-d941-41f6-8689-11c313c466c5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:55.018224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ab889-43f0-4c26-80bc-91db78a4c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:55.018960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab889-43f0-4c26-80bc-91db78a4c13c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:55.019802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab889-43f0-4c26-80bc-91db78a4c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:55.020080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ab889-43f0-4c26-80bc-91db78a4c13c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:55.020809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ab889-43f0-4c26-80bc-91db78a4c13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:55.022423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ab889-43f0-4c26-80bc-91db78a4c13c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:55.034927 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3857/7813] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:38:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:38:55.037103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:55.047546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb480d8-aad7-4277-8966-32a5db91bffc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:55.054490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:55.056047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:55.056356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:55.056636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] PATH_INFO: `/v3/projects/ca293d68b8cc44e6b641d477c9a3eb50/users/e8dd3c4dd2344bee986e909d5c45112a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:55.078476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca293d68b8cc44e6b641d477c9a3eb50, user_id=e8dd3c4dd2344bee986e909d5c45112a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:55.078476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:55.153493 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3957/7814] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:38:55 2021] PUT /identity/v3/projects/ca293d68b8cc44e6b641d477c9a3eb50/users/e8dd3c4dd2344bee986e909d5c45112a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:38:55.163401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:55.163731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:55.164033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:55.183487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:38:55.184744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:55.243217 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3858/7815] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:38:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:38:55.253232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:38:55.255643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:38:55.315697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eab3d-9385-44e8-a732-9e766c661bc8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:38:55.320475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdac96-0167-4088-a6d3-ea27e1127086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:38:55.321370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdac96-0167-4088-a6d3-ea27e1127086 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:38:55.321528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdac96-0167-4088-a6d3-ea27e1127086 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:38:55.322351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdac96-0167-4088-a6d3-ea27e1127086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:38:55.334805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdac96-0167-4088-a6d3-ea27e1127086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:38:55.337058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdac96-0167-4088-a6d3-ea27e1127086 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:38:55.348045 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3958/7816] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:38:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:01.145106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:01.150336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:01.170768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca8ee5-a4a9-49ee-85be-530df635d588 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:01.176931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:01.178091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.178573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.179024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] PATH_INFO: `/v3/users/a50b86c705cf4398aa6d626d4c57bb9c` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.185912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50b86c705cf4398aa6d626d4c57bb9c)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:01.188232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:01.305078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a75e-8afe-41cd-afa7-0c250776bd5f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.305613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a75e-8afe-41cd-afa7-0c250776bd5f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.305613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a75e-8afe-41cd-afa7-0c250776bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.334451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9339a75e-8afe-41cd-afa7-0c250776bd5f None None] MFA Rules not processed for user `e8dd3c4dd2344bee986e909d5c45112a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:01.335668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9339a75e-8afe-41cd-afa7-0c250776bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:01.405367 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3959/7817] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:01 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:01.410108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339a75e-8afe-41cd-afa7-0c250776bd5f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:01.421686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339a75e-8afe-41cd-afa7-0c250776bd5f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:01.427616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:01.428619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.428942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.429248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.429923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:01.432141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:01.434500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50b86c705cf4398aa6d626d4c57bb9c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:01.448479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50b86c705cf4398aa6d626d4c57bb9c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:01.461794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50b86c705cf4398aa6d626d4c57bb9c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:01.462639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50b86c705cf4398aa6d626d4c57bb9c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:01.463307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2cfe5c31-8970-498c-9c31-c398f65f3a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50b86c705cf4398aa6d626d4c57bb9c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:01.549362 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3960/7818] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:01 2021] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:01.554472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:01.556206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:01.571254 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3859/7819] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:01 2021] DELETE /identity/v3/users/a50b86c705cf4398aa6d626d4c57bb9c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:01.575738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.576218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.576970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.596214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:01.597456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:01.627322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b282d1-2f13-4700-8c77-7b88d85504ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:01.671229 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3860/7820] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:39:01.678202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:01.680206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:01.697532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:01.698207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.698498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.698776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.699516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:01.701512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:01.742346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ffdf1-ef00-4843-ba74-0989c56badf9 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:01.746129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:01.747520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.747520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.747520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.757458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:01.758970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:01.770983 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3861/7821] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:01.796642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3961/7822] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:01 2021] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:01.801156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:01.829378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585cf15-04f5-4773-9e01-db5b7f833e6f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:01.829378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:01.829378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.829378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.829775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.829775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:01.829775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:01.843277 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3862/7823] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:01 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:01.848424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:01.862921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afed70-3545-422a-afe4-2627e54925ce admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:01.867935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:01.869022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:01.869711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:01.869850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] PATH_INFO: `/v3/projects/31a159a4944c43258c0bd3a34c853e88/users/f04d749763584300849d1825cece25d8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:01.890324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a159a4944c43258c0bd3a34c853e88, user_id=f04d749763584300849d1825cece25d8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:01.892569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:01.985777 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3962/7824] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:01 2021] PUT /identity/v3/projects/31a159a4944c43258c0bd3a34c853e88/users/f04d749763584300849d1825cece25d8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:01.989853 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:02.000295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9192c4e-a1fb-47e7-a128-dab6727d311d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:02.057350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:02.058013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.058292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.058592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.059311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:02.060947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:02.073862 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3863/7825] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:01 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:02.075053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:02.090741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44100a08-904c-4a50-a0cf-8ff66a27302d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:02.092713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:02.094678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:02.095770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5261f-e4ec-430a-9917-25d31eb86a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:02.098112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5261f-e4ec-430a-9917-25d31eb86a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.098436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5261f-e4ec-430a-9917-25d31eb86a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.099056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5261f-e4ec-430a-9917-25d31eb86a7a admin admin] PATH_INFO: `/v3/projects/31a159a4944c43258c0bd3a34c853e88/users/f04d749763584300849d1825cece25d8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.101439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5261f-e4ec-430a-9917-25d31eb86a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a159a4944c43258c0bd3a34c853e88, user_id=f04d749763584300849d1825cece25d8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:02.105460 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5261f-e4ec-430a-9917-25d31eb86a7a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:02.248536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694170-97ea-42f0-80f6-39038c1df198 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:02.248536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:02.248536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.248536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.252566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] PATH_INFO: `/v3/projects/bc515949a1384b348ed3a4107a931ad0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.252566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc515949a1384b348ed3a4107a931ad0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:02.252783 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3963/7826] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:02 2021] PUT /identity/v3/projects/31a159a4944c43258c0bd3a34c853e88/users/f04d749763584300849d1825cece25d8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:02.252924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:02.344980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc515949a1384b348ed3a4107a931ad0', 'request_id': 'req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:02.350018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc515949a1384b348ed3a4107a931ad0', 'request_id': 'req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:02.488341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc515949a1384b348ed3a4107a931ad0', 'request_id': 'req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:02.488341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] The token cache is being invalidate because project bc515949a1384b348ed3a4107a931ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:02.488341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:02.488341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-45dab9e4-f3d5-4f0f-b0fc-66dc1d7c5da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:02.488341 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3864/7827] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:02 2021] DELETE /identity/v3/projects/bc515949a1384b348ed3a4107a931ad0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:39:02.491015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c037fdc-1d96-4ef4-84de-a3726d66115c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.492002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c037fdc-1d96-4ef4-84de-a3726d66115c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.492284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c037fdc-1d96-4ef4-84de-a3726d66115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.512975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3c037fdc-1d96-4ef4-84de-a3726d66115c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:02.514761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3c037fdc-1d96-4ef4-84de-a3726d66115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:02.817307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3964/7828] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:02.817491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78ad70-af0d-4d06-af99-c10c74f049eb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.817491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78ad70-af0d-4d06-af99-c10c74f049eb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.817491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78ad70-af0d-4d06-af99-c10c74f049eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.817491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fb78ad70-af0d-4d06-af99-c10c74f049eb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:02.817491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fb78ad70-af0d-4d06-af99-c10c74f049eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:02.817491 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3865/7829] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:02.819146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c037fdc-1d96-4ef4-84de-a3726d66115c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:02.819146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c037fdc-1d96-4ef4-84de-a3726d66115c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:02.819146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:02.819146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.819467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.819467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.819467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:39:02.819467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:02.819467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:02.819467 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3965/7830] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:39:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:39:02.820443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78ad70-af0d-4d06-af99-c10c74f049eb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:02.820443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78ad70-af0d-4d06-af99-c10c74f049eb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:02.820443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:02.820443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.820801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.820801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.820801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:02.820801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:02.864680 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3866/7831] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:02 2021] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:02.866122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:02.878113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b83582-d289-42c5-a397-0057386be4ae admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:02.946004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:02.946820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:02.947125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:02.947408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:02.948909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:02.951183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:03.060624 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3966/7832] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:02 2021] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:39:03.061984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:03.073398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37749-9dad-4e82-b57e-ce2ad661f072 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:03.081031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:03.082407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.082787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.088548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.088548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:03.088548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:03.119293 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3867/7833] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:03 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:03.120325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:03.134077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d213b4f-b28d-4d6c-89c1-30163209a785 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:03.139630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb7fc-1f69-42e5-a043-de1c819c4e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:03.140320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb7fc-1f69-42e5-a043-de1c819c4e37 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.140603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb7fc-1f69-42e5-a043-de1c819c4e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.140905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb7fc-1f69-42e5-a043-de1c819c4e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.141837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb7fc-1f69-42e5-a043-de1c819c4e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:03.145955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb7fc-1f69-42e5-a043-de1c819c4e37 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:03.156730 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3967/7834] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:39:03.161191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:03.173435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a78a7-cb17-4c90-a62f-ed9e96b414c9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:03.179381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:03.181056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.181476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.181880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] PATH_INFO: `/v3/projects/99114e98ebab4f59a23191455e14fa85/users/b150c13092b94b289cdd0ecffcba15a3/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.201931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=99114e98ebab4f59a23191455e14fa85, user_id=b150c13092b94b289cdd0ecffcba15a3, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:03.205915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:03.291287 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3868/7835] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:03 2021] PUT /identity/v3/projects/99114e98ebab4f59a23191455e14fa85/users/b150c13092b94b289cdd0ecffcba15a3/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:03.302192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28244c5-59de-4c89-8241-c8c7df589843 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.302487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28244c5-59de-4c89-8241-c8c7df589843 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.302882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28244c5-59de-4c89-8241-c8c7df589843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.333428 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a28244c5-59de-4c89-8241-c8c7df589843 None None] MFA Rules not processed for user `b150c13092b94b289cdd0ecffcba15a3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:03.334731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a28244c5-59de-4c89-8241-c8c7df589843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:03.410480 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3968/7836] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:03 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:03.411801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:03.497989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c4dfd-2794-4ec9-9bd1-f466a1a497cf admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:03.504402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:03.505297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.505721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.506003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.506740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:03.508727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:03.615514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3869/7837] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:03 2021] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:03.619718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28244c5-59de-4c89-8241-c8c7df589843 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:03.631363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28244c5-59de-4c89-8241-c8c7df589843 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:03.702397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:03.703100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.703388 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.703671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.704389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:03.707970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:03.871255 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3969/7838] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:03 2021] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:03.875214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:03.891210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b1505-cdff-4527-8008-50586a0cc9cd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:03.902978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:03.903774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.904138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.904494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.905498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:03.907203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:03.923263 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3870/7839] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:03 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:03.927718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:03.938545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bb45b-dc0f-4752-bfc7-f659431a20fc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:03.944270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:03.945211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:03.945488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:03.945760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] PATH_INFO: `/v3/projects/0d65ef06241d43b882895e4979969ead/users/555f1199a90f4b08a5d4fd735ba513c6/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:03.981632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d65ef06241d43b882895e4979969ead, user_id=555f1199a90f4b08a5d4fd735ba513c6, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:03.985136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:04.090211 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3970/7840] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:03 2021] PUT /identity/v3/projects/0d65ef06241d43b882895e4979969ead/users/555f1199a90f4b08a5d4fd735ba513c6/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:04.094462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:04.105310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282064f-d1b9-4f7f-bb5d-32967525c24d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:04.183244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b592c1-0901-4675-9376-8edf49d286ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:04.184239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b592c1-0901-4675-9376-8edf49d286ab admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:04.185307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b592c1-0901-4675-9376-8edf49d286ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:04.185830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b592c1-0901-4675-9376-8edf49d286ab admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:04.186610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b592c1-0901-4675-9376-8edf49d286ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:04.188252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b592c1-0901-4675-9376-8edf49d286ab admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:04.205453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3871/7841] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:04 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:39:04.207663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:04.221462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab795e3-3aa5-4208-b55f-37ac4b36f2b1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:04.243577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:04.244515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:04.244802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:04.245172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] PATH_INFO: `/v3/projects/0d65ef06241d43b882895e4979969ead/users/555f1199a90f4b08a5d4fd735ba513c6/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:04.247383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d65ef06241d43b882895e4979969ead, user_id=555f1199a90f4b08a5d4fd735ba513c6, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:04.250226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:04.265275 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3971/7842] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:04 2021] PUT /identity/v3/projects/0d65ef06241d43b882895e4979969ead/users/555f1199a90f4b08a5d4fd735ba513c6/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:04.274984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7aff0-a803-440a-b824-772a6f6e623d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:04.275480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7aff0-a803-440a-b824-772a6f6e623d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:04.275759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7aff0-a803-440a-b824-772a6f6e623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:04.327896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f2d7aff0-a803-440a-b824-772a6f6e623d None None] MFA Rules not processed for user `555f1199a90f4b08a5d4fd735ba513c6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:04.330640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f2d7aff0-a803-440a-b824-772a6f6e623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:04.439380 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3872/7843] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:04 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:04.446062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:04.448116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:04.534436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0477fd-d3b6-45d3-9dc9-6ff4099d82cb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:04.540452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d274fb-4de4-4dfc-b8e0-a34269500331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:04.541359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d274fb-4de4-4dfc-b8e0-a34269500331 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:04.541772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d274fb-4de4-4dfc-b8e0-a34269500331 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:04.542206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d274fb-4de4-4dfc-b8e0-a34269500331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:04.558375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d274fb-4de4-4dfc-b8e0-a34269500331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:04.560323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d274fb-4de4-4dfc-b8e0-a34269500331 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:04.576467 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3972/7844] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:04 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:04.854647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7aff0-a803-440a-b824-772a6f6e623d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:04.870175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7aff0-a803-440a-b824-772a6f6e623d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:04.876583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:04.877693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:04.878098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:04.878929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:04.978807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:04.980318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:05.023843 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3873/7845] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:04 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:08.838060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:08.838847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:08.839137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:08.870083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] MFA Rules not processed for user `f04d749763584300849d1825cece25d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:08.871329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:08.952480 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3973/7846] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:08 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:08.959632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:08.961300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:09.027446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8dac7-31a3-4027-9127-7150399bd5d7 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:09.031109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:09.031871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:09.032143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:09.032422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:09.034255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:09.097665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:09.099161 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:09.109347 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3874/7847] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:08 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:39:09.234934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:09.236398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:09.338959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80e415-17f8-493a-bccd-f4724b69b7f9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:09.346640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:09.348393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:09.348911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:09.349520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:09.351568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:09.366717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:09.368193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:09.379752 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3974/7848] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:09 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:11.982224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:11.984285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:12.079923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02d676-9861-4329-8451-346e346707f8 service glance] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:12.086440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:12.087173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:12.087552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:12.087894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:12.089904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:12.247660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:12.249375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:12.272614 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3875/7849] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:11 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:14.820197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:14.821729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:14.845481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f443a-3ff4-49fb-a755-050b5b22db8d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:14.851686 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:14.852936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:14.852936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:14.852936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:14.854809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:14.881259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:14.883126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:14.897658 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3975/7850] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:15.459145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:15.476983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032150a-8846-4b10-9119-3c494ad5f3a2 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:15.485052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:15.486340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:15.486751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:15.487129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:15.489945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:15.562256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:15.564050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:15.586512 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3876/7851] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:15 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:20.189865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:20.191473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:20.270962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002f61d-494b-443b-9295-cdd4ed124a52 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:20.277176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0665b56-8eb2-4703-bdb9-08a2385d2bdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:20.277557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665b56-8eb2-4703-bdb9-08a2385d2bdb service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:20.277842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665b56-8eb2-4703-bdb9-08a2385d2bdb service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:20.278150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665b56-8eb2-4703-bdb9-08a2385d2bdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:20.280439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c0665b56-8eb2-4703-bdb9-08a2385d2bdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:20.297646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0665b56-8eb2-4703-bdb9-08a2385d2bdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:20.299518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0665b56-8eb2-4703-bdb9-08a2385d2bdb service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:20.317010 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3976/7852] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:20.999082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:21.016146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a279-2a85-49d0-a557-3b5defe8c14c service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:21.021596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0d6f4-cd4d-4460-8356-b26ca16eb7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:21.024413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d6f4-cd4d-4460-8356-b26ca16eb7ca service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:21.024706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d6f4-cd4d-4460-8356-b26ca16eb7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:21.025144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d6f4-cd4d-4460-8356-b26ca16eb7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:21.027533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-50e0d6f4-cd4d-4460-8356-b26ca16eb7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:21.051827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0d6f4-cd4d-4460-8356-b26ca16eb7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:21.055669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0d6f4-cd4d-4460-8356-b26ca16eb7ca service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:21.084018 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3877/7853] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:21.299566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be654a-4449-4c1d-9ba4-48e9296105f3 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:21.300717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be654a-4449-4c1d-9ba4-48e9296105f3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:21.300993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be654a-4449-4c1d-9ba4-48e9296105f3 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:21.303119 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3977/7854] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:39:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:39:21.308942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34b0b0-0ac2-4bfb-ab27-97c28ed51568 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:21.310257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34b0b0-0ac2-4bfb-ab27-97c28ed51568 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:21.310950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34b0b0-0ac2-4bfb-ab27-97c28ed51568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:21.373221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-df34b0b0-0ac2-4bfb-ab27-97c28ed51568 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:21.374786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-df34b0b0-0ac2-4bfb-ab27-97c28ed51568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:21.385533 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3878/7855] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:39:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:21.411715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be654a-4449-4c1d-9ba4-48e9296105f3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:21.434313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be654a-4449-4c1d-9ba4-48e9296105f3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:21.440628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa8eb8-6b62-4d7e-a5ea-f836a4419817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:21.442358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa8eb8-6b62-4d7e-a5ea-f836a4419817 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:21.442980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa8eb8-6b62-4d7e-a5ea-f836a4419817 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:21.443491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa8eb8-6b62-4d7e-a5ea-f836a4419817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:21.459647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa8eb8-6b62-4d7e-a5ea-f836a4419817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:21.462165 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa8eb8-6b62-4d7e-a5ea-f836a4419817 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:21.475790 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3978/7856] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:39:27.779820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34b0b0-0ac2-4bfb-ab27-97c28ed51568 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:27.793542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34b0b0-0ac2-4bfb-ab27-97c28ed51568 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:27.797935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:27.798593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:27.798875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:27.799151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:27.800986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:27.910727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:27.910727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:27.929422 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3879/7857] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:27 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:32.069887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0f9d-2d12-43f6-be5c-a6cde5a6b9a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:32.070321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0f9d-2d12-43f6-be5c-a6cde5a6b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:32.070452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df0f9d-2d12-43f6-be5c-a6cde5a6b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:32.092470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e7df0f9d-2d12-43f6-be5c-a6cde5a6b9a3 None None] MFA Rules not processed for user `c3a55c151bef4387a4fef00ab6687a20`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:32.093749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e7df0f9d-2d12-43f6-be5c-a6cde5a6b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:32.101694 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3979/7858] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:32 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:37.847038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:37.916997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4ab3-85d2-4280-a58b-7224c56fb79b service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:37.922083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:37.923053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:37.923417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:37.923767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] PATH_INFO: `/v3/users/b150c13092b94b289cdd0ecffcba15a3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:37.925252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b150c13092b94b289cdd0ecffcba15a3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:37.927267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:38.164415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b150c13092b94b289cdd0ecffcba15a3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:38.170974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b150c13092b94b289cdd0ecffcba15a3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:38.182876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b150c13092b94b289cdd0ecffcba15a3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:38.183568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b150c13092b94b289cdd0ecffcba15a3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:38.184171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b150c13092b94b289cdd0ecffcba15a3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:38.281588 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3880/7859] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:37 2021] DELETE /identity/v3/users/b150c13092b94b289cdd0ecffcba15a3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:38.286045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:38.286537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:38.286622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:38.305102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:38.306344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:38.366320 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3980/7860] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:38.377076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:38.379535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:38.437448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa37e4-f829-4511-8d43-a81b30e48f63 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:38.441014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:38.441702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:38.441980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:38.442250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:38.452432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:38.453910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:38.464218 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3881/7861] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:38.906171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:38.907633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:38.919882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2066d-384e-4d66-9cbe-141514bfac32 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:38.925668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:38.926633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:38.927027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:38.927568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] PATH_INFO: `/v3/projects/99114e98ebab4f59a23191455e14fa85` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:38.929966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99114e98ebab4f59a23191455e14fa85)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:38.931930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:39.128539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99114e98ebab4f59a23191455e14fa85', 'request_id': 'req-60490afb-0a7b-459c-9ff4-9b7237a98258'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.207631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99114e98ebab4f59a23191455e14fa85', 'request_id': 'req-60490afb-0a7b-459c-9ff4-9b7237a98258'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.215169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99114e98ebab4f59a23191455e14fa85', 'request_id': 'req-60490afb-0a7b-459c-9ff4-9b7237a98258'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.225401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] The token cache is being invalidate because project 99114e98ebab4f59a23191455e14fa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:39.225688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.226384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.227943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3981/7862] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:38 2021] DELETE /identity/v3/projects/99114e98ebab4f59a23191455e14fa85 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:39.231882 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:39.242379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12cd9-8fe0-4660-8697-a77b84832fa7 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:39.300356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:39.301278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:39.301564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:39.301842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] PATH_INFO: `/v3/users/555f1199a90f4b08a5d4fd735ba513c6` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:39.303678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555f1199a90f4b08a5d4fd735ba513c6)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:39.305625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:39.480441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555f1199a90f4b08a5d4fd735ba513c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.487067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555f1199a90f4b08a5d4fd735ba513c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.498649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555f1199a90f4b08a5d4fd735ba513c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.499342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555f1199a90f4b08a5d4fd735ba513c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.499956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-953735fc-bec1-4b28-90ac-8f71aedad7e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555f1199a90f4b08a5d4fd735ba513c6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:39.596221 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3882/7863] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:39 2021] DELETE /identity/v3/users/555f1199a90f4b08a5d4fd735ba513c6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:40.027339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:40.028807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:40.045651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60490afb-0a7b-459c-9ff4-9b7237a98258 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:40.104896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:40.105774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.106052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.106327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] PATH_INFO: `/v3/projects/0d65ef06241d43b882895e4979969ead` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.107534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d65ef06241d43b882895e4979969ead)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:40.109547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:40.260071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d65ef06241d43b882895e4979969ead', 'request_id': 'req-820b4a5d-c467-4aea-99a6-c07690ffb10b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:40.373584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d65ef06241d43b882895e4979969ead', 'request_id': 'req-820b4a5d-c467-4aea-99a6-c07690ffb10b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:40.389180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d65ef06241d43b882895e4979969ead', 'request_id': 'req-820b4a5d-c467-4aea-99a6-c07690ffb10b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:40.393877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] The token cache is being invalidate because project 0d65ef06241d43b882895e4979969ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:40.394177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:40.394942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-820b4a5d-c467-4aea-99a6-c07690ffb10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:40.397239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3982/7864] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:40 2021] DELETE /identity/v3/projects/0d65ef06241d43b882895e4979969ead => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:40.408293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cced6-56b0-4022-9923-08ac4296c03e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.408774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cced6-56b0-4022-9923-08ac4296c03e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.408906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cced6-56b0-4022-9923-08ac4296c03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.426565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8b7cced6-56b0-4022-9923-08ac4296c03e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:40.427797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b7cced6-56b0-4022-9923-08ac4296c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:40.490464 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3883/7865] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:39:40.498545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086dfa-4a8f-4cbb-a7d5-59252f9ec48b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.498848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086dfa-4a8f-4cbb-a7d5-59252f9ec48b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.499225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086dfa-4a8f-4cbb-a7d5-59252f9ec48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.518862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ae086dfa-4a8f-4cbb-a7d5-59252f9ec48b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:40.520059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ae086dfa-4a8f-4cbb-a7d5-59252f9ec48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:40.529330 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3983/7866] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:40.533583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cced6-56b0-4022-9923-08ac4296c03e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:40.543540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cced6-56b0-4022-9923-08ac4296c03e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:40.548167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:40.548816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.549128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.549425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.550162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:39:40.550470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:40.552068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:40.563407 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3884/7867] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:39:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:39:40.567700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086dfa-4a8f-4cbb-a7d5-59252f9ec48b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:40.577591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae086dfa-4a8f-4cbb-a7d5-59252f9ec48b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:40.582486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:40.583143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.583429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.583705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.585068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:40.586992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:40.668801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3984/7868] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:40 2021] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:40.673290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:40.683417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e920a2-759e-41b8-be8a-010df0f82139 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:40.745676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:40.746266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.746547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.746821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.747526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:40.749496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:40.872267 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3885/7869] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:40 2021] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:39:40.876414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:40.894064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c3b44-539c-4be0-943b-725aa5a813c9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:40.899495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:40.900187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.905424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.905424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.905424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:40.905424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:40.918852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3985/7870] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:39:40.920507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:40.937750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2cf29-6305-44a5-87be-023407a33f73 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:40.942697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d78379-32ba-4d79-ad10-19db61906a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:40.943506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78379-32ba-4d79-ad10-19db61906a3c admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:40.943902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78379-32ba-4d79-ad10-19db61906a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:40.944278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78379-32ba-4d79-ad10-19db61906a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:40.945186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d78379-32ba-4d79-ad10-19db61906a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:40.946968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d78379-32ba-4d79-ad10-19db61906a3c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:40.978338 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3886/7871] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:40 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:39:40.979645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:40.992137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fa9fc-9d0b-4074-8a0d-cf76ef3bbd8b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:41.001579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:41.002609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.002991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.003342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] PATH_INFO: `/v3/projects/44a445a4912b4f489dac9933565ee6ef/users/a79b23756fc6451cbe2f8c2e4d9160d2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.019028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a445a4912b4f489dac9933565ee6ef, user_id=a79b23756fc6451cbe2f8c2e4d9160d2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:41.022263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:41.117987 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3986/7872] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:40 2021] PUT /identity/v3/projects/44a445a4912b4f489dac9933565ee6ef/users/a79b23756fc6451cbe2f8c2e4d9160d2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:41.129248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782115b-bdbc-41c5-8a22-99fcb3feb596 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.129718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782115b-bdbc-41c5-8a22-99fcb3feb596 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.130102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782115b-bdbc-41c5-8a22-99fcb3feb596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.160411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5782115b-bdbc-41c5-8a22-99fcb3feb596 None None] MFA Rules not processed for user `a79b23756fc6451cbe2f8c2e4d9160d2`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:41.161769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5782115b-bdbc-41c5-8a22-99fcb3feb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:41.224480 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3887/7873] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:41 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:41.229436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:41.292376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d42d5-7fad-4b4d-8e8f-56c3db54ad92 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:41.297084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:41.297814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.298021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.298296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.299133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:41.301559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:41.440868 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3987/7874] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:41 2021] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:41.445894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782115b-bdbc-41c5-8a22-99fcb3feb596 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:41.458152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782115b-bdbc-41c5-8a22-99fcb3feb596 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:41.517091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:41.518580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.518580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.518580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.519086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:41.521255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:41.633290 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3888/7875] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:41 2021] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:39:41.639601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:41.654712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da702422-6cce-4127-9c01-ae28f7afc8ad admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:41.660117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:41.660779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.661095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.661377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.662110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:41.663777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:41.674418 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3988/7876] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:41.679200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:41.689498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60d351-6ed5-4582-9c50-eb769ec4ec98 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:41.694992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:41.695888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.696168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.696781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] PATH_INFO: `/v3/projects/b43dbf5a479148939034f3e0949554c5/users/e002012bb06b4dcbbde61b6e6bab7e80/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.711448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43dbf5a479148939034f3e0949554c5, user_id=e002012bb06b4dcbbde61b6e6bab7e80, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:41.714123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:41.811711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3889/7877] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:41 2021] PUT /identity/v3/projects/b43dbf5a479148939034f3e0949554c5/users/e002012bb06b4dcbbde61b6e6bab7e80/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:39:41.815678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:41.826466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e8747-a335-492b-8bf2-84d6aba41dac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:41.884520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d065-5311-4d39-93b9-d1a677b8bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:41.885225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d065-5311-4d39-93b9-d1a677b8bab4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.885503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d065-5311-4d39-93b9-d1a677b8bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.885805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d065-5311-4d39-93b9-d1a677b8bab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.886526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d065-5311-4d39-93b9-d1a677b8bab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:41.888119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d065-5311-4d39-93b9-d1a677b8bab4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:41.898876 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3989/7878] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:41 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:41.903176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:41.913470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda759d-b71c-4aa7-9e8e-d6040ee4f3b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:41.918354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:41.919250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.919531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.919813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] PATH_INFO: `/v3/projects/b43dbf5a479148939034f3e0949554c5/users/e002012bb06b4dcbbde61b6e6bab7e80/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.921977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43dbf5a479148939034f3e0949554c5, user_id=e002012bb06b4dcbbde61b6e6bab7e80, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:41.924594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:41.937466 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3890/7879] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:41 2021] PUT /identity/v3/projects/b43dbf5a479148939034f3e0949554c5/users/e002012bb06b4dcbbde61b6e6bab7e80/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:41.951078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadff2c-0568-403b-a573-df7d27c8ac87 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:41.951078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadff2c-0568-403b-a573-df7d27c8ac87 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:41.951078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadff2c-0568-403b-a573-df7d27c8ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:41.981623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-aeadff2c-0568-403b-a573-df7d27c8ac87 None None] MFA Rules not processed for user `e002012bb06b4dcbbde61b6e6bab7e80`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:41.983152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-aeadff2c-0568-403b-a573-df7d27c8ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:42.060199 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3990/7880] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:41 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:42.070980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:42.072642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:42.146131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da438cbe-c2e9-47cf-bd8d-5cd49ee9f192 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:42.149951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1661f-b9bb-49fa-aceb-5aadca504a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:42.150709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1661f-b9bb-49fa-aceb-5aadca504a82 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:42.151127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1661f-b9bb-49fa-aceb-5aadca504a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:42.151422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1661f-b9bb-49fa-aceb-5aadca504a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:42.162918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1661f-b9bb-49fa-aceb-5aadca504a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:42.164636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1661f-b9bb-49fa-aceb-5aadca504a82 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:42.174759 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3891/7881] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:42 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:43.570513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadff2c-0568-403b-a573-df7d27c8ac87 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:43.631416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadff2c-0568-403b-a573-df7d27c8ac87 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:43.636223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:43.638375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:43.638935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:43.639211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] PATH_INFO: `/v3/users/a79b23756fc6451cbe2f8c2e4d9160d2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:43.640473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79b23756fc6451cbe2f8c2e4d9160d2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:43.642456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:43.819112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79b23756fc6451cbe2f8c2e4d9160d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:43.826348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79b23756fc6451cbe2f8c2e4d9160d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:43.841047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79b23756fc6451cbe2f8c2e4d9160d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:43.841929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79b23756fc6451cbe2f8c2e4d9160d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:43.968150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79b23756fc6451cbe2f8c2e4d9160d2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:43.976636 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3991/7882] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:43 2021] DELETE /identity/v3/users/a79b23756fc6451cbe2f8c2e4d9160d2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:43.981332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73b6c-bad6-40cd-b146-cf69b2de3a78 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:43.981889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73b6c-bad6-40cd-b146-cf69b2de3a78 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:43.982076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73b6c-bad6-40cd-b146-cf69b2de3a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:44.003971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1de73b6c-bad6-40cd-b146-cf69b2de3a78 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:44.008966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1de73b6c-bad6-40cd-b146-cf69b2de3a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:44.074252 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3892/7883] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:44.085275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:44.086691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:44.161478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eb9e7-93da-4d0e-8be8-730370459191 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:44.166133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:44.167028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:44.167380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:44.167579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:44.183998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:44.185843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:44.202891 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3992/7884] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:44.708130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73b6c-bad6-40cd-b146-cf69b2de3a78 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:44.720323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73b6c-bad6-40cd-b146-cf69b2de3a78 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:44.724636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:44.725636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:44.726074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:44.726529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:44.728915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:44.743994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:44.746032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:44.768445 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3893/7885] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:45.048401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:45.049761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:45.063520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d038ad-c968-403c-a1c7-92f51c137e78 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:45.071115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:45.072292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:45.072741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:45.073201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] PATH_INFO: `/v3/projects/44a445a4912b4f489dac9933565ee6ef` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:45.074667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a445a4912b4f489dac9933565ee6ef)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:45.076825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:45.226051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a445a4912b4f489dac9933565ee6ef', 'request_id': 'req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.370203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a445a4912b4f489dac9933565ee6ef', 'request_id': 'req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.378638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a445a4912b4f489dac9933565ee6ef', 'request_id': 'req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.390880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] The token cache is being invalidate because project 44a445a4912b4f489dac9933565ee6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:45.391162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.391995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.394095 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3993/7886] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:45 2021] DELETE /identity/v3/projects/44a445a4912b4f489dac9933565ee6ef => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:45.398214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:45.408739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499c47-a4c2-4b73-bc5b-5530ec94cdbb service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:45.481501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:45.482416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:45.482774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:45.483567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] PATH_INFO: `/v3/users/e002012bb06b4dcbbde61b6e6bab7e80` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:45.484814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e002012bb06b4dcbbde61b6e6bab7e80)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:45.488222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:45.732525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e002012bb06b4dcbbde61b6e6bab7e80'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.741253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e002012bb06b4dcbbde61b6e6bab7e80'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.753759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e002012bb06b4dcbbde61b6e6bab7e80'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.754590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e002012bb06b4dcbbde61b6e6bab7e80'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.755366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-ac5ddfea-1096-4b5a-8049-7c7a0ebc0cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e002012bb06b4dcbbde61b6e6bab7e80'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:45.846308 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3894/7887] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:45 2021] DELETE /identity/v3/users/e002012bb06b4dcbbde61b6e6bab7e80 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:46.429136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:46.436735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:46.451734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aca64b-aa9a-4c5e-8000-19c5c1fcd014 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:46.552589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:46.554154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:46.554546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:46.555297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] PATH_INFO: `/v3/projects/b43dbf5a479148939034f3e0949554c5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:46.556464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43dbf5a479148939034f3e0949554c5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:46.558518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:46.730349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43dbf5a479148939034f3e0949554c5', 'request_id': 'req-df08ff38-fdd9-48f4-9a93-46893d85d29f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:46.861564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43dbf5a479148939034f3e0949554c5', 'request_id': 'req-df08ff38-fdd9-48f4-9a93-46893d85d29f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:46.871082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43dbf5a479148939034f3e0949554c5', 'request_id': 'req-df08ff38-fdd9-48f4-9a93-46893d85d29f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:46.901776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] The token cache is being invalidate because project b43dbf5a479148939034f3e0949554c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:46.902434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:46.903187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-df08ff38-fdd9-48f4-9a93-46893d85d29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:46.904847 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3994/7888] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:46 2021] DELETE /identity/v3/projects/b43dbf5a479148939034f3e0949554c5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:46.910668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c30d9-a6ed-4208-9227-5b4fd4dd843a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:46.911140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c30d9-a6ed-4208-9227-5b4fd4dd843a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:46.911651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c30d9-a6ed-4208-9227-5b4fd4dd843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:46.935324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-020c30d9-a6ed-4208-9227-5b4fd4dd843a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:46.938469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-020c30d9-a6ed-4208-9227-5b4fd4dd843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:47.091970 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3895/7889] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:47.095854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbad12-265e-4a8f-8bc3-dbe22c46fd95 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:47.097476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbad12-265e-4a8f-8bc3-dbe22c46fd95 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:47.097923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbad12-265e-4a8f-8bc3-dbe22c46fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:47.149035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-01bbad12-265e-4a8f-8bc3-dbe22c46fd95 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:47.154595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01bbad12-265e-4a8f-8bc3-dbe22c46fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:47.184249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c30d9-a6ed-4208-9227-5b4fd4dd843a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:47.196989 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3995/7890] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:47.198148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c30d9-a6ed-4208-9227-5b4fd4dd843a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:47.203904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:47.204798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:47.205272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:47.205703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:47.206588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:39:47.207079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:47.213876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:47.223345 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3896/7891] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:39:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:39:47.227695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbad12-265e-4a8f-8bc3-dbe22c46fd95 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:47.237170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbad12-265e-4a8f-8bc3-dbe22c46fd95 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:47.260585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:47.260585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:47.260585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:47.260585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:47.260977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:47.260977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:47.411842 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3996/7892] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:47 2021] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:47.416869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:47.427320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f3a4-cb0d-4395-b4ca-61740f0ae8e7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:47.583469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:47.585392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:47.585857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:47.586307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:47.587295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:47.590429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:47.737966 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3897/7893] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:47 2021] POST /identity/v3/users => generated 291 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:47.739150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:47.750238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3493cfa-5dc1-4861-9fa8-37e58301eca3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:47.755522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:47.757070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:47.757657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:47.758140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:47.759116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:47.760977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:47.773395 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3997/7894] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:47.778478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:47.788463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edce315-7397-4d66-93e3-8f1323060eae admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:47.805560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b52bf-4b6c-40a1-9f8d-539dc82a6696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:47.806326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b52bf-4b6c-40a1-9f8d-539dc82a6696 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:47.806680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b52bf-4b6c-40a1-9f8d-539dc82a6696 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:47.807079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b52bf-4b6c-40a1-9f8d-539dc82a6696 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:47.807997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b52bf-4b6c-40a1-9f8d-539dc82a6696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:47.809608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b52bf-4b6c-40a1-9f8d-539dc82a6696 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:47.824570 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3898/7895] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:47 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:39:47.828661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:47.839635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddb30d-9120-4e91-b4a6-da97ae398ea3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:47.847399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:47.848587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:47.849257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:47.850337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] PATH_INFO: `/v3/projects/335f72451e144726b34d17ebd3de3e1d/users/90e3c9daa5994a798299a1cfbbb12304/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:47.869031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=335f72451e144726b34d17ebd3de3e1d, user_id=90e3c9daa5994a798299a1cfbbb12304, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:47.872285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:47.974142 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3998/7896] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:47 2021] PUT /identity/v3/projects/335f72451e144726b34d17ebd3de3e1d/users/90e3c9daa5994a798299a1cfbbb12304/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:48.072118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ca841-d811-49e9-af54-eeed82a24092 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:48.072593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ca841-d811-49e9-af54-eeed82a24092 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:48.072713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ca841-d811-49e9-af54-eeed82a24092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:48.125639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fb2ca841-d811-49e9-af54-eeed82a24092 None None] MFA Rules not processed for user `90e3c9daa5994a798299a1cfbbb12304`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:48.128257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fb2ca841-d811-49e9-af54-eeed82a24092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:48.237413 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3899/7897] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:48.242736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:48.320300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fcab0-65b7-415f-a61f-b021272ca75f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:48.325525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:48.326209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:48.326492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:48.326760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:48.327476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:48.329821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:48.533055 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 3999/7898] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:48 2021] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:48.536716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ca841-d811-49e9-af54-eeed82a24092 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:48.552839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ca841-d811-49e9-af54-eeed82a24092 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:48.656555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:48.657462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:48.658042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:48.658875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:48.659858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:48.663228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:48.765607 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3900/7899] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:48 2021] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:39:48.769286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:48.780704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038dfb-9032-4680-85b6-ad0414474fda admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:48.786227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:48.787641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:48.788074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:48.788353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:48.789687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:48.791314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:48.812343 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4000/7900] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:39:48.818787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:48.840719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdb61c-fdb8-4b6c-8038-86ae08d09537 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:48.849131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:48.851751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:48.852182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:48.852525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] PATH_INFO: `/v3/projects/1adde6bcac0041a2b698a828b8c6f39b/users/047a33596aab4f8d8c1fb58b2f0b894b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:48.888306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adde6bcac0041a2b698a828b8c6f39b, user_id=047a33596aab4f8d8c1fb58b2f0b894b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:48.894206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:49.033188 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3901/7901] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:48 2021] PUT /identity/v3/projects/1adde6bcac0041a2b698a828b8c6f39b/users/047a33596aab4f8d8c1fb58b2f0b894b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:49.037252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:49.052013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea3012-1fa7-4061-87bb-8e9458d8f3cd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:49.190395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21864fce-1d85-48c6-88c6-2977bec6d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:49.191786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21864fce-1d85-48c6-88c6-2977bec6d5fa admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:49.192212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21864fce-1d85-48c6-88c6-2977bec6d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:49.192492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21864fce-1d85-48c6-88c6-2977bec6d5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:49.193587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21864fce-1d85-48c6-88c6-2977bec6d5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:49.195278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21864fce-1d85-48c6-88c6-2977bec6d5fa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:49.220673 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4001/7902] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:39:49.221976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:49.236375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08961-29b5-4075-bb70-890c502b3eed admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:49.250012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:49.251254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:49.255055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:49.255055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] PATH_INFO: `/v3/projects/1adde6bcac0041a2b698a828b8c6f39b/users/047a33596aab4f8d8c1fb58b2f0b894b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:49.258716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adde6bcac0041a2b698a828b8c6f39b, user_id=047a33596aab4f8d8c1fb58b2f0b894b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:49.282801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:49.300015 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3902/7903] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:49 2021] PUT /identity/v3/projects/1adde6bcac0041a2b698a828b8c6f39b/users/047a33596aab4f8d8c1fb58b2f0b894b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:49.310469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a818c-539e-44f7-b597-7ca348896846 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:49.310812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a818c-539e-44f7-b597-7ca348896846 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:49.311099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a818c-539e-44f7-b597-7ca348896846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:49.343983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6a8a818c-539e-44f7-b597-7ca348896846 None None] MFA Rules not processed for user `047a33596aab4f8d8c1fb58b2f0b894b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:49.345403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6a8a818c-539e-44f7-b597-7ca348896846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:49.420618 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4002/7904] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:49 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:39:49.430694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:49.433779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:49.535846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8a47-ffd7-4e72-a1bb-97a6c3bc30bb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:49.541952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c27c0-015c-47fd-a237-fef319bec5cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:49.542667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c27c0-015c-47fd-a237-fef319bec5cf service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:49.542999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c27c0-015c-47fd-a237-fef319bec5cf service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:49.543463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c27c0-015c-47fd-a237-fef319bec5cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:49.555547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c27c0-015c-47fd-a237-fef319bec5cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:49.557503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c27c0-015c-47fd-a237-fef319bec5cf service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:49.580695 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3903/7905] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:49 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:50.171755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a818c-539e-44f7-b597-7ca348896846 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:50.259941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a818c-539e-44f7-b597-7ca348896846 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:50.265358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:50.266239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:50.266682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:50.266994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] PATH_INFO: `/v3/users/90e3c9daa5994a798299a1cfbbb12304` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:50.268439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e3c9daa5994a798299a1cfbbb12304)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:50.270417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:50.443876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e3c9daa5994a798299a1cfbbb12304'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:50.451029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e3c9daa5994a798299a1cfbbb12304'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:50.463452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e3c9daa5994a798299a1cfbbb12304'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:50.464204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e3c9daa5994a798299a1cfbbb12304'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:50.550975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e3c9daa5994a798299a1cfbbb12304'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:50.557723 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4003/7906] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:50 2021] DELETE /identity/v3/users/90e3c9daa5994a798299a1cfbbb12304 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:50.562190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:50.562662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:50.562746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:50.580683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:50.581913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:50.648843 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3904/7907] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:39:50.662761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:50.664187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:50.735077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229bdaa-6305-4a5d-a7bb-e4859e04e5e9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:50.738848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:50.739495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:50.739770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:50.740573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:50.750072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:50.751744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:50.761718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4004/7908] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:51.321838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:51.323348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:51.352149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdcb17-66ab-46d8-89a3-7d9dbd872141 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:51.377813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:51.379002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:51.379288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:51.379562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] PATH_INFO: `/v3/projects/335f72451e144726b34d17ebd3de3e1d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:51.381123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335f72451e144726b34d17ebd3de3e1d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:51.383036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:51.541749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335f72451e144726b34d17ebd3de3e1d', 'request_id': 'req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:51.550958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335f72451e144726b34d17ebd3de3e1d', 'request_id': 'req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:51.683818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335f72451e144726b34d17ebd3de3e1d', 'request_id': 'req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:51.702004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] The token cache is being invalidate because project 335f72451e144726b34d17ebd3de3e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:51.702295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:51.702960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:51.705168 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3905/7909] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:51 2021] DELETE /identity/v3/projects/335f72451e144726b34d17ebd3de3e1d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:51.708946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:51.720613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db01d-b9da-4b2a-b934-99729214de0b service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:51.790143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:51.791052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:51.791336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:51.791638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] PATH_INFO: `/v3/users/047a33596aab4f8d8c1fb58b2f0b894b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:51.794335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=047a33596aab4f8d8c1fb58b2f0b894b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:51.796284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:52.091367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047a33596aab4f8d8c1fb58b2f0b894b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:52.098779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047a33596aab4f8d8c1fb58b2f0b894b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:52.111877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047a33596aab4f8d8c1fb58b2f0b894b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:52.112637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047a33596aab4f8d8c1fb58b2f0b894b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:52.219448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-10a52fdd-b0ff-45c2-ab70-b783babd0c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047a33596aab4f8d8c1fb58b2f0b894b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:52.226891 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4005/7910] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:51 2021] DELETE /identity/v3/users/047a33596aab4f8d8c1fb58b2f0b894b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:52.852610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:52.854210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:52.874599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00a8d0-5e7e-4dd3-ab3e-d120f39a9089 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:52.954185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:52.955306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:52.955589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:52.955861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] PATH_INFO: `/v3/projects/1adde6bcac0041a2b698a828b8c6f39b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:52.957243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1adde6bcac0041a2b698a828b8c6f39b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:52.959744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:53.133468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1adde6bcac0041a2b698a828b8c6f39b', 'request_id': 'req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:53.141058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1adde6bcac0041a2b698a828b8c6f39b', 'request_id': 'req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:53.225760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1adde6bcac0041a2b698a828b8c6f39b', 'request_id': 'req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:53.239949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] The token cache is being invalidate because project 1adde6bcac0041a2b698a828b8c6f39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:53.240532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:53.241271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c0bf2d3a-bfba-4825-97a0-43d55d6d2fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:53.242919 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3906/7911] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:52 2021] DELETE /identity/v3/projects/1adde6bcac0041a2b698a828b8c6f39b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:53.249469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13228e3-6b2a-4db6-8d8f-ef352176e710 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.250443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13228e3-6b2a-4db6-8d8f-ef352176e710 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.250735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13228e3-6b2a-4db6-8d8f-ef352176e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.280499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a13228e3-6b2a-4db6-8d8f-ef352176e710 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:53.281759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a13228e3-6b2a-4db6-8d8f-ef352176e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:53.343853 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4006/7912] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:53.352352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b142-a9da-4d5b-8e5e-03670c2443be None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.352639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b142-a9da-4d5b-8e5e-03670c2443be None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.352938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b142-a9da-4d5b-8e5e-03670c2443be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.376291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1290b142-a9da-4d5b-8e5e-03670c2443be None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:53.377758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1290b142-a9da-4d5b-8e5e-03670c2443be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:53.386187 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3907/7913] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:53.398588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13228e3-6b2a-4db6-8d8f-ef352176e710 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:53.410410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13228e3-6b2a-4db6-8d8f-ef352176e710 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:53.416396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:53.425722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.425722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.425722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.425722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:39:53.425722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:53.425722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:53.438007 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4007/7914] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:39:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:39:53.439242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b142-a9da-4d5b-8e5e-03670c2443be None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:53.448547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b142-a9da-4d5b-8e5e-03670c2443be None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:53.453439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:53.454184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.454462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.454878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.455835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:53.457912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:53.544707 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3908/7915] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:39:53 2021] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:39:53.548757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:53.558926 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7db52-2cac-4df4-88c0-d05612cf704b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:53.645850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:53.647450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.647730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.651770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.651770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:53.651770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:53.754864 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4008/7916] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:39:53 2021] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:39:53.756586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:53.767017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b174bc0-cc84-4323-a1d4-cdac984c17d7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:53.773112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:53.773112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.773112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.773361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.774068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:53.775824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:53.792112 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3909/7917] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:53.793502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:53.805101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f53c7-5fc6-4919-a7e7-17a06ce37118 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:53.810299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6663d2-dfec-43cf-ae9e-4b6bf44efcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:53.811348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6663d2-dfec-43cf-ae9e-4b6bf44efcaf admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.812129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6663d2-dfec-43cf-ae9e-4b6bf44efcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.812414 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6663d2-dfec-43cf-ae9e-4b6bf44efcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.813969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6663d2-dfec-43cf-ae9e-4b6bf44efcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:53.819035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6663d2-dfec-43cf-ae9e-4b6bf44efcaf admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:53.827707 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4009/7918] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:39:53.831759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:53.842258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b70c5-b9de-4c56-8e54-f502f774df3a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:53.846974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:53.847893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.848325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.848748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] PATH_INFO: `/v3/projects/2a6f7f2d4b1243369e6e2a101f68557c/users/0b6c0fe828da4c18ae9764400f30740d/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:53.869635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6f7f2d4b1243369e6e2a101f68557c, user_id=0b6c0fe828da4c18ae9764400f30740d, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:53.872409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:53.987291 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3910/7919] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:39:53 2021] PUT /identity/v3/projects/2a6f7f2d4b1243369e6e2a101f68557c/users/0b6c0fe828da4c18ae9764400f30740d/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:39:53.998362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:53.998796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:53.999195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:54.031603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] MFA Rules not processed for user `0b6c0fe828da4c18ae9764400f30740d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:54.031603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:54.098642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4010/7920] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:53 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:39:54.109097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:54.114370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:54.172114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db3c08-5dbb-49cf-ad0b-aad43af3bcac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:54.175547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:54.176075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:54.176359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:54.176638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:54.186479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:54.187131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:54.188009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:54.188596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:54.201318 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3911/7921] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:39:54 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:39:54.263903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb46b3-e4cc-4e46-8786-53b33e581780 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:54.268722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:54.269632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:54.269913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:54.270210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] PATH_INFO: `/v3/users/171c198b6b734cd698b3c1eaf76a0234` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:54.271427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=171c198b6b734cd698b3c1eaf76a0234)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:54.273375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:54.853618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171c198b6b734cd698b3c1eaf76a0234'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:54.861194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171c198b6b734cd698b3c1eaf76a0234'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:54.873848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171c198b6b734cd698b3c1eaf76a0234'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:54.874555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171c198b6b734cd698b3c1eaf76a0234'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:54.968392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171c198b6b734cd698b3c1eaf76a0234'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:54.975410 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4011/7922] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:54 2021] DELETE /identity/v3/users/171c198b6b734cd698b3c1eaf76a0234 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:55.295716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:55.308934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e527e3-61d0-4aa3-a5b5-b810fbaa42b6 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:55.369911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:55.370978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:55.371260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:55.371535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] PATH_INFO: `/v3/projects/c77dc74a46d64a67991d82bf12adb1dc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:55.372746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77dc74a46d64a67991d82bf12adb1dc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:55.374695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:55.508117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77dc74a46d64a67991d82bf12adb1dc', 'request_id': 'req-883a5d7d-6119-4a87-b27d-5090c4e4afa5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:55.514494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77dc74a46d64a67991d82bf12adb1dc', 'request_id': 'req-883a5d7d-6119-4a87-b27d-5090c4e4afa5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:55.608109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77dc74a46d64a67991d82bf12adb1dc', 'request_id': 'req-883a5d7d-6119-4a87-b27d-5090c4e4afa5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:55.620623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] The token cache is being invalidate because project c77dc74a46d64a67991d82bf12adb1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:55.620963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:55.621617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:55.623200 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3912/7923] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:55 2021] DELETE /identity/v3/projects/c77dc74a46d64a67991d82bf12adb1dc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:55.627268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:55.628832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:55.643179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a50c6-e0ac-408b-812e-96789def1531 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:55.717378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:55.718275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:55.718541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:55.718844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] PATH_INFO: `/v3/users/3f7bfbe1464a4466b395dbc35592d7dd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:55.720136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7bfbe1464a4466b395dbc35592d7dd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:55.722222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:55.989296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7bfbe1464a4466b395dbc35592d7dd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:55.996182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7bfbe1464a4466b395dbc35592d7dd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.007773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7bfbe1464a4466b395dbc35592d7dd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.008477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7bfbe1464a4466b395dbc35592d7dd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.061168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-bb65a57f-aa15-4109-a1b1-790a508dc3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7bfbe1464a4466b395dbc35592d7dd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.067713 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4012/7924] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:39:55 2021] DELETE /identity/v3/users/3f7bfbe1464a4466b395dbc35592d7dd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:39:56.308173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:39:56.309812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:56.328437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a5d7d-6119-4a87-b27d-5090c4e4afa5 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:39:56.388136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:39:56.389288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:56.389574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:56.389852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] PATH_INFO: `/v3/projects/682ce12dc98b4f82b95ff686c0e788d8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:56.391091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=682ce12dc98b4f82b95ff686c0e788d8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:39:56.393060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:39:56.536200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682ce12dc98b4f82b95ff686c0e788d8', 'request_id': 'req-0679bbf7-553f-4553-aaa8-3706ae2c9e00'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.542832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682ce12dc98b4f82b95ff686c0e788d8', 'request_id': 'req-0679bbf7-553f-4553-aaa8-3706ae2c9e00'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.638394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682ce12dc98b4f82b95ff686c0e788d8', 'request_id': 'req-0679bbf7-553f-4553-aaa8-3706ae2c9e00'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.651189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] The token cache is being invalidate because project 682ce12dc98b4f82b95ff686c0e788d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:39:56.651472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.652094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:39:56.653664 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3913/7925] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:39:56 2021] DELETE /identity/v3/projects/682ce12dc98b4f82b95ff686c0e788d8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:39:58.398714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:39:58.399265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:39:58.399377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:39:58.416937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] MFA Rules not processed for user `0b6c0fe828da4c18ae9764400f30740d`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:39:58.418141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:39:58.471718 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4013/7926] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:39:58 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:08.797237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:08.798755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:08.885562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679bbf7-553f-4553-aaa8-3706ae2c9e00 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:08.890998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:08.891642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:08.891980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:08.892199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:08.894003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:08.908256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:08.909850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:08.922699 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3914/7927] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:40:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:40:20.307729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:20.309361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:20.384298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03ed4c-d361-4ac3-8b54-15687fa26457 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:20.389036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:20.389477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:20.389762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:20.390045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:20.391871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:20.467785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:20.469353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:20.480917 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4014/7928] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:40:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:40:30.818763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:30.820222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:30.839672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fab07-6284-4c9d-9442-b82c41af7274 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:30.844447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:30.846637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:30.846637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:30.847143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] PATH_INFO: `/v3/users/0d9b0c5962544b66b24db53b7e9b8333` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:30.848359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9b0c5962544b66b24db53b7e9b8333)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:30.850296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:31.034918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9b0c5962544b66b24db53b7e9b8333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.042142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9b0c5962544b66b24db53b7e9b8333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.054526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9b0c5962544b66b24db53b7e9b8333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.055042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9b0c5962544b66b24db53b7e9b8333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.055659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9b0c5962544b66b24db53b7e9b8333'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.142566 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3915/7929] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:40:30 2021] DELETE /identity/v3/users/0d9b0c5962544b66b24db53b7e9b8333 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:31.398835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:31.415755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba574-c5b4-4137-aeda-a4c157073893 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:31.480545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:31.481796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:31.483548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:31.483548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] PATH_INFO: `/v3/projects/980165331b334d7795b91adc96459725` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:31.483727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980165331b334d7795b91adc96459725)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:31.485649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:31.604017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980165331b334d7795b91adc96459725', 'request_id': 'req-fff9c588-b00e-4404-a852-17416e1a3e04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.666432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980165331b334d7795b91adc96459725', 'request_id': 'req-fff9c588-b00e-4404-a852-17416e1a3e04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.673333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980165331b334d7795b91adc96459725', 'request_id': 'req-fff9c588-b00e-4404-a852-17416e1a3e04'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.683807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] The token cache is being invalidate because project 980165331b334d7795b91adc96459725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:40:31.684091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.684743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:31.686389 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4015/7930] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:40:31 2021] DELETE /identity/v3/projects/980165331b334d7795b91adc96459725 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:31.690478 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:31.691980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:31.706846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16049df4-c4e4-4b6b-9eaa-482323e5cd86 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:31.767843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:31.769219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:31.769720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:31.770226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] PATH_INFO: `/v3/users/2e1d04230c7b45cab2d2fcb72fb218ad` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:31.785183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1d04230c7b45cab2d2fcb72fb218ad)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:31.787088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:32.033582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1d04230c7b45cab2d2fcb72fb218ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.041151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1d04230c7b45cab2d2fcb72fb218ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.054452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1d04230c7b45cab2d2fcb72fb218ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.055237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1d04230c7b45cab2d2fcb72fb218ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.055850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-2b25dc57-0acf-4a3e-afc0-a9fd7490a215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1d04230c7b45cab2d2fcb72fb218ad'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.134950 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3916/7931] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:40:31 2021] DELETE /identity/v3/users/2e1d04230c7b45cab2d2fcb72fb218ad => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:32.399916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:32.401355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:32.415064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c588-b00e-4404-a852-17416e1a3e04 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:32.486176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:32.487051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:32.487330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:32.487651 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] PATH_INFO: `/v3/projects/fbd3af0654c34dd8b4518ab7708aed91` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:32.499027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd3af0654c34dd8b4518ab7708aed91)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:32.500977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:32.592217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd3af0654c34dd8b4518ab7708aed91', 'request_id': 'req-da2ca390-75b3-4258-9076-414fc5623fef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.678101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd3af0654c34dd8b4518ab7708aed91', 'request_id': 'req-da2ca390-75b3-4258-9076-414fc5623fef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.686111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd3af0654c34dd8b4518ab7708aed91', 'request_id': 'req-da2ca390-75b3-4258-9076-414fc5623fef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.696166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] The token cache is being invalidate because project fbd3af0654c34dd8b4518ab7708aed91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:40:32.696456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.697104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-da2ca390-75b3-4258-9076-414fc5623fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:32.698630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4016/7932] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:40:32 2021] DELETE /identity/v3/projects/fbd3af0654c34dd8b4518ab7708aed91 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:32.704354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230ffb-2ae6-49b6-a9a2-07da27aa62b1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:32.704666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230ffb-2ae6-49b6-a9a2-07da27aa62b1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:32.704962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230ffb-2ae6-49b6-a9a2-07da27aa62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:32.722552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2d230ffb-2ae6-49b6-a9a2-07da27aa62b1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:32.723768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2d230ffb-2ae6-49b6-a9a2-07da27aa62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:32.784273 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3917/7933] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:32.792703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64690eba-4ee3-4f5a-85ca-a8e9ff7c30a8 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:32.793083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64690eba-4ee3-4f5a-85ca-a8e9ff7c30a8 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:32.793377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64690eba-4ee3-4f5a-85ca-a8e9ff7c30a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:32.813312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-64690eba-4ee3-4f5a-85ca-a8e9ff7c30a8 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:32.814867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-64690eba-4ee3-4f5a-85ca-a8e9ff7c30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:32.823162 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4017/7934] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:32.830785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230ffb-2ae6-49b6-a9a2-07da27aa62b1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:32.841460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230ffb-2ae6-49b6-a9a2-07da27aa62b1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:32.846124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:32.846770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:32.847049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:32.847326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:32.848140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:40:32.848448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:32.850046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:32.865008 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3918/7935] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:40:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:40:32.866735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64690eba-4ee3-4f5a-85ca-a8e9ff7c30a8 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:32.876629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64690eba-4ee3-4f5a-85ca-a8e9ff7c30a8 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:32.881464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:32.882133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:32.882410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:32.882681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:32.883378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:32.885289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:33.022351 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4018/7936] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:40:32 2021] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:40:33.027147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:33.037411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75897-795a-4dd7-b534-8bb1b955c4e4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:33.097565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:33.098251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:33.098541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:33.098817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:33.099611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:33.101580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:33.267849 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3919/7937] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:40:33 2021] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:40:33.271853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:33.283223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dbeef-d7ac-4a48-9427-4884484a993f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:33.289818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:33.289818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:33.289818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:33.290284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:33.291023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:33.292624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:33.308170 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4019/7938] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:40:33.311554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:33.322392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9f22d-525f-4f6c-9a9a-5dc75c748992 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:33.331016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef6d71-d770-4b5a-8228-bfb88275454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:33.331696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef6d71-d770-4b5a-8228-bfb88275454e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:33.332647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef6d71-d770-4b5a-8228-bfb88275454e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:33.332647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef6d71-d770-4b5a-8228-bfb88275454e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:33.333090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef6d71-d770-4b5a-8228-bfb88275454e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:33.334712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef6d71-d770-4b5a-8228-bfb88275454e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:33.346076 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3920/7939] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:40:33.353949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:33.364645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9222-778c-4f03-ba6c-a6525fd09380 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:33.370629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:33.372182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:33.372466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:33.372743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] PATH_INFO: `/v3/projects/fd48d45421c54fe18214db7c64eefb48/users/46e9ab1019684fa1af5351448f486a4f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:33.392014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd48d45421c54fe18214db7c64eefb48, user_id=46e9ab1019684fa1af5351448f486a4f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:33.394732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:33.502234 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4020/7940] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:40:33 2021] PUT /identity/v3/projects/fd48d45421c54fe18214db7c64eefb48/users/46e9ab1019684fa1af5351448f486a4f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:33.508670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d21dd-0806-4034-b2c2-417d273ca60a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:33.508987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d21dd-0806-4034-b2c2-417d273ca60a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:33.509273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d21dd-0806-4034-b2c2-417d273ca60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:33.527943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-657d21dd-0806-4034-b2c2-417d273ca60a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:33.529206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-657d21dd-0806-4034-b2c2-417d273ca60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:33.587646 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3921/7941] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:33.597269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:33.598943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:33.662602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117681d-5912-43d2-9813-9f05aa167620 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:33.666616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc70fb-1dce-414d-99ce-442fc3bf3871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:33.667283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc70fb-1dce-414d-99ce-442fc3bf3871 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:33.667866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc70fb-1dce-414d-99ce-442fc3bf3871 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:33.668171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc70fb-1dce-414d-99ce-442fc3bf3871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:33.677081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc70fb-1dce-414d-99ce-442fc3bf3871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:33.678490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc70fb-1dce-414d-99ce-442fc3bf3871 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:33.688578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4021/7942] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:40:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:40:35.160715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:35.161294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:35.161521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:35.194277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] MFA Rules not processed for user `46e9ab1019684fa1af5351448f486a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:35.196022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:35.273624 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3922/7943] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:35 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:35.278845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0ec0-6b19-46fb-95f0-03b3bc2b7d0d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:35.279387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0ec0-6b19-46fb-95f0-03b3bc2b7d0d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:35.279520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0ec0-6b19-46fb-95f0-03b3bc2b7d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:35.300264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-baaa0ec0-6b19-46fb-95f0-03b3bc2b7d0d None None] MFA Rules not processed for user `46e9ab1019684fa1af5351448f486a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:35.302023 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-baaa0ec0-6b19-46fb-95f0-03b3bc2b7d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:35.313226 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4022/7944] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:35 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:35.326745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:35.328224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:35.423719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42542b02-83db-470a-8874-3be13fe57d73 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:35.430810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:35.432355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:35.432355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:35.432355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:35.440933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:35.442443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:35.453066 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3923/7945] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:40:35 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:40:41.681005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23902-e237-47b7-b885-c421b384ab73 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:41.682387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23902-e237-47b7-b885-c421b384ab73 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:41.682844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23902-e237-47b7-b885-c421b384ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:41.705306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f3b23902-e237-47b7-b885-c421b384ab73 None None] MFA Rules not processed for user `01a07fc3a154483caea95cbd449f3970`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:41.706528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f3b23902-e237-47b7-b885-c421b384ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:41.797885 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4023/7946] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:41 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:49.400129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:49.401679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:49.419737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3ce9b-2d56-4a8c-87b5-9ac369b00779 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:49.425416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:49.426054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:49.426337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:49.426618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:49.428345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:49.442755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:49.444321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:49.457241 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3924/7947] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:40:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:40:56.611231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23902-e237-47b7-b885-c421b384ab73 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:56.627057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23902-e237-47b7-b885-c421b384ab73 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:56.632100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:56.633015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:56.633305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:56.633586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] PATH_INFO: `/v3/users/46e9ab1019684fa1af5351448f486a4f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:56.634990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e9ab1019684fa1af5351448f486a4f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:56.636936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:56.937022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e9ab1019684fa1af5351448f486a4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:56.944799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e9ab1019684fa1af5351448f486a4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:56.960192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e9ab1019684fa1af5351448f486a4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:56.961162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e9ab1019684fa1af5351448f486a4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:57.071798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d5a456bc-6dde-418e-a5a5-e685878a4b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e9ab1019684fa1af5351448f486a4f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:57.078969 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4024/7948] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:40:56 2021] DELETE /identity/v3/users/46e9ab1019684fa1af5351448f486a4f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:57.339760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:57.346374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db975d-124c-4df2-ab4d-4c23e2fdb147 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:57.407147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:57.408014 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:57.408293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:57.408564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] PATH_INFO: `/v3/projects/fd48d45421c54fe18214db7c64eefb48` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:57.409813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd48d45421c54fe18214db7c64eefb48)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:57.411684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:57.558075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd48d45421c54fe18214db7c64eefb48', 'request_id': 'req-14d0548f-5208-4b4b-af40-4401069a90bb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:57.565309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd48d45421c54fe18214db7c64eefb48', 'request_id': 'req-14d0548f-5208-4b4b-af40-4401069a90bb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:57.615390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd48d45421c54fe18214db7c64eefb48', 'request_id': 'req-14d0548f-5208-4b4b-af40-4401069a90bb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:57.627115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] The token cache is being invalidate because project fd48d45421c54fe18214db7c64eefb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:40:57.627401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:57.628225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14d0548f-5208-4b4b-af40-4401069a90bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:40:57.629972 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3925/7949] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:40:57 2021] DELETE /identity/v3/projects/fd48d45421c54fe18214db7c64eefb48 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:57.635947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726932aa-2693-4036-b465-5f70452b3fe0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:57.636478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726932aa-2693-4036-b465-5f70452b3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:57.636478 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726932aa-2693-4036-b465-5f70452b3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:57.655906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-726932aa-2693-4036-b465-5f70452b3fe0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:57.657396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-726932aa-2693-4036-b465-5f70452b3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:57.717600 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4025/7950] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:57.725560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75617787-e21a-40b5-9b47-4a84eab78e2e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:57.725847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75617787-e21a-40b5-9b47-4a84eab78e2e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:57.726153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75617787-e21a-40b5-9b47-4a84eab78e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:57.751733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-75617787-e21a-40b5-9b47-4a84eab78e2e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:57.752985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-75617787-e21a-40b5-9b47-4a84eab78e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:57.761309 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3926/7951] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:57.766047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726932aa-2693-4036-b465-5f70452b3fe0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:57.776243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726932aa-2693-4036-b465-5f70452b3fe0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:57.781506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:57.782203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:57.782633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:57.783361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:57.784100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:40:57.784413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:57.786181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:57.802101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4026/7952] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:40:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:40:57.803245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75617787-e21a-40b5-9b47-4a84eab78e2e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:57.813492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75617787-e21a-40b5-9b47-4a84eab78e2e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:57.818427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:57.819076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:57.819355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:57.819628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:57.820329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:57.822353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:57.892911 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3927/7953] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:40:57 2021] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:40:57.899939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:57.911339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540ffe1-ff5a-4f1d-8c86-9f027bb2534e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:57.970942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:57.973375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:57.973836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:57.974271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:57.975149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:57.977238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:58.113965 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4027/7954] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:40:57 2021] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:40:58.118193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:58.130127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4742-48ba-4820-a415-707395f776a0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:58.142523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:58.144236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:58.144964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:58.145167 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:58.146045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:58.147821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:58.161828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3928/7955] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:40:58 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:40:58.166349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:58.178913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a96bfc-51eb-40ad-9960-80c9a450e564 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:58.184476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1c097-f3ba-4b23-93f9-565173149c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:58.185257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c097-f3ba-4b23-93f9-565173149c0f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:58.185672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c097-f3ba-4b23-93f9-565173149c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:58.185982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c097-f3ba-4b23-93f9-565173149c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:58.186722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c097-f3ba-4b23-93f9-565173149c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:58.188470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c097-f3ba-4b23-93f9-565173149c0f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:58.203433 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4028/7956] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:40:58 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:40:58.207867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:58.219768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f02d1-b2fd-4087-8638-4600c697bd9e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:58.225653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105b9a7-bfe4-4efa-8d80-926d67f40fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:58.226485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b9a7-bfe4-4efa-8d80-926d67f40fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:58.226765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b9a7-bfe4-4efa-8d80-926d67f40fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:58.227059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105b9a7-bfe4-4efa-8d80-926d67f40fc3 admin admin] PATH_INFO: `/v3/projects/f6f76d86ec8a49e0b47607f2cb121c0b/users/4cab838ae2234356981342bba4a2c3e6/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:58.247595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105b9a7-bfe4-4efa-8d80-926d67f40fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f76d86ec8a49e0b47607f2cb121c0b, user_id=4cab838ae2234356981342bba4a2c3e6, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:58.250973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105b9a7-bfe4-4efa-8d80-926d67f40fc3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:58.365129 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3929/7957] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:40:58 2021] PUT /identity/v3/projects/f6f76d86ec8a49e0b47607f2cb121c0b/users/4cab838ae2234356981342bba4a2c3e6/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:40:58.370070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:58.370866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:58.370866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:58.405482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] MFA Rules not processed for user `4cab838ae2234356981342bba4a2c3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:58.406805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:58.488127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4029/7958] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:58.489818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:58.490153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:58.490429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:58.512674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] MFA Rules not processed for user `4cab838ae2234356981342bba4a2c3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:40:58.514786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:58.522911 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3930/7959] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:40:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:40:58.541282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:40:58.542879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:40:58.625220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc3de4-aea7-4b86-b577-41953031afd1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:40:58.632223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0655edc-2c37-4540-9c47-7fc893dc10b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:40:58.632906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0655edc-2c37-4540-9c47-7fc893dc10b4 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:40:58.633259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0655edc-2c37-4540-9c47-7fc893dc10b4 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:40:58.633537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0655edc-2c37-4540-9c47-7fc893dc10b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:40:58.643072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0655edc-2c37-4540-9c47-7fc893dc10b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:40:58.644679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0655edc-2c37-4540-9c47-7fc893dc10b4 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:40:58.654926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4030/7960] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:40:58 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:16.450962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:16.453246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:16.539548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881d7f-4826-43d0-b5b3-3c05f4d21fc6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:16.546019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:16.546660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:16.546936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:16.547208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:16.549077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:16.564027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:16.566049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:16.580626 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3931/7961] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:19.294807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d5c9-e834-4f27-b1c8-d330d49e1267 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:19.295913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d5c9-e834-4f27-b1c8-d330d49e1267 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:19.296014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38d5c9-e834-4f27-b1c8-d330d49e1267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:19.314529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4f38d5c9-e834-4f27-b1c8-d330d49e1267 None None] MFA Rules not processed for user `e8dd3c4dd2344bee986e909d5c45112a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:19.315724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4f38d5c9-e834-4f27-b1c8-d330d49e1267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:19.370822 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4031/7962] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:19 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:30.568776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:30.570209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:30.586509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a477c6-762d-4d6a-aef3-6f596d850da6 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:30.592305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b362b-50ac-4ab3-a7b6-2813b14c0b1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:30.593079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b362b-50ac-4ab3-a7b6-2813b14c0b1f service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:30.593401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b362b-50ac-4ab3-a7b6-2813b14c0b1f service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:30.593711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b362b-50ac-4ab3-a7b6-2813b14c0b1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:30.595718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ca1b362b-50ac-4ab3-a7b6-2813b14c0b1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:30.610055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b362b-50ac-4ab3-a7b6-2813b14c0b1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:30.611626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b362b-50ac-4ab3-a7b6-2813b14c0b1f service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:30.623798 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3932/7963] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:31.317815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc95f1f-39c0-411b-b9bd-01116469833e None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:31.318331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc95f1f-39c0-411b-b9bd-01116469833e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:31.318420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc95f1f-39c0-411b-b9bd-01116469833e None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:31.320159 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4032/7964] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:41:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:41:31.325577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:31.327546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:31.327546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:31.353519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:31.354694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:31.363808 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3933/7965] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:41:31 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:31.384649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc95f1f-39c0-411b-b9bd-01116469833e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:31.400801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc95f1f-39c0-411b-b9bd-01116469833e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:31.405883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:31.406512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:31.407328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:31.407577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:31.416580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:31.418262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:31.436923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4033/7966] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:35.138640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:35.140141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:35.198129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740fb1-5329-42a9-8ad5-79e4397d214a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:35.205114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee8a05-bfeb-45eb-915f-dcfe742825b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:35.205760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee8a05-bfeb-45eb-915f-dcfe742825b4 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:35.206042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee8a05-bfeb-45eb-915f-dcfe742825b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:35.206317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee8a05-bfeb-45eb-915f-dcfe742825b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:35.208097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-97ee8a05-bfeb-45eb-915f-dcfe742825b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:35.275034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee8a05-bfeb-45eb-915f-dcfe742825b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:35.276459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee8a05-bfeb-45eb-915f-dcfe742825b4 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:35.286588 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3934/7967] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:35 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:39.371871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:39.444196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eebcf-5236-4d14-8c46-b5483e5fb410 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:39.449154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:39.450028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:39.450310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:39.450588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] PATH_INFO: `/v3/users/4cab838ae2234356981342bba4a2c3e6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:39.451963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cab838ae2234356981342bba4a2c3e6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:39.456602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:39.697572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cab838ae2234356981342bba4a2c3e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:39.705100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cab838ae2234356981342bba4a2c3e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:39.716707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cab838ae2234356981342bba4a2c3e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:39.717446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cab838ae2234356981342bba4a2c3e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:39.802923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cab838ae2234356981342bba4a2c3e6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:39.823176 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4034/7968] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:41:39 2021] DELETE /identity/v3/users/4cab838ae2234356981342bba4a2c3e6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:39.828080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:39.829255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:39.829634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:39.853370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:39.854921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:39.930203 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3935/7969] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:41:39.941382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:39.942899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:40.017981 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464ef4c-ea7e-41f0-bc3c-26343d0e86f2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:40.022089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ba71b-8362-45c1-821a-db176549015e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:40.022921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba71b-8362-45c1-821a-db176549015e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:40.023290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba71b-8362-45c1-821a-db176549015e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:40.023668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba71b-8362-45c1-821a-db176549015e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:40.033991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ba71b-8362-45c1-821a-db176549015e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:40.035635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ba71b-8362-45c1-821a-db176549015e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:40.047176 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4035/7970] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:40.474337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:40.477952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:40.498043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d48a-e676-436a-9579-7f7b2fc18feb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:40.500052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:40.501108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:40.501467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:40.501922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] PATH_INFO: `/v3/projects/f6f76d86ec8a49e0b47607f2cb121c0b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:40.503115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f76d86ec8a49e0b47607f2cb121c0b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:40.505225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:40.662212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'request_id': 'req-3578403e-86d0-4db7-b770-a412bb4b9fe7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:40.672010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'request_id': 'req-3578403e-86d0-4db7-b770-a412bb4b9fe7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:40.746452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'request_id': 'req-3578403e-86d0-4db7-b770-a412bb4b9fe7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:40.758528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] The token cache is being invalidate because project f6f76d86ec8a49e0b47607f2cb121c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:40.758963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:40.759621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3578403e-86d0-4db7-b770-a412bb4b9fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:40.761658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3936/7971] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:40 2021] DELETE /identity/v3/projects/f6f76d86ec8a49e0b47607f2cb121c0b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:40.769096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d61b-ebe7-4b87-95a3-c6a7fd7d28a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:40.769661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d61b-ebe7-4b87-95a3-c6a7fd7d28a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:40.769661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d61b-ebe7-4b87-95a3-c6a7fd7d28a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:40.798488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c445d61b-ebe7-4b87-95a3-c6a7fd7d28a3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:40.799726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c445d61b-ebe7-4b87-95a3-c6a7fd7d28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:40.861985 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4036/7972] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:40.871991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872980b2-d04e-4d1d-886e-c29f26fc02f4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:40.872534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872980b2-d04e-4d1d-886e-c29f26fc02f4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:40.872534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872980b2-d04e-4d1d-886e-c29f26fc02f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:40.897013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-872980b2-d04e-4d1d-886e-c29f26fc02f4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:40.898660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-872980b2-d04e-4d1d-886e-c29f26fc02f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:40.906919 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3937/7973] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:40.911477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d61b-ebe7-4b87-95a3-c6a7fd7d28a3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:40.921412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d61b-ebe7-4b87-95a3-c6a7fd7d28a3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:40.926342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:40.927204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:40.927483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:40.927748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:40.928462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:41:40.928760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:40.930456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:40.946440 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4037/7974] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:41:40.950948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872980b2-d04e-4d1d-886e-c29f26fc02f4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:40.961575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872980b2-d04e-4d1d-886e-c29f26fc02f4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:40.966699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:40.967393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:40.967701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:40.967975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:40.968896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:40.971095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:41.073247 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3938/7975] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:40 2021] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:41.077696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:41.088564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f75e4-33ce-4982-a23a-d4fdf5e4b87e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:41.159455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:41.160122 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:41.160400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:41.160671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:41.161398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:41.163294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:41.271916 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4038/7976] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:41 2021] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:41.276112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:41.286504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931baa-ddc2-4206-9915-164b56727891 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:41.291103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:41.292371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:41.292371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:41.292371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:41.293099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:41.294684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:41.305499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3939/7977] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:41.309243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:41.319912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306472ed-a840-4cf3-874e-ab3c8f0f03fb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:41.324705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd2aab-9e43-4bb1-a5ae-e73aacb40e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:41.325319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2aab-9e43-4bb1-a5ae-e73aacb40e60 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:41.325596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2aab-9e43-4bb1-a5ae-e73aacb40e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:41.325867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2aab-9e43-4bb1-a5ae-e73aacb40e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:41.326588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd2aab-9e43-4bb1-a5ae-e73aacb40e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:41.328163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd2aab-9e43-4bb1-a5ae-e73aacb40e60 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:41.337923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4039/7978] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:41.341964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:41.352100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185792e7-50d6-4975-a085-97c01e6f3f62 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:41.357123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:41.357959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:41.358250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:41.358528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] PATH_INFO: `/v3/projects/f1cc2ab892ae40b99bc000a1b85a1fc9/users/0d2d7af13ab3477688d73a5ce3d2b1d9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:41.374383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cc2ab892ae40b99bc000a1b85a1fc9, user_id=0d2d7af13ab3477688d73a5ce3d2b1d9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:41.377715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:41.454660 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3940/7979] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:41 2021] PUT /identity/v3/projects/f1cc2ab892ae40b99bc000a1b85a1fc9/users/0d2d7af13ab3477688d73a5ce3d2b1d9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:41.464762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ebad-4458-4fa4-b964-82b6631e6754 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:41.465073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ebad-4458-4fa4-b964-82b6631e6754 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:41.465355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ebad-4458-4fa4-b964-82b6631e6754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:41.494176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-05e8ebad-4458-4fa4-b964-82b6631e6754 None None] MFA Rules not processed for user `0d2d7af13ab3477688d73a5ce3d2b1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:41.495410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-05e8ebad-4458-4fa4-b964-82b6631e6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:41.560521 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4040/7980] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:41 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:41.573833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:41.575723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:41.651345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb4562-ea5a-43ca-9777-17fa35919f41 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:41.658039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935421b-8043-4bed-b48e-5b172575a428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:41.658690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935421b-8043-4bed-b48e-5b172575a428 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:41.658985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935421b-8043-4bed-b48e-5b172575a428 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:41.659284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935421b-8043-4bed-b48e-5b172575a428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:41.668057 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935421b-8043-4bed-b48e-5b172575a428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:41.669753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935421b-8043-4bed-b48e-5b172575a428 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:41.679145 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3941/7981] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:41 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:41.717236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ebad-4458-4fa4-b964-82b6631e6754 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:41.778703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ebad-4458-4fa4-b964-82b6631e6754 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:41.783898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:41.784752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:41.785057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:41.785325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] PATH_INFO: `/v3/users/0d2d7af13ab3477688d73a5ce3d2b1d9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:41.786569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2d7af13ab3477688d73a5ce3d2b1d9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:41.788463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:42.005413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2d7af13ab3477688d73a5ce3d2b1d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:42.012380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2d7af13ab3477688d73a5ce3d2b1d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:42.025869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2d7af13ab3477688d73a5ce3d2b1d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:42.026617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2d7af13ab3477688d73a5ce3d2b1d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:42.117434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2d7af13ab3477688d73a5ce3d2b1d9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:42.124420 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4041/7982] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:41:41 2021] DELETE /identity/v3/users/0d2d7af13ab3477688d73a5ce3d2b1d9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:41:42.129136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:42.129679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:42.129679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:42.147495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:42.148694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:42.209721 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3942/7983] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:41:42.220953 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:42.222358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:42.284068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a2bdd-7819-4ed4-9b30-999d025a0de6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:42.287743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3675f-2945-4f7d-a94b-aee3a2a75b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:42.288390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3675f-2945-4f7d-a94b-aee3a2a75b0c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:42.288668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3675f-2945-4f7d-a94b-aee3a2a75b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:42.288970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3675f-2945-4f7d-a94b-aee3a2a75b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:42.297897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3675f-2945-4f7d-a94b-aee3a2a75b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:42.299425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3675f-2945-4f7d-a94b-aee3a2a75b0c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:42.309416 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4042/7984] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:42.719255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:42.720707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:42.732954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e169530-5f72-4bde-97be-94e736d7529d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:42.747875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:42.749975 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:42.750383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:42.751497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] PATH_INFO: `/v3/projects/f1cc2ab892ae40b99bc000a1b85a1fc9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:42.753171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cc2ab892ae40b99bc000a1b85a1fc9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:42.755226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:42.890197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cc2ab892ae40b99bc000a1b85a1fc9', 'request_id': 'req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:42.896561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cc2ab892ae40b99bc000a1b85a1fc9', 'request_id': 'req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:43.033645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cc2ab892ae40b99bc000a1b85a1fc9', 'request_id': 'req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:43.045415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] The token cache is being invalidate because project f1cc2ab892ae40b99bc000a1b85a1fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:43.045702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:43.046347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-80413b61-68ea-4b49-8f82-6ad8f2dab9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:43.048531 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3943/7985] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:42 2021] DELETE /identity/v3/projects/f1cc2ab892ae40b99bc000a1b85a1fc9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:41:43.054869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5269-f87d-44b6-ac4f-9754c35c691a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.055385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5269-f87d-44b6-ac4f-9754c35c691a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.059481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5269-f87d-44b6-ac4f-9754c35c691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.075049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1b3e5269-f87d-44b6-ac4f-9754c35c691a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:43.076929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1b3e5269-f87d-44b6-ac4f-9754c35c691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:43.142749 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4043/7986] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:43.150661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24916e9c-3a01-461a-ac81-30faa6578aca None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.151154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24916e9c-3a01-461a-ac81-30faa6578aca None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.151269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24916e9c-3a01-461a-ac81-30faa6578aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.170216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-24916e9c-3a01-461a-ac81-30faa6578aca None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:43.171401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-24916e9c-3a01-461a-ac81-30faa6578aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:43.180086 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3944/7987] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:43.184209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5269-f87d-44b6-ac4f-9754c35c691a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:43.193890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5269-f87d-44b6-ac4f-9754c35c691a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:43.198456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:43.199098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.199380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.199654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.200369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:41:43.200674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:43.202312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:43.217451 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4044/7988] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:41:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:41:43.222410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24916e9c-3a01-461a-ac81-30faa6578aca None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:43.232586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24916e9c-3a01-461a-ac81-30faa6578aca None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:43.238447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:43.239106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.239393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.239673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.240386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:43.242316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:43.319525 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3945/7989] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:43 2021] POST /identity/v3/projects => generated 359 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:43.323564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:43.333493 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da28cb-85a4-4c90-a6ae-47fe1665335d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:43.387700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:43.388659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.388977 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.389282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.389968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:43.391909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:43.490378 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4045/7990] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:43 2021] POST /identity/v3/users => generated 280 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:43.494393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:43.506032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401b02-6ac0-4e2e-8f97-a614767af894 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:43.510801 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:43.511441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.511717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.511992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.512707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:43.514574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:43.524904 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3946/7991] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:43.532498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:43.544983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed916c89-d140-4ba6-98b3-97aec15eabcb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:43.550200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c4327-f9f5-41b6-bb62-14f8e241835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:43.550855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4327-f9f5-41b6-bb62-14f8e241835e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.551133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4327-f9f5-41b6-bb62-14f8e241835e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.551409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c4327-f9f5-41b6-bb62-14f8e241835e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.552179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c4327-f9f5-41b6-bb62-14f8e241835e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:43.553753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c4327-f9f5-41b6-bb62-14f8e241835e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:43.564578 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4046/7992] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:43.574173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:43.588354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66caada-089b-4064-bf05-284b747ee30d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:43.594064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:43.595009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.595291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.595556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] PATH_INFO: `/v3/projects/358e5031a75a47e0936cbb45c2bcba97/users/118c19c7382b4a84b34ec378e4d92f6e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.610989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358e5031a75a47e0936cbb45c2bcba97, user_id=118c19c7382b4a84b34ec378e4d92f6e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:43.613778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:43.711917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3947/7993] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:43 2021] PUT /identity/v3/projects/358e5031a75a47e0936cbb45c2bcba97/users/118c19c7382b4a84b34ec378e4d92f6e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:43.723268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fadd0d-24b1-43de-8caf-3a90c6d2fa61 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.723593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fadd0d-24b1-43de-8caf-3a90c6d2fa61 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.723880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fadd0d-24b1-43de-8caf-3a90c6d2fa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.750362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a0fadd0d-24b1-43de-8caf-3a90c6d2fa61 None None] MFA Rules not processed for user `118c19c7382b4a84b34ec378e4d92f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:43.752123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a0fadd0d-24b1-43de-8caf-3a90c6d2fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:43.815577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4047/7994] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:43 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:43.854764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:43.919518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5443-892b-475a-b50a-7cb585c08255 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:43.925009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:43.925867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:43.926147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:43.926413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] PATH_INFO: `/v3/users/118c19c7382b4a84b34ec378e4d92f6e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:43.927671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=118c19c7382b4a84b34ec378e4d92f6e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:43.929602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:44.102422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118c19c7382b4a84b34ec378e4d92f6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:44.108854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118c19c7382b4a84b34ec378e4d92f6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:44.120150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118c19c7382b4a84b34ec378e4d92f6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:44.120828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118c19c7382b4a84b34ec378e4d92f6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:44.121474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118c19c7382b4a84b34ec378e4d92f6e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:44.192621 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3948/7995] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:41:43 2021] DELETE /identity/v3/users/118c19c7382b4a84b34ec378e4d92f6e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:44.197259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:44.197709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:44.197801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:44.215067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:44.216247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:44.276116 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4048/7996] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:44.285656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:44.287252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:44.351185 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d3143-1dbf-4b37-9715-e7e3cceb4f2a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:44.354905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655770-fd80-470f-996c-4f16a9a9def1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:44.355483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655770-fd80-470f-996c-4f16a9a9def1 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:44.355761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655770-fd80-470f-996c-4f16a9a9def1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:44.356031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655770-fd80-470f-996c-4f16a9a9def1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:44.365749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655770-fd80-470f-996c-4f16a9a9def1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:44.367237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655770-fd80-470f-996c-4f16a9a9def1 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:44.377924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3949/7997] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:44.778134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:44.778134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:44.787916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4e3cf-8ec8-49af-81cd-473e2a5cb4ed None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:44.792682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:44.793664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:44.794067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:44.794465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] PATH_INFO: `/v3/projects/358e5031a75a47e0936cbb45c2bcba97` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:44.795975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] RBAC: Authorizing `identity:delete_project(project_id=358e5031a75a47e0936cbb45c2bcba97)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:44.798395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:44.970891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358e5031a75a47e0936cbb45c2bcba97', 'request_id': 'req-c1a965d6-78cb-4a90-9de8-4f51416a913c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:45.043111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358e5031a75a47e0936cbb45c2bcba97', 'request_id': 'req-c1a965d6-78cb-4a90-9de8-4f51416a913c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:45.050089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358e5031a75a47e0936cbb45c2bcba97', 'request_id': 'req-c1a965d6-78cb-4a90-9de8-4f51416a913c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:45.060825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] The token cache is being invalidate because project 358e5031a75a47e0936cbb45c2bcba97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:45.061140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:45.061768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1a965d6-78cb-4a90-9de8-4f51416a913c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:45.063295 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4049/7998] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:44 2021] DELETE /identity/v3/projects/358e5031a75a47e0936cbb45c2bcba97 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:45.069072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa71a5-ea85-46f8-b678-bfe4741237c0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.069360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa71a5-ea85-46f8-b678-bfe4741237c0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.069658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa71a5-ea85-46f8-b678-bfe4741237c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.090026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b0aa71a5-ea85-46f8-b678-bfe4741237c0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:45.091226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b0aa71a5-ea85-46f8-b678-bfe4741237c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:45.152131 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3950/7999] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:45.160509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a0ec-5612-4460-bac6-9472261a64da None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.160794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a0ec-5612-4460-bac6-9472261a64da None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.161097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a0ec-5612-4460-bac6-9472261a64da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.179051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7ce3a0ec-5612-4460-bac6-9472261a64da None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:45.180230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7ce3a0ec-5612-4460-bac6-9472261a64da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:45.189468 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4050/8000] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:45.194084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa71a5-ea85-46f8-b678-bfe4741237c0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:45.204106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa71a5-ea85-46f8-b678-bfe4741237c0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:45.209262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:45.209914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.210195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.210470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.211198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:41:45.211503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:45.213121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:45.225364 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3951/8001] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:41:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:41:45.229773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a0ec-5612-4460-bac6-9472261a64da None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:45.239083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a0ec-5612-4460-bac6-9472261a64da None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:45.243804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:45.247917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.247917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.247917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.247917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:45.247917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:45.358423 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4051/8002] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:45 2021] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:45.360825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:45.370931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547b81a-e5d9-4700-81e6-03926e3569af admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:45.429003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:45.429619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.429902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.430176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.430886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:45.432797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:45.547505 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3952/8003] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:45 2021] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:45.551474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:45.561620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906dd78-31c6-411e-add0-61819c93cafd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:45.567021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:45.567654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.567937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.568216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.568991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:45.570622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:45.581779 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4052/8004] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:45 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:45.585675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:45.595415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f4d2-3d7c-42c1-ab35-1291f1709d6d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:45.600671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198dd9b-9ab2-49ea-80e8-84f91d9571bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:45.601369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198dd9b-9ab2-49ea-80e8-84f91d9571bc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.601695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198dd9b-9ab2-49ea-80e8-84f91d9571bc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.601964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198dd9b-9ab2-49ea-80e8-84f91d9571bc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.602682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198dd9b-9ab2-49ea-80e8-84f91d9571bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:45.604242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198dd9b-9ab2-49ea-80e8-84f91d9571bc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:45.614625 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3953/8005] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:45.618701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:45.629683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc0490-005a-491f-951f-292161d0351c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:45.634045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:45.634935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.635216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.635490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] PATH_INFO: `/v3/projects/caa3228fa0624e31aeba1d31e271320e/users/0233914ce54244d0bd646ddd938c15c0/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.653435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa3228fa0624e31aeba1d31e271320e, user_id=0233914ce54244d0bd646ddd938c15c0, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:45.656436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:45.765209 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4053/8006] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:45 2021] PUT /identity/v3/projects/caa3228fa0624e31aeba1d31e271320e/users/0233914ce54244d0bd646ddd938c15c0/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:45.777375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74d6d-7a7b-4408-873c-2f3ae38d536e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.777923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74d6d-7a7b-4408-873c-2f3ae38d536e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.778336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd74d6d-7a7b-4408-873c-2f3ae38d536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.807869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0bd74d6d-7a7b-4408-873c-2f3ae38d536e None None] MFA Rules not processed for user `0233914ce54244d0bd646ddd938c15c0`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:45.809252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0bd74d6d-7a7b-4408-873c-2f3ae38d536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:45.886482 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3954/8007] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:45 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:45.893887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:45.975275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec42ed-04ce-4b61-8114-8f8e5794baeb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:45.980202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:45.980888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:45.981192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:45.981474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:45.982190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:45.984183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:46.079345 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4054/8008] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:45 2021] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:46.080533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd74d6d-7a7b-4408-873c-2f3ae38d536e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:46.094495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd74d6d-7a7b-4408-873c-2f3ae38d536e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:46.156601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:46.157393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.157669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.157940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.158788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:46.160726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:46.262173 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3955/8009] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:46 2021] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:46.266554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:46.281417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abe02-78b3-4a77-870e-2ee656de5b82 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:46.286818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:46.287516 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.287801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.288079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.288839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:46.290554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:46.309597 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4055/8010] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:46 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:46.310493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:46.321362 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66acd8-036e-4714-ad96-a98347002401 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:46.326013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:46.327199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.327483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.327757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] PATH_INFO: `/v3/projects/c1eb3dbd9df4417b8e69a96f17352e12/users/2fad14624dbd443ab333b3a1fac885cd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.344667 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb3dbd9df4417b8e69a96f17352e12, user_id=2fad14624dbd443ab333b3a1fac885cd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:46.347333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:46.451658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3956/8011] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:46 2021] PUT /identity/v3/projects/c1eb3dbd9df4417b8e69a96f17352e12/users/2fad14624dbd443ab333b3a1fac885cd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:46.455369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:46.465885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bfb0a-7f78-4a2d-813d-f7e20e10f262 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:46.534841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c69221-b87c-4ba6-9284-820560aeac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:46.535534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69221-b87c-4ba6-9284-820560aeac41 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.535815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69221-b87c-4ba6-9284-820560aeac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.536092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69221-b87c-4ba6-9284-820560aeac41 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.536857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c69221-b87c-4ba6-9284-820560aeac41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:46.538499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c69221-b87c-4ba6-9284-820560aeac41 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:46.549295 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4056/8012] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:46 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:46.554154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:46.568815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc0880-1de3-44c5-85a0-a2afb9aa1f04 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:46.576433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:46.576941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.577231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.577556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] PATH_INFO: `/v3/projects/c1eb3dbd9df4417b8e69a96f17352e12/users/2fad14624dbd443ab333b3a1fac885cd/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.580082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb3dbd9df4417b8e69a96f17352e12, user_id=2fad14624dbd443ab333b3a1fac885cd, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:46.582824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:46.596567 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3957/8013] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:46 2021] PUT /identity/v3/projects/c1eb3dbd9df4417b8e69a96f17352e12/users/2fad14624dbd443ab333b3a1fac885cd/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:41:46.607830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f0af-76ae-4ce8-9ccc-aefc10321f2c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.608112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f0af-76ae-4ce8-9ccc-aefc10321f2c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.608392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f0af-76ae-4ce8-9ccc-aefc10321f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.637433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1df9f0af-76ae-4ce8-9ccc-aefc10321f2c None None] MFA Rules not processed for user `2fad14624dbd443ab333b3a1fac885cd`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:46.639112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1df9f0af-76ae-4ce8-9ccc-aefc10321f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:46.722187 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4057/8014] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:46 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:46.727147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:46.738263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf7ab-3def-4226-8685-a4b7f87235a3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:46.744683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:46.745375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.745653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.745928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.746719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:46.748327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:46.879501 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3958/8015] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:46 2021] POST /identity/v3/services => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:46.883727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f0af-76ae-4ce8-9ccc-aefc10321f2c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:46.894900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f0af-76ae-4ce8-9ccc-aefc10321f2c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:46.909983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:46.910643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:46.910907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:46.911189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:46.911907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:46.913016 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:46.913016 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:41:46.913016 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:41:46.913892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.021577 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4058/8016] 10.222.0.32 () {60 vars in 1212 bytes} [Sat Dec 25 21:41:46 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:47.026289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.036829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a80f9-f944-481e-8447-dff5bd07b81c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.041403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.042066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.042348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.042623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.043351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.045329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.116693 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3959/8017] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:47 2021] POST /identity/v3/services => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:47.117991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.129237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ae8b6-9053-40a6-ad3f-1cb2062c2efd tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.147652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.148218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.148499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.148775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.149541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.151135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.218273 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4059/8018] 10.222.0.32 () {60 vars in 1212 bytes} [Sat Dec 25 21:41:47 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:47.219472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.230227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc78d5b-f6f7-43e9-8d19-03391c40a925 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.234877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.235494 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.235771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.236045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.236913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.238471 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:47.238471 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:41:47.238471 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:41:47.239383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.249022 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3960/8019] 10.222.0.32 () {58 vars in 1190 bytes} [Sat Dec 25 21:41:47 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:41:47.250311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.261402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389df3-f283-4be1-b41f-a0c44853e573 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.266942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.267883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.268170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.268449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.269151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=69323243f6494fdd8b0aeba54f8f5abe)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.270168 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:47.270168 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:41:47.270168 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:41:47.271039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.280409 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4060/8020] 10.222.0.32 () {58 vars in 1289 bytes} [Sat Dec 25 21:41:47 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe => generated 333 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:41:47.281574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.291956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659545-e331-470c-8db0-51b1f3309aeb tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.296583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.297521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.297805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.298107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.298834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=69323243f6494fdd8b0aeba54f8f5abe)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.300329 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:47.300329 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:41:47.300329 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:41:47.301248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.307289 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3961/8021] 10.222.0.32 () {58 vars in 1290 bytes} [Sat Dec 25 21:41:47 2021] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe => generated 0 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Dec 25 21:41:47.311263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.321905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063761-c04f-4b38-a769-4801fa4f195a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.326719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.327606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.329508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.329508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.330410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=69323243f6494fdd8b0aeba54f8f5abe)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.331627 ncdv-master-1 devstack@keystone.service[96733]: WARNING py.warnings [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:47.331627 ncdv-master-1 devstack@keystone.service[96733]: warnings.warn(msg) Dec 25 21:41:47.331627 ncdv-master-1 devstack@keystone.service[96733]: Dec 25 21:41:47.332642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.409975 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4061/8022] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:41:47 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:47.413579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.426053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a264-069b-4e2d-873b-dea4e2fb23e0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.438595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.438595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.438595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.438995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.439253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.441744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.446932 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3962/8023] 10.222.0.32 () {58 vars in 1190 bytes} [Sat Dec 25 21:41:47 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:41:47.451346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.461550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95dbb2-25a4-4317-882b-89b5c1037315 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.466844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.467272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.467556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.467828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.468490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=69323243f6494fdd8b0aeba54f8f5abe)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.470104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.482529 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Could not find Endpoint Group: 69323243f6494fdd8b0aeba54f8f5abe.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 69323243f6494fdd8b0aeba54f8f5abe. Dec 25 21:41:47.484901 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4062/8024] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:41:47 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/69323243f6494fdd8b0aeba54f8f5abe => generated 120 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:41:47.488411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.498792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686da0-f4f7-4808-af6b-7ca7f5917c54 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.504098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.505283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.505676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.507281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services/16dddcc916c747d9afa3e1f47c27d74a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.507281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=16dddcc916c747d9afa3e1f47c27d74a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.508178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.573210 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3963/8025] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:47 2021] DELETE /identity/v3/services/16dddcc916c747d9afa3e1f47c27d74a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:47.578486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.597456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe262b-691f-4a96-a548-0f74df247c3a tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.615824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.617030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.617305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.617586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.618498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.620329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.757206 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4063/8026] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:47 2021] POST /identity/v3/services => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:47.758466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.777215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a827-37ba-464d-bfa5-7ace9fbc2e8c tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.806012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.806907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.807356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.807837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.809275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.811471 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:47.811471 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:41:47.811471 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:41:47.813004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:47.947311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:47.954568 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3964/8027] 10.222.0.32 () {60 vars in 1212 bytes} [Sat Dec 25 21:41:47 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:47.977369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f117428-3aaf-4832-bd21-a54f7b17b4d0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:47.983938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:47.984790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:47.985270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:47.985649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:47.986492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:47.988593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:48.069375 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4064/8028] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:47 2021] POST /identity/v3/services => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:48.070675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:48.082638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeb601-e26c-476e-b783-6a2b82c5128d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:48.099768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:48.100741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `PATCH` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:48.101056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:48.101332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8bc4fa4d4c364676ac080801161e713a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:48.102105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=8bc4fa4d4c364676ac080801161e713a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:48.103633 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:48.103633 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:41:48.103633 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:41:48.105787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:48.198428 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3965/8029] 10.222.0.32 () {60 vars in 1312 bytes} [Sat Dec 25 21:41:48 2021] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/8bc4fa4d4c364676ac080801161e713a => generated 336 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:41:48.198629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:48.210684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecdb89-98d9-4f31-9575-15978b8fb8f0 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:48.215793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:48.216982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:48.217391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:48.217700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services/908bb67cb71e43ab9574b47e404d5c88` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:48.218364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=908bb67cb71e43ab9574b47e404d5c88)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:48.220572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:48.341976 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4065/8030] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:48 2021] DELETE /identity/v3/services/908bb67cb71e43ab9574b47e404d5c88 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:48.354375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:48.367335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41a15-276f-4007-a975-cc7b57a4f658 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:48.392325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:48.393979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:48.394404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:48.394683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8bc4fa4d4c364676ac080801161e713a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:48.395353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8bc4fa4d4c364676ac080801161e713a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:48.396368 ncdv-master-1 devstack@keystone.service[96732]: WARNING py.warnings [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:48.396368 ncdv-master-1 devstack@keystone.service[96732]: warnings.warn(msg) Dec 25 21:41:48.396368 ncdv-master-1 devstack@keystone.service[96732]: Dec 25 21:41:48.397480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:48.487160 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3966/8031] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:41:48 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8bc4fa4d4c364676ac080801161e713a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:48.489020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:48.505171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa341b-cfc7-4b8f-8404-3f91cbcb3b7d tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:48.512327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:48.513673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:48.513988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:48.514352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services/0b54a0426d7b407c977568958604e2b7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:48.514957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0b54a0426d7b407c977568958604e2b7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:48.517224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:48.593817 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4066/8032] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:48 2021] DELETE /identity/v3/services/0b54a0426d7b407c977568958604e2b7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:48.598849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:48.610423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6dfe6-52fb-4af6-9aac-5eddb940cdb3 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:48.633825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:48.634761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:48.635547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:48.635925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/29c9e6dde11b4b25aae20c102cba8791` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:48.636551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=29c9e6dde11b4b25aae20c102cba8791)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:48.638662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:48.809186 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3967/8033] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:41:48 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/29c9e6dde11b4b25aae20c102cba8791 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:48.813178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:48.826058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978950-8a95-4c9c-ba9e-7dc40f8bdd23 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:48.831153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cea411-9bd4-42cc-83f5-706344e587d8 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fad14624dbd443ab333b3a1fac885cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb3dbd9df4417b8e69a96f17352e12', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:48.832132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea411-9bd4-42cc-83f5-706344e587d8 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:48.832664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea411-9bd4-42cc-83f5-706344e587d8 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:48.833402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea411-9bd4-42cc-83f5-706344e587d8 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] PATH_INFO: `/v3/services/7b57aa26cae349f08d2e3dbb3522b4ce` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:48.834184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cea411-9bd4-42cc-83f5-706344e587d8 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7b57aa26cae349f08d2e3dbb3522b4ce)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:48.836047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cea411-9bd4-42cc-83f5-706344e587d8 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:48.972737 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4067/8034] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:48 2021] DELETE /identity/v3/services/7b57aa26cae349f08d2e3dbb3522b4ce => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:48.974806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:49.075802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf6893-a3e9-4437-bf32-3c13e0ce5ed1 tempest-EndPointGroupsTest-1282785150 tempest-EndPointGroupsTest-1282785150-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:49.098351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:49.099279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:49.099601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:49.099917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] PATH_INFO: `/v3/users/0233914ce54244d0bd646ddd938c15c0` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:49.101880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0233914ce54244d0bd646ddd938c15c0)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:49.104349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:49.308682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0233914ce54244d0bd646ddd938c15c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:49.316516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0233914ce54244d0bd646ddd938c15c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:49.330459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0233914ce54244d0bd646ddd938c15c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:49.331325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0233914ce54244d0bd646ddd938c15c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:49.332012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0233914ce54244d0bd646ddd938c15c0'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:49.489310 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3968/8035] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:41:48 2021] DELETE /identity/v3/users/0233914ce54244d0bd646ddd938c15c0 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:49.494522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:49.494966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:49.495074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:49.515159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:49.516499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:49.593882 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4068/8036] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:49.616813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:49.618439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:49.692532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f47fc7-b66d-4d25-a8e6-eb57dd3369dd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:49.696952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:49.697670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:49.697980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:49.698278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:49.709428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:49.711130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:49.722424 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3969/8037] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:50.150227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:50.152081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:50.183395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab05ab4-4dcf-4c1c-a060-37cee737f933 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:50.199257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:50.200692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:50.201231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:50.201887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] PATH_INFO: `/v3/projects/caa3228fa0624e31aeba1d31e271320e` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:50.204106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa3228fa0624e31aeba1d31e271320e)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:50.207490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:50.393042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa3228fa0624e31aeba1d31e271320e', 'request_id': 'req-ccdf8cd1-309f-47ab-beff-ff32f2af4708'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.460423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa3228fa0624e31aeba1d31e271320e', 'request_id': 'req-ccdf8cd1-309f-47ab-beff-ff32f2af4708'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.468672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa3228fa0624e31aeba1d31e271320e', 'request_id': 'req-ccdf8cd1-309f-47ab-beff-ff32f2af4708'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.480276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] The token cache is being invalidate because project caa3228fa0624e31aeba1d31e271320e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:50.480692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.481503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.483210 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4069/8038] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:50 2021] DELETE /identity/v3/projects/caa3228fa0624e31aeba1d31e271320e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:50.487972 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:50.499032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da98f-5568-4aa4-a6f2-e3d465582c3f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:50.577437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:50.578319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:50.578597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:50.578905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] PATH_INFO: `/v3/users/2fad14624dbd443ab333b3a1fac885cd` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:50.580130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fad14624dbd443ab333b3a1fac885cd)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:50.582218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:50.778570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fad14624dbd443ab333b3a1fac885cd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.787477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fad14624dbd443ab333b3a1fac885cd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.801969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fad14624dbd443ab333b3a1fac885cd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.802776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fad14624dbd443ab333b3a1fac885cd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.803496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-37726a0a-4bdb-424c-b339-2c663861ad8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fad14624dbd443ab333b3a1fac885cd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:50.921225 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3970/8039] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:41:50 2021] DELETE /identity/v3/users/2fad14624dbd443ab333b3a1fac885cd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:41:51.376407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:51.378383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:51.395627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf8cd1-309f-47ab-beff-ff32f2af4708 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:51.458239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:51.460039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:51.460039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:51.460039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] PATH_INFO: `/v3/projects/c1eb3dbd9df4417b8e69a96f17352e12` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:51.460990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1eb3dbd9df4417b8e69a96f17352e12)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:51.462927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:51.587869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1eb3dbd9df4417b8e69a96f17352e12', 'request_id': 'req-4f336eff-da56-4993-bbed-398bc63982ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:51.644685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1eb3dbd9df4417b8e69a96f17352e12', 'request_id': 'req-4f336eff-da56-4993-bbed-398bc63982ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:51.652339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1eb3dbd9df4417b8e69a96f17352e12', 'request_id': 'req-4f336eff-da56-4993-bbed-398bc63982ea'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:51.664702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] The token cache is being invalidate because project c1eb3dbd9df4417b8e69a96f17352e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:51.665021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:51.665671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f336eff-da56-4993-bbed-398bc63982ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:51.667457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4070/8040] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:51 2021] DELETE /identity/v3/projects/c1eb3dbd9df4417b8e69a96f17352e12 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:51.673403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8f52-f7c2-4e2f-8618-d1ccc9e320de None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:51.673888 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8f52-f7c2-4e2f-8618-d1ccc9e320de None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:51.673979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae8f52-f7c2-4e2f-8618-d1ccc9e320de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:51.694430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1fae8f52-f7c2-4e2f-8618-d1ccc9e320de None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:51.695661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1fae8f52-f7c2-4e2f-8618-d1ccc9e320de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:51.755337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3971/8041] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:51.764581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f362b9-e07e-4103-ab0f-b21d44260c9e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:51.764581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f362b9-e07e-4103-ab0f-b21d44260c9e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:51.764581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f362b9-e07e-4103-ab0f-b21d44260c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:51.784894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c2f362b9-e07e-4103-ab0f-b21d44260c9e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:51.786107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c2f362b9-e07e-4103-ab0f-b21d44260c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:51.794285 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4071/8042] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:41:51.799063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae8f52-f7c2-4e2f-8618-d1ccc9e320de None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:51.809947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae8f52-f7c2-4e2f-8618-d1ccc9e320de None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:51.814647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:51.815965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:51.816359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:51.822312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:51.823151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:41:51.823463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:51.827144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:51.845977 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3972/8043] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:41:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:41:51.847975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f362b9-e07e-4103-ab0f-b21d44260c9e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:51.857568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f362b9-e07e-4103-ab0f-b21d44260c9e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:51.863939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:51.863939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:51.863939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:51.864180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:51.864811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:51.867124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:51.988489 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4072/8044] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:51 2021] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:51.992796 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.004054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c8bfb-3906-4af2-ba64-29adc139e5e4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.065146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.065824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.066107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.066383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.067094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.069040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:52.192705 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3973/8045] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:51 2021] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:52.196848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.207279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952023a-c2c0-4a27-b93b-5556ba011a03 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.212322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.213001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.213477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.213896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.214631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.216252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:52.227285 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4073/8046] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:52.231605 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.244242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef02e-7866-4223-8c46-8787ead4d64a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.250611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964be89-c74a-47ec-9f05-5fbbcfe9d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.251344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964be89-c74a-47ec-9f05-5fbbcfe9d688 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.251632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964be89-c74a-47ec-9f05-5fbbcfe9d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.251931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964be89-c74a-47ec-9f05-5fbbcfe9d688 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.252686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964be89-c74a-47ec-9f05-5fbbcfe9d688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.254336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964be89-c74a-47ec-9f05-5fbbcfe9d688 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:52.266154 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3974/8047] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:52 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:52.270315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.280612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1b366-880d-493b-ba21-b51d8eeccb5e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.285708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.286579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.286858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.287130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] PATH_INFO: `/v3/projects/833e4a7cbd604c2d9716e19a309672fe/users/21ad85f3ea7b4bc188cee628fe7e5b55/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.302746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=833e4a7cbd604c2d9716e19a309672fe, user_id=21ad85f3ea7b4bc188cee628fe7e5b55, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.305461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:52.403116 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4074/8048] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:52 2021] PUT /identity/v3/projects/833e4a7cbd604c2d9716e19a309672fe/users/21ad85f3ea7b4bc188cee628fe7e5b55/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:52.410566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd366c2-ba58-4490-ad22-9a32908f725e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.410566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd366c2-ba58-4490-ad22-9a32908f725e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.410566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd366c2-ba58-4490-ad22-9a32908f725e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.434210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5dd366c2-ba58-4490-ad22-9a32908f725e None None] MFA Rules not processed for user `21ad85f3ea7b4bc188cee628fe7e5b55`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:52.435421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5dd366c2-ba58-4490-ad22-9a32908f725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:52.509026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3975/8049] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:52 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:41:52.511494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.577583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f94d2-8bc0-4456-8729-7ccef858f33a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.584402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.585120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.585773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.586055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.586905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.588958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:52.706587 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4075/8050] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:52 2021] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:52.709421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd366c2-ba58-4490-ad22-9a32908f725e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.720447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd366c2-ba58-4490-ad22-9a32908f725e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.777598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.778267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.778547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.778821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.779525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.781627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:52.908292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3976/8051] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:52 2021] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:52.912318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.923012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2906383-1d71-498e-9fc2-ecf3b42d45f9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.927668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.928320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.928600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.928890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.929737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.931325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:52.942610 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4076/8052] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:52.947295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:52.960556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc5d8-3cf5-4647-afcf-7ca8076e72cb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:52.965921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:52.966809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:52.967087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:52.967358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] PATH_INFO: `/v3/projects/a04ea3cea9b644ecb48961805ceae9cc/users/cd603adae69b4af0a459237e35bd2357/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:52.982276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04ea3cea9b644ecb48961805ceae9cc, user_id=cd603adae69b4af0a459237e35bd2357, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:52.984921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:53.089357 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3977/8053] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:52 2021] PUT /identity/v3/projects/a04ea3cea9b644ecb48961805ceae9cc/users/cd603adae69b4af0a459237e35bd2357/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:53.093227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:53.103139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827fc9-cd8d-45cb-81b3-1d76a308e060 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:53.164310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139397-3701-4a30-9592-d7d5094796b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:53.165024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139397-3701-4a30-9592-d7d5094796b2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.165315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139397-3701-4a30-9592-d7d5094796b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.165592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139397-3701-4a30-9592-d7d5094796b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.166327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139397-3701-4a30-9592-d7d5094796b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:53.167999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3139397-3701-4a30-9592-d7d5094796b2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:53.178992 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4077/8054] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:53 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:53.183129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:53.193938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfac50-75bb-446c-b0ca-f53c929c2a63 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:53.198812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:53.199702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.199989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.200262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] PATH_INFO: `/v3/projects/a04ea3cea9b644ecb48961805ceae9cc/users/cd603adae69b4af0a459237e35bd2357/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.202299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04ea3cea9b644ecb48961805ceae9cc, user_id=cd603adae69b4af0a459237e35bd2357, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:53.204949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:53.215797 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3978/8055] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:53 2021] PUT /identity/v3/projects/a04ea3cea9b644ecb48961805ceae9cc/users/cd603adae69b4af0a459237e35bd2357/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:53.227058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dca823-7dd5-43cf-8ae3-f6533f1a38e0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.227436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dca823-7dd5-43cf-8ae3-f6533f1a38e0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.228028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dca823-7dd5-43cf-8ae3-f6533f1a38e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.259396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-03dca823-7dd5-43cf-8ae3-f6533f1a38e0 None None] MFA Rules not processed for user `cd603adae69b4af0a459237e35bd2357`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:53.260623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-03dca823-7dd5-43cf-8ae3-f6533f1a38e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:53.327520 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4078/8056] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:53 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:53.331978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:53.342825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224d52e-5c7e-41d3-8e65-2f16f911d675 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:53.347655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:53.348312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.348600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.348898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.349616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:53.351590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:53.467651 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3979/8057] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:53 2021] POST /identity/v3/projects => generated 333 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:53.471500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dca823-7dd5-43cf-8ae3-f6533f1a38e0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:53.481775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dca823-7dd5-43cf-8ae3-f6533f1a38e0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:53.551267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:53.551927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.552208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.552484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.553327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:53.555192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:53.666674 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4079/8058] 10.222.0.32 () {60 vars in 1151 bytes} [Sat Dec 25 21:41:53 2021] POST /identity/v3/projects => generated 332 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:53.670547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:53.682025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0273-7624-4844-89db-8a0114e6982a tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:53.739878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:53.740518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.740712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.744568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.744568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:53.744568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:53.859687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3980/8059] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:53 2021] POST /identity/v3/projects => generated 358 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:53.864938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:53.875542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35141c6-4d8d-4834-91cb-8ce53b43d7cf tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:53.932511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:53.933201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.933484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.933760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.934545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:53.936570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:53.962326 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4080/8060] 10.222.0.32 () {58 vars in 1130 bytes} [Sat Dec 25 21:41:53 2021] GET /identity/v3/projects => generated 6498 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:53.966299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:53.977590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b351-cb6b-4009-8783-5c53cbe64402 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:53.982471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:53.983136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:53.983424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:53.983712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:53.984484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:41:53.984791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:53.986892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:54.005780 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3981/8061] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:41:53 2021] GET /identity/v3/projects?enabled=False => generated 444 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:41:54.011056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:54.024577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17617b8-10d0-461e-a89a-9b990648d420 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:54.031187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:54.031889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:54.032206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:54.032487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:54.033317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Adding query filter params (parent_id=5d9756392e85496c8a43112cc86e75e8) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:41:54.033634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:54.036138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:54.056927 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4081/8062] 10.222.0.32 () {58 vars in 1215 bytes} [Sat Dec 25 21:41:54 2021] GET /identity/v3/projects?parent_id=5d9756392e85496c8a43112cc86e75e8 => generated 498 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:41:54.058718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:54.068953 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d6722-daab-4b0f-8ed7-1abb5eaaa838 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:54.075063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:54.076141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:54.076423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:54.076694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects/05081ad9a6044e8dba824d7ababcdcfb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:54.077978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05081ad9a6044e8dba824d7ababcdcfb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:54.079860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:54.210597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05081ad9a6044e8dba824d7ababcdcfb', 'request_id': 'req-f91be3da-be6d-4c33-8af1-426153b6d896'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.216535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05081ad9a6044e8dba824d7ababcdcfb', 'request_id': 'req-f91be3da-be6d-4c33-8af1-426153b6d896'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.294090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05081ad9a6044e8dba824d7ababcdcfb', 'request_id': 'req-f91be3da-be6d-4c33-8af1-426153b6d896'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.305155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] The token cache is being invalidate because project 05081ad9a6044e8dba824d7ababcdcfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:54.305449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.306206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.307804 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3982/8063] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:54 2021] DELETE /identity/v3/projects/05081ad9a6044e8dba824d7ababcdcfb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:54.311891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:54.313775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:54.331728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a54c-738a-454a-b14f-8f0a07b3896c tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:54.396308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:54.397225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:54.397485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:54.397750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects/5d9756392e85496c8a43112cc86e75e8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:54.398970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d9756392e85496c8a43112cc86e75e8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:54.400853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:54.551714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9756392e85496c8a43112cc86e75e8', 'request_id': 'req-69e3a3e6-6495-4806-872e-2b87de7667e2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.613819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9756392e85496c8a43112cc86e75e8', 'request_id': 'req-69e3a3e6-6495-4806-872e-2b87de7667e2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.621073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9756392e85496c8a43112cc86e75e8', 'request_id': 'req-69e3a3e6-6495-4806-872e-2b87de7667e2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.631850 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] The token cache is being invalidate because project 5d9756392e85496c8a43112cc86e75e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:54.632215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.632996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.634630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4082/8064] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:54 2021] DELETE /identity/v3/projects/5d9756392e85496c8a43112cc86e75e8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:54.638735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:54.651094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91be3da-be6d-4c33-8af1-426153b6d896 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:54.707786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd603adae69b4af0a459237e35bd2357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a04ea3cea9b644ecb48961805ceae9cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:54.708626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:54.708943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:54.709219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] PATH_INFO: `/v3/projects/54c49286198e4823a8744ad1f06cf8fc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:54.710435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorizing `identity:delete_project(project_id=54c49286198e4823a8744ad1f06cf8fc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:54.712370 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:54.826065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c49286198e4823a8744ad1f06cf8fc', 'request_id': 'req-5762c0c6-995d-453a-8deb-7a76d42542eb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.832331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c49286198e4823a8744ad1f06cf8fc', 'request_id': 'req-5762c0c6-995d-453a-8deb-7a76d42542eb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.923276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c49286198e4823a8744ad1f06cf8fc', 'request_id': 'req-5762c0c6-995d-453a-8deb-7a76d42542eb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.947859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] The token cache is being invalidate because project 54c49286198e4823a8744ad1f06cf8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:54.947859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.947859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5762c0c6-995d-453a-8deb-7a76d42542eb tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:54.947859 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3983/8065] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:54 2021] DELETE /identity/v3/projects/54c49286198e4823a8744ad1f06cf8fc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:54.949941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:54.951443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:55.016928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a3e6-6495-4806-872e-2b87de7667e2 tempest-ListProjectsTestJSON-967831378 tempest-ListProjectsTestJSON-967831378-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:55.071558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:55.072359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:55.072645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:55.072972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] PATH_INFO: `/v3/users/21ad85f3ea7b4bc188cee628fe7e5b55` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:55.074241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ad85f3ea7b4bc188cee628fe7e5b55)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:55.079800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:55.285180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ad85f3ea7b4bc188cee628fe7e5b55'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:55.291815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ad85f3ea7b4bc188cee628fe7e5b55'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:55.306290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ad85f3ea7b4bc188cee628fe7e5b55'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:55.307007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ad85f3ea7b4bc188cee628fe7e5b55'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:55.369991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ad85f3ea7b4bc188cee628fe7e5b55'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:55.377514 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4083/8066] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:41:54 2021] DELETE /identity/v3/users/21ad85f3ea7b4bc188cee628fe7e5b55 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:41:55.385296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:55.385296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:55.385296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:55.404156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:55.405659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:55.467453 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3984/8067] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:55.482557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:55.484156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:55.573217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863a30b-26d4-4584-8fb9-54af481d0d8c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:55.578520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:55.584469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:55.584469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:55.584469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:55.595356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:55.597046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:55.606899 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4084/8068] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:41:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:41:56.084813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:56.086340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:56.104131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf2794-aac9-492b-b7db-dd5a55fadf45 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:56.112351 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:56.113920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:56.114269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:56.114462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] PATH_INFO: `/v3/projects/833e4a7cbd604c2d9716e19a309672fe` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:56.115879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] RBAC: Authorizing `identity:delete_project(project_id=833e4a7cbd604c2d9716e19a309672fe)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:56.120097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:56.262803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833e4a7cbd604c2d9716e19a309672fe', 'request_id': 'req-50f86c30-39bc-4cc6-8b81-22be456f319a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.269790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833e4a7cbd604c2d9716e19a309672fe', 'request_id': 'req-50f86c30-39bc-4cc6-8b81-22be456f319a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.362946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833e4a7cbd604c2d9716e19a309672fe', 'request_id': 'req-50f86c30-39bc-4cc6-8b81-22be456f319a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.373820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] The token cache is being invalidate because project 833e4a7cbd604c2d9716e19a309672fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:56.374105 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.374772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.376955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3985/8069] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:56 2021] DELETE /identity/v3/projects/833e4a7cbd604c2d9716e19a309672fe => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:56.380900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:56.402201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bdba2-8741-4fea-b592-5bffe1720857 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:56.489243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:56.490285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:56.490671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:56.491051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] PATH_INFO: `/v3/users/cd603adae69b4af0a459237e35bd2357` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:56.492413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd603adae69b4af0a459237e35bd2357)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:56.494589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:56.679942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd603adae69b4af0a459237e35bd2357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.686892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd603adae69b4af0a459237e35bd2357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.699453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd603adae69b4af0a459237e35bd2357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.700196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd603adae69b4af0a459237e35bd2357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.763726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1e649cf-830c-437e-acb7-71df1f028a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd603adae69b4af0a459237e35bd2357'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:56.771653 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4085/8070] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:41:56 2021] DELETE /identity/v3/users/cd603adae69b4af0a459237e35bd2357 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:41:57.614312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:57.616450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:57.633695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86c30-39bc-4cc6-8b81-22be456f319a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:57.711379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:57.712361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:57.712645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:57.712951 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] PATH_INFO: `/v3/projects/a04ea3cea9b644ecb48961805ceae9cc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:57.714144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04ea3cea9b644ecb48961805ceae9cc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:57.716164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:57.859512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04ea3cea9b644ecb48961805ceae9cc', 'request_id': 'req-5564700f-d430-4ba5-b11d-d4229f1b4914'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:57.866860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04ea3cea9b644ecb48961805ceae9cc', 'request_id': 'req-5564700f-d430-4ba5-b11d-d4229f1b4914'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:57.945847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04ea3cea9b644ecb48961805ceae9cc', 'request_id': 'req-5564700f-d430-4ba5-b11d-d4229f1b4914'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:57.958325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] The token cache is being invalidate because project a04ea3cea9b644ecb48961805ceae9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:41:57.964093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:57.964846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5564700f-d430-4ba5-b11d-d4229f1b4914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:41:57.966479 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3986/8071] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:57 2021] DELETE /identity/v3/projects/a04ea3cea9b644ecb48961805ceae9cc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:57.973289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc115ca2-bb63-42d3-9f22-0fe2e82d8f94 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:57.973760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc115ca2-bb63-42d3-9f22-0fe2e82d8f94 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:57.973961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc115ca2-bb63-42d3-9f22-0fe2e82d8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:57.998570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dc115ca2-bb63-42d3-9f22-0fe2e82d8f94 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:57.999824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dc115ca2-bb63-42d3-9f22-0fe2e82d8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:58.065797 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4086/8072] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:58.073822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1bbc3-1acb-4c6a-b0b4-58b4737b745c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.074064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1bbc3-1acb-4c6a-b0b4-58b4737b745c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.074378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1bbc3-1acb-4c6a-b0b4-58b4737b745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.093968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05d1bbc3-1acb-4c6a-b0b4-58b4737b745c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:58.095198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05d1bbc3-1acb-4c6a-b0b4-58b4737b745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:58.103978 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3987/8073] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:58.108495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc115ca2-bb63-42d3-9f22-0fe2e82d8f94 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.121112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc115ca2-bb63-42d3-9f22-0fe2e82d8f94 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.126646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.127349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.127663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.127968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.128762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:41:58.129112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.130875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:58.146998 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4087/8074] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:41:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:41:58.148061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1bbc3-1acb-4c6a-b0b4-58b4737b745c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.157500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1bbc3-1acb-4c6a-b0b4-58b4737b745c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.163950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.164612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.164917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.166596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.166596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.167779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:58.250604 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3988/8075] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:58 2021] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:41:58.254887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.265480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2b5c4-a4c6-49fc-9c43-81cceb3cef63 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.322535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.323119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.323397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.323668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.324606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.326480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:58.423868 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4088/8076] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:58 2021] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:58.425905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.436590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856c73f-bce9-4d17-8da6-2c8fe74d6db4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.443493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.443864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.444149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.444426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.445198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.446789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:58.465792 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3989/8077] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:58 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:58.467225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.478219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d12fd2-d4bf-4d61-a810-27bb22ed369b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.484577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef956a-a660-47ea-b59c-79c6c266e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.485357 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef956a-a660-47ea-b59c-79c6c266e81d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.485705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef956a-a660-47ea-b59c-79c6c266e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.485963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef956a-a660-47ea-b59c-79c6c266e81d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.486692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef956a-a660-47ea-b59c-79c6c266e81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.488662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef956a-a660-47ea-b59c-79c6c266e81d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:58.499880 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4089/8078] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:58.504170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.515887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8a92a-dc12-4a91-8a58-8f6b4f8526ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.521449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.522338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.522615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.522884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] PATH_INFO: `/v3/projects/cc5eb6cab17f438abff615e4ecc3ae40/users/d838dc2285134bcb9b2befc4fca82f5f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.539357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5eb6cab17f438abff615e4ecc3ae40, user_id=d838dc2285134bcb9b2befc4fca82f5f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.542200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:58.654561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3990/8079] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:58 2021] PUT /identity/v3/projects/cc5eb6cab17f438abff615e4ecc3ae40/users/d838dc2285134bcb9b2befc4fca82f5f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:58.666978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f412-bbc2-437c-8961-076640296728 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.666978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f412-bbc2-437c-8961-076640296728 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.666978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f412-bbc2-437c-8961-076640296728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.700585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-63d0f412-bbc2-437c-8961-076640296728 None None] MFA Rules not processed for user `d838dc2285134bcb9b2befc4fca82f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:58.701849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-63d0f412-bbc2-437c-8961-076640296728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:58.767315 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4090/8080] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:58.772442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.834925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f3649-42af-41ec-b1c9-f3c017ea5272 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.839887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.840542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.840826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.841160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.841842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.843772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:58.914858 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3991/8081] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:58 2021] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:58.918787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f412-bbc2-437c-8961-076640296728 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:58.930917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f412-bbc2-437c-8961-076640296728 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:58.994839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:58.995504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:58.995784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:58.996646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:58.996773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:58.998666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:59.072310 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4091/8082] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:41:58 2021] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:59.077006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:59.088373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec203-4326-45a6-b3e3-226774860095 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:59.093315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:59.094097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.094454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.094806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.095641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:59.097393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:59.108303 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3992/8083] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:41:59.113221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:59.123341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58e78-a487-4fb4-adc8-b42fdf80c670 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:59.128682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:59.129599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.129882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.130158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] PATH_INFO: `/v3/projects/5d490d845c7b48c1af25d94f6521a80b/users/1d91db18cdca49cbb72a2b2c93d62023/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.145639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d490d845c7b48c1af25d94f6521a80b, user_id=1d91db18cdca49cbb72a2b2c93d62023, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:59.148268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:59.238531 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4092/8084] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:59 2021] PUT /identity/v3/projects/5d490d845c7b48c1af25d94f6521a80b/users/1d91db18cdca49cbb72a2b2c93d62023/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:41:59.242615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:59.252746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9038f-b6ec-4d3c-b82c-7a540bdcd830 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:59.311486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fad730-eea9-4de2-af53-b81393ca7a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:59.312430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fad730-eea9-4de2-af53-b81393ca7a79 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.312894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fad730-eea9-4de2-af53-b81393ca7a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.313233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fad730-eea9-4de2-af53-b81393ca7a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.313981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fad730-eea9-4de2-af53-b81393ca7a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:59.315584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fad730-eea9-4de2-af53-b81393ca7a79 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:59.325942 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3993/8085] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:41:59 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:41:59.335166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:59.345653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2b80-9f9d-4bc6-9767-a8f93cd44148 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:59.350872 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:59.351801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.352243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.352712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] PATH_INFO: `/v3/projects/5d490d845c7b48c1af25d94f6521a80b/users/1d91db18cdca49cbb72a2b2c93d62023/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.354896 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d490d845c7b48c1af25d94f6521a80b, user_id=1d91db18cdca49cbb72a2b2c93d62023, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:59.357714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:59.368921 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4093/8086] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:41:59 2021] PUT /identity/v3/projects/5d490d845c7b48c1af25d94f6521a80b/users/1d91db18cdca49cbb72a2b2c93d62023/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:41:59.380225 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2bbe5-c45f-4953-bc21-b52f48d64565 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.380511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2bbe5-c45f-4953-bc21-b52f48d64565 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.380784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2bbe5-c45f-4953-bc21-b52f48d64565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.407836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8ff2bbe5-c45f-4953-bc21-b52f48d64565 None None] MFA Rules not processed for user `1d91db18cdca49cbb72a2b2c93d62023`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:41:59.409061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8ff2bbe5-c45f-4953-bc21-b52f48d64565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:41:59.487191 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3994/8087] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:41:59 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:41:59.489692 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:59.510853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ea3be-2897-468d-b520-013b61ee3896 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:59.521918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d91db18cdca49cbb72a2b2c93d62023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d490d845c7b48c1af25d94f6521a80b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:59.522776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.523100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.523444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.524320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:59.527990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:41:59.632052 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4094/8088] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:41:59 2021] POST /identity/v3/projects => generated 358 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:41:59.636331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2bbe5-c45f-4953-bc21-b52f48d64565 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:59.696576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2bbe5-c45f-4953-bc21-b52f48d64565 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:59.747232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd838dc2285134bcb9b2befc4fca82f5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc5eb6cab17f438abff615e4ecc3ae40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:59.748015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.748295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.748558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] PATH_INFO: `/v3/projects/ee9f52708b0746a68480aa54247e50c4` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.749786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] RBAC: Authorizing `identity:delete_project(project_id=ee9f52708b0746a68480aa54247e50c4)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:59.760267 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Dec 25 21:41:59.761460 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3995/8089] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:59 2021] DELETE /identity/v3/projects/ee9f52708b0746a68480aa54247e50c4 => generated 136 bytes in 126 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Dec 25 21:41:59.766184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:41:59.835417 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811bf46-cc45-4b1a-b2c7-2b64b3801f0f tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:41:59.840578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d91db18cdca49cbb72a2b2c93d62023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d490d845c7b48c1af25d94f6521a80b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:41:59.841677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:41:59.842066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:41:59.842445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] PATH_INFO: `/v3/projects/ee9f52708b0746a68480aa54247e50c4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:41:59.844074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee9f52708b0746a68480aa54247e50c4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:41:59.846319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:00.016496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9f52708b0746a68480aa54247e50c4', 'request_id': 'req-58f2dc6e-08ec-4213-aacd-0675f2558e81'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.111882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9f52708b0746a68480aa54247e50c4', 'request_id': 'req-58f2dc6e-08ec-4213-aacd-0675f2558e81'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.118726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9f52708b0746a68480aa54247e50c4', 'request_id': 'req-58f2dc6e-08ec-4213-aacd-0675f2558e81'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.129865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] The token cache is being invalidate because project ee9f52708b0746a68480aa54247e50c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:42:00.130164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.131162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-58f2dc6e-08ec-4213-aacd-0675f2558e81 tempest-ProjectsNegativeTestJSON-1128232680 tempest-ProjectsNegativeTestJSON-1128232680-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.132931 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4095/8090] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:41:59 2021] DELETE /identity/v3/projects/ee9f52708b0746a68480aa54247e50c4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:00.137948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:00.140209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:00.205593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced32d0-ab91-4293-83fa-abb89c36a09c tempest-ProjectsNegativeTestJSON-1942206537 tempest-ProjectsNegativeTestJSON-1942206537-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:00.261516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:00.262379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:00.262658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:00.262931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] PATH_INFO: `/v3/users/d838dc2285134bcb9b2befc4fca82f5f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:00.264385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d838dc2285134bcb9b2befc4fca82f5f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:00.266311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:00.502428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd838dc2285134bcb9b2befc4fca82f5f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.510214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd838dc2285134bcb9b2befc4fca82f5f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.523567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd838dc2285134bcb9b2befc4fca82f5f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.524428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd838dc2285134bcb9b2befc4fca82f5f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.525065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd838dc2285134bcb9b2befc4fca82f5f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:00.580189 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3996/8091] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:42:00 2021] DELETE /identity/v3/users/d838dc2285134bcb9b2befc4fca82f5f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:00.585520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:00.585806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:00.586085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:00.606340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:00.608086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:00.669088 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4096/8092] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:42:00.679711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:00.681180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:00.743591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b6a5e-9c72-483c-b24a-3bcc01759f87 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:00.747353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:00.748000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:00.748285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:00.748560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:00.758722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:00.760130 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:00.770043 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3997/8093] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:42:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:42:01.187156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:01.188637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:01.212134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69032036-a1d8-4268-837a-043b0d4d4a4e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:01.221218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:01.224002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:01.224558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:01.225095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] PATH_INFO: `/v3/projects/cc5eb6cab17f438abff615e4ecc3ae40` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:01.229027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5eb6cab17f438abff615e4ecc3ae40)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:01.233278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:01.386406 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5eb6cab17f438abff615e4ecc3ae40', 'request_id': 'req-d246aefc-d1a4-4f09-aeb5-f855e099d153'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.466348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5eb6cab17f438abff615e4ecc3ae40', 'request_id': 'req-d246aefc-d1a4-4f09-aeb5-f855e099d153'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.475672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5eb6cab17f438abff615e4ecc3ae40', 'request_id': 'req-d246aefc-d1a4-4f09-aeb5-f855e099d153'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.489918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] The token cache is being invalidate because project cc5eb6cab17f438abff615e4ecc3ae40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:42:01.490273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.491106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.492898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4097/8094] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:42:01 2021] DELETE /identity/v3/projects/cc5eb6cab17f438abff615e4ecc3ae40 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:01.497129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:01.506893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225b08-84cf-419c-8b30-3ca5aa2eae77 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:01.574943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:01.576098 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:01.576471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:01.580379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] PATH_INFO: `/v3/users/1d91db18cdca49cbb72a2b2c93d62023` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:01.580379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d91db18cdca49cbb72a2b2c93d62023)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:01.580379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:01.777519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d91db18cdca49cbb72a2b2c93d62023'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.784162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d91db18cdca49cbb72a2b2c93d62023'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.796585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d91db18cdca49cbb72a2b2c93d62023'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.797091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d91db18cdca49cbb72a2b2c93d62023'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.797752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-28254ae9-f005-4907-ba39-dc12f4531ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d91db18cdca49cbb72a2b2c93d62023'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:01.902941 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3998/8095] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:42:01 2021] DELETE /identity/v3/users/1d91db18cdca49cbb72a2b2c93d62023 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:02.325853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:02.327419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:02.345912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246aefc-d1a4-4f09-aeb5-f855e099d153 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:02.410680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:02.411607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:02.411887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:02.412159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] PATH_INFO: `/v3/projects/5d490d845c7b48c1af25d94f6521a80b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:02.413578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d490d845c7b48c1af25d94f6521a80b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:02.415488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:02.540805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d490d845c7b48c1af25d94f6521a80b', 'request_id': 'req-653e1a28-a3f9-4243-930b-a609694f3c65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:02.637265 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d490d845c7b48c1af25d94f6521a80b', 'request_id': 'req-653e1a28-a3f9-4243-930b-a609694f3c65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:02.644356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d490d845c7b48c1af25d94f6521a80b', 'request_id': 'req-653e1a28-a3f9-4243-930b-a609694f3c65'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:02.654521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] The token cache is being invalidate because project 5d490d845c7b48c1af25d94f6521a80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:42:02.654810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:02.655441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-653e1a28-a3f9-4243-930b-a609694f3c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:02.657153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4098/8096] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:42:02 2021] DELETE /identity/v3/projects/5d490d845c7b48c1af25d94f6521a80b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:02.665100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce3f59-e229-49b6-9d66-7d70b719cf14 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:02.665386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce3f59-e229-49b6-9d66-7d70b719cf14 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:02.665676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce3f59-e229-49b6-9d66-7d70b719cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:02.684258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9fce3f59-e229-49b6-9d66-7d70b719cf14 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:02.685476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9fce3f59-e229-49b6-9d66-7d70b719cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:02.743381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 3999/8097] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:02.751329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4df1-7c7b-460c-b04c-950e3be95abe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:02.751617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4df1-7c7b-460c-b04c-950e3be95abe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:02.751940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4df1-7c7b-460c-b04c-950e3be95abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:02.772303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5b1b4df1-7c7b-460c-b04c-950e3be95abe None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:02.772303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5b1b4df1-7c7b-460c-b04c-950e3be95abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:02.780158 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4099/8098] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:02.784828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce3f59-e229-49b6-9d66-7d70b719cf14 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:02.794755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce3f59-e229-49b6-9d66-7d70b719cf14 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:02.799837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:02.801071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:02.801349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:02.801761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:02.802502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:42:02.802805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:02.804383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:02.815649 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4000/8099] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:42:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:42:02.819849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b4df1-7c7b-460c-b04c-950e3be95abe None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:02.829123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b4df1-7c7b-460c-b04c-950e3be95abe None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:02.833999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:02.834646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:02.834930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:02.835206 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:02.835889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:02.837821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:02.981721 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4100/8100] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:42:02 2021] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:42:02.985877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:02.995766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edcf1b-0707-4770-8faf-ce39d0a0afef admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:03.052139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:03.052728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:03.053046 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:03.053321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:03.054003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:03.055892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:03.164813 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4001/8101] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:42:02 2021] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:42:03.168800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:03.179252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2ba7e-6a71-4743-a0b4-9bc96750848e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:03.183901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:03.184550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:03.184861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:03.185168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:03.185927 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:03.187557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:03.199321 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4101/8102] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:42:03.203317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:03.213700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b703-0d70-4bf3-95b4-4b4bc8110e7b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:03.218358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d061c-fd1a-46c1-8233-ed9fea86537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:03.226371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d061c-fd1a-46c1-8233-ed9fea86537a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:03.226371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d061c-fd1a-46c1-8233-ed9fea86537a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:03.226371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d061c-fd1a-46c1-8233-ed9fea86537a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:03.226371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d061c-fd1a-46c1-8233-ed9fea86537a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:03.226371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d061c-fd1a-46c1-8233-ed9fea86537a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:03.235068 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4002/8103] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:42:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:42:03.239146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:03.249439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b5f59-ab27-432b-91d5-98967436edea admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:03.255116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:03.255995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:03.256299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:03.256569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] PATH_INFO: `/v3/projects/80d9615a06c0446ab59b623e07f72992/users/57ea77d3c533467ca58c7ec8aa8db904/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:03.272150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d9615a06c0446ab59b623e07f72992, user_id=57ea77d3c533467ca58c7ec8aa8db904, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:03.274829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:03.345670 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4102/8104] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:42:03 2021] PUT /identity/v3/projects/80d9615a06c0446ab59b623e07f72992/users/57ea77d3c533467ca58c7ec8aa8db904/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:42:03.357020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b527-dd92-45c4-8413-ef60dfce302a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:03.357311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b527-dd92-45c4-8413-ef60dfce302a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:03.357588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334b527-dd92-45c4-8413-ef60dfce302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:03.384400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a334b527-dd92-45c4-8413-ef60dfce302a None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:03.385721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a334b527-dd92-45c4-8413-ef60dfce302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:03.448284 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4003/8105] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:03 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:03.453270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:03.464005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbef55-6a6f-4fe5-b11d-01129e427917 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:03.469365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c304f-5ee8-4c85-b88e-e788dfb0b2b3 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:03.470224 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c304f-5ee8-4c85-b88e-e788dfb0b2b3 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:03.470511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c304f-5ee8-4c85-b88e-e788dfb0b2b3 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:03.471339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c304f-5ee8-4c85-b88e-e788dfb0b2b3 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:03.573197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-961c304f-5ee8-4c85-b88e-e788dfb0b2b3 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:03.626871 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4103/8106] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:03 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:04.633285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb873-4dd4-4fd1-b605-cbbfe256ad9f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:04.633791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb873-4dd4-4fd1-b605-cbbfe256ad9f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:04.633791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb873-4dd4-4fd1-b605-cbbfe256ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:04.651946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7bdfb873-4dd4-4fd1-b605-cbbfe256ad9f None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:04.653245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7bdfb873-4dd4-4fd1-b605-cbbfe256ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:04.656292 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4004/8107] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:04 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:04.661672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6972-859b-4374-b921-00016c79719e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:04.662141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6972-859b-4374-b921-00016c79719e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:04.662244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6972-859b-4374-b921-00016c79719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:04.680897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-04ee6972-859b-4374-b921-00016c79719e None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:04.682193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-04ee6972-859b-4374-b921-00016c79719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:04.689251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4104/8108] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:04 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:04.694825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfb873-4dd4-4fd1-b605-cbbfe256ad9f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:04.706120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfb873-4dd4-4fd1-b605-cbbfe256ad9f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:04.710797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d15d9-3cfa-4cc9-9384-e02b87cec532 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:04.711651 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d15d9-3cfa-4cc9-9384-e02b87cec532 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:04.711930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d15d9-3cfa-4cc9-9384-e02b87cec532 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:04.712233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d15d9-3cfa-4cc9-9384-e02b87cec532 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:04.755105 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-c99d15d9-3cfa-4cc9-9384-e02b87cec532 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Dec 25 21:42:04.756331 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4005/8109] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:04 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 188 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:42:04.762340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6972-859b-4374-b921-00016c79719e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:04.776044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6972-859b-4374-b921-00016c79719e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:04.781300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad3739-8daf-45b5-b936-d57a0f0a4806 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:04.782467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3739-8daf-45b5-b936-d57a0f0a4806 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:04.782794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3739-8daf-45b5-b936-d57a0f0a4806 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:04.783129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3739-8daf-45b5-b936-d57a0f0a4806 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:04.829163 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-c9ad3739-8daf-45b5-b936-d57a0f0a4806 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Dec 25 21:42:04.829163 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4105/8110] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:04 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 188 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Dec 25 21:42:04.833970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d15d9-3cfa-4cc9-9384-e02b87cec532 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:04.844149 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d15d9-3cfa-4cc9-9384-e02b87cec532 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:04.848382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f03cf3-56ec-40bf-8343-7ed89b46e8d8 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:04.849255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f03cf3-56ec-40bf-8343-7ed89b46e8d8 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:04.849540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f03cf3-56ec-40bf-8343-7ed89b46e8d8 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:04.849814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f03cf3-56ec-40bf-8343-7ed89b46e8d8 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:04.984960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-91f03cf3-56ec-40bf-8343-7ed89b46e8d8 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:05.089978 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4006/8111] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:04 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:06.095239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78da5-5dbd-4507-bbc7-1342477b3a7f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:06.095780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78da5-5dbd-4507-bbc7-1342477b3a7f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:06.095780 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78da5-5dbd-4507-bbc7-1342477b3a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:06.115696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8ba78da5-5dbd-4507-bbc7-1342477b3a7f None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:06.116892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8ba78da5-5dbd-4507-bbc7-1342477b3a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:06.120554 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4106/8112] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:06 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:06.125409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c7f16-4854-4636-ac93-2bbc828b1d1c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:06.125881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c7f16-4854-4636-ac93-2bbc828b1d1c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:06.125983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c7f16-4854-4636-ac93-2bbc828b1d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:06.145126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-083c7f16-4854-4636-ac93-2bbc828b1d1c None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:06.146339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-083c7f16-4854-4636-ac93-2bbc828b1d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:06.153433 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4007/8113] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:06.157663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba78da5-5dbd-4507-bbc7-1342477b3a7f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:06.169209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba78da5-5dbd-4507-bbc7-1342477b3a7f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:06.173246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b5d03-bde6-4ac4-9c26-2aea9ff2ac4d tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:06.174083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5d03-bde6-4ac4-9c26-2aea9ff2ac4d tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:06.174364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5d03-bde6-4ac4-9c26-2aea9ff2ac4d tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:06.174638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5d03-bde6-4ac4-9c26-2aea9ff2ac4d tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:06.327659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f18b5d03-bde6-4ac4-9c26-2aea9ff2ac4d tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:06.405751 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4107/8114] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:06 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:07.410080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0f0a-7497-4d01-b60d-d8cac51fa716 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:07.410568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0f0a-7497-4d01-b60d-d8cac51fa716 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:07.410668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0f0a-7497-4d01-b60d-d8cac51fa716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:07.427767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-317c0f0a-7497-4d01-b60d-d8cac51fa716 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:07.429146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-317c0f0a-7497-4d01-b60d-d8cac51fa716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:07.432034 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4008/8115] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:07 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:07.436638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e95738-555b-44d6-83d1-48969ee38b76 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:07.437143 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e95738-555b-44d6-83d1-48969ee38b76 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:07.437249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e95738-555b-44d6-83d1-48969ee38b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:07.457820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-93e95738-555b-44d6-83d1-48969ee38b76 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:07.459020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-93e95738-555b-44d6-83d1-48969ee38b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:07.465902 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4108/8116] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:07 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:07.470120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c0f0a-7497-4d01-b60d-d8cac51fa716 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:07.481594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c0f0a-7497-4d01-b60d-d8cac51fa716 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:07.485906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b389d-05dd-4f7d-bd4d-5509ce08c189 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:07.486782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b389d-05dd-4f7d-bd4d-5509ce08c189 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:07.487068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b389d-05dd-4f7d-bd4d-5509ce08c189 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:07.487343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b389d-05dd-4f7d-bd4d-5509ce08c189 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:07.619367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c00b389d-05dd-4f7d-bd4d-5509ce08c189 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:07.695572 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4009/8117] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:07 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:08.701556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1472-41bc-40fe-b130-3fe193ed857d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:08.702009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1472-41bc-40fe-b130-3fe193ed857d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:08.702095 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1472-41bc-40fe-b130-3fe193ed857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:08.720761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4dad1472-41bc-40fe-b130-3fe193ed857d None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:08.722580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4dad1472-41bc-40fe-b130-3fe193ed857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:08.725760 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4109/8118] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:08 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:08.730612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295487fa-4543-461c-8cbd-62afe5ba6265 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:08.731053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295487fa-4543-461c-8cbd-62afe5ba6265 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:08.731299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295487fa-4543-461c-8cbd-62afe5ba6265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:08.752077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-295487fa-4543-461c-8cbd-62afe5ba6265 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:08.753530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-295487fa-4543-461c-8cbd-62afe5ba6265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:08.760704 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4010/8119] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:08 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:42:08.765321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1472-41bc-40fe-b130-3fe193ed857d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:08.777007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1472-41bc-40fe-b130-3fe193ed857d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:08.781100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f03526-1f8f-42cb-a0b2-d9313c8199cc tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:08.781956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f03526-1f8f-42cb-a0b2-d9313c8199cc tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:08.782237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f03526-1f8f-42cb-a0b2-d9313c8199cc tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:08.782512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f03526-1f8f-42cb-a0b2-d9313c8199cc tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:08.911892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-76f03526-1f8f-42cb-a0b2-d9313c8199cc tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:08.980949 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4110/8120] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:08 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:09.986704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193db9b-fb8a-4954-8eb0-bdc3bb9ba3be None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:09.987172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193db9b-fb8a-4954-8eb0-bdc3bb9ba3be None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:09.987274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193db9b-fb8a-4954-8eb0-bdc3bb9ba3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:10.005454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7193db9b-fb8a-4954-8eb0-bdc3bb9ba3be None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:10.012471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7193db9b-fb8a-4954-8eb0-bdc3bb9ba3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:10.012471 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4011/8121] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:09 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:11.016067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41961-c269-42bb-8c7e-e525bdd46674 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:11.016621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41961-c269-42bb-8c7e-e525bdd46674 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:11.016621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c41961-c269-42bb-8c7e-e525bdd46674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:11.039431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-45c41961-c269-42bb-8c7e-e525bdd46674 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:11.040635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-45c41961-c269-42bb-8c7e-e525bdd46674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:11.047728 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4111/8122] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:11 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:11.057631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1b5a-81d9-474c-8182-8bd33591208d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:11.061050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1b5a-81d9-474c-8182-8bd33591208d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:11.061050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1b5a-81d9-474c-8182-8bd33591208d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:11.077408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d2ec1b5a-81d9-474c-8182-8bd33591208d None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:11.078630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d2ec1b5a-81d9-474c-8182-8bd33591208d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:11.081783 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4012/8123] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:11 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:11.086704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9b16-47ad-411d-96ee-a64f975e6031 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:11.086995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9b16-47ad-411d-96ee-a64f975e6031 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:11.087276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a9b16-47ad-411d-96ee-a64f975e6031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:11.219348 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3b3a9b16-47ad-411d-96ee-a64f975e6031 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 25 21:42:11.221243 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4112/8124] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:11 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 136 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 25 21:42:11.226688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711584d-0b52-48e5-a9f8-6236fc2fe487 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:11.231681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711584d-0b52-48e5-a9f8-6236fc2fe487 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:11.231681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711584d-0b52-48e5-a9f8-6236fc2fe487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:11.334817 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-8711584d-0b52-48e5-a9f8-6236fc2fe487 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 25 21:42:11.336289 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4013/8125] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:11 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 111 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 25 21:42:11.340912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d1dd-d0ba-431d-8eef-0e0333a8745c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:11.341210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d1dd-d0ba-431d-8eef-0e0333a8745c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:11.341491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d1dd-d0ba-431d-8eef-0e0333a8745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:11.365516 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-2f93d1dd-d0ba-431d-8eef-0e0333a8745c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 25 21:42:11.367037 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4113/8126] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:11 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 27 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Dec 25 21:42:22.379926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e57e-4df4-4cbf-8c83-08e2789f3e09 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:22.380475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e57e-4df4-4cbf-8c83-08e2789f3e09 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:22.380475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e57e-4df4-4cbf-8c83-08e2789f3e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:22.490464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f213e57e-4df4-4cbf-8c83-08e2789f3e09 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:22.492269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f213e57e-4df4-4cbf-8c83-08e2789f3e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:22.497341 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4014/8127] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:22 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:22.503959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93d1dd-d0ba-431d-8eef-0e0333a8745c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:22.515835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93d1dd-d0ba-431d-8eef-0e0333a8745c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:22.519995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0336c5-fea9-406b-8659-641135685833 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:22.520784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0336c5-fea9-406b-8659-641135685833 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:22.521596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0336c5-fea9-406b-8659-641135685833 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:22.521936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0336c5-fea9-406b-8659-641135685833 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:22.665982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cc0336c5-fea9-406b-8659-641135685833 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:22.752756 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4114/8128] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:22 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:42:23.758555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36165de2-bce2-40ee-a8b8-9e7dc37b924b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:23.759122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36165de2-bce2-40ee-a8b8-9e7dc37b924b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:23.759122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36165de2-bce2-40ee-a8b8-9e7dc37b924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:23.776458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-36165de2-bce2-40ee-a8b8-9e7dc37b924b None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:23.777652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-36165de2-bce2-40ee-a8b8-9e7dc37b924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:23.780652 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4015/8129] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:23 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:23.785356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015143e-aee6-4334-93c2-275f3a8aed50 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:23.785819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015143e-aee6-4334-93c2-275f3a8aed50 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:23.789730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015143e-aee6-4334-93c2-275f3a8aed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:23.800497 ncdv-master-1 devstack@keystone.service[96733]: WARNING keystone.server.flask.application [None req-3015143e-aee6-4334-93c2-275f3a8aed50 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Dec 25 21:42:23.801609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4115/8130] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:23 2021] POST /identity/v3/auth/tokens => generated 80 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 25 21:42:23.806334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2558-a252-4873-ad8f-8308a2779f30 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:23.806620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2558-a252-4873-ad8f-8308a2779f30 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:23.806895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2558-a252-4873-ad8f-8308a2779f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:23.898100 ncdv-master-1 devstack@keystone.service[96732]: WARNING keystone.server.flask.application [None req-bf6f2558-a252-4873-ad8f-8308a2779f30 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. Dec 25 21:42:23.899654 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4016/8131] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:23 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 94 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Dec 25 21:42:23.904364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2d09-a750-49d9-b7c2-6fb1934463fe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:23.904709 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2d09-a750-49d9-b7c2-6fb1934463fe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:23.905196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c2d09-a750-49d9-b7c2-6fb1934463fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:23.976676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-860c2d09-a750-49d9-b7c2-6fb1934463fe None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:23.977936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-860c2d09-a750-49d9-b7c2-6fb1934463fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:23.985001 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4116/8132] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:23.989452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2558-a252-4873-ad8f-8308a2779f30 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:24.001117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2558-a252-4873-ad8f-8308a2779f30 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:24.005261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0e3a8-fe64-430f-a1aa-b895d3e30e36 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:24.006143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0e3a8-fe64-430f-a1aa-b895d3e30e36 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:24.006426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0e3a8-fe64-430f-a1aa-b895d3e30e36 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:24.006703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0e3a8-fe64-430f-a1aa-b895d3e30e36 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:24.131354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-63b0e3a8-fe64-430f-a1aa-b895d3e30e36 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:24.221613 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4017/8133] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:23 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:25.227031 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897127-b901-40c1-baf9-72fab06db243 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:25.227879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897127-b901-40c1-baf9-72fab06db243 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:25.227879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897127-b901-40c1-baf9-72fab06db243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:25.245787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a3897127-b901-40c1-baf9-72fab06db243 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:25.247009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a3897127-b901-40c1-baf9-72fab06db243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:25.262525 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4117/8134] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:25 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:25.262677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101ee48-6bdb-4603-9b62-b706fecd55d1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:25.262677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101ee48-6bdb-4603-9b62-b706fecd55d1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:25.262677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101ee48-6bdb-4603-9b62-b706fecd55d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:25.274229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8101ee48-6bdb-4603-9b62-b706fecd55d1 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:25.275402 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8101ee48-6bdb-4603-9b62-b706fecd55d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:25.282625 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4018/8135] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:25 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:25.287181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897127-b901-40c1-baf9-72fab06db243 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:25.297990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897127-b901-40c1-baf9-72fab06db243 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:25.302039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a24872-983f-4fc6-b670-303c1ae6500c tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:25.303507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a24872-983f-4fc6-b670-303c1ae6500c tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:25.303791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a24872-983f-4fc6-b670-303c1ae6500c tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:25.304090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a24872-983f-4fc6-b670-303c1ae6500c tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:25.441978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-02a24872-983f-4fc6-b670-303c1ae6500c tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:25.530152 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4118/8136] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:25 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:26.535719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d777-262a-4dfd-beb3-9465b5b6445b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:26.536282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d777-262a-4dfd-beb3-9465b5b6445b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:26.536282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8d777-262a-4dfd-beb3-9465b5b6445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:26.555565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6fd8d777-262a-4dfd-beb3-9465b5b6445b None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:26.556893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6fd8d777-262a-4dfd-beb3-9465b5b6445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:26.560270 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4019/8137] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:26 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:26.564982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf75608-060c-4c08-8f66-d9b6e2a6e010 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:26.565469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf75608-060c-4c08-8f66-d9b6e2a6e010 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:26.565615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf75608-060c-4c08-8f66-d9b6e2a6e010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:26.585413 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bdf75608-060c-4c08-8f66-d9b6e2a6e010 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:26.586632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bdf75608-060c-4c08-8f66-d9b6e2a6e010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:26.593632 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4119/8138] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:26 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:26.598079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d777-262a-4dfd-beb3-9465b5b6445b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:26.608903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8d777-262a-4dfd-beb3-9465b5b6445b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:26.612827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a1289-e9ca-464d-bca0-d8a54d9c15a7 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea77d3c533467ca58c7ec8aa8db904', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80d9615a06c0446ab59b623e07f72992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:26.613994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1289-e9ca-464d-bca0-d8a54d9c15a7 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:26.614235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1289-e9ca-464d-bca0-d8a54d9c15a7 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:26.614536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1289-e9ca-464d-bca0-d8a54d9c15a7 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:26.738722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-124a1289-e9ca-464d-bca0-d8a54d9c15a7 tempest-IdentityV3UsersTest-603169103 tempest-IdentityV3UsersTest-603169103-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:26.891799 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4020/8139] 10.222.0.32 () {60 vars in 1268 bytes} [Sat Dec 25 21:42:26 2021] POST /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904/password => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:27.896649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320bec-882d-4848-aa95-da4058725971 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:27.897613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320bec-882d-4848-aa95-da4058725971 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:27.897744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320bec-882d-4848-aa95-da4058725971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:27.917278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-58320bec-882d-4848-aa95-da4058725971 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:27.918670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-58320bec-882d-4848-aa95-da4058725971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:27.921901 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4120/8140] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:27 2021] POST /identity/v3/auth/tokens => generated 352 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Dec 25 21:42:28.927833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bfd7f-6327-42f3-ab23-4291d8bf8388 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:28.929094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bfd7f-6327-42f3-ab23-4291d8bf8388 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:28.929094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bfd7f-6327-42f3-ab23-4291d8bf8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:28.948898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7a7bfd7f-6327-42f3-ab23-4291d8bf8388 None None] MFA Rules not processed for user `57ea77d3c533467ca58c7ec8aa8db904`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:28.950139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7a7bfd7f-6327-42f3-ab23-4291d8bf8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:28.957063 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4021/8141] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:28.965504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58320bec-882d-4848-aa95-da4058725971 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:29.028407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58320bec-882d-4848-aa95-da4058725971 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:29.033126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:29.034021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:29.034303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:29.034575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] PATH_INFO: `/v3/users/57ea77d3c533467ca58c7ec8aa8db904` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:29.035787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ea77d3c533467ca58c7ec8aa8db904)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:29.038342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:29.263282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:29.270228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:29.282200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:29.282873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:29.379061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ea77d3c533467ca58c7ec8aa8db904'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:29.386132 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4121/8142] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:42:28 2021] DELETE /identity/v3/users/57ea77d3c533467ca58c7ec8aa8db904 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:29.391050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:29.391336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:29.391615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:29.414890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:29.420277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:29.476891 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4022/8143] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:29.486825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:29.488308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:29.546408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b34e66-e9e6-4ecc-bb1d-4ae7eb7e5607 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:29.549957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01712a94-afa6-4ae1-bba4-011af048fafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:29.550590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712a94-afa6-4ae1-bba4-011af048fafd service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:29.550869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712a94-afa6-4ae1-bba4-011af048fafd service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:29.551140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712a94-afa6-4ae1-bba4-011af048fafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:29.560245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01712a94-afa6-4ae1-bba4-011af048fafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:29.562330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01712a94-afa6-4ae1-bba4-011af048fafd service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:29.574307 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4122/8144] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:42:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:42:30.032745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:30.035486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:30.051288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383a8fa-de94-4ab7-9142-f3e2758fd875 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:30.056748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:30.057655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.057938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.058215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] PATH_INFO: `/v3/projects/80d9615a06c0446ab59b623e07f72992` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.059546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d9615a06c0446ab59b623e07f72992)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:30.061496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:30.168573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d9615a06c0446ab59b623e07f72992', 'request_id': 'req-48126c0f-f51c-4498-9698-42018b5ed92d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:30.176009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d9615a06c0446ab59b623e07f72992', 'request_id': 'req-48126c0f-f51c-4498-9698-42018b5ed92d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:30.254737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d9615a06c0446ab59b623e07f72992', 'request_id': 'req-48126c0f-f51c-4498-9698-42018b5ed92d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:30.265752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] The token cache is being invalidate because project 80d9615a06c0446ab59b623e07f72992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:42:30.266037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:30.266646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-48126c0f-f51c-4498-9698-42018b5ed92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:30.268208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4023/8145] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:42:30 2021] DELETE /identity/v3/projects/80d9615a06c0446ab59b623e07f72992 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:30.275646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271ec1b-d157-4692-b426-fe1b522395ee None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.276163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271ec1b-d157-4692-b426-fe1b522395ee None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.276315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271ec1b-d157-4692-b426-fe1b522395ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.295723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c271ec1b-d157-4692-b426-fe1b522395ee None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:30.297006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c271ec1b-d157-4692-b426-fe1b522395ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:30.356020 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4123/8146] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:30.364156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98777883-954c-4f73-b932-1e23232e009e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.364442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98777883-954c-4f73-b932-1e23232e009e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.364721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98777883-954c-4f73-b932-1e23232e009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.384343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-98777883-954c-4f73-b932-1e23232e009e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:30.385570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-98777883-954c-4f73-b932-1e23232e009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:30.393973 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4024/8147] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:30.398058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271ec1b-d157-4692-b426-fe1b522395ee None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:30.408037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271ec1b-d157-4692-b426-fe1b522395ee None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:30.412668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:30.459378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.459378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.459378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.459378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:42:30.459378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:30.459378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:30.459962 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4124/8148] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:42:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:42:30.462377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98777883-954c-4f73-b932-1e23232e009e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:30.471519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98777883-954c-4f73-b932-1e23232e009e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:30.476128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:30.477307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.477593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.477935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.478621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:30.480557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:30.591168 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4025/8149] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:42:30 2021] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:42:30.592563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:30.603052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9320d3b-64a4-47c4-bc0a-8815723aadca admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:30.667832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:30.668505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.668784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.669096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.669912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:30.672106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:30.864123 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4125/8150] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:42:30 2021] POST /identity/v3/users => generated 291 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:42:30.865739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:30.876914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abde3cd-85b6-455a-b982-632271b50279 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:30.881784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:30.890284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.890284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.890284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.890284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:30.890284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:30.909256 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4026/8151] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:42:30 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:42:30.913283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:30.926504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce668-10ad-42e5-a240-2d0b013816f1 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:30.931974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f440-3b7d-48d8-a1dd-fe73d28c1f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:30.932783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f440-3b7d-48d8-a1dd-fe73d28c1f60 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.933226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f440-3b7d-48d8-a1dd-fe73d28c1f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.933599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f440-3b7d-48d8-a1dd-fe73d28c1f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.934471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f440-3b7d-48d8-a1dd-fe73d28c1f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:30.936180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f440-3b7d-48d8-a1dd-fe73d28c1f60 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:30.952457 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4126/8152] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:42:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:42:30.955919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:30.966285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bb695-d25f-4a19-ba06-01d1cab8245e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:30.971941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:30.972848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:30.973160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:30.973436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] PATH_INFO: `/v3/projects/1f0d57d28df946648dbdd9b355ddad96/users/279b5b87bc844b25976a144b11939d9a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:30.989510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0d57d28df946648dbdd9b355ddad96, user_id=279b5b87bc844b25976a144b11939d9a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:30.992077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:31.095454 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4027/8153] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:42:30 2021] PUT /identity/v3/projects/1f0d57d28df946648dbdd9b355ddad96/users/279b5b87bc844b25976a144b11939d9a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:31.106401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39263-fff9-4883-8db9-58a7951409d9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:31.106694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39263-fff9-4883-8db9-58a7951409d9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:31.106966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39263-fff9-4883-8db9-58a7951409d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:31.134324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fbf39263-fff9-4883-8db9-58a7951409d9 None None] MFA Rules not processed for user `279b5b87bc844b25976a144b11939d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:31.135528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fbf39263-fff9-4883-8db9-58a7951409d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:31.201528 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4127/8154] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:31 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:31.217505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:31.231883 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:31.318191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31867-1464-45ae-92a5-03e1991f1b85 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:31.323798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf26c-4e05-4625-9939-092424a2bee3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:31.324551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf26c-4e05-4625-9939-092424a2bee3 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:31.324798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf26c-4e05-4625-9939-092424a2bee3 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:31.325209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf26c-4e05-4625-9939-092424a2bee3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:31.335904 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf26c-4e05-4625-9939-092424a2bee3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:31.347107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf26c-4e05-4625-9939-092424a2bee3 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:31.349011 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4028/8155] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:42:31 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:42:31.821255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39263-fff9-4883-8db9-58a7951409d9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:31.905243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39263-fff9-4883-8db9-58a7951409d9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:31.910245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:31.914955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:31.914955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:31.914955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] PATH_INFO: `/v3/users/279b5b87bc844b25976a144b11939d9a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:31.914955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279b5b87bc844b25976a144b11939d9a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:31.915742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:32.170918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279b5b87bc844b25976a144b11939d9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:32.180197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279b5b87bc844b25976a144b11939d9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:32.202682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279b5b87bc844b25976a144b11939d9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:32.203967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279b5b87bc844b25976a144b11939d9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:32.316858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279b5b87bc844b25976a144b11939d9a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:32.328497 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4128/8156] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:42:31 2021] DELETE /identity/v3/users/279b5b87bc844b25976a144b11939d9a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:32.330768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:32.338466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:32.338466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:32.350979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:32.352961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:32.416471 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4029/8157] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:42:32.426560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:32.427966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:32.493523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d39ac-d6b9-46e0-a83d-ef772e2833d8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:32.497653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be58208-a049-4481-a1da-e0c2919c605e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:32.498421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58208-a049-4481-a1da-e0c2919c605e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:32.498799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58208-a049-4481-a1da-e0c2919c605e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:32.499168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58208-a049-4481-a1da-e0c2919c605e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:32.511957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be58208-a049-4481-a1da-e0c2919c605e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:32.515339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be58208-a049-4481-a1da-e0c2919c605e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:32.528585 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4129/8158] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:42:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:42:32.957866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:32.957866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:32.969591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac254e-7c12-40bf-91d6-314ea310e40d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:32.974317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:32.975250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:32.975601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:32.975954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] PATH_INFO: `/v3/projects/1f0d57d28df946648dbdd9b355ddad96` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:32.977825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0d57d28df946648dbdd9b355ddad96)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:32.979867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:33.094458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0d57d28df946648dbdd9b355ddad96', 'request_id': 'req-399d618c-8d8b-4f1c-b448-8b9fa5b48947'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:33.100312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0d57d28df946648dbdd9b355ddad96', 'request_id': 'req-399d618c-8d8b-4f1c-b448-8b9fa5b48947'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:33.156163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0d57d28df946648dbdd9b355ddad96', 'request_id': 'req-399d618c-8d8b-4f1c-b448-8b9fa5b48947'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:33.166508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] The token cache is being invalidate because project 1f0d57d28df946648dbdd9b355ddad96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:42:33.166913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:33.167536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-399d618c-8d8b-4f1c-b448-8b9fa5b48947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:42:33.169094 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4030/8159] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:42:32 2021] DELETE /identity/v3/projects/1f0d57d28df946648dbdd9b355ddad96 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:33.175153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0106-5313-44a4-a1d4-b15657c3aa3a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.175623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0106-5313-44a4-a1d4-b15657c3aa3a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.175713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d0106-5313-44a4-a1d4-b15657c3aa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.194156 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f98d0106-5313-44a4-a1d4-b15657c3aa3a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:33.195351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f98d0106-5313-44a4-a1d4-b15657c3aa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:33.257208 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4130/8160] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:33.266963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fb8c-51f1-4c51-b579-1178866a5202 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.267255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fb8c-51f1-4c51-b579-1178866a5202 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.267537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fb8c-51f1-4c51-b579-1178866a5202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.287107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-adb4fb8c-51f1-4c51-b579-1178866a5202 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:33.288284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-adb4fb8c-51f1-4c51-b579-1178866a5202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:33.296309 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4031/8161] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:42:33.300642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0106-5313-44a4-a1d4-b15657c3aa3a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:33.311014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d0106-5313-44a4-a1d4-b15657c3aa3a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:33.315790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:33.316459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.316764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.317078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.317806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:42:33.318110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:33.319698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:33.331789 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4131/8162] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:42:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:42:33.336007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fb8c-51f1-4c51-b579-1178866a5202 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:33.346006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fb8c-51f1-4c51-b579-1178866a5202 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:33.350622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:33.351377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.357203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.357203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.357203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:33.357203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:33.444505 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4032/8163] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:42:33 2021] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:42:33.449078 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:33.459059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc73019-79b1-42f3-9c19-8c59e772ace4 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:33.520612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:33.521329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.521611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.521884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.522601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:33.525167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:33.643311 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4132/8164] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:42:33 2021] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:42:33.647411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:33.658142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da3693-995f-44b2-b601-f5acc5a0b097 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:33.665515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:33.665515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.665834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.666673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.667641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:33.670659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:33.684855 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4033/8165] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:42:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:42:33.688829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:33.709439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba8e4a-c8bc-44be-8ec0-17be6eed7a0b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:33.714902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c32b2-467a-47ae-b15f-4404fa01603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:33.715573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c32b2-467a-47ae-b15f-4404fa01603a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.716298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c32b2-467a-47ae-b15f-4404fa01603a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.716448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c32b2-467a-47ae-b15f-4404fa01603a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.717302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c32b2-467a-47ae-b15f-4404fa01603a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:33.718964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c32b2-467a-47ae-b15f-4404fa01603a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:33.732933 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4133/8166] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:42:33 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:42:33.734107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:33.745047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63618b-f5f2-410d-9c3b-7aa2b4dba2e1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:33.749673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:33.750556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.750836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.751110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] PATH_INFO: `/v3/projects/6ca85d447d714c1ca24121ae04b3edf0/users/94b2fd2034794da0ab4d8df1c9be60f2/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.767809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca85d447d714c1ca24121ae04b3edf0, user_id=94b2fd2034794da0ab4d8df1c9be60f2, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:33.770476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:33.895308 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4034/8167] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:42:33 2021] PUT /identity/v3/projects/6ca85d447d714c1ca24121ae04b3edf0/users/94b2fd2034794da0ab4d8df1c9be60f2/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:42:33.898257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0d48-e94d-4c0b-a0a4-4cb3ff9aa891 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:33.898942 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0d48-e94d-4c0b-a0a4-4cb3ff9aa891 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:33.899310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb0d48-e94d-4c0b-a0a4-4cb3ff9aa891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:33.937870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-22eb0d48-e94d-4c0b-a0a4-4cb3ff9aa891 None None] MFA Rules not processed for user `94b2fd2034794da0ab4d8df1c9be60f2`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:33.937870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-22eb0d48-e94d-4c0b-a0a4-4cb3ff9aa891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:34.012202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4134/8168] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:33 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:42:34.023184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:42:34.026585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:34.097619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0132-f465-47d7-a13e-846ab975952f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:42:34.101538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:42:34.102222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:34.102498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:34.102769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:34.111231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:42:34.112641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:42:34.121324 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4035/8169] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:42:34 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:42:53.057898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:42:53.058528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:42:53.058528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:42:53.078816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] MFA Rules not processed for user `01a07fc3a154483caea95cbd449f3970`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:42:53.080263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:42:53.169097 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4135/8170] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:42:53 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:43:06.110268 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:06.111735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:06.125920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40779358-aa3c-4285-bd94-e3794a3522af service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:06.129811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:06.130703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:06.130988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:06.131285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:06.135438 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:06.150190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:06.151629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:06.162723 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4036/8171] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:06 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:43:12.115393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:12.117766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:12.329891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfdd8e-fe42-49bd-b759-c3c348f21a31 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:12.340208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:12.341050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:12.341664 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:12.342018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:12.343984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:12.356831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:12.362429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:12.369724 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4136/8172] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:12 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:43:39.716987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:39.734737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e561fc-97db-4605-8a35-fba1b7e5ab17 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:39.742616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75211fde-a141-4e92-a3b6-aac20e426411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:39.742616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211fde-a141-4e92-a3b6-aac20e426411 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:39.742616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211fde-a141-4e92-a3b6-aac20e426411 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:39.743123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75211fde-a141-4e92-a3b6-aac20e426411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:39.745363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-75211fde-a141-4e92-a3b6-aac20e426411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:39.771536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211fde-a141-4e92-a3b6-aac20e426411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:39.773620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75211fde-a141-4e92-a3b6-aac20e426411 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:39.790838 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4037/8173] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:43:40.537236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:40.554944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d75e4a-416d-41ce-9f74-74ad52c56b65 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:40.563476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d9dc6-813f-47a5-96b1-c38880d383ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:40.564266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9dc6-813f-47a5-96b1-c38880d383ce service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:40.564620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9dc6-813f-47a5-96b1-c38880d383ce service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:40.565133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9dc6-813f-47a5-96b1-c38880d383ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:40.567716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-562d9dc6-813f-47a5-96b1-c38880d383ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:40.638643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d9dc6-813f-47a5-96b1-c38880d383ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:40.640306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d9dc6-813f-47a5-96b1-c38880d383ce service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:40.661783 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4137/8174] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:40 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:43:41.713048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7235-2419-4656-a3de-aa49f79df6e5 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:41.713629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7235-2419-4656-a3de-aa49f79df6e5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:41.713629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7235-2419-4656-a3de-aa49f79df6e5 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:41.715377 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4038/8175] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:43:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:43:41.721083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075071f-773d-420a-8453-ad8597a72d20 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:41.721572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075071f-773d-420a-8453-ad8597a72d20 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:41.722138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075071f-773d-420a-8453-ad8597a72d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:41.757176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e075071f-773d-420a-8453-ad8597a72d20 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:43:41.757176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e075071f-773d-420a-8453-ad8597a72d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:41.869068 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4138/8176] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:43:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:43:41.892352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7235-2419-4656-a3de-aa49f79df6e5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:41.894180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6a5a7235-2419-4656-a3de-aa49f79df6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:41.916576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7235-2419-4656-a3de-aa49f79df6e5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:41.922553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:41.923306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:41.923661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:41.924188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:41.935729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:41.937632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:41.979126 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4039/8177] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:43:42.589137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075071f-773d-420a-8453-ad8597a72d20 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:42.615581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075071f-773d-420a-8453-ad8597a72d20 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:42.628680 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:42.629720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:42.630067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:42.630814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:42.633716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:42.658207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:42.660128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:42.680005 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4139/8178] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:43:45.569221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:45.586476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde67f9-802d-454a-b9c4-781e37591ad5 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:45.591223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:45.592043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:45.592757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:45.593295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:45.595462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:45.615617 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:45.617735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:45.633858 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4040/8179] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:43:57.633597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:43:57.686475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eafdbe-11aa-4b28-9fe0-73724c05cd4c service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:43:57.701790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:43:57.703577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:43:57.705187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:43:57.705717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:43:57.710775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:43:57.743496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:43:57.746211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:43:57.769165 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4140/8180] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:43:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:03.127772 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:03.130071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:03.222550 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5265e6-ad5a-46ce-a1d0-7990a6a95d08 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:03.228146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:03.233437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:03.233437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:03.233437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] PATH_INFO: `/v3/users/0b6c0fe828da4c18ae9764400f30740d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:03.233437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6c0fe828da4c18ae9764400f30740d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:03.234417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:03.245348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:03.264823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd52c-65f4-445f-abab-d1e542016370 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:03.268947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed227a-baef-43ad-81f8-31e0193a538b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:03.269808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed227a-baef-43ad-81f8-31e0193a538b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:03.270240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed227a-baef-43ad-81f8-31e0193a538b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:03.270744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed227a-baef-43ad-81f8-31e0193a538b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:03.275657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-53ed227a-baef-43ad-81f8-31e0193a538b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:03.303076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed227a-baef-43ad-81f8-31e0193a538b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:03.305840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed227a-baef-43ad-81f8-31e0193a538b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:03.322078 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4141/8181] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:03.495276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6c0fe828da4c18ae9764400f30740d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:03.504015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6c0fe828da4c18ae9764400f30740d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:03.519919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6c0fe828da4c18ae9764400f30740d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:03.520993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6c0fe828da4c18ae9764400f30740d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:03.521631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6c0fe828da4c18ae9764400f30740d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:03.628102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:03.628995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:03.629443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:03.642274 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4041/8182] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:44:03 2021] DELETE /identity/v3/users/0b6c0fe828da4c18ae9764400f30740d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:03.659980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:03.664204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:03.777862 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4142/8183] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:03.789143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:03.790857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:03.913974 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a313dc-31c4-4a95-96c3-53c94d12c248 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:03.920664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166e5e2-dd6f-4606-9a39-b96bf3856941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:03.921736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e5e2-dd6f-4606-9a39-b96bf3856941 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:03.922246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e5e2-dd6f-4606-9a39-b96bf3856941 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:03.922732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166e5e2-dd6f-4606-9a39-b96bf3856941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:03.934733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166e5e2-dd6f-4606-9a39-b96bf3856941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:03.938144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166e5e2-dd6f-4606-9a39-b96bf3856941 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:03.973088 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4042/8184] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:04.432269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:04.434931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:04.457826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816d99-9643-49f6-b1fe-2f776c19fa33 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:04.475270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:04.476631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:04.477296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:04.477738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] PATH_INFO: `/v3/projects/2a6f7f2d4b1243369e6e2a101f68557c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:04.479635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6f7f2d4b1243369e6e2a101f68557c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:04.483107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:04.661598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6f7f2d4b1243369e6e2a101f68557c', 'request_id': 'req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:04.780757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6f7f2d4b1243369e6e2a101f68557c', 'request_id': 'req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:04.794975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6f7f2d4b1243369e6e2a101f68557c', 'request_id': 'req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:04.815702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] The token cache is being invalidate because project 2a6f7f2d4b1243369e6e2a101f68557c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:44:04.818356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:04.819761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b5a6f21-12e6-4c7d-abc3-dbd9bdf140a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:04.822190 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4143/8185] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:44:04 2021] DELETE /identity/v3/projects/2a6f7f2d4b1243369e6e2a101f68557c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:04.829688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951f10-70b8-41b0-b741-9a982daade8f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:04.830917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951f10-70b8-41b0-b741-9a982daade8f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:04.831741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951f10-70b8-41b0-b741-9a982daade8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:04.855980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-63951f10-70b8-41b0-b741-9a982daade8f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:04.857838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63951f10-70b8-41b0-b741-9a982daade8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:04.996371 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4043/8186] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:05.004074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda036b-127d-423e-bad6-1d6c49117408 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.004372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda036b-127d-423e-bad6-1d6c49117408 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.004660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda036b-127d-423e-bad6-1d6c49117408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.036612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ddda036b-127d-423e-bad6-1d6c49117408 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:05.039848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ddda036b-127d-423e-bad6-1d6c49117408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:05.059566 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4144/8187] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:05.066272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951f10-70b8-41b0-b741-9a982daade8f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:05.081532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951f10-70b8-41b0-b741-9a982daade8f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:05.092077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:05.092818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.093165 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.093407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.094151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:44:05.094777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:05.099160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:05.127778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda036b-127d-423e-bad6-1d6c49117408 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:05.131575 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4044/8188] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:44:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:44:05.177743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda036b-127d-423e-bad6-1d6c49117408 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:05.187295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:05.190792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.190792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.190792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.190792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:05.192297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:05.226020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:05.227719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:05.251986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467bf8a-168a-4b10-b025-393f9883aa79 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:05.267764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:05.269260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.269821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.270276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] PATH_INFO: `/v3/users/c3a55c151bef4387a4fef00ab6687a20` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.271585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a55c151bef4387a4fef00ab6687a20)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:05.274436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:05.296002 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4145/8189] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:44:05 2021] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:05.300553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:05.401278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664424e-358e-40f1-ad60-917a9ac0588f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:05.406321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:05.407705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.407705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.407705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.408606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:05.410579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:05.510752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a55c151bef4387a4fef00ab6687a20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:05.524119 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a55c151bef4387a4fef00ab6687a20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:05.540474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a55c151bef4387a4fef00ab6687a20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:05.541334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a55c151bef4387a4fef00ab6687a20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:05.542990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d0dcb2ca-3b78-4a97-b49e-b6aa0b6bd921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a55c151bef4387a4fef00ab6687a20'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:05.555643 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4146/8190] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:44:05 2021] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:05.559750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:05.561625 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:05.575243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9f402-27f1-4763-963a-066bffb1945a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:05.580452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:05.581276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.581756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.582252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.583110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:05.585009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:05.596026 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4147/8191] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:05 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:05.600844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:05.612321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffcf8c-7e7c-4b5c-9e29-16f6f677e4f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:05.617796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:05.618490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.618777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.619057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.619839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:05.621473 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:05.632918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4148/8192] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:05.636381 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4045/8193] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:44:05 2021] DELETE /identity/v3/users/c3a55c151bef4387a4fef00ab6687a20 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:05.638511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:05.652062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f752af-fb9e-45ad-8dc4-16266fecb258 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:05.716061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:05.717098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.717446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.717792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] PATH_INFO: `/v3/projects/59ed9da8ed224ce9b429cb4c633a2498/users/71846607489941c5a65d9a3648c6c7d9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.733306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ed9da8ed224ce9b429cb4c633a2498, user_id=71846607489941c5a65d9a3648c6c7d9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:05.736099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:05.823874 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4149/8194] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:05 2021] PUT /identity/v3/projects/59ed9da8ed224ce9b429cb4c633a2498/users/71846607489941c5a65d9a3648c6c7d9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:44:05.834359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1840dc3-bb9a-4539-8af9-1f5dc9783d8a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:05.834915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1840dc3-bb9a-4539-8af9-1f5dc9783d8a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:05.834915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1840dc3-bb9a-4539-8af9-1f5dc9783d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:05.863715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e1840dc3-bb9a-4539-8af9-1f5dc9783d8a None None] MFA Rules not processed for user `71846607489941c5a65d9a3648c6c7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:05.865033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e1840dc3-bb9a-4539-8af9-1f5dc9783d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:05.940559 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4046/8195] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:05.945801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.026251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288edf-121a-4dc9-8e27-2eaf75555d3f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.031620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.034348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.034348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.034348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.034348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.036066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.155988 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4150/8196] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:44:05 2021] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:06.162037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1840dc3-bb9a-4539-8af9-1f5dc9783d8a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.179418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1840dc3-bb9a-4539-8af9-1f5dc9783d8a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.255026 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.256548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.256548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.256762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.262337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.262337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.285036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.292389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:06.320250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947b0f-7b79-4292-b9f6-09786154eaa8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.332051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.333033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.333362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.333583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] PATH_INFO: `/v3/projects/a416565d81324f55b88111b36c4a777c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.334989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a416565d81324f55b88111b36c4a777c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.339486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.355459 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4047/8197] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:44:06 2021] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:44:06.355459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.365162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a24d6-3757-4ab2-84b0-2d47a3971fb7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.386157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.387120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.387404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.387683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.388436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.391206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.417240 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4048/8198] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:06.417240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.423199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f91173-bb3e-48bd-a6e0-a78a482ea34b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.434996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.435985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.436260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.437504 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] PATH_INFO: `/v3/projects/2591da5f24614e9a8f95df63ea15fa8f/users/372fecc7859a480290f342afc224480f/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.474261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2591da5f24614e9a8f95df63ea15fa8f, user_id=372fecc7859a480290f342afc224480f, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.481783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.565263 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4049/8199] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:06 2021] PUT /identity/v3/projects/2591da5f24614e9a8f95df63ea15fa8f/users/372fecc7859a480290f342afc224480f/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:44:06.573496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.590325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a416565d81324f55b88111b36c4a777c', 'request_id': 'req-ae801197-8cf5-4d25-b17b-cefa1b6058cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:06.667502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e995-d0ab-40e0-a55a-52dbe797e9d7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.672694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.673919 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.680532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.680532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.680914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a416565d81324f55b88111b36c4a777c', 'request_id': 'req-ae801197-8cf5-4d25-b17b-cefa1b6058cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:06.681035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.681035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.682880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a416565d81324f55b88111b36c4a777c', 'request_id': 'req-ae801197-8cf5-4d25-b17b-cefa1b6058cc'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:06.690690 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4050/8200] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:06 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:06.691873 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.701416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] The token cache is being invalidate because project a416565d81324f55b88111b36c4a777c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:44:06.701992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:06.713125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ae801197-8cf5-4d25-b17b-cefa1b6058cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:06.713125 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4151/8201] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:44:06 2021] DELETE /identity/v3/projects/a416565d81324f55b88111b36c4a777c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:44:06.713430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9e0f3-f2e1-4588-bfb5-5400d506ac3a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.714580 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a67b-35ac-4753-a775-2e7a3c333050 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.714869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a67b-35ac-4753-a775-2e7a3c333050 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.715148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042a67b-35ac-4753-a775-2e7a3c333050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.717556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0af45-8dbf-4430-bba2-87fc4a9c0092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.718462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0af45-8dbf-4430-bba2-87fc4a9c0092 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.718734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0af45-8dbf-4430-bba2-87fc4a9c0092 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.719073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0af45-8dbf-4430-bba2-87fc4a9c0092 admin admin] PATH_INFO: `/v3/projects/2591da5f24614e9a8f95df63ea15fa8f/users/372fecc7859a480290f342afc224480f/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.721849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0af45-8dbf-4430-bba2-87fc4a9c0092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2591da5f24614e9a8f95df63ea15fa8f, user_id=372fecc7859a480290f342afc224480f, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.725978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0af45-8dbf-4430-bba2-87fc4a9c0092 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.741589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1042a67b-35ac-4753-a775-2e7a3c333050 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:06.741589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1042a67b-35ac-4753-a775-2e7a3c333050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:06.746130 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4051/8202] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:06 2021] PUT /identity/v3/projects/2591da5f24614e9a8f95df63ea15fa8f/users/372fecc7859a480290f342afc224480f/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:06.756341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a023ed-3382-4c89-9b13-5d39f9ac8e35 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.756638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a023ed-3382-4c89-9b13-5d39f9ac8e35 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.756930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a023ed-3382-4c89-9b13-5d39f9ac8e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.801584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-30a023ed-3382-4c89-9b13-5d39f9ac8e35 None None] MFA Rules not processed for user `372fecc7859a480290f342afc224480f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:06.801584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-30a023ed-3382-4c89-9b13-5d39f9ac8e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:06.851291 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4152/8203] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:06.854474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.855011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.855167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.899445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:06.905220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:06.919583 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4052/8204] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:06 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:06.924844 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4153/8205] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:06.929101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a023ed-3382-4c89-9b13-5d39f9ac8e35 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.936853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:06.938575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:06.942819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a023ed-3382-4c89-9b13-5d39f9ac8e35 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:06.948790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:06.949671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:06.950052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:06.950588 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:06.951436 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:44:06.951857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:06.954152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:06.979101 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4053/8206] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:44:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:44:06.983937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:07.012290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea076d-33f2-4fec-a135-6c609730081a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:07.041191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:07.046490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.046490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.046490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.046490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:07.046490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:07.051918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567d294-b87a-4ab0-b414-480909b95d0b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:07.065760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:07.067111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.069249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.069746 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.071843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:07.179468 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4054/8207] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:44:06 2021] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:07.180965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:07.188655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:07.189845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:07.213986 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4154/8208] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:07.272637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d0c84-0b09-4d2f-bd00-d32334274a1f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:07.278973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:07.279652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.279946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.280227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.281319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:07.283496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:07.474802 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4055/8209] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:44:07 2021] POST /identity/v3/users => generated 287 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:07.478557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:07.515820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc944-a3ec-4425-ab29-ee9c955d847d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:07.530662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:07.530662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.531668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.531964 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.532775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:07.534649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:07.546686 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4155/8210] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:07 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:07.552051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:07.565089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521b86a-4f5d-482a-88c3-aecdf5879b82 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:07.571855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd8cd9-3863-48c1-84a5-af683b65ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:07.572599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8cd9-3863-48c1-84a5-af683b65ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.572834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8cd9-3863-48c1-84a5-af683b65ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.573201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd8cd9-3863-48c1-84a5-af683b65ef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.573945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd8cd9-3863-48c1-84a5-af683b65ef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:07.575785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd8cd9-3863-48c1-84a5-af683b65ef23 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:07.601535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:07.616995 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4056/8211] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:07 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:07.617631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178785-ab92-4e90-8ec3-71294eb3d24a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:07.626906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:07.629241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.629610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.629966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] PATH_INFO: `/v3/projects/085f682b164b4e0a84eabf214450d8c8/users/faa67786e6484306ad10e316585b04dc/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.664424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085f682b164b4e0a84eabf214450d8c8, user_id=faa67786e6484306ad10e316585b04dc, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:07.666857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:07.781008 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4156/8212] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:07 2021] PUT /identity/v3/projects/085f682b164b4e0a84eabf214450d8c8/users/faa67786e6484306ad10e316585b04dc/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:07.786442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.786903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.787392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.807815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:07.809524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:07.885788 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4057/8213] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:07.897823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:07.973606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267fb3b-8008-4ed2-8bb0-efb5ce84c351 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:07.979180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:07.979961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:07.980311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:07.980654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:07.991482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:07.994115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:08.011031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4157/8214] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:08.703847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:08.706451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:08.840553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a588-cb42-4f4b-b63c-49e3ecf0d28b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:08.846310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:08.847271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:08.847645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:08.848169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:08.852680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:08.924673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:08.928887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:08.950618 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4058/8215] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:08 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:10.073667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:10.078339 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:10.100757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff03f6-fa98-4e48-b1e5-8e0262e78a72 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:10.118134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1778b6-83ee-47c8-a1a8-a800a7df010b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:10.119774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1778b6-83ee-47c8-a1a8-a800a7df010b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:10.120183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1778b6-83ee-47c8-a1a8-a800a7df010b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:10.120554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1778b6-83ee-47c8-a1a8-a800a7df010b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:10.123222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba1778b6-83ee-47c8-a1a8-a800a7df010b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:10.155030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1778b6-83ee-47c8-a1a8-a800a7df010b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:10.158421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1778b6-83ee-47c8-a1a8-a800a7df010b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:10.177602 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4158/8216] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:12.498828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:12.514826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f47ca6-2fa5-4fb5-863d-38448a7d6238 service cinder] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:12.518878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:12.523634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:12.524131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:12.524581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:12.607815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:12.609767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:12.624091 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4059/8217] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:12 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:22.365731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d41c1-39c6-4965-84ce-ebdb2625700c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:22.366254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d41c1-39c6-4965-84ce-ebdb2625700c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:22.366254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d41c1-39c6-4965-84ce-ebdb2625700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:22.421046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f69d41c1-39c6-4965-84ce-ebdb2625700c None None] MFA Rules not processed for user `faa67786e6484306ad10e316585b04dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:22.422556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f69d41c1-39c6-4965-84ce-ebdb2625700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:22.577469 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:22.603151 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4159/8218] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:22 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:22.612921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389522b-be75-4ce3-a45d-e8cb9755e638 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:22.627194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:22.628182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:22.629495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:22.633238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:22.634202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:22.641423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:22.789372 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4060/8219] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:44:22 2021] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:22.791055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d41c1-39c6-4965-84ce-ebdb2625700c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:22.806179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d41c1-39c6-4965-84ce-ebdb2625700c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:22.948026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:22.948949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:22.949851 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:22.954666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:22.956018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:22.960281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:23.126914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:23.134845 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4160/8220] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:44:22 2021] POST /identity/v3/users => generated 294 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:23.141260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413bbe1-5b7d-4711-a038-926871ae3e0c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:23.163431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:23.164160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:23.164428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:23.164710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:23.170444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:23.178404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:23.210617 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:23.217767 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4061/8221] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:23 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:23.225657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa1653-139c-44ed-9358-bd578857726d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:23.241704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:23.242646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:23.242924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:23.243201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] PATH_INFO: `/v3/projects/7111026d02ad417e83bc2f057ded219d/users/902218fc6f20495da59daa79a21ab451/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:23.284527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7111026d02ad417e83bc2f057ded219d, user_id=902218fc6f20495da59daa79a21ab451, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:23.291738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:23.395285 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4161/8222] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:23 2021] PUT /identity/v3/projects/7111026d02ad417e83bc2f057ded219d/users/902218fc6f20495da59daa79a21ab451/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:23.400295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:23.423429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81dbe8-ff92-47ed-be91-bf5fb7a9c3e3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:23.532306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91cc8-0072-452f-a74a-f3643d9d83d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:23.533422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91cc8-0072-452f-a74a-f3643d9d83d8 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:23.533973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91cc8-0072-452f-a74a-f3643d9d83d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:23.534737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91cc8-0072-452f-a74a-f3643d9d83d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:23.536331 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91cc8-0072-452f-a74a-f3643d9d83d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:23.538914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91cc8-0072-452f-a74a-f3643d9d83d8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:23.565167 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4062/8223] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:23 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:44:23.569019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:23.582814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e48ac-7eef-4be2-9167-daa8f1608745 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:23.595930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2d8c0-1a20-4818-81ce-a32fd60fabf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:23.597613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2d8c0-1a20-4818-81ce-a32fd60fabf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:23.598112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2d8c0-1a20-4818-81ce-a32fd60fabf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:23.600432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2d8c0-1a20-4818-81ce-a32fd60fabf4 admin admin] PATH_INFO: `/v3/projects/7111026d02ad417e83bc2f057ded219d/users/902218fc6f20495da59daa79a21ab451/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:23.603042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2d8c0-1a20-4818-81ce-a32fd60fabf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7111026d02ad417e83bc2f057ded219d, user_id=902218fc6f20495da59daa79a21ab451, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:23.607346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2d8c0-1a20-4818-81ce-a32fd60fabf4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:23.621901 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4162/8224] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:23 2021] PUT /identity/v3/projects/7111026d02ad417e83bc2f057ded219d/users/902218fc6f20495da59daa79a21ab451/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:31.043050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c6661-ca3e-4bc5-8f09-88757328cba5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:31.043498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c6661-ca3e-4bc5-8f09-88757328cba5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:31.043661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c6661-ca3e-4bc5-8f09-88757328cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:31.100169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0b7c6661-ca3e-4bc5-8f09-88757328cba5 None None] MFA Rules not processed for user `01a07fc3a154483caea95cbd449f3970`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:31.101706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0b7c6661-ca3e-4bc5-8f09-88757328cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:31.240666 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4063/8225] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:31 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:31.252722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730b19-9ccd-47fb-8ed1-8495d573256f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:31.253591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730b19-9ccd-47fb-8ed1-8495d573256f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:31.254075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730b19-9ccd-47fb-8ed1-8495d573256f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:31.287111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-79730b19-9ccd-47fb-8ed1-8495d573256f None None] MFA Rules not processed for user `71846607489941c5a65d9a3648c6c7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:31.299175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-79730b19-9ccd-47fb-8ed1-8495d573256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:31.532253 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4163/8226] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:31 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:32.919991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c6661-ca3e-4bc5-8f09-88757328cba5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:32.979380 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79730b19-9ccd-47fb-8ed1-8495d573256f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:33.074706 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c6661-ca3e-4bc5-8f09-88757328cba5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:33.093820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:33.094865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:33.097334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:33.097892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:33.102857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:33.123449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79730b19-9ccd-47fb-8ed1-8495d573256f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:33.128369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:33.130215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:33.140449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:33.141520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:33.141520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:33.141710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:33.144328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:33.153047 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4064/8227] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:33.169128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:33.170784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:33.195997 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4164/8228] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:44:33.602887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:33.604457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:33.755291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd08fd-89b3-4c76-8e4a-fb655d925c8a service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:33.760695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:33.762773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:33.763260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:33.763689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] PATH_INFO: `/v3/users/e8dd3c4dd2344bee986e909d5c45112a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:33.765339 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dd3c4dd2344bee986e909d5c45112a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:33.769219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:34.061143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dd3c4dd2344bee986e909d5c45112a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:34.083277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dd3c4dd2344bee986e909d5c45112a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:34.098232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dd3c4dd2344bee986e909d5c45112a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:34.099345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dd3c4dd2344bee986e909d5c45112a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:34.099949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dd3c4dd2344bee986e909d5c45112a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:34.201222 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4065/8229] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:44:33 2021] DELETE /identity/v3/users/e8dd3c4dd2344bee986e909d5c45112a => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:34.652856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:34.667637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9543-ae78-4cf9-baf3-823947673c7c service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:34.812509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:34.813532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:34.813812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:34.814258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] PATH_INFO: `/v3/projects/ca293d68b8cc44e6b641d477c9a3eb50` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:34.819937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca293d68b8cc44e6b641d477c9a3eb50)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:34.821905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:35.014883 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca293d68b8cc44e6b641d477c9a3eb50', 'request_id': 'req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.107160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca293d68b8cc44e6b641d477c9a3eb50', 'request_id': 'req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.128155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca293d68b8cc44e6b641d477c9a3eb50', 'request_id': 'req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.177146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] The token cache is being invalidate because project ca293d68b8cc44e6b641d477c9a3eb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:44:35.177870 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.178912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.182102 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4165/8230] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:44:34 2021] DELETE /identity/v3/projects/ca293d68b8cc44e6b641d477c9a3eb50 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:35.186103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:35.193674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:35.230371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bf755-1561-4109-a2cd-9b68e3e06bfa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:35.379792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:35.383791 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:35.384243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:35.384620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] PATH_INFO: `/v3/users/f04d749763584300849d1825cece25d8` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:35.389729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04d749763584300849d1825cece25d8)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:35.394288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:35.679901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04d749763584300849d1825cece25d8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.709458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04d749763584300849d1825cece25d8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.738864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04d749763584300849d1825cece25d8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.740361 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04d749763584300849d1825cece25d8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.741168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04d749763584300849d1825cece25d8'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:35.848477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4066/8231] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:44:35 2021] DELETE /identity/v3/users/f04d749763584300849d1825cece25d8 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:36.165283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:36.177207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:36.209259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc02f-c347-4c8a-82c8-6e1db173d0f6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:36.328732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:36.331912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:36.332382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:36.333015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] PATH_INFO: `/v3/users/94b2fd2034794da0ab4d8df1c9be60f2` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:36.338318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b2fd2034794da0ab4d8df1c9be60f2)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:36.340717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:36.360100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:36.361666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:36.381577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa59a3-60bd-4968-81cb-acaeb96b4b0a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:36.391481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:36.392367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:36.392825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:36.393272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] PATH_INFO: `/v3/projects/31a159a4944c43258c0bd3a34c853e88` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:36.397495 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a159a4944c43258c0bd3a34c853e88)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:36.400451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:36.667136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a159a4944c43258c0bd3a34c853e88', 'request_id': 'req-9e6b7178-6094-4f9a-9b06-072716e91e2b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.669814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b2fd2034794da0ab4d8df1c9be60f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.693764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a159a4944c43258c0bd3a34c853e88', 'request_id': 'req-9e6b7178-6094-4f9a-9b06-072716e91e2b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.696932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b2fd2034794da0ab4d8df1c9be60f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.738908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b2fd2034794da0ab4d8df1c9be60f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.741315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b2fd2034794da0ab4d8df1c9be60f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.765835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a159a4944c43258c0bd3a34c853e88', 'request_id': 'req-9e6b7178-6094-4f9a-9b06-072716e91e2b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.780101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] The token cache is being invalidate because project 31a159a4944c43258c0bd3a34c853e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:44:36.780749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.781636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9e6b7178-6094-4f9a-9b06-072716e91e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.783509 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4067/8232] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:44:36 2021] DELETE /identity/v3/projects/31a159a4944c43258c0bd3a34c853e88 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:44:36.828711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b2fd2034794da0ab4d8df1c9be60f2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:36.842923 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4166/8233] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:44:36 2021] DELETE /identity/v3/users/94b2fd2034794da0ab4d8df1c9be60f2 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:36.848107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e25cc-5214-4642-a70f-b6028763078f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:36.848506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e25cc-5214-4642-a70f-b6028763078f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:36.848912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e25cc-5214-4642-a70f-b6028763078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:36.916006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-001e25cc-5214-4642-a70f-b6028763078f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:36.918979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-001e25cc-5214-4642-a70f-b6028763078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:37.088449 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4068/8234] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:37.128396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:37.134393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:37.263490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc33538-6e36-4027-b669-194aa922d21e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:37.280569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:37.281636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:37.282101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:37.282531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:37.306563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:37.308507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:37.311499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454db2a-5261-417e-aab4-72a22ebb4085 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:37.312031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454db2a-5261-417e-aab4-72a22ebb4085 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:37.312545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454db2a-5261-417e-aab4-72a22ebb4085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:37.321911 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4167/8235] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:37.383676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e454db2a-5261-417e-aab4-72a22ebb4085 None None] MFA Rules not processed for user `902218fc6f20495da59daa79a21ab451`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:37.385615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e454db2a-5261-417e-aab4-72a22ebb4085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:37.517983 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4069/8236] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:37 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:37.526512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:37.528056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:37.663539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d20a-edf5-4cd0-b97e-ee35b0f9c860 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:37.669480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:37.670622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:37.671183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:37.671416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:37.680155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:37.681765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:37.693414 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4168/8237] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:37 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:37.745775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae231e-f8c9-42a3-9d8a-169e521deb2a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:37.746496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae231e-f8c9-42a3-9d8a-169e521deb2a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:37.746928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae231e-f8c9-42a3-9d8a-169e521deb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:37.773845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-81ae231e-f8c9-42a3-9d8a-169e521deb2a None None] MFA Rules not processed for user `faa67786e6484306ad10e316585b04dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:37.775100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-81ae231e-f8c9-42a3-9d8a-169e521deb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:37.780579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:37.784324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:37.800442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323e78d-b31a-4b5a-b6b1-5902b243cd8f service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:37.813340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:37.814219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:37.814499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:37.814771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] PATH_INFO: `/v3/projects/6ca85d447d714c1ca24121ae04b3edf0` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:37.819094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca85d447d714c1ca24121ae04b3edf0)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:37.822213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:37.894328 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4070/8238] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:37 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:37.993063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca85d447d714c1ca24121ae04b3edf0', 'request_id': 'req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:38.095394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca85d447d714c1ca24121ae04b3edf0', 'request_id': 'req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:38.103824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca85d447d714c1ca24121ae04b3edf0', 'request_id': 'req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:38.117900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] The token cache is being invalidate because project 6ca85d447d714c1ca24121ae04b3edf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:44:38.118281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:38.119037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8af0e6ec-9b6c-43a5-9a78-a2f0ddeecea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:38.120640 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4169/8239] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:44:37 2021] DELETE /identity/v3/projects/6ca85d447d714c1ca24121ae04b3edf0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:38.126730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bf92d-21f8-4579-88b6-cab09a3b1158 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.127246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bf92d-21f8-4579-88b6-cab09a3b1158 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.127564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bf92d-21f8-4579-88b6-cab09a3b1158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.150483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b07bf92d-21f8-4579-88b6-cab09a3b1158 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:38.152182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b07bf92d-21f8-4579-88b6-cab09a3b1158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:38.220158 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4071/8240] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:38.227824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91fc0-b7b1-46af-ae5b-da44db6c4942 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.228113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91fc0-b7b1-46af-ae5b-da44db6c4942 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.228390 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91fc0-b7b1-46af-ae5b-da44db6c4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.247949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c6e91fc0-b7b1-46af-ae5b-da44db6c4942 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:38.249221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c6e91fc0-b7b1-46af-ae5b-da44db6c4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:38.258622 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4170/8241] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:38.263237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bf92d-21f8-4579-88b6-cab09a3b1158 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:38.274283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bf92d-21f8-4579-88b6-cab09a3b1158 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:38.283373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:38.283373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.283373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.283373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.283759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:44:38.283759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:38.283759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:38.295113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4072/8242] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:44:38.304290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e91fc0-b7b1-46af-ae5b-da44db6c4942 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:38.313987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e91fc0-b7b1-46af-ae5b-da44db6c4942 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:38.319491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:38.320218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.320496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.320768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.321494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:38.323364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:38.451438 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4171/8243] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:44:38 2021] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:38.455987 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:38.466818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1b9b-c542-4ec4-88cc-34fe9c58d2f9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:38.533183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:38.533861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.534140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.534484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.535260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:38.538136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:38.657828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4073/8244] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:44:38 2021] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:38.665573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:38.682742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6c591-6798-4de0-ae40-b25306cc7b90 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:38.695207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:38.696089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.696431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.696622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.698067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:38.699710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:38.711496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4172/8245] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:38 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:38.715394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:38.726672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691b9a-26ab-481b-91ad-6b4bb93fb237 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:38.750785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba67a5-1392-4d3a-a07a-854313919875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:38.751650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba67a5-1392-4d3a-a07a-854313919875 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.752359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba67a5-1392-4d3a-a07a-854313919875 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.752359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba67a5-1392-4d3a-a07a-854313919875 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.753123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba67a5-1392-4d3a-a07a-854313919875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:38.756405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba67a5-1392-4d3a-a07a-854313919875 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:38.782061 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4074/8246] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:38 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:38.786046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:38.797703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80067c-143c-4081-84fc-68e7c0bf6515 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:38.803109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:38.804008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:38.804284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:38.804556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] PATH_INFO: `/v3/projects/28efe0fd140c4f468e458fdbd895617b/users/16516e2948eb4264990fce3e5985378a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:38.823033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28efe0fd140c4f468e458fdbd895617b, user_id=16516e2948eb4264990fce3e5985378a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:38.826415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:39.030105 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4173/8247] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:38 2021] PUT /identity/v3/projects/28efe0fd140c4f468e458fdbd895617b/users/16516e2948eb4264990fce3e5985378a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:39.041475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:39.041846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:39.042135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:39.121115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] MFA Rules not processed for user `16516e2948eb4264990fce3e5985378a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:39.123635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:39.237718 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4075/8248] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:39.249302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:39.251062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:39.340855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184fef6-bee1-45a7-8189-97c2d516e3a7 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:39.348266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:39.349804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:39.350094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:39.350370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:39.360292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:39.361784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:39.372473 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4174/8249] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:39 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:43.059242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:43.061828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:43.184416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f6bba-b8a2-4a2b-af09-516af8ca002b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:43.190288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:43.191187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:43.191626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:43.192066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:43.195711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:43.221120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:43.222777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:43.251477 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4076/8250] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:44.319500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:44.333091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869baa3e-ccce-4ab8-9d65-dccc4ecb9bcc service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:44.347077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa39a6a-8dbc-4530-9d38-5bedc04b0b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:44.348175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39a6a-8dbc-4530-9d38-5bedc04b0b81 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:44.348345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39a6a-8dbc-4530-9d38-5bedc04b0b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:44.348623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa39a6a-8dbc-4530-9d38-5bedc04b0b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:44.357502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-daa39a6a-8dbc-4530-9d38-5bedc04b0b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:44.388302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39a6a-8dbc-4530-9d38-5bedc04b0b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:44.394797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa39a6a-8dbc-4530-9d38-5bedc04b0b81 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:44.409606 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4175/8251] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:49.751476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:49.819824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371358e3-6155-4fdd-b7c8-39a1dd144616 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:49.824744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:49.825660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:49.826145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:49.826446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] PATH_INFO: `/v3/users/16516e2948eb4264990fce3e5985378a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:49.827827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16516e2948eb4264990fce3e5985378a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:49.829844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:50.116002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16516e2948eb4264990fce3e5985378a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:50.123391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16516e2948eb4264990fce3e5985378a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:50.135036 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16516e2948eb4264990fce3e5985378a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:50.135815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16516e2948eb4264990fce3e5985378a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:50.136678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16516e2948eb4264990fce3e5985378a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:50.229258 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4077/8252] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:44:49 2021] DELETE /identity/v3/users/16516e2948eb4264990fce3e5985378a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:50.233891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:50.234363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:50.234480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:50.253767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:50.255294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:50.322723 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4176/8253] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:50.334058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:50.337246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:50.401377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc32c-c0bf-4490-8df9-5a27111ef468 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:50.405288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76a2b2-ccd9-46e3-bc5e-e62ab7ec9a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:50.405941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76a2b2-ccd9-46e3-bc5e-e62ab7ec9a95 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:50.406224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76a2b2-ccd9-46e3-bc5e-e62ab7ec9a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:50.406502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76a2b2-ccd9-46e3-bc5e-e62ab7ec9a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:50.416751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76a2b2-ccd9-46e3-bc5e-e62ab7ec9a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:50.418530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76a2b2-ccd9-46e3-bc5e-e62ab7ec9a95 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:50.433208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4078/8254] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:50.772176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:50.774372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:50.792464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6ad80-0834-4cfb-81c9-3e9006df8692 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:50.797574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:50.798440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:50.798724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:50.799001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] PATH_INFO: `/v3/projects/28efe0fd140c4f468e458fdbd895617b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:50.800211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28efe0fd140c4f468e458fdbd895617b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:50.802695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:50.913397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28efe0fd140c4f468e458fdbd895617b', 'request_id': 'req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:51.014812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28efe0fd140c4f468e458fdbd895617b', 'request_id': 'req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:51.021817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28efe0fd140c4f468e458fdbd895617b', 'request_id': 'req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:51.033112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] The token cache is being invalidate because project 28efe0fd140c4f468e458fdbd895617b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:44:51.033509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:51.034163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e39c4a04-5ba2-4f16-a8c2-b9f28175349e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:51.035692 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4177/8255] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:44:50 2021] DELETE /identity/v3/projects/28efe0fd140c4f468e458fdbd895617b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:51.041956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77cc6-05ac-4288-b203-2a6a1b36daff None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.051048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77cc6-05ac-4288-b203-2a6a1b36daff None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.051048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77cc6-05ac-4288-b203-2a6a1b36daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.060903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3bf77cc6-05ac-4288-b203-2a6a1b36daff None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:51.062132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3bf77cc6-05ac-4288-b203-2a6a1b36daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:51.122113 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4079/8256] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:51.131585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d433-35dd-4959-80db-471b4aa08a54 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.131874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d433-35dd-4959-80db-471b4aa08a54 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.132151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d433-35dd-4959-80db-471b4aa08a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.150655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c985d433-35dd-4959-80db-471b4aa08a54 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:51.151855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c985d433-35dd-4959-80db-471b4aa08a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:51.160708 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4178/8257] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:51.170083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf77cc6-05ac-4288-b203-2a6a1b36daff None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:51.180634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf77cc6-05ac-4288-b203-2a6a1b36daff None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:51.190210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:51.190909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.191216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.191485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.193364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:44:51.193364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:51.194228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:51.206870 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4080/8258] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:44:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:44:51.215955 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985d433-35dd-4959-80db-471b4aa08a54 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:51.226275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985d433-35dd-4959-80db-471b4aa08a54 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:51.231034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:51.231711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.231989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.232261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.232993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:51.234877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:51.331496 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4179/8259] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:44:51 2021] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:51.336454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:51.346756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6e911-6d23-47b8-aa45-b33ec859550e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:51.402911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:51.403580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.403867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.404147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.404837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:51.406837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:51.479337 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4081/8260] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:44:51 2021] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:44:51.483520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:51.494186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440faf-0182-4763-a636-296694bf5363 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:51.498846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:51.499584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.499866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.500139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.500907 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:51.502512 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:51.513685 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4180/8261] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:51.517781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:51.528546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e418b61-186a-4207-922c-c7a9ff0ed439 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:51.533568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119af48-bd17-4c01-8706-ad03e2bf9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:51.534235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119af48-bd17-4c01-8706-ad03e2bf9fce admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.534520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119af48-bd17-4c01-8706-ad03e2bf9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.534797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119af48-bd17-4c01-8706-ad03e2bf9fce admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.535533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119af48-bd17-4c01-8706-ad03e2bf9fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:51.537188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119af48-bd17-4c01-8706-ad03e2bf9fce admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:51.547208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4082/8262] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:44:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:44:51.551327 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:51.562337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe6e6-b11d-494e-9b0b-2678a0d9e1f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:51.567050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:51.568527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.568957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.569275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] PATH_INFO: `/v3/projects/484f383bb9c04abda69ebea9399fe979/users/976bd65f580742f4a8fd78523a8c4cb5/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.586138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=484f383bb9c04abda69ebea9399fe979, user_id=976bd65f580742f4a8fd78523a8c4cb5, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:51.589091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:51.684108 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4181/8263] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:44:51 2021] PUT /identity/v3/projects/484f383bb9c04abda69ebea9399fe979/users/976bd65f580742f4a8fd78523a8c4cb5/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:51.694854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab761cd-db39-43c0-b4e9-140de62ca69c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.695141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab761cd-db39-43c0-b4e9-140de62ca69c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.695416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab761cd-db39-43c0-b4e9-140de62ca69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.721693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1ab761cd-db39-43c0-b4e9-140de62ca69c None None] MFA Rules not processed for user `976bd65f580742f4a8fd78523a8c4cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:51.723035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1ab761cd-db39-43c0-b4e9-140de62ca69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:51.790425 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4083/8264] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:51 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:51.802047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:51.803853 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:51.880571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7a0f9-b3e6-4dea-81eb-31acb99f53fe admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:51.884348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:51.885052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:51.885377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:51.885700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:51.896714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:51.898222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:51.908157 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4182/8265] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:51 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:44:55.740223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabea67-0c1d-46b0-a0f2-a3400334c228 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:55.741089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabea67-0c1d-46b0-a0f2-a3400334c228 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:55.741542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabea67-0c1d-46b0-a0f2-a3400334c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:55.759647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cbabea67-0c1d-46b0-a0f2-a3400334c228 None None] MFA Rules not processed for user `faa67786e6484306ad10e316585b04dc`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:55.760903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cbabea67-0c1d-46b0-a0f2-a3400334c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:55.829507 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4084/8266] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:55 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:44:58.885842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:58.967361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2fdd2-51a1-457c-91c2-ed06cd8cca4a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:58.972106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:58.973301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:58.973483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:58.973842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] PATH_INFO: `/v3/users/976bd65f580742f4a8fd78523a8c4cb5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:58.975029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=976bd65f580742f4a8fd78523a8c4cb5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:58.977135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:59.156495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976bd65f580742f4a8fd78523a8c4cb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.163866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976bd65f580742f4a8fd78523a8c4cb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.177429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976bd65f580742f4a8fd78523a8c4cb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.178182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976bd65f580742f4a8fd78523a8c4cb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.249571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976bd65f580742f4a8fd78523a8c4cb5'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.258167 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4183/8267] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:44:58 2021] DELETE /identity/v3/users/976bd65f580742f4a8fd78523a8c4cb5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:59.263256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:59.263784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:59.263934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:59.289743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:59.291964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:59.371325 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4085/8268] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:44:59.382537 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:59.385600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:59.450982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b436-3be3-4b80-8ba0-baa1584c84bb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:59.456376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6ba70-4fdb-4e55-9fec-73df5283da93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:59.457189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6ba70-4fdb-4e55-9fec-73df5283da93 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:59.457543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6ba70-4fdb-4e55-9fec-73df5283da93 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:59.457895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6ba70-4fdb-4e55-9fec-73df5283da93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:59.468412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6ba70-4fdb-4e55-9fec-73df5283da93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:59.470006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6ba70-4fdb-4e55-9fec-73df5283da93 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:59.480753 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4184/8269] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:44:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:44:59.710178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:44:59.711829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:44:59.726060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c5d7-d7eb-4483-ba88-252ce819dd07 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:44:59.731811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:44:59.733216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:59.733685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:59.734122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] PATH_INFO: `/v3/projects/484f383bb9c04abda69ebea9399fe979` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:59.735726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=484f383bb9c04abda69ebea9399fe979)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:44:59.737601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:44:59.857932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484f383bb9c04abda69ebea9399fe979', 'request_id': 'req-00b8375e-05c8-4ef6-bca2-2a088be8da45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.873568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484f383bb9c04abda69ebea9399fe979', 'request_id': 'req-00b8375e-05c8-4ef6-bca2-2a088be8da45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.947813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484f383bb9c04abda69ebea9399fe979', 'request_id': 'req-00b8375e-05c8-4ef6-bca2-2a088be8da45'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.966116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] The token cache is being invalidate because project 484f383bb9c04abda69ebea9399fe979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:44:59.966415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.967117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-00b8375e-05c8-4ef6-bca2-2a088be8da45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:44:59.968995 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4086/8270] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:44:59 2021] DELETE /identity/v3/projects/484f383bb9c04abda69ebea9399fe979 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:44:59.975488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1783b1-7fb6-4e40-9021-880fa0a0be7c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:44:59.975935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1783b1-7fb6-4e40-9021-880fa0a0be7c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:44:59.976053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1783b1-7fb6-4e40-9021-880fa0a0be7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:44:59.994875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3d1783b1-7fb6-4e40-9021-880fa0a0be7c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:44:59.996216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3d1783b1-7fb6-4e40-9021-880fa0a0be7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:00.063599 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4185/8271] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:44:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:45:00.072222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08037-28d9-4c34-bccb-ac88e1cb3b18 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.072565 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08037-28d9-4c34-bccb-ac88e1cb3b18 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.072914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e08037-28d9-4c34-bccb-ac88e1cb3b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.100696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-52e08037-28d9-4c34-bccb-ac88e1cb3b18 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:00.101907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-52e08037-28d9-4c34-bccb-ac88e1cb3b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:00.113600 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4087/8272] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:00.116697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1783b1-7fb6-4e40-9021-880fa0a0be7c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:00.126238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1783b1-7fb6-4e40-9021-880fa0a0be7c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:00.131394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:00.132037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.132312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.132583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.133342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:45:00.133646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:00.135256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:00.146974 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4186/8273] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:45:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:45:00.155534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08037-28d9-4c34-bccb-ac88e1cb3b18 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:00.165884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e08037-28d9-4c34-bccb-ac88e1cb3b18 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:00.172177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:00.172852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.173169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.173448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.174163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:00.176169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:00.280938 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4088/8274] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:45:00 2021] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:45:00.285199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:00.295975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5365b4c-9878-4044-9c38-de09ae34b7a2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:00.356466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:00.357169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.357479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.357727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.358429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:00.360368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:00.451292 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4187/8275] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:45:00 2021] POST /identity/v3/users => generated 281 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:00.455295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:00.467538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88c939-70f2-4107-b895-e1a687171826 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:00.474411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:00.475348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.475625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.475983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.476821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:00.479071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:00.492980 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4089/8276] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:00.500361 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:00.529922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476bceb-ea77-4daa-bf94-4dab48154cf0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:00.535013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2c93d-8765-4a3c-8b93-5c1334f415aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:00.535611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2c93d-8765-4a3c-8b93-5c1334f415aa admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.535893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2c93d-8765-4a3c-8b93-5c1334f415aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.536776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2c93d-8765-4a3c-8b93-5c1334f415aa admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.537698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2c93d-8765-4a3c-8b93-5c1334f415aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:00.539366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2c93d-8765-4a3c-8b93-5c1334f415aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:00.550558 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4188/8277] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:00 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:00.554471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:00.568386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9d8ad-a918-42a9-bf23-129f734dcb8a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:00.575620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:00.576834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.577886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.578337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] PATH_INFO: `/v3/projects/ebdc409fadbd4a71aa1e98f8a0586bd1/users/9ae3c233eb324ec585acace88876f831/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.598257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdc409fadbd4a71aa1e98f8a0586bd1, user_id=9ae3c233eb324ec585acace88876f831, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:00.601627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:00.685852 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4090/8278] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:45:00 2021] PUT /identity/v3/projects/ebdc409fadbd4a71aa1e98f8a0586bd1/users/9ae3c233eb324ec585acace88876f831/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:00.697090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.697379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.697657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.724897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] MFA Rules not processed for user `9ae3c233eb324ec585acace88876f831`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:00.726124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:00.816670 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4189/8279] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:00 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:00.830312 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:00.832074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:00.897466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8d5ff-4020-4468-beed-db7183c8f2e9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:00.902027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:00.902787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:00.903078 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:00.903373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:00.913662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:00.915386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:00.928689 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4091/8280] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:00 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:12.079608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:12.081683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:12.171113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67014ee-1caa-4e33-87b0-d13d475e2d23 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:12.177728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:12.181101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:12.181593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:12.182056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:12.184477 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:12.201192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:12.203319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:12.219060 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4190/8281] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:27.414406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:27.416291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:27.525218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f26a-6f48-456e-ac89-742085562a44 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:27.529936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:27.530829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:27.531101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:27.531378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] PATH_INFO: `/v3/users/faa67786e6484306ad10e316585b04dc` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:27.532619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa67786e6484306ad10e316585b04dc)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:27.534646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:27.729035 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa67786e6484306ad10e316585b04dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:27.738652 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa67786e6484306ad10e316585b04dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:27.751158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa67786e6484306ad10e316585b04dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:27.751932 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa67786e6484306ad10e316585b04dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:27.752594 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa67786e6484306ad10e316585b04dc'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:27.803925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4092/8282] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:45:27 2021] DELETE /identity/v3/users/faa67786e6484306ad10e316585b04dc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:28.060864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:28.075057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90040099-0d7b-4f35-b020-8711bd45f619 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:28.140846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:28.141749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:28.142013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:28.142288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] PATH_INFO: `/v3/projects/085f682b164b4e0a84eabf214450d8c8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:28.143467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=085f682b164b4e0a84eabf214450d8c8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:28.146490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:28.273743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085f682b164b4e0a84eabf214450d8c8', 'request_id': 'req-44b10259-e9ad-47d3-badd-94fba77606fd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.370407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085f682b164b4e0a84eabf214450d8c8', 'request_id': 'req-44b10259-e9ad-47d3-badd-94fba77606fd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.380302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085f682b164b4e0a84eabf214450d8c8', 'request_id': 'req-44b10259-e9ad-47d3-badd-94fba77606fd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.398983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] The token cache is being invalidate because project 085f682b164b4e0a84eabf214450d8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:45:28.398983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.398983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.399437 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4191/8283] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:45:28 2021] DELETE /identity/v3/projects/085f682b164b4e0a84eabf214450d8c8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:28.402950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:28.404373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:28.417744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a996f68-abd7-480a-8c34-69bb5227dfb6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:28.480486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:28.482103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:28.482488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:28.482874 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] PATH_INFO: `/v3/users/902218fc6f20495da59daa79a21ab451` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:28.484271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902218fc6f20495da59daa79a21ab451)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:28.486317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:28.661020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902218fc6f20495da59daa79a21ab451'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.665321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902218fc6f20495da59daa79a21ab451'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.677560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902218fc6f20495da59daa79a21ab451'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.678235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902218fc6f20495da59daa79a21ab451'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.678832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e29f04a2-ff70-44fd-9485-4cfef7b93155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902218fc6f20495da59daa79a21ab451'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:28.731807 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4093/8284] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:45:28 2021] DELETE /identity/v3/users/902218fc6f20495da59daa79a21ab451 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:28.978727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:28.983155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:28.997027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b10259-e9ad-47d3-badd-94fba77606fd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:29.064163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:29.065057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:29.065880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:29.066150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] PATH_INFO: `/v3/projects/7111026d02ad417e83bc2f057ded219d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:29.067599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7111026d02ad417e83bc2f057ded219d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:29.069697 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:29.193007 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7111026d02ad417e83bc2f057ded219d', 'request_id': 'req-23174e49-1459-431e-a4ad-2d90eef6583b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:29.267756 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7111026d02ad417e83bc2f057ded219d', 'request_id': 'req-23174e49-1459-431e-a4ad-2d90eef6583b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:29.276063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7111026d02ad417e83bc2f057ded219d', 'request_id': 'req-23174e49-1459-431e-a4ad-2d90eef6583b'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:29.287204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] The token cache is being invalidate because project 7111026d02ad417e83bc2f057ded219d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:45:29.287489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:29.288139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:29.289698 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4192/8285] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:45:28 2021] DELETE /identity/v3/projects/7111026d02ad417e83bc2f057ded219d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:36.549160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b2fdc-afa3-40ee-a20f-faf771808bdf None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:36.549645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b2fdc-afa3-40ee-a20f-faf771808bdf None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:36.549737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b2fdc-afa3-40ee-a20f-faf771808bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:36.567541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-430b2fdc-afa3-40ee-a20f-faf771808bdf None None] MFA Rules not processed for user `71846607489941c5a65d9a3648c6c7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:36.568737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-430b2fdc-afa3-40ee-a20f-faf771808bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:36.625161 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4094/8286] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:37.581527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:37.581527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:37.671412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174e49-1459-431e-a4ad-2d90eef6583b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:37.677614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:37.679025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:37.679421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:37.679869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] PATH_INFO: `/v3/users/9ae3c233eb324ec585acace88876f831` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:37.681470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae3c233eb324ec585acace88876f831)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:37.683312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:37.845890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae3c233eb324ec585acace88876f831'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:37.853434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae3c233eb324ec585acace88876f831'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:37.865632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae3c233eb324ec585acace88876f831'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:37.866329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae3c233eb324ec585acace88876f831'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:37.975497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae3c233eb324ec585acace88876f831'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:37.982325 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4193/8287] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:45:37 2021] DELETE /identity/v3/users/9ae3c233eb324ec585acace88876f831 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:37.986934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:37.987389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:37.987670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:38.005563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:38.006754 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:38.066926 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4095/8288] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:45:38.077208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:38.078624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:38.140233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c69d2b-575f-43cf-bc91-da7d34e00e05 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:38.143829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9cde-b4a1-4b54-a80e-e353d7cbf5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:38.148897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9cde-b4a1-4b54-a80e-e353d7cbf5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:38.148897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9cde-b4a1-4b54-a80e-e353d7cbf5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:38.148897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9cde-b4a1-4b54-a80e-e353d7cbf5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:38.154840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9cde-b4a1-4b54-a80e-e353d7cbf5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:38.156365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a9cde-b4a1-4b54-a80e-e353d7cbf5e1 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:38.166856 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4194/8289] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:38.451807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:38.453335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:38.466134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65d28a-5cbb-4741-8665-2c2dcff54b73 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:38.470860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:38.471759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:38.472042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:38.472322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] PATH_INFO: `/v3/projects/ebdc409fadbd4a71aa1e98f8a0586bd1` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:38.474152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdc409fadbd4a71aa1e98f8a0586bd1)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:38.476227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:38.564040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdc409fadbd4a71aa1e98f8a0586bd1', 'request_id': 'req-567f9907-1f78-4d48-aefd-2aa32f2a25c3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:38.570393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdc409fadbd4a71aa1e98f8a0586bd1', 'request_id': 'req-567f9907-1f78-4d48-aefd-2aa32f2a25c3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:38.655386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdc409fadbd4a71aa1e98f8a0586bd1', 'request_id': 'req-567f9907-1f78-4d48-aefd-2aa32f2a25c3'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:38.667321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] The token cache is being invalidate because project ebdc409fadbd4a71aa1e98f8a0586bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:45:38.667612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:38.668244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-567f9907-1f78-4d48-aefd-2aa32f2a25c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:38.669929 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4096/8290] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:45:38 2021] DELETE /identity/v3/projects/ebdc409fadbd4a71aa1e98f8a0586bd1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:38.676568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a3c3-56dd-4fc7-95f0-daefab59bd93 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:38.677050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a3c3-56dd-4fc7-95f0-daefab59bd93 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:38.677181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a3c3-56dd-4fc7-95f0-daefab59bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:38.695915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2588a3c3-56dd-4fc7-95f0-daefab59bd93 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:38.697058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2588a3c3-56dd-4fc7-95f0-daefab59bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:38.755405 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4195/8291] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:38.763701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd88843-5e6a-468d-90ef-6ee94aa71558 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:38.763992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd88843-5e6a-468d-90ef-6ee94aa71558 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:38.764274 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd88843-5e6a-468d-90ef-6ee94aa71558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:38.783147 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ecd88843-5e6a-468d-90ef-6ee94aa71558 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:38.784376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ecd88843-5e6a-468d-90ef-6ee94aa71558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:38.793273 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4097/8292] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:38.797443 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a3c3-56dd-4fc7-95f0-daefab59bd93 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:38.807342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a3c3-56dd-4fc7-95f0-daefab59bd93 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:38.811963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:38.812643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:38.812952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:38.813228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:38.813944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:45:38.814249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:38.815848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:38.827336 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4196/8293] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:45:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:45:38.831512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd88843-5e6a-468d-90ef-6ee94aa71558 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:38.841929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd88843-5e6a-468d-90ef-6ee94aa71558 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:38.846695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:38.847341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:38.847624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:38.848460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:38.849767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:38.851708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:38.957800 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4098/8294] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:45:38 2021] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:38.961216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:38.971605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d94a-5c9c-4403-ab04-7bf56bbf4923 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:39.030590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:39.031322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:39.031604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:39.031876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:39.032567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:39.034576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:39.130239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4197/8295] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:45:38 2021] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:39.134178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:39.145463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baeb48-4acf-432b-9859-e084fef27e2e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:39.150120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:39.150783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:39.151060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:39.151336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:39.152064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:39.153708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:39.164199 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4099/8296] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:45:39.168359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:39.179903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4453e-329d-4b1f-833e-45a41278314e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:39.185619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd335f6c-3f02-4bc5-b2de-40922184621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:39.186270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335f6c-3f02-4bc5-b2de-40922184621d admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:39.186562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335f6c-3f02-4bc5-b2de-40922184621d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:39.186830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335f6c-3f02-4bc5-b2de-40922184621d admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:39.187917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd335f6c-3f02-4bc5-b2de-40922184621d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:39.189817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd335f6c-3f02-4bc5-b2de-40922184621d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:39.201423 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4198/8297] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:39 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:39.205656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:39.216631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fa76d-0ec1-4b39-83c7-1b75a5baed8b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:39.221251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:39.222285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:39.222762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:39.223202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] PATH_INFO: `/v3/projects/b06aed9603024d699e3090cef722f711/users/a47df59f616043efbf950b48da4acdf9/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:39.237833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06aed9603024d699e3090cef722f711, user_id=a47df59f616043efbf950b48da4acdf9, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:39.240553 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:39.329583 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4100/8298] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:45:39 2021] PUT /identity/v3/projects/b06aed9603024d699e3090cef722f711/users/a47df59f616043efbf950b48da4acdf9/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:39.340627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572332e-3ae4-4a50-9ac5-1a103cabde0d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:39.340937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572332e-3ae4-4a50-9ac5-1a103cabde0d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:39.341227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572332e-3ae4-4a50-9ac5-1a103cabde0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:39.368868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8572332e-3ae4-4a50-9ac5-1a103cabde0d None None] MFA Rules not processed for user `a47df59f616043efbf950b48da4acdf9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:39.370268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8572332e-3ae4-4a50-9ac5-1a103cabde0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:39.458705 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4199/8299] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:39 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:39.465942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:39.467840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:39.539166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae8ee-e8d0-4eab-8275-a591ce972bb1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:39.543287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054b88f-cd7e-4f43-a280-4c2d1cbccebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:39.543994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b88f-cd7e-4f43-a280-4c2d1cbccebb service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:39.544286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b88f-cd7e-4f43-a280-4c2d1cbccebb service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:39.544562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b88f-cd7e-4f43-a280-4c2d1cbccebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:39.556237 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054b88f-cd7e-4f43-a280-4c2d1cbccebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:39.558852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054b88f-cd7e-4f43-a280-4c2d1cbccebb service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:39.570310 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4101/8300] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:39 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:47.728919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572332e-3ae4-4a50-9ac5-1a103cabde0d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:47.790499 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572332e-3ae4-4a50-9ac5-1a103cabde0d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:47.795024 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:47.795891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:47.796168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:47.796442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] PATH_INFO: `/v3/users/a47df59f616043efbf950b48da4acdf9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:47.797667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47df59f616043efbf950b48da4acdf9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:47.799604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:47.983997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47df59f616043efbf950b48da4acdf9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:47.990723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47df59f616043efbf950b48da4acdf9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.002283 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47df59f616043efbf950b48da4acdf9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.002943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47df59f616043efbf950b48da4acdf9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.077079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47df59f616043efbf950b48da4acdf9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.083597 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4200/8301] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:45:47 2021] DELETE /identity/v3/users/a47df59f616043efbf950b48da4acdf9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:48.089673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:48.090153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:48.090260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:48.107631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:48.108814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:48.176794 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4102/8302] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:48.186483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:48.187868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:48.247331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931e6d8-d669-4afe-8017-ba035bfbfb3d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:48.251088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b7e60-0dfc-4cd7-a5fa-5e7dce4c4daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:48.251729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b7e60-0dfc-4cd7-a5fa-5e7dce4c4daf service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:48.252006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b7e60-0dfc-4cd7-a5fa-5e7dce4c4daf service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:48.252279 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b7e60-0dfc-4cd7-a5fa-5e7dce4c4daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:48.262643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b7e60-0dfc-4cd7-a5fa-5e7dce4c4daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:48.264066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b7e60-0dfc-4cd7-a5fa-5e7dce4c4daf service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:48.274782 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4201/8303] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:48.506418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:48.508077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:48.528631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710bf9c-7748-4b1e-994b-9c28b49bf302 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:48.533263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:48.534182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:48.534458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:48.534725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] PATH_INFO: `/v3/projects/b06aed9603024d699e3090cef722f711` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:48.535921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06aed9603024d699e3090cef722f711)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:48.538040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:48.653818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06aed9603024d699e3090cef722f711', 'request_id': 'req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.659885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06aed9603024d699e3090cef722f711', 'request_id': 'req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.735142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06aed9603024d699e3090cef722f711', 'request_id': 'req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.747485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] The token cache is being invalidate because project b06aed9603024d699e3090cef722f711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:45:48.747840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.749444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e2c3d2c0-8b62-48e7-85ac-f4033da7d20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:48.751403 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4103/8304] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:45:48 2021] DELETE /identity/v3/projects/b06aed9603024d699e3090cef722f711 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:45:48.756903 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9cef2-fde7-4a71-88ce-da9aaeb1a19e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:48.757385 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9cef2-fde7-4a71-88ce-da9aaeb1a19e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:48.759140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9cef2-fde7-4a71-88ce-da9aaeb1a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:48.780116 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a7a9cef2-fde7-4a71-88ce-da9aaeb1a19e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:48.782004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a7a9cef2-fde7-4a71-88ce-da9aaeb1a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:48.841465 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4202/8305] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:48.850378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573bbde-ca1d-494f-b247-d59b0c99f1d7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:48.850666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573bbde-ca1d-494f-b247-d59b0c99f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:48.850990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573bbde-ca1d-494f-b247-d59b0c99f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:48.871709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8573bbde-ca1d-494f-b247-d59b0c99f1d7 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:48.871709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8573bbde-ca1d-494f-b247-d59b0c99f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:48.878595 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4104/8306] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:48.883231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9cef2-fde7-4a71-88ce-da9aaeb1a19e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:48.893187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9cef2-fde7-4a71-88ce-da9aaeb1a19e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:48.898540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:48.899182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:48.899466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:48.899745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:48.900464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:45:48.900774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:48.902400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:48.913732 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4203/8307] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:45:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:45:48.918154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573bbde-ca1d-494f-b247-d59b0c99f1d7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:48.927206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573bbde-ca1d-494f-b247-d59b0c99f1d7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:48.931771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:48.932425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:48.932704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:48.933008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:48.933701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:48.935564 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.023240 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4105/8308] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:45:48 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:49.027166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.036928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a9f82-0bba-424c-b255-392b96902281 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.095786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.096448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.096728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.097034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.097779 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.099737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.169491 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4204/8309] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:45:49 2021] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:49.175041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.185292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095d508-909c-48aa-a886-0470c35271ac admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.189952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.190608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.190890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.191661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.192416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.194038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.204176 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4106/8310] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:49.208789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.218679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41855173-e9c0-431d-a169-2795d9ad41ee admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.223334 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c501cf-65b6-445f-a9b9-8092965aaaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.223973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c501cf-65b6-445f-a9b9-8092965aaaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.224255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c501cf-65b6-445f-a9b9-8092965aaaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.224524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c501cf-65b6-445f-a9b9-8092965aaaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.225274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c501cf-65b6-445f-a9b9-8092965aaaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.226843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c501cf-65b6-445f-a9b9-8092965aaaa0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.236454 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4205/8311] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:49.240411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.250247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ff97b-34d1-4620-bbab-c0e83618bc63 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.255324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.256197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.256476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.256753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] PATH_INFO: `/v3/projects/279819639ef54e359d1e00a99cb324e2/users/6c8a9e34d2244d84ac3abc21964c0261/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.272967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] RBAC: Authorizing `identity:create_grant(project_id=279819639ef54e359d1e00a99cb324e2, user_id=6c8a9e34d2244d84ac3abc21964c0261, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.275587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.334748 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4107/8312] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:45:49 2021] PUT /identity/v3/projects/279819639ef54e359d1e00a99cb324e2/users/6c8a9e34d2244d84ac3abc21964c0261/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:49.344849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf05eb5-f051-4336-9316-466fc22c896b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.345234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf05eb5-f051-4336-9316-466fc22c896b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.345582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf05eb5-f051-4336-9316-466fc22c896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.372342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1bf05eb5-f051-4336-9316-466fc22c896b None None] MFA Rules not processed for user `6c8a9e34d2244d84ac3abc21964c0261`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:49.373690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1bf05eb5-f051-4336-9316-466fc22c896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:49.438992 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4206/8313] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:49 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:49.443997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.504477 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a05ea8-2ec5-4b3f-b5b1-888f0de271da admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.509176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.509827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.510104 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.510630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.511305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.513253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.616582 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4108/8314] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:45:49 2021] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:49.620690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf05eb5-f051-4336-9316-466fc22c896b None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.631935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf05eb5-f051-4336-9316-466fc22c896b None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.686979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.687565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.687845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.688118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.688811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.692732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.792736 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4207/8315] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:45:49 2021] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:49.796760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.808554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157684da-2f3f-4be8-ac2e-b816aaf0a084 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.813628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.814497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.814776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.815049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.816596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.818752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.829776 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4109/8316] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:49.833931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.844557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56a392-406a-44c2-9d79-58d4e5c90bb0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:49.849871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:49.853017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:49.853017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:49.853017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] PATH_INFO: `/v3/projects/fecaa511d27d4cb0b132e110e7b5947d/users/1353131740cf4784b3dbb21c35cfc9d8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:49.866412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecaa511d27d4cb0b132e110e7b5947d, user_id=1353131740cf4784b3dbb21c35cfc9d8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:49.869086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:49.935273 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4208/8317] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:45:49 2021] PUT /identity/v3/projects/fecaa511d27d4cb0b132e110e7b5947d/users/1353131740cf4784b3dbb21c35cfc9d8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:45:49.939241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:49.949767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bcbff-d3fa-49ce-9301-c0988a21f9c3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:50.005030 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc65d3-5301-4979-adc1-78cd38f56a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:50.005689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc65d3-5301-4979-adc1-78cd38f56a6f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:50.005982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc65d3-5301-4979-adc1-78cd38f56a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:50.006252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc65d3-5301-4979-adc1-78cd38f56a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:50.006978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc65d3-5301-4979-adc1-78cd38f56a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:50.008562 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc65d3-5301-4979-adc1-78cd38f56a6f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:50.018883 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4110/8318] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:50.023366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:50.033788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a9ba-46bd-4563-8937-48ed59e30483 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:50.039286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:50.040190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:50.041508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:50.041508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] PATH_INFO: `/v3/projects/fecaa511d27d4cb0b132e110e7b5947d/users/1353131740cf4784b3dbb21c35cfc9d8/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:50.042764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecaa511d27d4cb0b132e110e7b5947d, user_id=1353131740cf4784b3dbb21c35cfc9d8, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:50.045389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:50.055436 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4209/8319] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:45:50 2021] PUT /identity/v3/projects/fecaa511d27d4cb0b132e110e7b5947d/users/1353131740cf4784b3dbb21c35cfc9d8/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:50.065530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57682-78ca-4682-9590-af8e2d06fb1d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:50.065895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57682-78ca-4682-9590-af8e2d06fb1d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:50.066175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae57682-78ca-4682-9590-af8e2d06fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:50.093881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cae57682-78ca-4682-9590-af8e2d06fb1d None None] MFA Rules not processed for user `1353131740cf4784b3dbb21c35cfc9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:50.095089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cae57682-78ca-4682-9590-af8e2d06fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:50.163130 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4111/8320] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:50 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:50.173667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:50.175351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:50.233296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237becbb-472e-4be7-a843-841980830c29 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:50.237053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:50.237719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:50.238010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:50.238294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:50.247521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:50.249013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:50.258438 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4210/8321] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:50 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:50.348008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57682-78ca-4682-9590-af8e2d06fb1d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:50.359867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae57682-78ca-4682-9590-af8e2d06fb1d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:50.363419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1e03b-d4f5-4c60-b49a-c7c222125638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:50.364075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1e03b-d4f5-4c60-b49a-c7c222125638 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:50.364353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1e03b-d4f5-4c60-b49a-c7c222125638 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:50.364625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1e03b-d4f5-4c60-b49a-c7c222125638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:50.418414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1e03b-d4f5-4c60-b49a-c7c222125638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:50.419822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1e03b-d4f5-4c60-b49a-c7c222125638 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:50.428519 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4112/8322] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:50 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:56.606453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:56.676811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9eb79-c7c5-4433-b091-109fec1506ad service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:56.682360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:56.683249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:56.683531 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:56.683806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] PATH_INFO: `/v3/users/6c8a9e34d2244d84ac3abc21964c0261` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:56.685107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8a9e34d2244d84ac3abc21964c0261)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:56.687034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:56.884370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8a9e34d2244d84ac3abc21964c0261'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:56.891654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8a9e34d2244d84ac3abc21964c0261'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:56.904375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8a9e34d2244d84ac3abc21964c0261'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:56.905129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8a9e34d2244d84ac3abc21964c0261'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:56.946693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8a9e34d2244d84ac3abc21964c0261'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:56.953370 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4211/8323] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:45:56 2021] DELETE /identity/v3/users/6c8a9e34d2244d84ac3abc21964c0261 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:56.958985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:56.958985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:56.959517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:56.978689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:56.979962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:57.044629 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4113/8324] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:57.055269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:57.056806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:57.120329 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630be56-182e-4d0d-bc47-e1a9ad0c828e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:57.126374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:57.126374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:57.126374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:57.126374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:57.136286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:57.137705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:57.148499 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4212/8325] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:45:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:45:57.554508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:57.556658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:57.575759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b1902-1988-47c9-a912-c52bbf0ec634 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:57.581922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:57.582830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:57.583164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:57.583423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] PATH_INFO: `/v3/projects/279819639ef54e359d1e00a99cb324e2` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:57.584922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=279819639ef54e359d1e00a99cb324e2)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:57.587928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:57.700464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279819639ef54e359d1e00a99cb324e2', 'request_id': 'req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:57.706345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279819639ef54e359d1e00a99cb324e2', 'request_id': 'req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:57.768968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279819639ef54e359d1e00a99cb324e2', 'request_id': 'req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:57.779515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] The token cache is being invalidate because project 279819639ef54e359d1e00a99cb324e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:45:57.779797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:57.780409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:57.781979 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4114/8326] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:45:57 2021] DELETE /identity/v3/projects/279819639ef54e359d1e00a99cb324e2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:57.785891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:57.795764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c17301-2a4f-4b52-9a0f-921b7225c4f9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:57.851019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:57.851874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:57.852170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:57.852419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] PATH_INFO: `/v3/users/1353131740cf4784b3dbb21c35cfc9d8` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:57.853742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1353131740cf4784b3dbb21c35cfc9d8)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:57.855691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:58.034014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1353131740cf4784b3dbb21c35cfc9d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.041123 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1353131740cf4784b3dbb21c35cfc9d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.052832 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1353131740cf4784b3dbb21c35cfc9d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.053561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1353131740cf4784b3dbb21c35cfc9d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.100290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5defb545-b0e4-4843-90fb-0f81a2f75b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1353131740cf4784b3dbb21c35cfc9d8'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.106145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4213/8327] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:45:57 2021] DELETE /identity/v3/users/1353131740cf4784b3dbb21c35cfc9d8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:58.496795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:58.498294 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:58.511482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7c5e6-4baf-4d13-9129-67e1cd142edd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:58.576249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:58.577136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:58.577413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:58.577679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] PATH_INFO: `/v3/projects/fecaa511d27d4cb0b132e110e7b5947d` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:58.578907 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecaa511d27d4cb0b132e110e7b5947d)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:58.580981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:58.682570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecaa511d27d4cb0b132e110e7b5947d', 'request_id': 'req-c81d8e52-ec3b-4c7a-baa0-e974df604713'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.688639 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecaa511d27d4cb0b132e110e7b5947d', 'request_id': 'req-c81d8e52-ec3b-4c7a-baa0-e974df604713'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.774572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecaa511d27d4cb0b132e110e7b5947d', 'request_id': 'req-c81d8e52-ec3b-4c7a-baa0-e974df604713'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.784823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] The token cache is being invalidate because project fecaa511d27d4cb0b132e110e7b5947d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:45:58.785157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.785773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c81d8e52-ec3b-4c7a-baa0-e974df604713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:45:58.787293 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4115/8328] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:45:58 2021] DELETE /identity/v3/projects/fecaa511d27d4cb0b132e110e7b5947d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:58.792864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa10af-623d-42bc-852b-9ccffb372c4a None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:58.793355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa10af-623d-42bc-852b-9ccffb372c4a None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:58.793456 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa10af-623d-42bc-852b-9ccffb372c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:58.811135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-beaa10af-623d-42bc-852b-9ccffb372c4a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:58.812307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-beaa10af-623d-42bc-852b-9ccffb372c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:58.875371 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4214/8329] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:58.884759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a3dfd-4a1a-4979-ba44-1cb3c1125054 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:58.885076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a3dfd-4a1a-4979-ba44-1cb3c1125054 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:58.885677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a3dfd-4a1a-4979-ba44-1cb3c1125054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:58.904813 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-3c3a3dfd-4a1a-4979-ba44-1cb3c1125054 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:58.906018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3c3a3dfd-4a1a-4979-ba44-1cb3c1125054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:58.913961 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4116/8330] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:45:58.918133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa10af-623d-42bc-852b-9ccffb372c4a None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:58.927728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa10af-623d-42bc-852b-9ccffb372c4a None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:58.933959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:58.933959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:58.933959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:58.933959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:58.934552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:45:58.934857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:58.936431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:58.948528 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4215/8331] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:45:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:45:58.952914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a3dfd-4a1a-4979-ba44-1cb3c1125054 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:58.962829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a3dfd-4a1a-4979-ba44-1cb3c1125054 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:58.967707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:58.968349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:58.970766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:58.970766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:58.970766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:58.971514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.050070 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4117/8332] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:45:58 2021] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:45:59.054810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.064609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb052f-7bf8-40d5-947a-2ce023f6feab admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.122624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.123321 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.123602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.123879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.124613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.126558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.209356 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4216/8333] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:45:59 2021] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:59.213447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.224128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72120a1c-c420-4ae7-9687-9a830981533f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.228884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.229568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.229902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.230175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.230902 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.232483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.244775 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4118/8334] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:59.248676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.259365 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6354acf-bd8c-47ee-9ba2-88a3a51bf0cd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.264404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bf1d1-36aa-428e-83f2-78b85cd423ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.269708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf1d1-36aa-428e-83f2-78b85cd423ff admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.269708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf1d1-36aa-428e-83f2-78b85cd423ff admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.269708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf1d1-36aa-428e-83f2-78b85cd423ff admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.269708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bf1d1-36aa-428e-83f2-78b85cd423ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.269708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bf1d1-36aa-428e-83f2-78b85cd423ff admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.278995 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4217/8335] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:59.283259 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.293481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ed3c3-a02c-432e-9e45-95cd98cc0b53 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.298352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.299219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.299979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.300263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] PATH_INFO: `/v3/projects/149356e4ad8c46bf99b5a68754160755/users/9741b10f619c44f9b5c14c9945d125cd/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.315059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149356e4ad8c46bf99b5a68754160755, user_id=9741b10f619c44f9b5c14c9945d125cd, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.318334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.398391 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4119/8336] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:45:59 2021] PUT /identity/v3/projects/149356e4ad8c46bf99b5a68754160755/users/9741b10f619c44f9b5c14c9945d125cd/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:45:59.408799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bb19-3595-444d-bcfd-717aba862f59 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.409103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bb19-3595-444d-bcfd-717aba862f59 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.409383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bb19-3595-444d-bcfd-717aba862f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.436861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5f53bb19-3595-444d-bcfd-717aba862f59 None None] MFA Rules not processed for user `9741b10f619c44f9b5c14c9945d125cd`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:45:59.438162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5f53bb19-3595-444d-bcfd-717aba862f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:45:59.501352 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4218/8337] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:45:59 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:45:59.505947 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.566396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637adcf-48a8-46e8-9d38-b6eec9cfd7d0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.571306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.571965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.572242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.572512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.573262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.575124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.690581 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4120/8338] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:45:59 2021] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:59.694774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53bb19-3595-444d-bcfd-717aba862f59 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.705558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53bb19-3595-444d-bcfd-717aba862f59 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.761527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.762190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.762476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.762753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.763455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.765392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.871942 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4219/8339] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:45:59 2021] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:45:59.875782 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.886356 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885486d-012e-4a74-8c02-8989d12cebcd admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.891002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.892713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.892713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.892713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.893051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.894679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.905973 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4121/8340] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:45:59.910058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.920684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71344-8166-41fe-82f2-49af1117c021 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.925301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c93545-74ea-4bb0-b3cf-f8fb9ac9a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.925948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93545-74ea-4bb0-b3cf-f8fb9ac9a032 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.926230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93545-74ea-4bb0-b3cf-f8fb9ac9a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.926505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93545-74ea-4bb0-b3cf-f8fb9ac9a032 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.927229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c93545-74ea-4bb0-b3cf-f8fb9ac9a032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.928820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c93545-74ea-4bb0-b3cf-f8fb9ac9a032 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:45:59.938584 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4220/8341] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:45:59.947056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:45:59.957297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03c54d-c49f-45e4-9a00-e3c7aee51b1a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:45:59.962488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:45:59.963371 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:45:59.963649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:45:59.963925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] PATH_INFO: `/v3/projects/688c27a5deac424bb41809428b0ff927/users/5364e4d50b024907a074f0b20b3356ef/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:45:59.979347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688c27a5deac424bb41809428b0ff927, user_id=5364e4d50b024907a074f0b20b3356ef, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:45:59.982005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.060749 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4122/8342] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:45:59 2021] PUT /identity/v3/projects/688c27a5deac424bb41809428b0ff927/users/5364e4d50b024907a074f0b20b3356ef/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:00.071616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe5b85-882a-4e8c-93b0-08c0a7c0d573 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.071905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe5b85-882a-4e8c-93b0-08c0a7c0d573 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.072177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe5b85-882a-4e8c-93b0-08c0a7c0d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.097869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-17fe5b85-882a-4e8c-93b0-08c0a7c0d573 None None] MFA Rules not processed for user `5364e4d50b024907a074f0b20b3356ef`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:00.099045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-17fe5b85-882a-4e8c-93b0-08c0a7c0d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:00.160844 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4221/8343] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:00 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:00.165819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:00.224397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcc88e-7048-4f7d-b027-dd0105a67b57 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:00.229616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:00.230264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.230544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.230817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.231501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:00.233417 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.341222 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4123/8344] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:46:00 2021] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:46:00.345272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe5b85-882a-4e8c-93b0-08c0a7c0d573 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:00.356263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe5b85-882a-4e8c-93b0-08c0a7c0d573 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:00.408742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:00.409421 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.409699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.409969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.410650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:00.413132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.478603 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4222/8345] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:46:00 2021] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:46:00.481723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:00.492616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b160-2ee6-43c6-ba4b-71f1e36ed909 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:00.497506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:00.498162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.498446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.498723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.499544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:00.501155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.512837 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4124/8346] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:00.516867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:00.526813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a874b0-d7ae-4e85-bb5a-4c501697e5aa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:00.531486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:00.532359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.532645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.532983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] PATH_INFO: `/v3/projects/249798e6dbdf459584ceca0d21b40f9a/users/d127652c85bf44f9b2185a19f2dec748/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.547513 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249798e6dbdf459584ceca0d21b40f9a, user_id=d127652c85bf44f9b2185a19f2dec748, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:00.550187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.609055 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4223/8347] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:00 2021] PUT /identity/v3/projects/249798e6dbdf459584ceca0d21b40f9a/users/d127652c85bf44f9b2185a19f2dec748/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:00.613124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:00.624009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f69c7-1140-478a-bd08-8869a9de89d6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:00.683982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491f776-5a0b-4450-92d0-16cb11eb855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:00.683982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491f776-5a0b-4450-92d0-16cb11eb855d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.683982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491f776-5a0b-4450-92d0-16cb11eb855d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.683982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491f776-5a0b-4450-92d0-16cb11eb855d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.684443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491f776-5a0b-4450-92d0-16cb11eb855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:00.684443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491f776-5a0b-4450-92d0-16cb11eb855d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.691119 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4125/8348] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:00 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:00.695882 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:00.706192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8719734-0202-4ab6-9650-f91f29ce61e8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:00.711394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:00.712271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.712555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.712830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] PATH_INFO: `/v3/projects/249798e6dbdf459584ceca0d21b40f9a/users/d127652c85bf44f9b2185a19f2dec748/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.714833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249798e6dbdf459584ceca0d21b40f9a, user_id=d127652c85bf44f9b2185a19f2dec748, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:00.717514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.728202 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4224/8349] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:00 2021] PUT /identity/v3/projects/249798e6dbdf459584ceca0d21b40f9a/users/d127652c85bf44f9b2185a19f2dec748/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:00.738900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.739195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.739476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.765620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] MFA Rules not processed for user `d127652c85bf44f9b2185a19f2dec748`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:00.766847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:00.833102 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4126/8350] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:00 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:00.844050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:00.845878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:00.903645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d244-2f00-45a2-8b84-aba73c29f8e6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:00.907643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:00.908295 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:00.908579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:00.908859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:00.918168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:00.919597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:00.929132 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4225/8351] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:00 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:01.035474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:01.037118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:01.052233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a27a6e-5c14-499b-8aaf-ebb4186f082c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:01.056408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa483cb-53fd-4a2f-a565-6ab36c0ad052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:01.057079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa483cb-53fd-4a2f-a565-6ab36c0ad052 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:01.057393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa483cb-53fd-4a2f-a565-6ab36c0ad052 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:01.057672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa483cb-53fd-4a2f-a565-6ab36c0ad052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:01.114411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa483cb-53fd-4a2f-a565-6ab36c0ad052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:01.116561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa483cb-53fd-4a2f-a565-6ab36c0ad052 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:01.125357 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4127/8352] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:01 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:08.158312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:08.220782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da300-6d70-4cf4-b983-9b124f015e66 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:08.225660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:08.226522 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:08.226804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:08.227075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] PATH_INFO: `/v3/users/9741b10f619c44f9b5c14c9945d125cd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:08.228288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9741b10f619c44f9b5c14c9945d125cd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:08.230294 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:08.353193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9741b10f619c44f9b5c14c9945d125cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:08.359752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9741b10f619c44f9b5c14c9945d125cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:08.371835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9741b10f619c44f9b5c14c9945d125cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:08.372495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9741b10f619c44f9b5c14c9945d125cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:08.425707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9741b10f619c44f9b5c14c9945d125cd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:08.433126 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4226/8353] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:46:08 2021] DELETE /identity/v3/users/9741b10f619c44f9b5c14c9945d125cd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:08.437809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:08.438325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:08.438419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:08.455567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:08.460456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:08.516295 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4128/8354] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:08.526164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:08.527548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:08.586813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07e7a-e065-437c-8841-9f1b747cae5b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:08.590486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:08.591121 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:08.591402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:08.591671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:08.600497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:08.602497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:08.611941 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4227/8355] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:08.999325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:09.000744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:09.013452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa53e-8ac2-4f79-ad3a-7221ca4b6ad1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:09.018329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:09.020653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:09.020653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:09.020653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] PATH_INFO: `/v3/projects/149356e4ad8c46bf99b5a68754160755` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:09.021150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] RBAC: Authorizing `identity:delete_project(project_id=149356e4ad8c46bf99b5a68754160755)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:09.023551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:09.146631 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149356e4ad8c46bf99b5a68754160755', 'request_id': 'req-83534767-3cfe-4041-b873-6dd49e2554be'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.153803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149356e4ad8c46bf99b5a68754160755', 'request_id': 'req-83534767-3cfe-4041-b873-6dd49e2554be'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.231415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149356e4ad8c46bf99b5a68754160755', 'request_id': 'req-83534767-3cfe-4041-b873-6dd49e2554be'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.241728 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] The token cache is being invalidate because project 149356e4ad8c46bf99b5a68754160755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:46:09.242197 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.242954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.244561 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4129/8356] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:46:08 2021] DELETE /identity/v3/projects/149356e4ad8c46bf99b5a68754160755 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:09.248666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:09.258860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6189-4d59-4c83-9681-4c9525ab7995 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:09.313763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:09.314623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:09.314911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:09.315184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] PATH_INFO: `/v3/users/5364e4d50b024907a074f0b20b3356ef` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:09.316360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5364e4d50b024907a074f0b20b3356ef)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:09.318303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:09.433120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5364e4d50b024907a074f0b20b3356ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.439817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5364e4d50b024907a074f0b20b3356ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.451854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5364e4d50b024907a074f0b20b3356ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.452538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5364e4d50b024907a074f0b20b3356ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.500083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5364e4d50b024907a074f0b20b3356ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:09.506650 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4228/8357] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:46:09 2021] DELETE /identity/v3/users/5364e4d50b024907a074f0b20b3356ef => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:09.873536 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:09.874943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:09.890038 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534767-3cfe-4041-b873-6dd49e2554be admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:09.946697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:09.947485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:09.947760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:09.948032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] PATH_INFO: `/v3/projects/688c27a5deac424bb41809428b0ff927` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:09.949258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688c27a5deac424bb41809428b0ff927)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:09.951195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:10.059740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688c27a5deac424bb41809428b0ff927', 'request_id': 'req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.065876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688c27a5deac424bb41809428b0ff927', 'request_id': 'req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.128295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688c27a5deac424bb41809428b0ff927', 'request_id': 'req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.139525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] The token cache is being invalidate because project 688c27a5deac424bb41809428b0ff927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:46:10.139809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.140473 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.142061 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4130/8358] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:46:09 2021] DELETE /identity/v3/projects/688c27a5deac424bb41809428b0ff927 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:10.146015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:10.147381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:10.160677 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003cff1-1ee4-40d5-aac3-8641cc71d1da admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:10.215849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:10.216638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:10.216945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:10.217221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] PATH_INFO: `/v3/users/d127652c85bf44f9b2185a19f2dec748` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:10.218404 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d127652c85bf44f9b2185a19f2dec748)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:10.220302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:10.450984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd127652c85bf44f9b2185a19f2dec748'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.457623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd127652c85bf44f9b2185a19f2dec748'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.468949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd127652c85bf44f9b2185a19f2dec748'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.469545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd127652c85bf44f9b2185a19f2dec748'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.545547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d962d20-8b4b-470b-963c-7985d9c71373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd127652c85bf44f9b2185a19f2dec748'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:10.551468 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4229/8359] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:46:10 2021] DELETE /identity/v3/users/d127652c85bf44f9b2185a19f2dec748 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:10.941758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:10.943264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:10.956677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238a50-3dab-47e5-8efc-d1acf4eb90b6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:11.013474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:11.014248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.014525 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.014795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] PATH_INFO: `/v3/projects/249798e6dbdf459584ceca0d21b40f9a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.015969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249798e6dbdf459584ceca0d21b40f9a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:11.018009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:11.134662 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249798e6dbdf459584ceca0d21b40f9a', 'request_id': 'req-f0919b11-961a-4a49-802a-fd7dae310868'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:11.141008 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249798e6dbdf459584ceca0d21b40f9a', 'request_id': 'req-f0919b11-961a-4a49-802a-fd7dae310868'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:11.179920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249798e6dbdf459584ceca0d21b40f9a', 'request_id': 'req-f0919b11-961a-4a49-802a-fd7dae310868'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:11.189923 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] The token cache is being invalidate because project 249798e6dbdf459584ceca0d21b40f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:46:11.190205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:11.190950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f0919b11-961a-4a49-802a-fd7dae310868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:11.192461 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4131/8360] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:46:10 2021] DELETE /identity/v3/projects/249798e6dbdf459584ceca0d21b40f9a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:11.200049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849beb-b37e-4bda-b687-fb10461f2b97 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.200338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849beb-b37e-4bda-b687-fb10461f2b97 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.200613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849beb-b37e-4bda-b687-fb10461f2b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.218886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b8849beb-b37e-4bda-b687-fb10461f2b97 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:11.220177 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b8849beb-b37e-4bda-b687-fb10461f2b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:11.279259 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4230/8361] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:11.287403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda182c-d1ff-4c77-8b57-a0eb9c169cf6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.287695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda182c-d1ff-4c77-8b57-a0eb9c169cf6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.288004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda182c-d1ff-4c77-8b57-a0eb9c169cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.306630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2fda182c-d1ff-4c77-8b57-a0eb9c169cf6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:11.308007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2fda182c-d1ff-4c77-8b57-a0eb9c169cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:11.316229 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4132/8362] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:11.320989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8849beb-b37e-4bda-b687-fb10461f2b97 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:11.330735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8849beb-b37e-4bda-b687-fb10461f2b97 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:11.335944 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:11.336585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.336859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.337164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.337888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:46:11.338184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:11.339766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:11.351380 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4231/8363] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:46:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:46:11.355876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda182c-d1ff-4c77-8b57-a0eb9c169cf6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:11.365347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda182c-d1ff-4c77-8b57-a0eb9c169cf6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:11.370435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:11.371083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.371364 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.371637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.372334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:11.374310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:11.461729 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4133/8364] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:46:11 2021] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:46:11.465823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:11.476047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b616d-614c-4c47-bb2e-72cf973425aa admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:11.531301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:11.531885 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.532167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.532445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.533179 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:11.535120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:11.625896 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4232/8365] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:46:11 2021] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:46:11.629931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:11.641324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54ab2f-9b7d-49aa-8f7e-9980a9dbcd44 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:11.646301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:11.646900 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.647192 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.647470 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.648202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:11.649845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:11.660426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4134/8366] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:11.664470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:11.674462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710412b-b656-447c-89dc-41f838a82902 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:11.679307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42a978-8170-4cee-8ec6-70f132075c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:11.679951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a978-8170-4cee-8ec6-70f132075c72 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.680233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a978-8170-4cee-8ec6-70f132075c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.680509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a978-8170-4cee-8ec6-70f132075c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.681791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42a978-8170-4cee-8ec6-70f132075c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:11.683372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42a978-8170-4cee-8ec6-70f132075c72 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:11.693112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4233/8367] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:11.697551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:11.707341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d52ba-839d-4887-9c40-d9b13dc25c4d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:11.711921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:11.712785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.713154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.713426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] PATH_INFO: `/v3/projects/9fa8630d2e43497ba2b768b480d83a98/users/b45633f2a78049f6b73c1f46e5ecb1a4/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.727498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa8630d2e43497ba2b768b480d83a98, user_id=b45633f2a78049f6b73c1f46e5ecb1a4, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:11.730205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:11.893139 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4135/8368] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:11 2021] PUT /identity/v3/projects/9fa8630d2e43497ba2b768b480d83a98/users/b45633f2a78049f6b73c1f46e5ecb1a4/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:46:11.906239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad548ea-d2a9-4abc-aa3a-2446a8dc42c6 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:11.906528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad548ea-d2a9-4abc-aa3a-2446a8dc42c6 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:11.906808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad548ea-d2a9-4abc-aa3a-2446a8dc42c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:11.933982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1ad548ea-d2a9-4abc-aa3a-2446a8dc42c6 None None] MFA Rules not processed for user `b45633f2a78049f6b73c1f46e5ecb1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:11.935169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1ad548ea-d2a9-4abc-aa3a-2446a8dc42c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:12.000091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4234/8369] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:11 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:12.004636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:12.066082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e0d9-ffe7-4c53-93ab-f0fa38650df9 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:12.070762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:12.071409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.071708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.071979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.072661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:12.074580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:12.163893 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4136/8370] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:46:12 2021] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:46:12.168371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad548ea-d2a9-4abc-aa3a-2446a8dc42c6 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:12.183840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad548ea-d2a9-4abc-aa3a-2446a8dc42c6 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:12.239665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:12.240328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.240610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.240899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.241605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:12.243520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:12.340112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4235/8371] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:46:12 2021] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:46:12.344007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:12.354709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516ebd-9c44-4552-96f0-5e2f29b3df77 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:12.359406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:12.360054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.360335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.360607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.361423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:12.362988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:12.373910 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4137/8372] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:12.378017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:12.388264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbfa24-2213-406a-862e-06ef15e7d0ac admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:12.392869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:12.393747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.394041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.394289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] PATH_INFO: `/v3/projects/d574308c4c8c471285e6dbd5cd7aa2d3/users/00e9e5e3647f4d488dc49a9d53c3cf19/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.409201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d574308c4c8c471285e6dbd5cd7aa2d3, user_id=00e9e5e3647f4d488dc49a9d53c3cf19, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:12.411861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:12.483244 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4236/8373] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:12 2021] PUT /identity/v3/projects/d574308c4c8c471285e6dbd5cd7aa2d3/users/00e9e5e3647f4d488dc49a9d53c3cf19/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:12.489520 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:12.496957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cf779-561d-455b-8ee5-edfb782ce881 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:12.563613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbcfb1-f474-41eb-967d-ef17a5c1987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:12.564276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbcfb1-f474-41eb-967d-ef17a5c1987f admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.564557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbcfb1-f474-41eb-967d-ef17a5c1987f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.564827 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbcfb1-f474-41eb-967d-ef17a5c1987f admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.565580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbcfb1-f474-41eb-967d-ef17a5c1987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:12.567162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbcfb1-f474-41eb-967d-ef17a5c1987f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:12.578259 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4138/8374] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:12.582852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:12.594141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd115-ce8b-42f1-b78a-ee735cdfd62b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:12.600645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:12.601434 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.601973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.602472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] PATH_INFO: `/v3/projects/d574308c4c8c471285e6dbd5cd7aa2d3/users/00e9e5e3647f4d488dc49a9d53c3cf19/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.605846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d574308c4c8c471285e6dbd5cd7aa2d3, user_id=00e9e5e3647f4d488dc49a9d53c3cf19, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:12.608858 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:12.620195 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4237/8375] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:12 2021] PUT /identity/v3/projects/d574308c4c8c471285e6dbd5cd7aa2d3/users/00e9e5e3647f4d488dc49a9d53c3cf19/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:12.630589 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.630885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.631163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.658733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] MFA Rules not processed for user `00e9e5e3647f4d488dc49a9d53c3cf19`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:12.659978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:12.730911 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4139/8376] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:12 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:46:12.741765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:12.743607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:12.805127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2818df3-913f-4e18-8ed9-06380315ea06 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:12.809056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:12.809823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:12.810111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:12.810387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:12.873607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:12.875833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:12.889899 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4238/8377] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:12 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:46:18.305773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:18.307976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:18.382545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54418c13-1f07-4b13-a644-6cbd3f551a5b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:18.389064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:18.389767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:18.390175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:18.390552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:18.392549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:18.410428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:18.412126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:18.425715 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4140/8378] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:20.319816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:20.322236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:20.341303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e8b65-8f99-4e23-ba2d-1c28e75ae607 service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:20.346848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397dc56-a31f-4b16-9138-d7e01ef2ccad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:20.346848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397dc56-a31f-4b16-9138-d7e01ef2ccad service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:20.346848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397dc56-a31f-4b16-9138-d7e01ef2ccad service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:20.346848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397dc56-a31f-4b16-9138-d7e01ef2ccad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:20.357742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397dc56-a31f-4b16-9138-d7e01ef2ccad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:20.359225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397dc56-a31f-4b16-9138-d7e01ef2ccad service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:20.370835 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4239/8379] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:20 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:26.754365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:26.756634 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:26.837613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153284f-4b2a-45b2-a7f4-656147f6382f service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:26.842735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:26.843814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:26.844188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:26.844691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] PATH_INFO: `/v3/users/01a07fc3a154483caea95cbd449f3970` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:26.846396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a07fc3a154483caea95cbd449f3970)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:26.853290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:27.097981 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a07fc3a154483caea95cbd449f3970'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.106814 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a07fc3a154483caea95cbd449f3970'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.119048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a07fc3a154483caea95cbd449f3970'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.119738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a07fc3a154483caea95cbd449f3970'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.120481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a07fc3a154483caea95cbd449f3970'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.180096 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4141/8380] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:46:26 2021] DELETE /identity/v3/users/01a07fc3a154483caea95cbd449f3970 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:27.187474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:27.187935 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:27.188063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:27.207566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:27.208809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:27.272755 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4240/8381] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:46:27.289927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:27.291697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:27.352891 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13272562-6968-4c19-8dab-2ab988e38d22 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:27.356534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:27.357220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:27.357507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:27.357783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:27.367148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:27.369231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:27.380529 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4142/8382] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:27.611235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:27.612786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:27.627148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604746b-e56d-42cb-a258-289ff24932e2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:27.632774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:27.634906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:27.635286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:27.635658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] PATH_INFO: `/v3/projects/4ff29c23c5844f45826a02b6ae6b65e7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:27.637169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff29c23c5844f45826a02b6ae6b65e7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:27.639543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:27.729278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff29c23c5844f45826a02b6ae6b65e7', 'request_id': 'req-6e5c177b-d9fa-402c-a0e0-d5123977c419'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.791968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff29c23c5844f45826a02b6ae6b65e7', 'request_id': 'req-6e5c177b-d9fa-402c-a0e0-d5123977c419'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.798908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff29c23c5844f45826a02b6ae6b65e7', 'request_id': 'req-6e5c177b-d9fa-402c-a0e0-d5123977c419'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.810288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] The token cache is being invalidate because project 4ff29c23c5844f45826a02b6ae6b65e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:46:27.810658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.811351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:27.812922 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4241/8383] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:46:27 2021] DELETE /identity/v3/projects/4ff29c23c5844f45826a02b6ae6b65e7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:27.817074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:27.834648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327a0d3-ec58-4499-998d-9e397e33ab33 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:27.886482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:27.887363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:27.887645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:27.887918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] PATH_INFO: `/v3/users/58358a2e96c94ea3b018b93c1aef29ac` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:27.899228 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=58358a2e96c94ea3b018b93c1aef29ac)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:27.903044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:28.104186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58358a2e96c94ea3b018b93c1aef29ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.112693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58358a2e96c94ea3b018b93c1aef29ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.125555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58358a2e96c94ea3b018b93c1aef29ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.126307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58358a2e96c94ea3b018b93c1aef29ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.126921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-f6fde6af-ee6a-46a4-a1b2-f72c634f5dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58358a2e96c94ea3b018b93c1aef29ac'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.208522 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4143/8384] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:46:27 2021] DELETE /identity/v3/users/58358a2e96c94ea3b018b93c1aef29ac => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:28.444315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:28.445966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:28.461520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c177b-d9fa-402c-a0e0-d5123977c419 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:28.524619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:28.525577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:28.525994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:28.526280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] PATH_INFO: `/v3/projects/852b86f977de452a989c0d5ab77e2f09` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:28.527489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852b86f977de452a989c0d5ab77e2f09)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:28.529450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:28.638867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852b86f977de452a989c0d5ab77e2f09', 'request_id': 'req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.699902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852b86f977de452a989c0d5ab77e2f09', 'request_id': 'req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.707717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852b86f977de452a989c0d5ab77e2f09', 'request_id': 'req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.719090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] The token cache is being invalidate because project 852b86f977de452a989c0d5ab77e2f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:46:28.719601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.720437 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e74fc2c5-b5d9-4f06-9094-b4168a2ddfa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:46:28.723635 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4242/8385] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:46:28 2021] DELETE /identity/v3/projects/852b86f977de452a989c0d5ab77e2f09 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:28.731403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e183b0-8708-41c4-a5ba-f171bd4005e3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:28.731921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e183b0-8708-41c4-a5ba-f171bd4005e3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:28.732458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e183b0-8708-41c4-a5ba-f171bd4005e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:28.751398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-44e183b0-8708-41c4-a5ba-f171bd4005e3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:28.752768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-44e183b0-8708-41c4-a5ba-f171bd4005e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:28.820606 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4144/8386] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:28.830203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2aeb-29fa-45f4-9cbf-6f258536e5f3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:28.830480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2aeb-29fa-45f4-9cbf-6f258536e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:28.830757 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2aeb-29fa-45f4-9cbf-6f258536e5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:28.853628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c1bd2aeb-29fa-45f4-9cbf-6f258536e5f3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:28.854972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c1bd2aeb-29fa-45f4-9cbf-6f258536e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:28.873935 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4243/8387] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:28.876799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e183b0-8708-41c4-a5ba-f171bd4005e3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:28.888727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e183b0-8708-41c4-a5ba-f171bd4005e3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:28.895621 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:28.896234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:28.896655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:28.897067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:28.908173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:46:28.908173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:28.908173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:28.918420 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4145/8388] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:46:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:46:28.922879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2aeb-29fa-45f4-9cbf-6f258536e5f3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:28.937103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2aeb-29fa-45f4-9cbf-6f258536e5f3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:28.949722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:28.953053 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:28.953542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:28.956272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:28.957153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:28.964994 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:29.056344 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4244/8389] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:46:28 2021] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:46:29.060802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:29.073658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8e93-ca6b-4368-8e6a-db722f7a21ce admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:29.176091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:29.176959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:29.177354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:29.177708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:29.178530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:29.181595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:29.255505 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4146/8390] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:46:29 2021] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:46:29.261956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:29.273336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f19aab-4be3-4ec1-a51b-9779cf3df03e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:29.279485 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:29.280507 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:29.281245 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:29.281770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:29.282726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:29.284561 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:29.298250 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4245/8391] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:29 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:29.305267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:29.318566 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94bf2-4569-4218-891d-4021a72e4c35 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:29.324411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef1e38-1062-4205-a48c-63aac592a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:29.325127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef1e38-1062-4205-a48c-63aac592a72a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:29.325411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef1e38-1062-4205-a48c-63aac592a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:29.325689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef1e38-1062-4205-a48c-63aac592a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:29.326433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef1e38-1062-4205-a48c-63aac592a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:29.328054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef1e38-1062-4205-a48c-63aac592a72a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:29.341711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4147/8392] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:29 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:29.345747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:29.359052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5b7c3-3cd3-4c97-9562-af23d5d71341 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:29.365623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:29.366717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:29.367440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:29.367918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] PATH_INFO: `/v3/projects/64e4751d74674097b87a3ad1c686e9e5/users/f61753173a4d493ba1f1f3174c35f83e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:29.395635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e4751d74674097b87a3ad1c686e9e5, user_id=f61753173a4d493ba1f1f3174c35f83e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:29.399097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:29.494738 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4246/8393] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:29 2021] PUT /identity/v3/projects/64e4751d74674097b87a3ad1c686e9e5/users/f61753173a4d493ba1f1f3174c35f83e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:29.500172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f73e-a79f-4135-8850-5ab41191b0ab None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:29.500534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f73e-a79f-4135-8850-5ab41191b0ab None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:29.500941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4f73e-a79f-4135-8850-5ab41191b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:29.522624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cdf4f73e-a79f-4135-8850-5ab41191b0ab None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:29.523952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cdf4f73e-a79f-4135-8850-5ab41191b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:29.602257 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4148/8394] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:29.612995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:29.614868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:29.677836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80675d82-ee77-4612-8c59-6384e48da3a8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:29.682230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:29.682886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:29.683168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:29.683470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:29.694081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:29.695511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:29.706601 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4247/8395] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:36.157287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26b79d-a21e-4136-9aef-b2641c661947 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:36.157287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26b79d-a21e-4136-9aef-b2641c661947 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:36.157785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26b79d-a21e-4136-9aef-b2641c661947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:36.196065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-af26b79d-a21e-4136-9aef-b2641c661947 None None] MFA Rules not processed for user `f61753173a4d493ba1f1f3174c35f83e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:36.197284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-af26b79d-a21e-4136-9aef-b2641c661947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:36.288243 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4149/8396] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:36.288991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:36.299741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a436-67c4-4fc4-a277-0f59c4e78ed9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:36.315423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:36.315423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:36.315423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:36.315423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:36.316083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:36.316083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:36.436022 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4248/8397] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:46:36 2021] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:46:36.439908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26b79d-a21e-4136-9aef-b2641c661947 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:36.456628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26b79d-a21e-4136-9aef-b2641c661947 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:36.535216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:36.536056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:36.536490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:36.536860 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:36.537681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:36.539944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:36.632758 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4150/8398] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:46:36 2021] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:46:36.638244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:36.652494 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e07de-4eac-4758-a4ce-e01f9ba01fa2 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:36.676554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:36.680688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:36.685049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:36.685049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:36.685049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:36.689415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:36.704383 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4249/8399] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:36 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:46:36.708848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:36.726100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ca333-ecd5-42ed-abc3-d60ec51e84f6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:36.731917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:36.733065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:36.733464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:36.741193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] PATH_INFO: `/v3/projects/2cad11b925d6435b80d2b6f99851adb9/users/c66ee49421024b6cb63bcd3dd47efa3a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:36.760567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cad11b925d6435b80d2b6f99851adb9, user_id=c66ee49421024b6cb63bcd3dd47efa3a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:36.763515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:36.843711 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4151/8400] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:36 2021] PUT /identity/v3/projects/2cad11b925d6435b80d2b6f99851adb9/users/c66ee49421024b6cb63bcd3dd47efa3a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:36.848319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:36.862520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1560b-5fa3-4000-8fcc-e48f8a9963e3 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:37.034645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2374fa-80bf-49ae-9865-501a7bed55c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:37.035349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2374fa-80bf-49ae-9865-501a7bed55c1 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:37.035639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2374fa-80bf-49ae-9865-501a7bed55c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:37.037603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2374fa-80bf-49ae-9865-501a7bed55c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:37.037603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2374fa-80bf-49ae-9865-501a7bed55c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:37.038753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2374fa-80bf-49ae-9865-501a7bed55c1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:37.076956 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4250/8401] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:46:36 2021] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:46:37.078272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:37.096257 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b407a-29d7-43c5-b6cd-340bcd61ae5b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:37.105944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d28bbe-945b-4811-8f2c-895016d5daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:37.106890 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28bbe-945b-4811-8f2c-895016d5daaa admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:37.107129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28bbe-945b-4811-8f2c-895016d5daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:37.107405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d28bbe-945b-4811-8f2c-895016d5daaa admin admin] PATH_INFO: `/v3/projects/2cad11b925d6435b80d2b6f99851adb9/users/c66ee49421024b6cb63bcd3dd47efa3a/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:37.110262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d28bbe-945b-4811-8f2c-895016d5daaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cad11b925d6435b80d2b6f99851adb9, user_id=c66ee49421024b6cb63bcd3dd47efa3a, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:37.115110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d28bbe-945b-4811-8f2c-895016d5daaa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:37.153085 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4152/8402] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:46:37 2021] PUT /identity/v3/projects/2cad11b925d6435b80d2b6f99851adb9/users/c66ee49421024b6cb63bcd3dd47efa3a/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:46:42.545107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:42.545584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:42.545887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:42.596576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] MFA Rules not processed for user `71846607489941c5a65d9a3648c6c7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:42.596576 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:42.803835 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4251/8403] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:42 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:44.886871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c416b-9d08-4264-b0bd-836ed509d1e0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:44.887366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c416b-9d08-4264-b0bd-836ed509d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:44.887458 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c416b-9d08-4264-b0bd-836ed509d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:44.929283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b13c416b-9d08-4264-b0bd-836ed509d1e0 None None] MFA Rules not processed for user `c66ee49421024b6cb63bcd3dd47efa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:44.931804 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b13c416b-9d08-4264-b0bd-836ed509d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:45.026925 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4153/8404] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:44 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:45.041666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:45.044582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:45.133111 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc230e4-4cfd-4b8d-bf6a-d682697ec746 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:45.139426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:45.140098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:45.140384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:45.140660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:45.240166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:45.241834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:45.253318 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4252/8405] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:45 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:46:48.141379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:48.141872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:48.141989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:48.159682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] MFA Rules not processed for user `f61753173a4d493ba1f1f3174c35f83e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:46:48.160960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:48.168515 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4154/8406] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:46:48 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:46:54.970778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:46:54.984436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7e413-fee5-48b0-89e2-4a1da8033fdf service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:46:54.990088 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:46:54.990735 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:46:54.991087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:46:54.991301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:46:54.993749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:46:55.009670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:46:55.011237 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:46:55.026031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4253/8407] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:46:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:01.758231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:01.760282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:01.817203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5365bc-dc20-4ee2-9234-42513db3b8c1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:01.820808 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403ca0a-ba5f-4380-85bd-ed982718932d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:01.822109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403ca0a-ba5f-4380-85bd-ed982718932d service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:01.822390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403ca0a-ba5f-4380-85bd-ed982718932d service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:01.822665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403ca0a-ba5f-4380-85bd-ed982718932d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:01.831653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403ca0a-ba5f-4380-85bd-ed982718932d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:01.833097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403ca0a-ba5f-4380-85bd-ed982718932d service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:01.842744 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4155/8408] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:01 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:12.110550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:12.111947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:12.205408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d4c15-d822-4ef2-be89-57a9f5c5ec1a service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:12.210033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:12.210921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:12.211208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:12.211484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] PATH_INFO: `/v3/users/b45633f2a78049f6b73c1f46e5ecb1a4` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:12.212682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45633f2a78049f6b73c1f46e5ecb1a4)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:12.214659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:12.380890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45633f2a78049f6b73c1f46e5ecb1a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:12.388543 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45633f2a78049f6b73c1f46e5ecb1a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:12.399790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45633f2a78049f6b73c1f46e5ecb1a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:12.400458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45633f2a78049f6b73c1f46e5ecb1a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:12.459169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45633f2a78049f6b73c1f46e5ecb1a4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:12.465133 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4254/8409] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:12 2021] DELETE /identity/v3/users/b45633f2a78049f6b73c1f46e5ecb1a4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:12.469707 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:12.470200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:12.470340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:12.508563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:12.510039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:12.567163 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4156/8410] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:12.577716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:12.579119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:12.652249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ccd8e-e4ab-4eff-b9dd-92f96148be76 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:12.655895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:12.656931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:12.657431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:12.657930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:12.668795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:12.670247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:12.679575 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4255/8411] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:13.084156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:13.085613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:13.098931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3e139-e043-41c3-80fb-36d3cde318b5 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:13.103762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:13.104657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:13.104969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:13.105248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] PATH_INFO: `/v3/projects/9fa8630d2e43497ba2b768b480d83a98` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:13.107055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa8630d2e43497ba2b768b480d83a98)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:13.108995 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:13.248114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa8630d2e43497ba2b768b480d83a98', 'request_id': 'req-b1ec8dc0-698e-4d6e-b338-98202642165c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.254218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa8630d2e43497ba2b768b480d83a98', 'request_id': 'req-b1ec8dc0-698e-4d6e-b338-98202642165c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.310939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa8630d2e43497ba2b768b480d83a98', 'request_id': 'req-b1ec8dc0-698e-4d6e-b338-98202642165c'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.320996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] The token cache is being invalidate because project 9fa8630d2e43497ba2b768b480d83a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:13.321335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.322041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.323585 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4157/8412] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:13 2021] DELETE /identity/v3/projects/9fa8630d2e43497ba2b768b480d83a98 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:13.327577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:13.337249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17518f49-533a-4623-ac77-abff4091eebb service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:13.392509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:13.393401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:13.393684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:13.393957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] PATH_INFO: `/v3/users/00e9e5e3647f4d488dc49a9d53c3cf19` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:13.395149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e9e5e3647f4d488dc49a9d53c3cf19)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:13.397075 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:13.757855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e9e5e3647f4d488dc49a9d53c3cf19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.765300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e9e5e3647f4d488dc49a9d53c3cf19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.776469 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e9e5e3647f4d488dc49a9d53c3cf19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.777155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e9e5e3647f4d488dc49a9d53c3cf19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.847899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9916799a-b71e-4c4d-b1c5-f9ec31b02bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e9e5e3647f4d488dc49a9d53c3cf19'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:13.854019 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4256/8413] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:13 2021] DELETE /identity/v3/users/00e9e5e3647f4d488dc49a9d53c3cf19 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:14.313133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:14.314699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:14.335093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8dc0-698e-4d6e-b338-98202642165c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:14.397199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:14.398055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:14.398334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:14.398606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] PATH_INFO: `/v3/projects/d574308c4c8c471285e6dbd5cd7aa2d3` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:14.399786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d574308c4c8c471285e6dbd5cd7aa2d3)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:14.401720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:14.527234 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd574308c4c8c471285e6dbd5cd7aa2d3', 'request_id': 'req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:14.533640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd574308c4c8c471285e6dbd5cd7aa2d3', 'request_id': 'req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:14.596795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd574308c4c8c471285e6dbd5cd7aa2d3', 'request_id': 'req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:14.608131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] The token cache is being invalidate because project d574308c4c8c471285e6dbd5cd7aa2d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:14.608409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:14.609055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-748f01e0-4e30-4477-9ff3-ad2c6788d7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:14.610574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4158/8414] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:14 2021] DELETE /identity/v3/projects/d574308c4c8c471285e6dbd5cd7aa2d3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:14.616296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb7d4-d20f-438d-adaf-89207b74afe0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:14.616767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb7d4-d20f-438d-adaf-89207b74afe0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:14.616865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fb7d4-d20f-438d-adaf-89207b74afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:14.635045 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e96fb7d4-d20f-438d-adaf-89207b74afe0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:14.636269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e96fb7d4-d20f-438d-adaf-89207b74afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:14.693059 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4257/8415] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:14.701677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5013f49-cd3a-4273-81e6-4e1c444d3ab4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:14.701965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5013f49-cd3a-4273-81e6-4e1c444d3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:14.702242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5013f49-cd3a-4273-81e6-4e1c444d3ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:14.721693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d5013f49-cd3a-4273-81e6-4e1c444d3ab4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:14.722871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d5013f49-cd3a-4273-81e6-4e1c444d3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:14.730611 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4159/8416] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:14.735243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fb7d4-d20f-438d-adaf-89207b74afe0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:14.744807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fb7d4-d20f-438d-adaf-89207b74afe0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:14.749500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:14.750138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:14.750420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:14.750693 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:14.751409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:47:14.751743 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:14.753382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:14.765172 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4258/8417] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:47:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:47:14.769002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5013f49-cd3a-4273-81e6-4e1c444d3ab4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:14.778419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5013f49-cd3a-4273-81e6-4e1c444d3ab4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:14.782999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:14.783629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:14.783905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:14.784177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:14.784856 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:14.786747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:14.920012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4160/8418] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:47:14 2021] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:14.923762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:14.933778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d37f8b-571a-4110-b8cb-457ba51f804f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:14.989444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:14.990102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:14.990389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:14.990656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:14.991328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:14.993248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:15.065112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4259/8419] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:47:14 2021] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:47:15.069175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:15.080216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6d750-58b5-4643-84d5-3bee204919f0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:15.085178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:15.085836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:15.086127 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:15.086476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:15.087208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:15.088795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:15.099676 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4161/8420] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:15.103602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:15.113573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a77547-850f-49e5-990c-29e011e18f1a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:15.118347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f03395-7509-49dc-8f10-462e55ebfe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:15.119028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03395-7509-49dc-8f10-462e55ebfe0a admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:15.119307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03395-7509-49dc-8f10-462e55ebfe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:15.119583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03395-7509-49dc-8f10-462e55ebfe0a admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:15.120438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f03395-7509-49dc-8f10-462e55ebfe0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:15.122112 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f03395-7509-49dc-8f10-462e55ebfe0a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:15.131937 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4260/8421] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:15.136146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:15.146624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2bbcb-db17-4d47-b188-f937420d6cd7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:15.151305 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:15.152177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:15.152452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:15.152721 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] PATH_INFO: `/v3/projects/66934462c37d4394a5fd25935c7bf534/users/a8d3f65362a945dc861069fd57bcd8fe/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:15.167320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=66934462c37d4394a5fd25935c7bf534, user_id=a8d3f65362a945dc861069fd57bcd8fe, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:15.169956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:15.249948 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4162/8422] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:15 2021] PUT /identity/v3/projects/66934462c37d4394a5fd25935c7bf534/users/a8d3f65362a945dc861069fd57bcd8fe/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:15.260500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d18c-1615-4754-9498-d9cf853ad28e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:15.265346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d18c-1615-4754-9498-d9cf853ad28e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:15.265346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d18c-1615-4754-9498-d9cf853ad28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:15.288587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5e06d18c-1615-4754-9498-d9cf853ad28e None None] MFA Rules not processed for user `a8d3f65362a945dc861069fd57bcd8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:15.289815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5e06d18c-1615-4754-9498-d9cf853ad28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:15.351341 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4261/8423] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:15 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:15.360993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:15.362848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:15.419664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c3fbd-c132-4800-9fe4-300dc0ec82ea admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:15.423244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80df48-b8a3-4ee8-9166-474abebd7b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:15.423875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80df48-b8a3-4ee8-9166-474abebd7b82 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:15.424154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80df48-b8a3-4ee8-9166-474abebd7b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:15.424424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80df48-b8a3-4ee8-9166-474abebd7b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:15.432386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80df48-b8a3-4ee8-9166-474abebd7b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:15.433828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80df48-b8a3-4ee8-9166-474abebd7b82 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:15.442921 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4163/8424] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:15 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:22.530389 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06d18c-1615-4754-9498-d9cf853ad28e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:22.589701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06d18c-1615-4754-9498-d9cf853ad28e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:22.594287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:22.595204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:22.595483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:22.595752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] PATH_INFO: `/v3/users/a8d3f65362a945dc861069fd57bcd8fe` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:22.596954 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d3f65362a945dc861069fd57bcd8fe)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:22.598844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:22.791760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d3f65362a945dc861069fd57bcd8fe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:22.799108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d3f65362a945dc861069fd57bcd8fe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:22.811104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d3f65362a945dc861069fd57bcd8fe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:22.811777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d3f65362a945dc861069fd57bcd8fe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:22.905134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d3f65362a945dc861069fd57bcd8fe'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:22.911101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4262/8425] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:22 2021] DELETE /identity/v3/users/a8d3f65362a945dc861069fd57bcd8fe => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:22.915759 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:22.916247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:22.916354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:22.934255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:22.935445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:22.993012 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4164/8426] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:47:23.003198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:23.004612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:23.062802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bba26-9d0d-4efc-975d-96d31ec304fd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:23.066453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5df687-d168-42a7-aa1b-5c1911a24214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:23.067085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5df687-d168-42a7-aa1b-5c1911a24214 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:23.067362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5df687-d168-42a7-aa1b-5c1911a24214 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:23.067633 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5df687-d168-42a7-aa1b-5c1911a24214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:23.077041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5df687-d168-42a7-aa1b-5c1911a24214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:23.082865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5df687-d168-42a7-aa1b-5c1911a24214 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:23.088023 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4263/8427] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:23.477422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:23.478930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:23.491457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258147-d106-45bd-b11a-26f2ae6a40ff None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:23.496250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:23.497141 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:23.502031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:23.502031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] PATH_INFO: `/v3/projects/66934462c37d4394a5fd25935c7bf534` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:23.502031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66934462c37d4394a5fd25935c7bf534)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:23.502031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:23.595159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66934462c37d4394a5fd25935c7bf534', 'request_id': 'req-1078789a-5eee-47ff-9991-57c7bc5a1f57'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:23.601214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66934462c37d4394a5fd25935c7bf534', 'request_id': 'req-1078789a-5eee-47ff-9991-57c7bc5a1f57'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:23.664092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66934462c37d4394a5fd25935c7bf534', 'request_id': 'req-1078789a-5eee-47ff-9991-57c7bc5a1f57'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:23.675421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] The token cache is being invalidate because project 66934462c37d4394a5fd25935c7bf534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:23.675711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:23.676344 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-1078789a-5eee-47ff-9991-57c7bc5a1f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:23.677919 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4165/8428] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:23 2021] DELETE /identity/v3/projects/66934462c37d4394a5fd25935c7bf534 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:23.684059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff57040-b7da-47e2-b60d-64f113ec6cfe None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:23.684506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff57040-b7da-47e2-b60d-64f113ec6cfe None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:23.684618 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff57040-b7da-47e2-b60d-64f113ec6cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:23.702397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7ff57040-b7da-47e2-b60d-64f113ec6cfe None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:23.703629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7ff57040-b7da-47e2-b60d-64f113ec6cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:23.760596 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4264/8429] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:23.768343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b808-9b5f-4b86-bb08-5452e240b546 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:23.771431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b808-9b5f-4b86-bb08-5452e240b546 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:23.771431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b808-9b5f-4b86-bb08-5452e240b546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:23.787523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e072b808-9b5f-4b86-bb08-5452e240b546 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:23.788711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e072b808-9b5f-4b86-bb08-5452e240b546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:23.797218 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4166/8430] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:23.801372 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff57040-b7da-47e2-b60d-64f113ec6cfe None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:23.811102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff57040-b7da-47e2-b60d-64f113ec6cfe None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:23.815798 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:23.816439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:23.816720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:23.817036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:23.817759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:47:23.818167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:23.819755 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:23.831458 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4265/8431] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:47:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:47:23.837789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b808-9b5f-4b86-bb08-5452e240b546 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:23.847614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b808-9b5f-4b86-bb08-5452e240b546 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:23.852159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:23.852914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:23.853191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:23.853461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:23.854174 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:23.856051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:23.958856 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4167/8432] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:47:23 2021] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:23.963043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:23.974100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144d617-6025-4c2d-b258-2d77a2fa4c31 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.028125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.029442 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.029733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.030012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.030719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.032621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.134192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4266/8433] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:47:23 2021] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:24.138784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.148959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444495f-7c4c-402b-8b02-b15cf661453c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.153465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.154663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.154939 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.155337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.156031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.157640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.170902 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4168/8434] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:24.172484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.182495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022676a-c6de-4829-ae52-66012e5e655b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.187553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0c084-3a24-4208-9dcc-a6e97c65e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.188213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0c084-3a24-4208-9dcc-a6e97c65e040 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.188495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0c084-3a24-4208-9dcc-a6e97c65e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.188772 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0c084-3a24-4208-9dcc-a6e97c65e040 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.189550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0c084-3a24-4208-9dcc-a6e97c65e040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.191175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0c084-3a24-4208-9dcc-a6e97c65e040 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.202801 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4267/8435] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:47:24.205468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.215532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765e43a-41d3-49d3-853e-ad4387250e95 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.220899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.221767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.222043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.222321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] PATH_INFO: `/v3/projects/e8892d086e634f9699010eceffbb59d7/users/74053d7091ef41a1ad314ee0da374068/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.236724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8892d086e634f9699010eceffbb59d7, user_id=74053d7091ef41a1ad314ee0da374068, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.240547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.345468 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4169/8436] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:24 2021] PUT /identity/v3/projects/e8892d086e634f9699010eceffbb59d7/users/74053d7091ef41a1ad314ee0da374068/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:47:24.356492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366625b-d479-4ae9-9c9b-29581cfe5de9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.356784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366625b-d479-4ae9-9c9b-29581cfe5de9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.357085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366625b-d479-4ae9-9c9b-29581cfe5de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.384577 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1366625b-d479-4ae9-9c9b-29581cfe5de9 None None] MFA Rules not processed for user `74053d7091ef41a1ad314ee0da374068`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:24.385766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1366625b-d479-4ae9-9c9b-29581cfe5de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:24.456345 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4268/8437] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:24 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:24.460806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.520109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045e6dc-48f1-46e2-b9d8-356891f11641 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.524825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.525512 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.525797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.526093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.526794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.528674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.614426 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4170/8438] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:47:24 2021] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:24.618652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366625b-d479-4ae9-9c9b-29581cfe5de9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.629813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366625b-d479-4ae9-9c9b-29581cfe5de9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.684754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.686029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.686190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.686462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.687154 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.689067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.773678 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4269/8439] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:47:24 2021] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:24.777760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.788066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a02e84-897b-4621-97af-0bfdb425581a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.792734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.793426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.793715 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.793991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.795279 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.796857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.807501 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4171/8440] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:24.811950 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.821809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bda0b-f1f9-43d1-b90d-594fa95aa749 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.826475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd1ce9-4943-4b0f-81b4-5e6eb6d009b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.827148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1ce9-4943-4b0f-81b4-5e6eb6d009b5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.827430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1ce9-4943-4b0f-81b4-5e6eb6d009b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.827706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1ce9-4943-4b0f-81b4-5e6eb6d009b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.828458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd1ce9-4943-4b0f-81b4-5e6eb6d009b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.830069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd1ce9-4943-4b0f-81b4-5e6eb6d009b5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.839816 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4270/8441] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:24 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:24.843886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:24.853789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e292f-3258-45ee-bbc3-7a9f6ae982ca admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:24.858910 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:24.859776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.860050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.860322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] PATH_INFO: `/v3/projects/4dfd37a6924844a2add31d9416165a64/users/f865fd0bf42540369024752f8ceed563/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.875039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfd37a6924844a2add31d9416165a64, user_id=f865fd0bf42540369024752f8ceed563, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:24.877689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:24.943782 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4172/8442] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:24 2021] PUT /identity/v3/projects/4dfd37a6924844a2add31d9416165a64/users/f865fd0bf42540369024752f8ceed563/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:47:24.953958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbf422-65ae-4eb8-a99e-3de015bdb4e1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:24.954480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbf422-65ae-4eb8-a99e-3de015bdb4e1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:24.954609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbf422-65ae-4eb8-a99e-3de015bdb4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:24.981131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-84dbf422-65ae-4eb8-a99e-3de015bdb4e1 None None] MFA Rules not processed for user `f865fd0bf42540369024752f8ceed563`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:24.984980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-84dbf422-65ae-4eb8-a99e-3de015bdb4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:25.043651 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4271/8443] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:25.048751 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:25.109049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efcbc7-12b5-4128-a316-961ae8c1b0b7 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:25.113762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:25.114412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.114704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.114982 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.115685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:25.117641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:25.203562 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4173/8444] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:47:25 2021] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:25.207427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbf422-65ae-4eb8-a99e-3de015bdb4e1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:25.218930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbf422-65ae-4eb8-a99e-3de015bdb4e1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:25.273202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:25.273865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.280706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.280706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.280706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:25.280706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:25.373583 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4272/8445] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:47:25 2021] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:25.377591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:25.388168 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb05e-3120-4d28-87f3-a94e84bfebce admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:25.393017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:25.393677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.393966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.394241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.394964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:25.396542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:25.406708 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4174/8446] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:25.410637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:25.421520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3a4a4-a8e8-4467-8022-679ea60bf5eb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:25.426266 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:25.427168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.427438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.427713 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] PATH_INFO: `/v3/projects/b2b127d717d448c38173877e2e3b873b/users/c626860abefe46f3b17edf68754b02ef/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.442268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b127d717d448c38173877e2e3b873b, user_id=c626860abefe46f3b17edf68754b02ef, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:25.444998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:25.539966 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4273/8447] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:25 2021] PUT /identity/v3/projects/b2b127d717d448c38173877e2e3b873b/users/c626860abefe46f3b17edf68754b02ef/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:25.544032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:25.553872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a674095-8fd3-4d9e-8b36-8d2473d400a1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:25.607700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc030ccd-5361-4759-be3d-67bc7b80b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:25.608353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030ccd-5361-4759-be3d-67bc7b80b6cf admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.608632 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030ccd-5361-4759-be3d-67bc7b80b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.608927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030ccd-5361-4759-be3d-67bc7b80b6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.609648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc030ccd-5361-4759-be3d-67bc7b80b6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:25.611215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc030ccd-5361-4759-be3d-67bc7b80b6cf admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:25.620752 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4175/8448] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:25 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:25.625109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:25.635551 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedc08e-52c6-45fb-b6ca-ce6d0fb73edd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:25.640619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:25.641517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.641797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.642068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] PATH_INFO: `/v3/projects/b2b127d717d448c38173877e2e3b873b/users/c626860abefe46f3b17edf68754b02ef/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.644040 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b127d717d448c38173877e2e3b873b, user_id=c626860abefe46f3b17edf68754b02ef, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:25.646655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:25.657006 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4274/8449] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:25 2021] PUT /identity/v3/projects/b2b127d717d448c38173877e2e3b873b/users/c626860abefe46f3b17edf68754b02ef/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:25.667830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.669954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.669954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.694032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] MFA Rules not processed for user `c626860abefe46f3b17edf68754b02ef`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:25.695210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:25.760179 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4176/8450] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:25 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:25.771068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:25.772725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:25.835548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036338-c460-4f61-9328-2a5ab6c85d53 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:25.839314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:25.839956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:25.840247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:25.840526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:25.896518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:25.897992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:25.907011 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4275/8451] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:25 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:27.763131 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:27.764539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:27.779597 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c04ddc-973b-4161-813e-ad9c9f1d8da7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:27.783300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a359f65-6c33-459f-8dc5-76498fc956f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:27.787517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359f65-6c33-459f-8dc5-76498fc956f3 service cinder] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:27.787517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359f65-6c33-459f-8dc5-76498fc956f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:27.787517 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359f65-6c33-459f-8dc5-76498fc956f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:27.839433 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a359f65-6c33-459f-8dc5-76498fc956f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:27.840861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a359f65-6c33-459f-8dc5-76498fc956f3 service cinder] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:27.849828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4177/8452] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:29.014229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:29.025187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0addf-6047-40f9-93b2-e84e50f4a80e service cinder] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:29.028830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140d67d-5625-4b83-9a3b-8cf85d69c9f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f668b27e2af43fd812f309f6908199c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:29.029534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d67d-5625-4b83-9a3b-8cf85d69c9f5 service cinder] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:29.029810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d67d-5625-4b83-9a3b-8cf85d69c9f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:29.030107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d67d-5625-4b83-9a3b-8cf85d69c9f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:29.038888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140d67d-5625-4b83-9a3b-8cf85d69c9f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:29.040359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140d67d-5625-4b83-9a3b-8cf85d69c9f5 service cinder] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:29.049926 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4276/8453] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:29 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:38.254875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013648e4-4de1-4d40-abfa-5bcc24efd89c None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:38.256354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013648e4-4de1-4d40-abfa-5bcc24efd89c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:38.256627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013648e4-4de1-4d40-abfa-5bcc24efd89c None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:38.259504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4178/8454] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:47:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:47:38.267274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25d74f-b156-4db3-a097-9fc09af1bad1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:38.267777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25d74f-b156-4db3-a097-9fc09af1bad1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:38.267913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25d74f-b156-4db3-a097-9fc09af1bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:38.325013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fb25d74f-b156-4db3-a097-9fc09af1bad1 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:38.326468 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fb25d74f-b156-4db3-a097-9fc09af1bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:38.386485 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4277/8455] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 21:47:38 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:38.407298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013648e4-4de1-4d40-abfa-5bcc24efd89c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:38.409802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-013648e4-4de1-4d40-abfa-5bcc24efd89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:38.428421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013648e4-4de1-4d40-abfa-5bcc24efd89c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:38.432357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:38.433067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:38.438861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:38.438861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:38.443232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:38.444790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:38.455452 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4179/8456] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:39.923744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25d74f-b156-4db3-a097-9fc09af1bad1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:40.014530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25d74f-b156-4db3-a097-9fc09af1bad1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:40.019924 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:40.021263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:40.021828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:40.022150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] PATH_INFO: `/v3/users/74053d7091ef41a1ad314ee0da374068` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:40.025205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74053d7091ef41a1ad314ee0da374068)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:40.027610 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:40.155848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:40.157357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:40.172868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb370a-69a3-4011-9d26-1de85858b96a service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:40.177499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:40.178368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:40.183251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:40.183251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] PATH_INFO: `/v3/users/71846607489941c5a65d9a3648c6c7d9` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:40.183251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71846607489941c5a65d9a3648c6c7d9)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:40.183251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:40.244096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74053d7091ef41a1ad314ee0da374068'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.250694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74053d7091ef41a1ad314ee0da374068'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.262248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74053d7091ef41a1ad314ee0da374068'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.265765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74053d7091ef41a1ad314ee0da374068'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.350685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8d06ff94-691c-4067-8777-55f195331916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74053d7091ef41a1ad314ee0da374068'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.356784 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4278/8457] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:39 2021] DELETE /identity/v3/users/74053d7091ef41a1ad314ee0da374068 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:40.361878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:40.362164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:40.362439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:40.387137 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71846607489941c5a65d9a3648c6c7d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.388781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:40.390671 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:40.394442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71846607489941c5a65d9a3648c6c7d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.406711 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71846607489941c5a65d9a3648c6c7d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.407334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71846607489941c5a65d9a3648c6c7d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.407946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6f895d15-8509-4d14-ac2d-6518e2711a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71846607489941c5a65d9a3648c6c7d9'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:40.447332 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4279/8458] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:47:40.458415 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:40.459846 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:40.471820 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4180/8459] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:40 2021] DELETE /identity/v3/users/71846607489941c5a65d9a3648c6c7d9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:40.478089 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc731f-3e47-48ba-aa0d-1c4dd983fc6a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:40.478267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc731f-3e47-48ba-aa0d-1c4dd983fc6a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:40.478587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc731f-3e47-48ba-aa0d-1c4dd983fc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:40.497132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b1fc731f-3e47-48ba-aa0d-1c4dd983fc6a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:40.498369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b1fc731f-3e47-48ba-aa0d-1c4dd983fc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:40.527718 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06101e5d-f559-4ba3-af0d-f493a8f9d3c5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:40.565389 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4181/8460] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:40.575391 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:40.575571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc731f-3e47-48ba-aa0d-1c4dd983fc6a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:40.576039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:40.576840 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:40.577147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:40.586348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:40.587750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc731f-3e47-48ba-aa0d-1c4dd983fc6a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:40.587911 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:40.594486 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:40.595118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:40.595397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:40.595669 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:40.598011 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4280/8461] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:47:40.605103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:40.606450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:40.616265 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4182/8462] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:47:40.901264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:40.902711 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:40.916476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae08f9-3db0-4f53-b8f2-808f8a999919 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:40.925160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:40.926159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:40.926638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:40.927072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] PATH_INFO: `/v3/projects/59ed9da8ed224ce9b429cb4c633a2498` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:40.928604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ed9da8ed224ce9b429cb4c633a2498)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:40.930875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:41.037104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ed9da8ed224ce9b429cb4c633a2498', 'request_id': 'req-b95fe397-e42b-4f6a-b1e4-22fad5977b91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.105346 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ed9da8ed224ce9b429cb4c633a2498', 'request_id': 'req-b95fe397-e42b-4f6a-b1e4-22fad5977b91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.106544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:41.107980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:41.112945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ed9da8ed224ce9b429cb4c633a2498', 'request_id': 'req-b95fe397-e42b-4f6a-b1e4-22fad5977b91'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.124730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] The token cache is being invalidate because project 59ed9da8ed224ce9b429cb4c633a2498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:41.125057 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.125712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.127483 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4281/8463] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:40 2021] DELETE /identity/v3/projects/59ed9da8ed224ce9b429cb4c633a2498 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:41.129074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb92b4-7267-4dfd-8409-8f2d9fd05c4c service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:41.135873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:41.137374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:41.187855 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:41.188749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:41.189069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:41.190088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] PATH_INFO: `/v3/projects/e8892d086e634f9699010eceffbb59d7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:41.190606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8892d086e634f9699010eceffbb59d7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:41.192567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:41.201785 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fe397-e42b-4f6a-b1e4-22fad5977b91 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:41.206775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:41.207643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:41.207928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:41.208226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] PATH_INFO: `/v3/users/372fecc7859a480290f342afc224480f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:41.209484 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=372fecc7859a480290f342afc224480f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:41.211429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:41.297881 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8892d086e634f9699010eceffbb59d7', 'request_id': 'req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.303938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8892d086e634f9699010eceffbb59d7', 'request_id': 'req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.367658 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8892d086e634f9699010eceffbb59d7', 'request_id': 'req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.378931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] The token cache is being invalidate because project e8892d086e634f9699010eceffbb59d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:41.379218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.379846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.381421 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4183/8464] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:41 2021] DELETE /identity/v3/projects/e8892d086e634f9699010eceffbb59d7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:41.385424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:41.386744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:41.403871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372fecc7859a480290f342afc224480f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.410595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372fecc7859a480290f342afc224480f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.423508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372fecc7859a480290f342afc224480f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.424803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372fecc7859a480290f342afc224480f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.449212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6d85e-6039-43ea-bdf1-1a8666a8e6da admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:41.453915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:41.454777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:41.455061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:41.455334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] PATH_INFO: `/v3/users/f865fd0bf42540369024752f8ceed563` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:41.456552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f865fd0bf42540369024752f8ceed563)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:41.458488 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:41.493387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372fecc7859a480290f342afc224480f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.500386 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4282/8465] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:41 2021] DELETE /identity/v3/users/372fecc7859a480290f342afc224480f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:41.684269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f865fd0bf42540369024752f8ceed563'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.692329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f865fd0bf42540369024752f8ceed563'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.704358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f865fd0bf42540369024752f8ceed563'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.705181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f865fd0bf42540369024752f8ceed563'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.710419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-b37ab5cd-f1c0-4528-950a-b5e701e6e28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f865fd0bf42540369024752f8ceed563'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:41.778828 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4184/8466] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:41 2021] DELETE /identity/v3/users/f865fd0bf42540369024752f8ceed563 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:47:41.899379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:41.901094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:41.976695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b2ae3-ee19-4d53-b56b-7839f98fb0da admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.031720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.032600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.032901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.033184 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] PATH_INFO: `/v3/projects/2591da5f24614e9a8f95df63ea15fa8f` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.034374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2591da5f24614e9a8f95df63ea15fa8f)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.036347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.158541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2591da5f24614e9a8f95df63ea15fa8f', 'request_id': 'req-f6c4589c-bedb-4639-828b-c74468145973'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.218426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2591da5f24614e9a8f95df63ea15fa8f', 'request_id': 'req-f6c4589c-bedb-4639-828b-c74468145973'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.225126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2591da5f24614e9a8f95df63ea15fa8f', 'request_id': 'req-f6c4589c-bedb-4639-828b-c74468145973'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.235278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] The token cache is being invalidate because project 2591da5f24614e9a8f95df63ea15fa8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:42.235567 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.236229 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.237811 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4283/8467] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:41 2021] DELETE /identity/v3/projects/2591da5f24614e9a8f95df63ea15fa8f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:42.246732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6add6-683f-49ed-be9c-82bb12e0914a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.247219 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6add6-683f-49ed-be9c-82bb12e0914a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.247319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6add6-683f-49ed-be9c-82bb12e0914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.284309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-12c6add6-683f-49ed-be9c-82bb12e0914a None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:42.285560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-12c6add6-683f-49ed-be9c-82bb12e0914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:42.294611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.296094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:42.351444 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4185/8468] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:42.360160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fb7c6-5801-4eef-b9e5-aea1fe503933 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.360448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fb7c6-5801-4eef-b9e5-aea1fe503933 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.360718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fb7c6-5801-4eef-b9e5-aea1fe503933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.364575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4589c-bedb-4639-828b-c74468145973 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.369364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.370210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.370528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.370796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] PATH_INFO: `/v3/projects/4dfd37a6924844a2add31d9416165a64` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.371982 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dfd37a6924844a2add31d9416165a64)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.374433 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.378828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ea0fb7c6-5801-4eef-b9e5-aea1fe503933 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:42.380077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ea0fb7c6-5801-4eef-b9e5-aea1fe503933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:42.388373 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4186/8469] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:47:42.393166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fb7c6-5801-4eef-b9e5-aea1fe503933 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.402106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fb7c6-5801-4eef-b9e5-aea1fe503933 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.406733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.407374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.407659 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.407937 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.408718 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:47:42.409007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.410583 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.421858 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4187/8470] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:47:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:47:42.425934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.435323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038b907-6c68-4973-a2bd-fbf315ca862e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.440527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.441218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.441493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.441786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.442450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.444348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.493612 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dfd37a6924844a2add31d9416165a64', 'request_id': 'req-6d858f07-e31e-4eaf-ad36-499ecd6175e0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.557857 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4188/8471] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:47:42 2021] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:47:42.562445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.573730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dfd37a6924844a2add31d9416165a64', 'request_id': 'req-6d858f07-e31e-4eaf-ad36-499ecd6175e0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.581219 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dfd37a6924844a2add31d9416165a64', 'request_id': 'req-6d858f07-e31e-4eaf-ad36-499ecd6175e0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.596100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] The token cache is being invalidate because project 4dfd37a6924844a2add31d9416165a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:42.596572 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.597593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.599903 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4284/8472] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:42 2021] DELETE /identity/v3/projects/4dfd37a6924844a2add31d9416165a64 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:42.603794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.605676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:42.625172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885d126-a4cf-4cf3-8db3-f3b124bb260d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.630288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.630956 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.631235 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.631507 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.632193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.634369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.668904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858f07-e31e-4eaf-ad36-499ecd6175e0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.674163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.675030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.675313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.675587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] PATH_INFO: `/v3/users/c626860abefe46f3b17edf68754b02ef` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.676793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c626860abefe46f3b17edf68754b02ef)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.678741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.705490 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4189/8473] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:47:42 2021] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:47:42.709432 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.711033 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:42.723160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ca1bc-a260-46ce-b470-44518f7de503 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.727832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.733152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.733152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.733152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.733152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.733152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.741491 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4190/8474] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:47:42.745206 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.754957 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca0f6-0773-4bb2-9fbb-7ad58c6f9c88 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.759823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.763427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.763427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.763427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.763427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.763427 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.772812 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4191/8475] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:42 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:47:42.776341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.787386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0cae8-6836-4ff9-8744-d814da721263 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:42.791409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab041c-ef29-4710-8ea3-f0e9ccd2fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:42.792272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab041c-ef29-4710-8ea3-f0e9ccd2fb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.792561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab041c-ef29-4710-8ea3-f0e9ccd2fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.792838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab041c-ef29-4710-8ea3-f0e9ccd2fb29 admin admin] PATH_INFO: `/v3/projects/444a282fecb241bb84b910063c85139b/users/7d33ee320aa6410a8f7a5ce8920a16cb/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.807836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab041c-ef29-4710-8ea3-f0e9ccd2fb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444a282fecb241bb84b910063c85139b, user_id=7d33ee320aa6410a8f7a5ce8920a16cb, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:42.810604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab041c-ef29-4710-8ea3-f0e9ccd2fb29 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:42.861688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c626860abefe46f3b17edf68754b02ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.868430 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c626860abefe46f3b17edf68754b02ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.880702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c626860abefe46f3b17edf68754b02ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.881441 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c626860abefe46f3b17edf68754b02ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.882247 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4192/8476] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:42 2021] PUT /identity/v3/projects/444a282fecb241bb84b910063c85139b/users/7d33ee320aa6410a8f7a5ce8920a16cb/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:47:42.893163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f32e12-646a-47a4-8f5c-1c1aeb9fbd6f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:42.893449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f32e12-646a-47a4-8f5c-1c1aeb9fbd6f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:42.893726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f32e12-646a-47a4-8f5c-1c1aeb9fbd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:42.918696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a3f32e12-646a-47a4-8f5c-1c1aeb9fbd6f None None] MFA Rules not processed for user `7d33ee320aa6410a8f7a5ce8920a16cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:42.920556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3f32e12-646a-47a4-8f5c-1c1aeb9fbd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:42.949689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c626860abefe46f3b17edf68754b02ef'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:42.956935 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4285/8477] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:47:42 2021] DELETE /identity/v3/users/c626860abefe46f3b17edf68754b02ef => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:47:42.986296 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4193/8478] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:42 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:47:42.991104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:42.992988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:43.058020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64804b-d72d-4dc0-b6b7-7694e3a7033c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.063368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.064019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.064303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.064578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.065324 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.067205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:43.139731 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4286/8479] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:47:42 2021] POST /identity/v3/projects => generated 389 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:43.144590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f32e12-646a-47a4-8f5c-1c1aeb9fbd6f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:43.208693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f32e12-646a-47a4-8f5c-1c1aeb9fbd6f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.264896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.265573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.265842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.266111 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.266807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.268702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:43.358236 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:43.360315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:43.365726 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4194/8480] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:47:43 2021] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:43.370462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:43.376916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f027d-15c2-47af-a1f8-941c79682518 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.382350 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648609b-36bd-41cc-a57b-308865adcebe admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.388045 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.388708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.389720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.396940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.396940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.396940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:43.397248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.397248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.397248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.397248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] PATH_INFO: `/v3/projects/b2b127d717d448c38173877e2e3b873b` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.397620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b127d717d448c38173877e2e3b873b)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.398305 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:43.402873 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4195/8481] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:43 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:43.406837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:43.416598 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f407e9-7f50-47b4-808d-2e35414dcec2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.421788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.422424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.422704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.422973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.423684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.425928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:43.436345 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4196/8482] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:47:43.440428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:43.450267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45017a6-87ab-433f-b9ed-db104ff9a730 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.454997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b2732-9509-4028-8a1b-08965b849fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.455783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2732-9509-4028-8a1b-08965b849fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.456062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2732-9509-4028-8a1b-08965b849fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.456338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2732-9509-4028-8a1b-08965b849fa3 admin admin] PATH_INFO: `/v3/projects/fc46a4f26a1c4270884e04227ca1be85/users/52a727e9471a4a86b1f69e0e48f14eed/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.470299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b2732-9509-4028-8a1b-08965b849fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc46a4f26a1c4270884e04227ca1be85, user_id=52a727e9471a4a86b1f69e0e48f14eed, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.472999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b2732-9509-4028-8a1b-08965b849fa3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:43.544881 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4197/8483] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:43 2021] PUT /identity/v3/projects/fc46a4f26a1c4270884e04227ca1be85/users/52a727e9471a4a86b1f69e0e48f14eed/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:47:43.555471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b127d717d448c38173877e2e3b873b', 'request_id': 'req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:43.559591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fc73a-bd62-4de9-9d16-35153062dc00 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.559878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fc73a-bd62-4de9-9d16-35153062dc00 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.560146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fc73a-bd62-4de9-9d16-35153062dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.585765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-172fc73a-bd62-4de9-9d16-35153062dc00 None None] MFA Rules not processed for user `52a727e9471a4a86b1f69e0e48f14eed`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:43.586946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-172fc73a-bd62-4de9-9d16-35153062dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:43.625660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b127d717d448c38173877e2e3b873b', 'request_id': 'req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:43.635566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b127d717d448c38173877e2e3b873b', 'request_id': 'req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:43.651047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] The token cache is being invalidate because project b2b127d717d448c38173877e2e3b873b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:47:43.651359 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:43.652016 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:47:43.653854 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4287/8484] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:47:43 2021] DELETE /identity/v3/projects/b2b127d717d448c38173877e2e3b873b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:47:43.667774 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4198/8485] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:43 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:47:43.672922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:43.674412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:43.752130 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ecf1d-5a09-4e5b-832b-13a6c594e53a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.757674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.758652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.758936 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.759217 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.759940 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.761984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:43.850612 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4288/8486] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:47:43 2021] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:47:43.854935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fc73a-bd62-4de9-9d16-35153062dc00 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:43.867273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fc73a-bd62-4de9-9d16-35153062dc00 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:43.929086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:43.929765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:43.930044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:43.930323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:43.931023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:43.932984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:44.016090 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4199/8487] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:47:43 2021] POST /identity/v3/users => generated 301 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:47:44.017506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:44.028426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465029e-1de9-4f9c-8665-d0351d7ddf7a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:44.033797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:44.034479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:44.034760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:44.035037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:44.035774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:44.037544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:44.049957 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4289/8488] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 21:47:44.054301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:44.064914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c36f-e8cd-45df-9c11-d80d64050cf0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:44.069700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:44.070616 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:44.071080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:44.071357 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] PATH_INFO: `/v3/projects/0eaf256c6e8b421bb3068c3b1dce3e1a/users/54bba3e3e89348059d0ea118b8f5cdac/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:44.087333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaf256c6e8b421bb3068c3b1dce3e1a, user_id=54bba3e3e89348059d0ea118b8f5cdac, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:44.090040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:44.160983 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4200/8489] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:44 2021] PUT /identity/v3/projects/0eaf256c6e8b421bb3068c3b1dce3e1a/users/54bba3e3e89348059d0ea118b8f5cdac/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:44.165099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:44.177642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60180d84-35a4-466f-be6a-3f671677f61b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:44.241587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e927785-722b-40a4-bba6-1c42978a0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:44.242268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e927785-722b-40a4-bba6-1c42978a0b9c admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:44.242548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e927785-722b-40a4-bba6-1c42978a0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:44.242822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e927785-722b-40a4-bba6-1c42978a0b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:44.243647 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e927785-722b-40a4-bba6-1c42978a0b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:44.245857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e927785-722b-40a4-bba6-1c42978a0b9c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:44.256562 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4290/8490] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:47:44 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:47:44.261911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:44.274093 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a4d4-5296-41f8-85f3-c26d7a636c64 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:44.279077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:44.280533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:44.280821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:44.281124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] PATH_INFO: `/v3/projects/0eaf256c6e8b421bb3068c3b1dce3e1a/users/54bba3e3e89348059d0ea118b8f5cdac/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:44.283200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaf256c6e8b421bb3068c3b1dce3e1a, user_id=54bba3e3e89348059d0ea118b8f5cdac, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:44.285842 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:44.296402 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4201/8491] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:47:44 2021] PUT /identity/v3/projects/0eaf256c6e8b421bb3068c3b1dce3e1a/users/54bba3e3e89348059d0ea118b8f5cdac/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:47:44.307732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:44.308028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:44.308314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:44.335426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] MFA Rules not processed for user `54bba3e3e89348059d0ea118b8f5cdac`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:44.336643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:44.403244 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4291/8492] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:44 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:47:44.416596 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:44.419182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:44.493800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43f206-454c-44bf-a59f-133c61645de1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:44.500474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16c3db-a85a-4b08-a5f7-750919a3c5df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:44.501180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c3db-a85a-4b08-a5f7-750919a3c5df service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:44.501468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c3db-a85a-4b08-a5f7-750919a3c5df service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:44.501750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16c3db-a85a-4b08-a5f7-750919a3c5df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:44.503602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5d16c3db-a85a-4b08-a5f7-750919a3c5df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:44.569363 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16c3db-a85a-4b08-a5f7-750919a3c5df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:44.570899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16c3db-a85a-4b08-a5f7-750919a3c5df service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:44.580448 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4202/8493] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:44 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:47.683169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:47:47.684655 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:47.745941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fe09f-8590-4600-83cc-00aa29367dc0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:47:47.749472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:47:47.750144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:47.750423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:47.750698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:47.760113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:47:47.761663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:47:47.771593 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4292/8494] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:47:47 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:47:52.071984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6073a6-2f0c-44e2-b936-f2f7c124dbf0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:47:52.072515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6073a6-2f0c-44e2-b936-f2f7c124dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:47:52.072515 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6073a6-2f0c-44e2-b936-f2f7c124dbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:47:52.090223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ce6073a6-2f0c-44e2-b936-f2f7c124dbf0 None None] MFA Rules not processed for user `7d33ee320aa6410a8f7a5ce8920a16cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:47:52.093063 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ce6073a6-2f0c-44e2-b936-f2f7c124dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:47:52.101805 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4203/8495] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:47:52 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:48:07.488148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:48:07.502191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a09b-c8f2-4238-a08c-b7aedf7d33be service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:48:07.510061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:48:07.510987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:48:07.511275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:48:07.511563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:48:07.516369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:48:07.539909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:48:07.541975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:48:07.557608 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4293/8496] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:48:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:48:48.231239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:48:48.231836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:48:48.231836 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:48:48.251310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] MFA Rules not processed for user `7d33ee320aa6410a8f7a5ce8920a16cb`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:48:48.252447 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:48:48.259817 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4204/8497] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:48:48 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:48:48.296809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:48:48.298274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:48:48.375376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbf0ec-a296-4dec-baf4-2c99b41887b0 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:48:48.380318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:48:48.381013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:48:48.381296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:48:48.381587 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:48:48.383811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:48:48.405060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:48:48.406328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:48:48.421343 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4294/8498] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:48:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:48:49.079760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:48:49.081310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:48:49.108201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:48:49.125178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e570a-d2e5-4d76-8818-e72ff66972b2 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:48:49.130694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:48:49.131563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:48:49.132731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:48:49.133318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:48:49.135946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:48:49.157877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:48:49.159669 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:48:49.177279 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4295/8499] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:48:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:48:49.178414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4917d-bc7f-4373-b02a-38852c8d4199 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:48:49.185215 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbc4c-172b-47c0-85ed-08b414128bd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:48:49.186775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbc4c-172b-47c0-85ed-08b414128bd2 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:48:49.187301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbc4c-172b-47c0-85ed-08b414128bd2 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:48:49.188705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbc4c-172b-47c0-85ed-08b414128bd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:48:49.191044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-953fbc4c-172b-47c0-85ed-08b414128bd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:48:49.216821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbc4c-172b-47c0-85ed-08b414128bd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:48:49.218541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbc4c-172b-47c0-85ed-08b414128bd2 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:48:49.232770 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4205/8500] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:48:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:49:16.170877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:16.233596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1c3df-66ca-4d20-9e73-1008f47c3e2a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:16.238608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:16.239533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:16.239963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:16.240251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] PATH_INFO: `/v3/users/7d33ee320aa6410a8f7a5ce8920a16cb` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:16.241888 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d33ee320aa6410a8f7a5ce8920a16cb)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:16.243916 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:16.643191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d33ee320aa6410a8f7a5ce8920a16cb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:16.650134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d33ee320aa6410a8f7a5ce8920a16cb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:16.667303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d33ee320aa6410a8f7a5ce8920a16cb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:16.668005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d33ee320aa6410a8f7a5ce8920a16cb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:16.775410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d33ee320aa6410a8f7a5ce8920a16cb'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:16.782239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4296/8501] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:49:16 2021] DELETE /identity/v3/users/7d33ee320aa6410a8f7a5ce8920a16cb => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:16.786816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:16.787388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:16.787388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:16.804831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:49:16.806041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:16.863393 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4206/8502] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:49:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:49:16.873347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:16.874742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:16.936440 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b73381-d479-49de-8afd-d2fe7df8b05a admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:16.939913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:16.940545 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:16.940824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:16.941125 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:16.950349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:16.951778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:16.961349 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4297/8503] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:49:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:49:17.511968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:17.513454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:17.526211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293f7fd-7a99-4198-b9d9-2719f15406c6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:17.530988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:17.531851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:17.532132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:17.532403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] PATH_INFO: `/v3/projects/444a282fecb241bb84b910063c85139b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:17.533644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444a282fecb241bb84b910063c85139b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:17.535556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:17.663582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444a282fecb241bb84b910063c85139b', 'request_id': 'req-763cc037-8ae3-4a52-bad6-d6122535d678'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:17.669630 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444a282fecb241bb84b910063c85139b', 'request_id': 'req-763cc037-8ae3-4a52-bad6-d6122535d678'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:17.772864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444a282fecb241bb84b910063c85139b', 'request_id': 'req-763cc037-8ae3-4a52-bad6-d6122535d678'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:17.783717 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] The token cache is being invalidate because project 444a282fecb241bb84b910063c85139b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:49:17.783992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:17.784615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:17.786194 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4207/8504] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:49:17 2021] DELETE /identity/v3/projects/444a282fecb241bb84b910063c85139b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:17.790240 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:17.800609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1998e59-2b48-46d2-9d62-5d9ad8fb5f6d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:17.854191 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:17.855055 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:17.855337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:17.855614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] PATH_INFO: `/v3/users/52a727e9471a4a86b1f69e0e48f14eed` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:17.856794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a727e9471a4a86b1f69e0e48f14eed)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:17.858815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:18.094171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a727e9471a4a86b1f69e0e48f14eed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.100777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a727e9471a4a86b1f69e0e48f14eed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.112865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a727e9471a4a86b1f69e0e48f14eed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.113582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a727e9471a4a86b1f69e0e48f14eed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.174585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a727e9471a4a86b1f69e0e48f14eed'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.180472 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4298/8505] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:49:17 2021] DELETE /identity/v3/users/52a727e9471a4a86b1f69e0e48f14eed => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:18.594966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:18.596955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:18.612083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc037-8ae3-4a52-bad6-d6122535d678 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:18.678671 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:18.679535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:18.679875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:18.680150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] PATH_INFO: `/v3/projects/fc46a4f26a1c4270884e04227ca1be85` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:18.681412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc46a4f26a1c4270884e04227ca1be85)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:18.683332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:18.789574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc46a4f26a1c4270884e04227ca1be85', 'request_id': 'req-14dd7578-1975-4ec6-9296-711544e3c907'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.795483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc46a4f26a1c4270884e04227ca1be85', 'request_id': 'req-14dd7578-1975-4ec6-9296-711544e3c907'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.858073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc46a4f26a1c4270884e04227ca1be85', 'request_id': 'req-14dd7578-1975-4ec6-9296-711544e3c907'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.868181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] The token cache is being invalidate because project fc46a4f26a1c4270884e04227ca1be85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:49:18.868464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.869117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:18.870652 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4208/8506] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:49:18 2021] DELETE /identity/v3/projects/fc46a4f26a1c4270884e04227ca1be85 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:18.874678 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:18.876719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:18.889679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b3f4-d8c7-4d54-81de-9505efeebd6d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:18.963614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:18.966455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:18.966829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:18.967200 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] PATH_INFO: `/v3/users/54bba3e3e89348059d0ea118b8f5cdac` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:18.968449 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bba3e3e89348059d0ea118b8f5cdac)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:18.970447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:19.162690 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bba3e3e89348059d0ea118b8f5cdac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.169292 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bba3e3e89348059d0ea118b8f5cdac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.181495 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bba3e3e89348059d0ea118b8f5cdac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.182297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bba3e3e89348059d0ea118b8f5cdac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.240864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9c7b4b4f-7f53-4f61-a1d9-185ff9fe4c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bba3e3e89348059d0ea118b8f5cdac'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.247342 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4299/8507] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:49:18 2021] DELETE /identity/v3/users/54bba3e3e89348059d0ea118b8f5cdac => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:19.485573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:19.486992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:19.499928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd7578-1975-4ec6-9296-711544e3c907 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:19.556548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:19.557443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:19.557724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:19.557996 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] PATH_INFO: `/v3/projects/0eaf256c6e8b421bb3068c3b1dce3e1a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:19.559177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaf256c6e8b421bb3068c3b1dce3e1a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:19.561201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:19.711576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaf256c6e8b421bb3068c3b1dce3e1a', 'request_id': 'req-59fc7ac6-1d17-4431-b033-fdd398c95823'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.717576 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaf256c6e8b421bb3068c3b1dce3e1a', 'request_id': 'req-59fc7ac6-1d17-4431-b033-fdd398c95823'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.812330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaf256c6e8b421bb3068c3b1dce3e1a', 'request_id': 'req-59fc7ac6-1d17-4431-b033-fdd398c95823'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.822544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] The token cache is being invalidate because project 0eaf256c6e8b421bb3068c3b1dce3e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:49:19.822826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.823464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-59fc7ac6-1d17-4431-b033-fdd398c95823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:19.825021 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4209/8508] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:49:19 2021] DELETE /identity/v3/projects/0eaf256c6e8b421bb3068c3b1dce3e1a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:19.830963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388454ca-cf16-4697-bcc2-995e1e85c4ea None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:19.832789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388454ca-cf16-4697-bcc2-995e1e85c4ea None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:19.832789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388454ca-cf16-4697-bcc2-995e1e85c4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:19.860216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-388454ca-cf16-4697-bcc2-995e1e85c4ea None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:49:19.861432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-388454ca-cf16-4697-bcc2-995e1e85c4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:19.918205 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4300/8509] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:49:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:49:19.926705 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f55bc-079b-4818-8a69-42b95c8e8e23 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:19.926992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f55bc-079b-4818-8a69-42b95c8e8e23 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:19.927319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f55bc-079b-4818-8a69-42b95c8e8e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:19.945752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-2f4f55bc-079b-4818-8a69-42b95c8e8e23 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:49:19.946991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2f4f55bc-079b-4818-8a69-42b95c8e8e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:19.955404 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4210/8510] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:49:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:49:19.959734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388454ca-cf16-4697-bcc2-995e1e85c4ea None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:19.970807 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388454ca-cf16-4697-bcc2-995e1e85c4ea None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:19.975589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:19.976263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:19.976547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:19.976857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:19.977660 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:49:19.977974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:19.979563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:19.991810 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4301/8511] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:49:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:49:19.996054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f55bc-079b-4818-8a69-42b95c8e8e23 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:20.005343 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f55bc-079b-4818-8a69-42b95c8e8e23 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:20.010321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:20.010964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:20.011242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:20.011511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:20.012202 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:20.014144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:20.099499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4211/8512] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:49:19 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:49:20.103505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:20.114017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d0cee-ffa8-423f-b218-7d21ec8f508b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:20.167844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:20.168498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:20.168776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:20.169077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:20.169753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:20.171640 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:20.258834 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4302/8513] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:49:20 2021] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:49:20.263476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:20.273878 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d29cb-540d-4cda-8bce-9c4ccaab9e6b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:20.278624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:20.279314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:20.279591 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:20.279862 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:20.280585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:20.282224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:20.292569 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4212/8514] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:49:20.296233 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:20.306745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b74f6-2b28-4730-9d4b-243e594a85f5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:20.311533 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd7c06-e10b-4b2a-bd2c-61c7e0c1b502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:20.312173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd7c06-e10b-4b2a-bd2c-61c7e0c1b502 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:20.312453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd7c06-e10b-4b2a-bd2c-61c7e0c1b502 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:20.313403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd7c06-e10b-4b2a-bd2c-61c7e0c1b502 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:20.314169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd7c06-e10b-4b2a-bd2c-61c7e0c1b502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:20.315741 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd7c06-e10b-4b2a-bd2c-61c7e0c1b502 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:20.325856 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4303/8515] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:49:20.330879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:20.340593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293602-ca65-4f9a-9238-ce96c047f2d4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:20.345275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:20.346142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:20.346422 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:20.346696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] PATH_INFO: `/v3/projects/419382b75cc24e299a2f85f5eea43dbd/users/5043c601478b46a599ea5d8b4c1c612a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:20.361485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419382b75cc24e299a2f85f5eea43dbd, user_id=5043c601478b46a599ea5d8b4c1c612a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:20.364160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:20.430059 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4213/8516] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:49:20 2021] PUT /identity/v3/projects/419382b75cc24e299a2f85f5eea43dbd/users/5043c601478b46a599ea5d8b4c1c612a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:49:20.435457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832601b5-6008-4041-bb9a-7f362db4285c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:20.435744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832601b5-6008-4041-bb9a-7f362db4285c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:20.436022 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832601b5-6008-4041-bb9a-7f362db4285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:20.454919 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-832601b5-6008-4041-bb9a-7f362db4285c None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:49:20.457228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-832601b5-6008-4041-bb9a-7f362db4285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:20.513211 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4304/8517] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:49:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:49:20.523374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:20.525155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:20.582457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb44d8-ae2b-41b5-8bb5-7cd4e7be1d11 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:20.586179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:20.586823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:20.587117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:20.587390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:20.596742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:20.598173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:20.607499 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4214/8518] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:49:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:49:22.067094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942360-6ff8-403c-bd89-2737aa0d4394 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:22.067619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942360-6ff8-403c-bd89-2737aa0d4394 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:22.067748 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33942360-6ff8-403c-bd89-2737aa0d4394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:22.095943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-33942360-6ff8-403c-bd89-2737aa0d4394 None None] MFA Rules not processed for user `5043c601478b46a599ea5d8b4c1c612a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:49:22.097205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-33942360-6ff8-403c-bd89-2737aa0d4394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:22.160619 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4305/8519] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:49:22 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:49:22.165209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:22.175640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377949-0192-461d-848a-466fc9e1f96f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:22.180348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:22.181852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:22.182139 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:22.182410 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:22.183150 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:22.185121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:22.277050 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4215/8520] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:49:22 2021] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:49:22.281020 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942360-6ff8-403c-bd89-2737aa0d4394 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:22.292752 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33942360-6ff8-403c-bd89-2737aa0d4394 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:22.347021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:22.347607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:22.347889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:22.348169 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:22.348996 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:22.350827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:22.452802 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4306/8521] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:49:22 2021] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:49:22.457514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:22.467824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ab9f6-495b-4339-9661-01a3ceb55fa3 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:22.473115 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:22.473776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:22.474058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:22.474335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:22.475061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:22.476642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:22.487016 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4216/8522] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:49:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:49:22.491071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:22.501175 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85abef-e4a3-400d-b1cd-676c03a42d55 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:22.505877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:22.507012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:22.507290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:22.507562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] PATH_INFO: `/v3/projects/491980fabfb540e1b73eb846e845f1f6/users/c2c448cce49c4a7a9f2991e742e2253b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:22.522102 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=491980fabfb540e1b73eb846e845f1f6, user_id=c2c448cce49c4a7a9f2991e742e2253b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:22.524696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:22.620741 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4307/8523] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:49:22 2021] PUT /identity/v3/projects/491980fabfb540e1b73eb846e845f1f6/users/c2c448cce49c4a7a9f2991e742e2253b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:22.624513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:22.635187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089f391-a41c-453c-9862-ab7817dfe348 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:22.687964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb7d2c-3e16-4320-8a83-e02e09141fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:22.689271 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb7d2c-3e16-4320-8a83-e02e09141fdc admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:22.689762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb7d2c-3e16-4320-8a83-e02e09141fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:22.690044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb7d2c-3e16-4320-8a83-e02e09141fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:22.690762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb7d2c-3e16-4320-8a83-e02e09141fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:22.692386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb7d2c-3e16-4320-8a83-e02e09141fdc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:22.702183 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4217/8524] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:49:22 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:49:22.706943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:22.717221 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0415-08a2-4898-846f-c4184a83e62e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:22.721990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874986a-d908-4196-b876-ba5781de3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:22.722887 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874986a-d908-4196-b876-ba5781de3c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:22.723170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874986a-d908-4196-b876-ba5781de3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:22.723445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874986a-d908-4196-b876-ba5781de3c50 admin admin] PATH_INFO: `/v3/projects/491980fabfb540e1b73eb846e845f1f6/users/c2c448cce49c4a7a9f2991e742e2253b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:22.725496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874986a-d908-4196-b876-ba5781de3c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491980fabfb540e1b73eb846e845f1f6, user_id=c2c448cce49c4a7a9f2991e742e2253b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:22.728094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874986a-d908-4196-b876-ba5781de3c50 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:22.738154 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4308/8525] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:49:22 2021] PUT /identity/v3/projects/491980fabfb540e1b73eb846e845f1f6/users/c2c448cce49c4a7a9f2991e742e2253b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:23.862340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:23.862840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:23.862970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:23.890614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] MFA Rules not processed for user `c2c448cce49c4a7a9f2991e742e2253b`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:49:23.892424 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:23.974721 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4218/8526] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:49:23 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:49:23.985071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:23.985583 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:23.985701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:24.003167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] MFA Rules not processed for user `5043c601478b46a599ea5d8b4c1c612a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:49:24.004598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:24.064162 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4309/8527] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:49:23 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:49:24.075572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:24.076998 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:24.168524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72efb09-6bbb-4a6a-befb-81f20d89d9f6 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:24.174499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:24.175132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:24.175414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:24.175691 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:24.183340 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:24.184922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:24.193773 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4219/8528] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:49:24 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:49:46.923993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:46.925521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:46.944370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c6889-119d-4d30-aba7-91d78df61327 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:46.950383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:46.951032 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:46.951311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:46.951585 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:46.953386 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:46.969374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:46.971011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:46.993058 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4310/8529] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:49:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:49:50.517210 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:50.583166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404e41-2f14-4bc6-8875-9667e618b494 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:50.588897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:50.590993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:50.590993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:50.590993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] PATH_INFO: `/v3/users/5043c601478b46a599ea5d8b4c1c612a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:50.591614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5043c601478b46a599ea5d8b4c1c612a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:50.594743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:50.821088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5043c601478b46a599ea5d8b4c1c612a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:50.827643 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5043c601478b46a599ea5d8b4c1c612a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:50.839376 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5043c601478b46a599ea5d8b4c1c612a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:50.840028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5043c601478b46a599ea5d8b4c1c612a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:50.840654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5043c601478b46a599ea5d8b4c1c612a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:50.904720 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4220/8530] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:49:50 2021] DELETE /identity/v3/users/5043c601478b46a599ea5d8b4c1c612a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:51.167770 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:51.179029 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b0943-5b5f-4c53-b3fd-7446aced790e service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:51.237461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:51.238317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:51.238602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:51.238877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] PATH_INFO: `/v3/projects/419382b75cc24e299a2f85f5eea43dbd` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:51.240059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=419382b75cc24e299a2f85f5eea43dbd)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:51.242001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:51.348348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419382b75cc24e299a2f85f5eea43dbd', 'request_id': 'req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.423412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419382b75cc24e299a2f85f5eea43dbd', 'request_id': 'req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.429547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419382b75cc24e299a2f85f5eea43dbd', 'request_id': 'req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.443992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] The token cache is being invalidate because project 419382b75cc24e299a2f85f5eea43dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:49:51.443992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.443992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.443992 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4311/8531] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:49:51 2021] DELETE /identity/v3/projects/419382b75cc24e299a2f85f5eea43dbd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:51.446387 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:51.447785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:51.461523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a52cf-630e-412e-8a19-a8d96a5d69e2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:51.517871 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:51.518738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:51.519015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:51.519280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] PATH_INFO: `/v3/users/c2c448cce49c4a7a9f2991e742e2253b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:51.520479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c448cce49c4a7a9f2991e742e2253b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:51.522412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:51.758263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c448cce49c4a7a9f2991e742e2253b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.764971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c448cce49c4a7a9f2991e742e2253b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.776429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c448cce49c4a7a9f2991e742e2253b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.777113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c448cce49c4a7a9f2991e742e2253b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.777763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c448cce49c4a7a9f2991e742e2253b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:51.853507 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4221/8532] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:49:51 2021] DELETE /identity/v3/users/c2c448cce49c4a7a9f2991e742e2253b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:49:52.072835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:49:52.083784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:49:52.087474 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cfa4e-4ead-4a34-b04e-8d1e72a3e7c0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:49:52.142667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:49:52.143517 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:49:52.143800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:49:52.144072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] PATH_INFO: `/v3/projects/491980fabfb540e1b73eb846e845f1f6` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:49:52.145273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491980fabfb540e1b73eb846e845f1f6)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:49:52.147137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:49:52.238146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491980fabfb540e1b73eb846e845f1f6', 'request_id': 'req-b4007bfd-6cea-4bf7-ba7b-d075aabee098'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:52.320912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491980fabfb540e1b73eb846e845f1f6', 'request_id': 'req-b4007bfd-6cea-4bf7-ba7b-d075aabee098'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:52.327427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491980fabfb540e1b73eb846e845f1f6', 'request_id': 'req-b4007bfd-6cea-4bf7-ba7b-d075aabee098'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:52.338316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] The token cache is being invalidate because project 491980fabfb540e1b73eb846e845f1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:49:52.338598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:52.339214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:49:52.340729 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4312/8533] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:49:52 2021] DELETE /identity/v3/projects/491980fabfb540e1b73eb846e845f1f6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:50:19.733157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:50:19.734569 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:50:19.814714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a96c-5026-4acc-aad2-65a5ac9c864d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:50:19.870218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:50:19.870861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:50:19.871144 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:50:19.871419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:50:19.873194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:50:19.886685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:50:19.888248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:50:19.900742 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4222/8534] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:50:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:51:24.466621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:51:24.467989 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:24.484616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4007bfd-6cea-4bf7-ba7b-d075aabee098 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:51:24.490077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:51:24.490705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:51:24.490984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:51:24.491256 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:51:24.492957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:24.507115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:51:24.508675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:51:24.520607 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4313/8535] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:51:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:51:46.204383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:51:46.205866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:46.285116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5d6fa-0a19-4c71-a59e-33f833521ea1 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:51:46.291547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:51:46.292278 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:51:46.292570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:51:46.292922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:51:46.294704 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:46.353329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:51:46.354908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:51:46.364986 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4223/8536] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:51:46 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:51:48.410496 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:51:48.411891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:48.471732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30709449-6c43-49be-8513-9eeb32539f35 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:51:48.475395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:51:48.476166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:51:48.476450 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:51:48.476724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:51:48.478505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:48.539841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:51:48.541343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:51:48.551072 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4314/8537] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:51:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:51:55.892292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:51:55.893768 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:55.917081 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18276-d5cc-43bb-ba21-c9dbc3c78ad3 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:51:55.921736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:51:55.922534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:51:55.922811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:51:55.923079 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] PATH_INFO: `/v3/users/f61753173a4d493ba1f1f3174c35f83e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:51:55.924276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61753173a4d493ba1f1f3174c35f83e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:51:55.926194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:51:56.104868 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61753173a4d493ba1f1f3174c35f83e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.111805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61753173a4d493ba1f1f3174c35f83e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.123913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61753173a4d493ba1f1f3174c35f83e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.124610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61753173a4d493ba1f1f3174c35f83e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.125256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61753173a4d493ba1f1f3174c35f83e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.193456 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4224/8538] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:51:55 2021] DELETE /identity/v3/users/f61753173a4d493ba1f1f3174c35f83e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:51:56.430038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:51:56.452347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec92a0-19b3-4e54-9669-2763ed797096 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:51:56.513051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:51:56.513902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:51:56.514187 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:51:56.514459 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] PATH_INFO: `/v3/projects/64e4751d74674097b87a3ad1c686e9e5` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:51:56.515636 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e4751d74674097b87a3ad1c686e9e5)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:51:56.517571 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:51:56.621470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e4751d74674097b87a3ad1c686e9e5', 'request_id': 'req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.673632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e4751d74674097b87a3ad1c686e9e5', 'request_id': 'req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.680371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e4751d74674097b87a3ad1c686e9e5', 'request_id': 'req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.691000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] The token cache is being invalidate because project 64e4751d74674097b87a3ad1c686e9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:51:56.691285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.691917 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.693499 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4315/8539] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:51:56 2021] DELETE /identity/v3/projects/64e4751d74674097b87a3ad1c686e9e5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:51:56.697647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:51:56.699080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:56.713067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b1f8e-0f01-4052-91ab-f60a71be2221 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:51:56.767313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:51:56.768184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:51:56.768465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:51:56.768742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] PATH_INFO: `/v3/users/c66ee49421024b6cb63bcd3dd47efa3a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:51:56.770071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66ee49421024b6cb63bcd3dd47efa3a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:51:56.771983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:51:56.896946 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66ee49421024b6cb63bcd3dd47efa3a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.904459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66ee49421024b6cb63bcd3dd47efa3a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.916039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66ee49421024b6cb63bcd3dd47efa3a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.916725 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66ee49421024b6cb63bcd3dd47efa3a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:56.917379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-330ef1ff-f77e-4a83-abb5-74d00f1dff35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66ee49421024b6cb63bcd3dd47efa3a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:57.011774 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4225/8540] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:51:56 2021] DELETE /identity/v3/users/c66ee49421024b6cb63bcd3dd47efa3a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:51:57.252225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:51:57.253929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:51:57.267269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381dbe-ae2b-40d2-a1f5-b77a2b6d792d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:51:57.327971 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:51:57.329303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:51:57.329722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:51:57.330132 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] PATH_INFO: `/v3/projects/2cad11b925d6435b80d2b6f99851adb9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:51:57.331854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cad11b925d6435b80d2b6f99851adb9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:51:57.335058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:51:57.432766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cad11b925d6435b80d2b6f99851adb9', 'request_id': 'req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:57.490462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cad11b925d6435b80d2b6f99851adb9', 'request_id': 'req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:57.497894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cad11b925d6435b80d2b6f99851adb9', 'request_id': 'req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:57.509074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] The token cache is being invalidate because project 2cad11b925d6435b80d2b6f99851adb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:51:57.509360 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:57.509987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-2b9d5828-a51b-4438-9fc1-17e4c55b32e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:51:57.511549 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4316/8541] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:51:57 2021] DELETE /identity/v3/projects/2cad11b925d6435b80d2b6f99851adb9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:07.037276 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3760-d929-444d-8b10-822b816bcf53 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.037846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3760-d929-444d-8b10-822b816bcf53 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.037846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3760-d929-444d-8b10-822b816bcf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.055399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-bebd3760-d929-444d-8b10-822b816bcf53 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:07.056571 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bebd3760-d929-444d-8b10-822b816bcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:07.112660 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4226/8542] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:52:07.121682 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01028-7622-4bc7-a5f1-69698724be1d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.122174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01028-7622-4bc7-a5f1-69698724be1d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.122291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01028-7622-4bc7-a5f1-69698724be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.141186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d0e01028-7622-4bc7-a5f1-69698724be1d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:07.142381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d0e01028-7622-4bc7-a5f1-69698724be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:07.150295 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4317/8543] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:07.154830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3760-d929-444d-8b10-822b816bcf53 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.164309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3760-d929-444d-8b10-822b816bcf53 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.168828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.169500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.169780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.170051 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.170771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:52:07.171075 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.172648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.184419 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4227/8544] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:52:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:52:07.199039 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01028-7622-4bc7-a5f1-69698724be1d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.208205 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01028-7622-4bc7-a5f1-69698724be1d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.213009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.213670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.213934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.214263 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.214902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.216793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.285419 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4318/8545] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:52:07 2021] POST /identity/v3/projects => generated 393 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:52:07.289689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.299539 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e25f2c-db9b-49d0-8858-f1777594d706 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.354368 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.355027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.355306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.355577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.356255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.358229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.427318 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4228/8546] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:52:07 2021] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:52:07.432001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.442362 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c293d5f-9118-4b76-8fb6-f53b9628b8ab admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.447141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.447829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.448117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.448395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.449197 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.450812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.461600 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4319/8547] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:52:07.466586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.478277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c4b1-d630-4d84-a942-90d6d47e9379 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.483113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10298e-0204-4435-9127-1ccedb0154e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.483802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10298e-0204-4435-9127-1ccedb0154e6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.484085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10298e-0204-4435-9127-1ccedb0154e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.484365 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10298e-0204-4435-9127-1ccedb0154e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.485138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10298e-0204-4435-9127-1ccedb0154e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.486764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10298e-0204-4435-9127-1ccedb0154e6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.497462 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4229/8548] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:52:07.501745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.512225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15ad49-a4d1-4315-aad6-dfb137227a62 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.517036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.517909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.518189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.518461 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] PATH_INFO: `/v3/projects/283beb68bf4d4ba8951f370b7b057323/users/55da14ac01534b83affd4478904fd87f/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.532645 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283beb68bf4d4ba8951f370b7b057323, user_id=55da14ac01534b83affd4478904fd87f, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.535311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.605189 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4320/8549] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:52:07 2021] PUT /identity/v3/projects/283beb68bf4d4ba8951f370b7b057323/users/55da14ac01534b83affd4478904fd87f/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:07.618687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871141a-388d-479d-a253-d74a9506a7d7 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.618970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871141a-388d-479d-a253-d74a9506a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.619246 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871141a-388d-479d-a253-d74a9506a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.645450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f871141a-388d-479d-a253-d74a9506a7d7 None None] MFA Rules not processed for user `55da14ac01534b83affd4478904fd87f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:07.646637 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f871141a-388d-479d-a253-d74a9506a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:07.710398 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4230/8550] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:07 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:07.715423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.777282 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fefa4a-294f-40dc-94eb-f2cfa66bcfc6 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.782117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.782771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.783051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.783325 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.784011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.785991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.863209 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4321/8551] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:52:07 2021] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:52:07.867835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871141a-388d-479d-a253-d74a9506a7d7 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:07.879124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871141a-388d-479d-a253-d74a9506a7d7 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:07.933013 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:07.933672 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:07.933950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:07.934250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:07.934934 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:07.936826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:07.993757 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4231/8552] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:52:07 2021] POST /identity/v3/users => generated 302 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:52:07.997737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:08.009046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca4c1-d874-45c1-bdf4-2aa7632c42e8 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:08.013857 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:08.014503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:08.014828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:08.015140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:08.015876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:08.017487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:08.028467 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4322/8553] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:52:08.032485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:08.042429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab22f7-4c28-4160-9b24-4621821a79d0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:08.047159 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:08.048049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:08.048330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:08.048603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] PATH_INFO: `/v3/projects/d2d9ec07b6154cd5a9ede3e238760682/users/b83f18d8638945e5a0d1410199846a68/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:08.065126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d9ec07b6154cd5a9ede3e238760682, user_id=b83f18d8638945e5a0d1410199846a68, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:08.068073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:08.148156 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4232/8554] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:52:08 2021] PUT /identity/v3/projects/d2d9ec07b6154cd5a9ede3e238760682/users/b83f18d8638945e5a0d1410199846a68/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 21:52:08.152384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:08.162509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5090ec-1e92-4ff9-b45b-a0c8b9054820 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:08.216679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6097-5533-44aa-8ba6-f8b1adff64e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:08.217370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6097-5533-44aa-8ba6-f8b1adff64e7 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:08.217648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6097-5533-44aa-8ba6-f8b1adff64e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:08.217922 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6097-5533-44aa-8ba6-f8b1adff64e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:08.218635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6097-5533-44aa-8ba6-f8b1adff64e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:08.220225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6097-5533-44aa-8ba6-f8b1adff64e7 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:08.230814 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4323/8555] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:52:08.235094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:08.245929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651c93b-ba9a-4661-84fe-72a92206932d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:08.250574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9e328-e439-4cbe-9e75-fca0fdcb73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:08.251448 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9e328-e439-4cbe-9e75-fca0fdcb73e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:08.251730 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9e328-e439-4cbe-9e75-fca0fdcb73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:08.252005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9e328-e439-4cbe-9e75-fca0fdcb73e3 admin admin] PATH_INFO: `/v3/projects/d2d9ec07b6154cd5a9ede3e238760682/users/b83f18d8638945e5a0d1410199846a68/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:08.254281 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9e328-e439-4cbe-9e75-fca0fdcb73e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d9ec07b6154cd5a9ede3e238760682, user_id=b83f18d8638945e5a0d1410199846a68, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:08.256865 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9e328-e439-4cbe-9e75-fca0fdcb73e3 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:08.266832 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4233/8556] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:52:08 2021] PUT /identity/v3/projects/d2d9ec07b6154cd5a9ede3e238760682/users/b83f18d8638945e5a0d1410199846a68/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:08.276776 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839231c-1321-4228-957c-02c9fea02550 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:08.277098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839231c-1321-4228-957c-02c9fea02550 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:08.277381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839231c-1321-4228-957c-02c9fea02550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:08.305742 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0839231c-1321-4228-957c-02c9fea02550 None None] MFA Rules not processed for user `b83f18d8638945e5a0d1410199846a68`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:08.306875 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0839231c-1321-4228-957c-02c9fea02550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:08.372047 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4324/8557] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:08 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:08.424379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4d51-cba6-493c-9891-e3be82cc3cf3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:08.424668 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4d51-cba6-493c-9891-e3be82cc3cf3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:08.424983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4d51-cba6-493c-9891-e3be82cc3cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:08.443186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-42cc4d51-cba6-493c-9891-e3be82cc3cf3 None None] MFA Rules not processed for user `55da14ac01534b83affd4478904fd87f`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:08.444383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-42cc4d51-cba6-493c-9891-e3be82cc3cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:08.497981 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4234/8558] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:08 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:08.511868 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839231c-1321-4228-957c-02c9fea02550 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:08.513302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0839231c-1321-4228-957c-02c9fea02550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:08.587257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839231c-1321-4228-957c-02c9fea02550 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:08.592734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:08.593416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:08.593701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:08.593980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:08.601714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:08.603877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:08.612764 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4325/8559] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:08 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:18.148540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4d51-cba6-493c-9891-e3be82cc3cf3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:18.164431 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4d51-cba6-493c-9891-e3be82cc3cf3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:18.169872 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51289d-7859-4487-8959-8911cbeba9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:18.170503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51289d-7859-4487-8959-8911cbeba9ac service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:18.170783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51289d-7859-4487-8959-8911cbeba9ac service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:18.171054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51289d-7859-4487-8959-8911cbeba9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:18.172809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7c51289d-7859-4487-8959-8911cbeba9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:18.187348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51289d-7859-4487-8959-8911cbeba9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:18.188977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51289d-7859-4487-8959-8911cbeba9ac service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:18.202346 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4235/8560] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:19.683918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:19.685371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:19.702038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf113d31-04a3-4504-8da9-6bbe86e40c47 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:19.707454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:19.708074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:19.708352 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:19.708715 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:19.717281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:19.718830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:19.728608 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4326/8561] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:19 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:19.742534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a363aa-b539-4f7b-911c-fc9956719736 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:19.743001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a363aa-b539-4f7b-911c-fc9956719736 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:19.743107 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a363aa-b539-4f7b-911c-fc9956719736 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:19.744934 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4236/8562] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:52:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:52:19.749672 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] Authenticating service token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:52:19.762945 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:19.770821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2def7-bf50-4589-b5eb-d00cb3a0f68d service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:19.775914 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab4349-55f2-4a8d-928d-0fac6ab62f14 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83f18d8638945e5a0d1410199846a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d9ec07b6154cd5a9ede3e238760682', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:19.776730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4349-55f2-4a8d-928d-0fac6ab62f14 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:19.777042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4349-55f2-4a8d-928d-0fac6ab62f14 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:19.777320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4349-55f2-4a8d-928d-0fac6ab62f14 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] PATH_INFO: `/v3/projects/d2d9ec07b6154cd5a9ede3e238760682` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:19.778492 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab4349-55f2-4a8d-928d-0fac6ab62f14 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2d9ec07b6154cd5a9ede3e238760682)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:19.780227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab4349-55f2-4a8d-928d-0fac6ab62f14 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:19.781898 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4327/8563] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:52:19 2021] GET /identity/v3/projects/d2d9ec07b6154cd5a9ede3e238760682 => generated 391 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:52:19.983798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a363aa-b539-4f7b-911c-fc9956719736 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:19.985497 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-08a363aa-b539-4f7b-911c-fc9956719736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:20.052931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a363aa-b539-4f7b-911c-fc9956719736 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:20.056509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:20.057184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:20.057463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:20.057732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:20.059472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:20.072233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:20.073677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:20.083835 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4237/8564] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:19 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:20.269675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e057b-54a7-4629-8624-41d7294d9e86 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:20.269988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e057b-54a7-4629-8624-41d7294d9e86 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:20.270264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e057b-54a7-4629-8624-41d7294d9e86 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:20.272122 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4328/8565] 10.222.0.32 () {54 vars in 912 bytes} [Sat Dec 25 21:52:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:52:20.277805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] Authenticating service token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Dec 25 21:52:20.293265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:20.302492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289eefa-3817-4720-9ab7-c79a6603115e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:20.307108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83f18d8638945e5a0d1410199846a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d9ec07b6154cd5a9ede3e238760682', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:20.307892 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:20.308175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:20.308461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] PATH_INFO: `/v3/projects/d2d9ec07b6154cd5a9ede3e238760682` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:20.309687 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] RBAC: Authorizing `identity:get_project(project_id=d2d9ec07b6154cd5a9ede3e238760682)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:20.311445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:20.313139 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4238/8566] 10.222.0.32 () {58 vars in 1443 bytes} [Sat Dec 25 21:52:20 2021] GET /identity/v3/projects/d2d9ec07b6154cd5a9ede3e238760682 => generated 391 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:52:20.545732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e057b-54a7-4629-8624-41d7294d9e86 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:20.559514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e057b-54a7-4629-8624-41d7294d9e86 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:20.563038 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42b0d6-c94d-49a6-a002-ce26e4b0d2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:20.563659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b0d6-c94d-49a6-a002-ce26e4b0d2ae service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:20.563939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b0d6-c94d-49a6-a002-ce26e4b0d2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:20.564214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42b0d6-c94d-49a6-a002-ce26e4b0d2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:20.565973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ce42b0d6-c94d-49a6-a002-ce26e4b0d2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:20.577923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42b0d6-c94d-49a6-a002-ce26e4b0d2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:20.579333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42b0d6-c94d-49a6-a002-ce26e4b0d2ae service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:20.589416 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4329/8567] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:24.694962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:24.755574 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0848d-39c1-4422-9805-c7f27130ab8a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:24.760627 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:24.761502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:24.761779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:24.762047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] PATH_INFO: `/v3/users/55da14ac01534b83affd4478904fd87f` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:24.763223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55da14ac01534b83affd4478904fd87f)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:24.765142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:24.926518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55da14ac01534b83affd4478904fd87f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:24.933901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55da14ac01534b83affd4478904fd87f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:24.945156 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55da14ac01534b83affd4478904fd87f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:24.945828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55da14ac01534b83affd4478904fd87f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:24.946446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55da14ac01534b83affd4478904fd87f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.055766 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4239/8568] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:52:24 2021] DELETE /identity/v3/users/55da14ac01534b83affd4478904fd87f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:25.069700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:25.070262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:25.070262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:25.092930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:25.094129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:25.150548 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4330/8569] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:25.160384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:25.161829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:25.220615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc22c-5837-4d81-80f3-1e404a3ab152 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:25.224330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:25.225001 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:25.225283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:25.225558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:25.234475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:25.235880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:25.245715 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4240/8570] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:25.509402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:25.510844 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:25.524250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471213f-43bb-46c0-a302-d7a0c8cbee43 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:25.529439 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:25.531071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:25.531071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:25.531071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] PATH_INFO: `/v3/projects/283beb68bf4d4ba8951f370b7b057323` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:25.532149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=283beb68bf4d4ba8951f370b7b057323)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:25.534092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:25.638426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283beb68bf4d4ba8951f370b7b057323', 'request_id': 'req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.701383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283beb68bf4d4ba8951f370b7b057323', 'request_id': 'req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.707732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283beb68bf4d4ba8951f370b7b057323', 'request_id': 'req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.718313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] The token cache is being invalidate because project 283beb68bf4d4ba8951f370b7b057323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:52:25.718588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.719289 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.720832 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4331/8571] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:52:25 2021] DELETE /identity/v3/projects/283beb68bf4d4ba8951f370b7b057323 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:25.724964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:25.735295 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af15b2-e828-4d45-84d5-0600d5d07a45 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:25.789245 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:25.790032 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:25.790315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:25.790579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] PATH_INFO: `/v3/users/b83f18d8638945e5a0d1410199846a68` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:25.792345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83f18d8638945e5a0d1410199846a68)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:25.794273 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:25.966674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83f18d8638945e5a0d1410199846a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.973375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83f18d8638945e5a0d1410199846a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.986018 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83f18d8638945e5a0d1410199846a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.986713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83f18d8638945e5a0d1410199846a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:25.987513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-30e1d992-7ab8-45bf-879c-813914581b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83f18d8638945e5a0d1410199846a68'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:26.061810 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4241/8572] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:52:25 2021] DELETE /identity/v3/users/b83f18d8638945e5a0d1410199846a68 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:26.456831 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:26.458427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:26.472072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d63884-d5c7-45fe-99fc-0d9ffe88a9fd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:26.530149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:26.531006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:26.531286 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:26.531557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] PATH_INFO: `/v3/projects/d2d9ec07b6154cd5a9ede3e238760682` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:26.532730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d9ec07b6154cd5a9ede3e238760682)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:26.534689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:26.633841 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d9ec07b6154cd5a9ede3e238760682', 'request_id': 'req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:26.707214 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d9ec07b6154cd5a9ede3e238760682', 'request_id': 'req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:26.713861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d9ec07b6154cd5a9ede3e238760682', 'request_id': 'req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:26.724373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] The token cache is being invalidate because project d2d9ec07b6154cd5a9ede3e238760682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:52:26.724658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:26.725317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-5ddd6b82-64ed-461c-b28a-3a5a4e0f4a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:52:26.726851 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4332/8573] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:52:26 2021] DELETE /identity/v3/projects/d2d9ec07b6154cd5a9ede3e238760682 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:26.734204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e8a79-f584-4708-a5ee-6be5451e72a4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:26.734739 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e8a79-f584-4708-a5ee-6be5451e72a4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:26.734915 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e8a79-f584-4708-a5ee-6be5451e72a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:26.753330 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b71e8a79-f584-4708-a5ee-6be5451e72a4 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:26.754530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b71e8a79-f584-4708-a5ee-6be5451e72a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:26.818284 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4242/8574] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:26.826920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf827-71c6-4634-88cf-7da04a8855a3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:26.827199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf827-71c6-4634-88cf-7da04a8855a3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:26.827472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf827-71c6-4634-88cf-7da04a8855a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:26.846194 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-eb2cf827-71c6-4634-88cf-7da04a8855a3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:26.847375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-eb2cf827-71c6-4634-88cf-7da04a8855a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:26.856021 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4333/8575] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:26.860243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e8a79-f584-4708-a5ee-6be5451e72a4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:26.870064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e8a79-f584-4708-a5ee-6be5451e72a4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:26.875459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:26.876100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:26.876379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:26.876649 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:26.877640 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:52:26.877943 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:26.879505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:26.890790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4243/8576] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:52:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:52:26.894966 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cf827-71c6-4634-88cf-7da04a8855a3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:26.904210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cf827-71c6-4634-88cf-7da04a8855a3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:26.908894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:26.909547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:26.909836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:26.910103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:26.910782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:26.912661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:27.023943 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4334/8577] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:52:26 2021] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:52:27.028126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:27.038031 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff8d5e-bed2-4058-980c-4963dcd1e426 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:27.095727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:27.096393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:27.096680 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:27.096979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:27.097656 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:27.099561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:27.170801 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4244/8578] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:52:27 2021] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:52:27.174766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:27.185436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ff490-e8a9-4ca2-b3a0-3d60d8bdea87 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:27.190215 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:27.190864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:27.191146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:27.191420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:27.192204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:27.193848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:27.204065 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4335/8579] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:52:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:52:27.207899 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:27.218549 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc2a65-8f0e-44ce-9f46-a7d4678f6c10 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:27.223217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5f59e-e880-49ad-ba57-3ae058b4a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:27.223866 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f59e-e880-49ad-ba57-3ae058b4a108 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:27.224146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f59e-e880-49ad-ba57-3ae058b4a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:27.224421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f59e-e880-49ad-ba57-3ae058b4a108 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:27.225187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5f59e-e880-49ad-ba57-3ae058b4a108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:27.226755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5f59e-e880-49ad-ba57-3ae058b4a108 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:27.237077 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4245/8580] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:52:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:52:27.241042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:27.251051 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70521dbd-e42e-4726-a410-4f17bf9a87fc admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:27.256141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:27.257059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:27.257345 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:27.257623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] PATH_INFO: `/v3/projects/90d2eddaaa684a86a317f70bb44fdde5/users/5d6c5eaab6ba43418a4a0e05312f53bf/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:27.271878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d2eddaaa684a86a317f70bb44fdde5, user_id=5d6c5eaab6ba43418a4a0e05312f53bf, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:27.274620 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:27.353258 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4336/8581] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:52:27 2021] PUT /identity/v3/projects/90d2eddaaa684a86a317f70bb44fdde5/users/5d6c5eaab6ba43418a4a0e05312f53bf/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:52:27.359034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ada77-3acc-4a86-a141-565707a63bfc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:27.359324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ada77-3acc-4a86-a141-565707a63bfc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:27.359604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ada77-3acc-4a86-a141-565707a63bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:27.377132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-760ada77-3acc-4a86-a141-565707a63bfc None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:27.378313 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-760ada77-3acc-4a86-a141-565707a63bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:27.433574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4246/8582] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:27.443317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:27.445026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:27.502877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1018ad-91e8-42eb-9c72-e1db9c2f3fa0 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:27.506574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3c266-6501-49bc-90f9-ee3e4b3eda5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:27.510049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3c266-6501-49bc-90f9-ee3e4b3eda5b service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:27.510049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3c266-6501-49bc-90f9-ee3e4b3eda5b service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:27.510049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3c266-6501-49bc-90f9-ee3e4b3eda5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:27.517377 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3c266-6501-49bc-90f9-ee3e4b3eda5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:27.518808 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3c266-6501-49bc-90f9-ee3e4b3eda5b service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:27.528667 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4337/8583] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:28.651897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:28.658496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:28.658496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:28.678626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] MFA Rules not processed for user `5d6c5eaab6ba43418a4a0e05312f53bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:28.680017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:28.747626 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4247/8584] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:28.759759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528651f5-25d1-4afe-aa3b-dd33a77f9c21 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:28.760638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528651f5-25d1-4afe-aa3b-dd33a77f9c21 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:28.760984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528651f5-25d1-4afe-aa3b-dd33a77f9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:28.783999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-528651f5-25d1-4afe-aa3b-dd33a77f9c21 None None] MFA Rules not processed for user `5d6c5eaab6ba43418a4a0e05312f53bf`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:28.785252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-528651f5-25d1-4afe-aa3b-dd33a77f9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:28.793024 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4338/8585] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:52:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:28.805016 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:28.806468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:28.880287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b0a90-f4d8-416d-8ffa-c971240efb15 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:28.885908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1a66-ce89-4d5b-8d77-906f10b8194c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:28.886551 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1a66-ce89-4d5b-8d77-906f10b8194c service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:28.886834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1a66-ce89-4d5b-8d77-906f10b8194c service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:28.887113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1a66-ce89-4d5b-8d77-906f10b8194c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:28.894876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1a66-ce89-4d5b-8d77-906f10b8194c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:28.896385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1a66-ce89-4d5b-8d77-906f10b8194c service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:28.905680 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4248/8586] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:28 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:40.402176 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528651f5-25d1-4afe-aa3b-dd33a77f9c21 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:40.414826 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528651f5-25d1-4afe-aa3b-dd33a77f9c21 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:40.418457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ed857-60b4-4bde-9971-1c0ad7685119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:40.419110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed857-60b4-4bde-9971-1c0ad7685119 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:40.419376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed857-60b4-4bde-9971-1c0ad7685119 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:40.419654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed857-60b4-4bde-9971-1c0ad7685119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:40.421462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e6ed857-60b4-4bde-9971-1c0ad7685119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:40.433073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ed857-60b4-4bde-9971-1c0ad7685119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:40.434486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ed857-60b4-4bde-9971-1c0ad7685119 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:40.444622 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4339/8587] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:52:40.592614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7914c-2987-4fc7-bd32-33eacd74958b None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:40.593191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7914c-2987-4fc7-bd32-33eacd74958b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:40.593191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7914c-2987-4fc7-bd32-33eacd74958b None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:40.594951 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4249/8588] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:52:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:52:40.599993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2370-5714-48c1-ba06-a043b61d121c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:40.606096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2370-5714-48c1-ba06-a043b61d121c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:40.606096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2370-5714-48c1-ba06-a043b61d121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:40.646371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-23fc2370-5714-48c1-ba06-a043b61d121c None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:52:40.647479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-23fc2370-5714-48c1-ba06-a043b61d121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:40.707127 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4340/8589] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:52:40 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:52:40.727858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7914c-2987-4fc7-bd32-33eacd74958b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:52:40.732023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-86d7914c-2987-4fc7-bd32-33eacd74958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:52:40.749085 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7914c-2987-4fc7-bd32-33eacd74958b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:52:40.754290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:52:40.754948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:52:40.755227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:52:40.755552 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:52:40.764698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:52:40.766292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:52:40.776079 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4250/8590] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:52:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:53:10.170062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2370-5714-48c1-ba06-a043b61d121c None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:10.182011 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2370-5714-48c1-ba06-a043b61d121c None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:10.185761 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:10.186420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:10.186707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:10.186979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:10.188737 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:10.201058 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:10.202470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:10.212737 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4341/8591] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:53:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:53:10.681100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:10.694572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef43ad2-1156-4fa7-909f-2341398fd23c service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:10.700109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:10.701059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:10.701348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:10.701610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:10.703453 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:10.716389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:10.717852 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:10.728658 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4251/8592] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:53:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:53:20.079774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:20.097827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35b06-aacf-43aa-b68f-83b25e05afdf service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:20.104150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:20.105069 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:20.105347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:20.110064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] PATH_INFO: `/v3/users/5d6c5eaab6ba43418a4a0e05312f53bf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:20.110064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6c5eaab6ba43418a4a0e05312f53bf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:20.110064 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:20.294523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6c5eaab6ba43418a4a0e05312f53bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.301275 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6c5eaab6ba43418a4a0e05312f53bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.313004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6c5eaab6ba43418a4a0e05312f53bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.313662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6c5eaab6ba43418a4a0e05312f53bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.401768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0668b915-c3fe-4bf2-82e1-315d119dd894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6c5eaab6ba43418a4a0e05312f53bf'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.407788 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4342/8593] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:53:20 2021] DELETE /identity/v3/users/5d6c5eaab6ba43418a4a0e05312f53bf => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:53:20.645511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:20.657143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b407b-1a78-44bd-8fcd-f303cce052c5 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:20.715559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:20.716415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:20.716696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:20.717006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] PATH_INFO: `/v3/projects/90d2eddaaa684a86a317f70bb44fdde5` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:20.718196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d2eddaaa684a86a317f70bb44fdde5)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:20.720087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:20.817805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d2eddaaa684a86a317f70bb44fdde5', 'request_id': 'req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.823758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d2eddaaa684a86a317f70bb44fdde5', 'request_id': 'req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.876158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d2eddaaa684a86a317f70bb44fdde5', 'request_id': 'req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.886500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] The token cache is being invalidate because project 90d2eddaaa684a86a317f70bb44fdde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:53:20.886786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.887407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-54e045a4-498f-4c1c-99dd-c3db44ebc9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:53:20.889046 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4252/8594] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:53:20 2021] DELETE /identity/v3/projects/90d2eddaaa684a86a317f70bb44fdde5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:53:20.894823 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410456ff-d523-457c-9a0c-9a6c9fe8f425 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:20.895110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410456ff-d523-457c-9a0c-9a6c9fe8f425 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:20.895409 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410456ff-d523-457c-9a0c-9a6c9fe8f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:20.913812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-410456ff-d523-457c-9a0c-9a6c9fe8f425 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:53:20.914992 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-410456ff-d523-457c-9a0c-9a6c9fe8f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:20.973252 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4343/8595] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:53:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:53:20.981889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b6e-05f0-44f7-aa45-7268653ffb4f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:20.982170 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b6e-05f0-44f7-aa45-7268653ffb4f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:20.982441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f9b6e-05f0-44f7-aa45-7268653ffb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.000838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-c75f9b6e-05f0-44f7-aa45-7268653ffb4f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:53:21.002071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c75f9b6e-05f0-44f7-aa45-7268653ffb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:21.009883 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4253/8596] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:53:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:53:21.014318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410456ff-d523-457c-9a0c-9a6c9fe8f425 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:21.023859 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410456ff-d523-457c-9a0c-9a6c9fe8f425 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:21.028838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:21.029509 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.029787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.030059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.030801 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:53:21.031103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:21.032681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:21.044293 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4344/8597] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:53:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 25 21:53:21.048411 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b6e-05f0-44f7-aa45-7268653ffb4f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:21.057694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f9b6e-05f0-44f7-aa45-7268653ffb4f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:21.062270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:21.062914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.063193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.063467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.064162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:21.066096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:21.160666 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4254/8598] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:53:21 2021] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:53:21.161821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:21.172099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2f998-ad42-447c-af14-5b990229e529 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:21.228260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:21.228949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.229311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.229566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.230375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:21.232269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:21.330503 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4345/8599] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:53:21 2021] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 21:53:21.334434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:21.345358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41600098-d17a-4439-939f-9ba3fa0fe948 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:21.350050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:21.350727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.351015 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.351292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.352017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:21.353674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:21.363463 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4255/8600] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:53:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:53:21.367199 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:21.377934 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd2cb-6dfd-430c-a1ce-16a20bbda430 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:21.382698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75956841-35f1-4f95-97f0-1004621e130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:21.387548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956841-35f1-4f95-97f0-1004621e130b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.387548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956841-35f1-4f95-97f0-1004621e130b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.387548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75956841-35f1-4f95-97f0-1004621e130b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.387548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75956841-35f1-4f95-97f0-1004621e130b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:21.387548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75956841-35f1-4f95-97f0-1004621e130b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:21.396416 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4346/8601] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:53:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:53:21.400516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:21.411048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1682a1-da1f-438c-a97a-f75121a669c6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:21.415587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:21.416454 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.416737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.417052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] PATH_INFO: `/v3/projects/9320712a3a5e434d84414d98bfe55244/users/36a0bcb4058b470094465b56095ee02c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.431134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9320712a3a5e434d84414d98bfe55244, user_id=36a0bcb4058b470094465b56095ee02c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:21.434306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:21.518590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4256/8602] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:53:21 2021] PUT /identity/v3/projects/9320712a3a5e434d84414d98bfe55244/users/36a0bcb4058b470094465b56095ee02c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:53:21.523849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503461-d8d7-46f0-ad94-26415e57245b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.524203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503461-d8d7-46f0-ad94-26415e57245b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.524487 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503461-d8d7-46f0-ad94-26415e57245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.542004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-7f503461-d8d7-46f0-ad94-26415e57245b None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:53:21.543173 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7f503461-d8d7-46f0-ad94-26415e57245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:21.598535 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4347/8603] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:53:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:53:21.608252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:21.610024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:21.668101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47038-bbab-40ad-a497-f6b78eadccf8 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:21.671819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d423d-4f3f-4ade-8426-3dfeba510450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:21.672457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d423d-4f3f-4ade-8426-3dfeba510450 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:21.672745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d423d-4f3f-4ade-8426-3dfeba510450 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:21.673048 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d423d-4f3f-4ade-8426-3dfeba510450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:21.682358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d423d-4f3f-4ade-8426-3dfeba510450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:21.684301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d423d-4f3f-4ade-8426-3dfeba510450 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:21.693900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4257/8604] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:53:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:53:22.901162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:22.902511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:22.902511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:22.931708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] MFA Rules not processed for user `36a0bcb4058b470094465b56095ee02c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:53:22.937044 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:23.002003 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4348/8605] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:53:22 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:53:23.013384 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705877-17c2-4dda-aafd-9191dae57399 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:23.013950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705877-17c2-4dda-aafd-9191dae57399 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:23.013950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705877-17c2-4dda-aafd-9191dae57399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:23.031372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-32705877-17c2-4dda-aafd-9191dae57399 None None] MFA Rules not processed for user `36a0bcb4058b470094465b56095ee02c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:53:23.032848 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-32705877-17c2-4dda-aafd-9191dae57399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:23.039957 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4258/8606] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:53:23 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:53:23.051731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:23.053227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:23.137482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e40387-c31e-450a-a915-7ec9a94a0cdc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:23.142928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77d8e7-b254-4546-b576-cb2ced1f7602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:23.143563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d8e7-b254-4546-b576-cb2ced1f7602 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:23.143845 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d8e7-b254-4546-b576-cb2ced1f7602 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:23.144119 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d8e7-b254-4546-b576-cb2ced1f7602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:23.151668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d8e7-b254-4546-b576-cb2ced1f7602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:23.153285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d8e7-b254-4546-b576-cb2ced1f7602 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:23.161786 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4349/8607] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:53:23 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:53:35.501544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6a79-6d3e-4694-aa3f-0c47c8f48f8d None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:35.502108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6a79-6d3e-4694-aa3f-0c47c8f48f8d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:35.502108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6a79-6d3e-4694-aa3f-0c47c8f48f8d None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:35.503883 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4259/8608] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:53:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:53:35.508791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:35.517768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:35.517768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:35.528249 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:53:35.529458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:35.588065 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4350/8609] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:53:35 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:53:35.609679 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c6a79-6d3e-4694-aa3f-0c47c8f48f8d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:35.611369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8c6c6a79-6d3e-4694-aa3f-0c47c8f48f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:35.630830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c6a79-6d3e-4694-aa3f-0c47c8f48f8d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:35.635749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:35.636375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:35.636655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:35.636958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:35.645186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:35.646769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:35.656785 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4260/8610] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:53:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:53:48.139613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:48.141159 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:48.154781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139fb5f-07f6-4cda-b661-c9887cf5e4ba None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:48.158961 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0d3d0-27fd-417e-b602-23e83421065d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:48.159106 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d3d0-27fd-417e-b602-23e83421065d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:48.159319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d3d0-27fd-417e-b602-23e83421065d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:48.159614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d3d0-27fd-417e-b602-23e83421065d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:48.161366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7ff0d3d0-27fd-417e-b602-23e83421065d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:48.177416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0d3d0-27fd-417e-b602-23e83421065d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:48.181402 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0d3d0-27fd-417e-b602-23e83421065d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:48.194460 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4351/8611] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:53:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:53:49.367580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:53:49.380151 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f19c8-2dd5-4306-80a1-1e4f26479e23 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:53:49.383776 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:53:49.384403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:53:49.384682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:53:49.385037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:53:49.386771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:53:49.402724 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:53:49.404158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:53:49.417145 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4261/8612] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:53:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:54:13.381234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c52cc-b30d-49b6-a60a-b387f50e3a06 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:54:13.387347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c52cc-b30d-49b6-a60a-b387f50e3a06 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:54:13.387347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c52cc-b30d-49b6-a60a-b387f50e3a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:54:13.399348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-339c52cc-b30d-49b6-a60a-b387f50e3a06 None None] MFA Rules not processed for user `36a0bcb4058b470094465b56095ee02c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:54:13.400528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-339c52cc-b30d-49b6-a60a-b387f50e3a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:54:13.408270 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4352/8613] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:54:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:54:14.045058 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:54:14.046615 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:54:14.072912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1555e1a-6689-48a3-b7ab-bce8bc33a934 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:54:14.079153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d57ab-a268-4ac6-a5f6-badae551e466 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:54:14.079944 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d57ab-a268-4ac6-a5f6-badae551e466 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:54:14.080258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d57ab-a268-4ac6-a5f6-badae551e466 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:54:14.080535 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d57ab-a268-4ac6-a5f6-badae551e466 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:54:14.082392 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-413d57ab-a268-4ac6-a5f6-badae551e466 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:54:14.096490 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d57ab-a268-4ac6-a5f6-badae551e466 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:54:14.098077 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d57ab-a268-4ac6-a5f6-badae551e466 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:54:14.110729 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4262/8614] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:54:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:54:25.460218 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0754665-8ff9-4f7f-84d2-1f8e996efd58 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:54:25.460751 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0754665-8ff9-4f7f-84d2-1f8e996efd58 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:54:25.460862 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0754665-8ff9-4f7f-84d2-1f8e996efd58 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:54:25.462608 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4353/8615] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:54:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:54:25.468558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:54:25.469066 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:54:25.469491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:54:25.490568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:54:25.491769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:54:25.500841 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4263/8616] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:54:25 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:54:25.522147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0754665-8ff9-4f7f-84d2-1f8e996efd58 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:54:25.538829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0754665-8ff9-4f7f-84d2-1f8e996efd58 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:54:25.543881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:54:25.544505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:54:25.544809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:54:25.545109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:54:25.553598 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:54:25.555209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:54:25.565054 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4354/8617] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:54:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:54:55.990198 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:54:55.991799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:54:56.009720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396dda9-6f72-4fd6-9868-db7717bd23c3 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:54:56.015752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:54:56.016390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:54:56.016666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:54:56.016960 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:54:56.018650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:54:56.032585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:54:56.034231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:54:56.046773 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4264/8618] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:54:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:55:06.096652 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:06.108943 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05769c00-0a09-4768-8e6e-b1dc25c442c5 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:06.113514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:06.114375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:06.114656 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:06.114931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] PATH_INFO: `/v3/users/36a0bcb4058b470094465b56095ee02c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:06.116149 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a0bcb4058b470094465b56095ee02c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:06.118141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:06.302269 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a0bcb4058b470094465b56095ee02c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.309998 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a0bcb4058b470094465b56095ee02c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.321717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a0bcb4058b470094465b56095ee02c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.322424 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a0bcb4058b470094465b56095ee02c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.426967 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-e8e08f09-4252-4abd-bbda-2aeff2c5a2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a0bcb4058b470094465b56095ee02c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.434035 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4355/8619] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:55:06 2021] DELETE /identity/v3/users/36a0bcb4058b470094465b56095ee02c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:55:06.685963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:06.698575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec922d2-0d32-465f-960a-0496a18b083d service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:06.757306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:06.758499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:06.758781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:06.759074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] PATH_INFO: `/v3/projects/9320712a3a5e434d84414d98bfe55244` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:06.760413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9320712a3a5e434d84414d98bfe55244)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:06.762961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:06.879489 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9320712a3a5e434d84414d98bfe55244', 'request_id': 'req-6d309024-c23a-48f3-adf9-82c1ced7d52d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.885985 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9320712a3a5e434d84414d98bfe55244', 'request_id': 'req-6d309024-c23a-48f3-adf9-82c1ced7d52d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.948933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9320712a3a5e434d84414d98bfe55244', 'request_id': 'req-6d309024-c23a-48f3-adf9-82c1ced7d52d'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.960287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] The token cache is being invalidate because project 9320712a3a5e434d84414d98bfe55244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 21:55:06.960703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.961548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-6d309024-c23a-48f3-adf9-82c1ced7d52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 21:55:06.963131 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4265/8620] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:55:06 2021] DELETE /identity/v3/projects/9320712a3a5e434d84414d98bfe55244 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:55:06.969895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56b36-e44c-4307-84c5-95b43276717d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:06.970208 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56b36-e44c-4307-84c5-95b43276717d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:06.970489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf56b36-e44c-4307-84c5-95b43276717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:06.989247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1bf56b36-e44c-4307-84c5-95b43276717d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:55:06.993455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1bf56b36-e44c-4307-84c5-95b43276717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:07.054336 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4356/8621] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:55:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:55:07.062423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087395b-dc99-41d0-8de7-a3288b338505 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.062799 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087395b-dc99-41d0-8de7-a3288b338505 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.063129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087395b-dc99-41d0-8de7-a3288b338505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.081699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8087395b-dc99-41d0-8de7-a3288b338505 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:55:07.083024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8087395b-dc99-41d0-8de7-a3288b338505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:07.096208 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4266/8622] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:55:07.100564 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf56b36-e44c-4307-84c5-95b43276717d None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:07.110445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf56b36-e44c-4307-84c5-95b43276717d None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:07.115158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:07.115797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.116081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.116354 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.117107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 21:55:07.117411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:07.119013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:07.130957 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4357/8623] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 21:55:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 21:55:07.135133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087395b-dc99-41d0-8de7-a3288b338505 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:07.144930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087395b-dc99-41d0-8de7-a3288b338505 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:07.149547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:07.150183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.150461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.150732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.151420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:07.153386 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:07.228032 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4267/8624] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 21:55:07 2021] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:55:07.232446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:07.242594 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abdb4-b5d8-4a49-ba63-10883082ff7b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:07.297244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:07.297902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.298180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.298452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.299137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:07.301061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:07.414413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4358/8625] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 21:55:07 2021] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 21:55:07.418555 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:07.428828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431e55a-1b3e-4301-a6f0-806ae29a6a2b admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:07.433476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:07.434642 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.434922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.435199 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.435921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:07.437548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:07.447687 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4268/8626] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:55:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:55:07.452192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:07.462138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857aaa-732b-44b8-9ec2-96ebc566c79d admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:07.466795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c589b-f182-48af-83c9-9e78ef579a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:07.467447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c589b-f182-48af-83c9-9e78ef579a26 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.467726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c589b-f182-48af-83c9-9e78ef579a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.468001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c589b-f182-48af-83c9-9e78ef579a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.468721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c589b-f182-48af-83c9-9e78ef579a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:07.470349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c589b-f182-48af-83c9-9e78ef579a26 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:07.481101 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4359/8627] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:55:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 21:55:07.484961 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:07.495124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf4b3c-87b0-4c8c-8a5d-9c661475660a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:07.501106 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deaa06-ac82-4597-a3eb-8b9f571cede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:07.504480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deaa06-ac82-4597-a3eb-8b9f571cede6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.504480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deaa06-ac82-4597-a3eb-8b9f571cede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.504480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deaa06-ac82-4597-a3eb-8b9f571cede6 admin admin] PATH_INFO: `/v3/projects/1e594b8d48e948b8ae34d96bebfc2a36/users/119465233440460aba79a1ff63865c6c/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.516884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deaa06-ac82-4597-a3eb-8b9f571cede6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e594b8d48e948b8ae34d96bebfc2a36, user_id=119465233440460aba79a1ff63865c6c, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:07.519523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6deaa06-ac82-4597-a3eb-8b9f571cede6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:07.586226 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4269/8628] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 21:55:07 2021] PUT /identity/v3/projects/1e594b8d48e948b8ae34d96bebfc2a36/users/119465233440460aba79a1ff63865c6c/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 21:55:07.591384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bedcee-015a-4445-9947-5eb2c7434a81 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.591674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bedcee-015a-4445-9947-5eb2c7434a81 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.591948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bedcee-015a-4445-9947-5eb2c7434a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.609877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-70bedcee-015a-4445-9947-5eb2c7434a81 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:55:07.613231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-70bedcee-015a-4445-9947-5eb2c7434a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:07.667554 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4360/8629] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:55:07.677468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28b58-d899-48f6-8d3a-3d1d4294e501 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.677761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28b58-d899-48f6-8d3a-3d1d4294e501 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.678040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28b58-d899-48f6-8d3a-3d1d4294e501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.696126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dfc28b58-d899-48f6-8d3a-3d1d4294e501 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:55:07.697345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dfc28b58-d899-48f6-8d3a-3d1d4294e501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:07.745284 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4270/8630] 10.222.0.32 () {58 vars in 1061 bytes} [Sat Dec 25 21:55:07 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:55:07.752063 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bedcee-015a-4445-9947-5eb2c7434a81 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:07.761260 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bedcee-015a-4445-9947-5eb2c7434a81 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:07.764843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:07.765498 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:07.765775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:07.766047 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:07.774762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:07.776178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:07.785354 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4361/8631] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:55:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:55:13.170867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e72de3-f37f-4e5c-8ded-1178fb0d06b1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:13.171441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e72de3-f37f-4e5c-8ded-1178fb0d06b1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:13.171441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e72de3-f37f-4e5c-8ded-1178fb0d06b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:13.200608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-46e72de3-f37f-4e5c-8ded-1178fb0d06b1 None None] MFA Rules not processed for user `119465233440460aba79a1ff63865c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:55:13.201926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-46e72de3-f37f-4e5c-8ded-1178fb0d06b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:13.267617 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4271/8632] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:55:13 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:55:13.279595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:13.281138 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:13.359565 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22cf89-ff69-4ac8-a7a3-e00d152f4c78 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:13.365471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:13.366127 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:13.366410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:13.366716 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:13.375569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:13.377203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:13.386057 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4362/8633] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:55:13 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:55:17.028452 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc85f6-0200-44fb-9ab2-9c9077283a35 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:17.028989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc85f6-0200-44fb-9ab2-9c9077283a35 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:17.029096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc85f6-0200-44fb-9ab2-9c9077283a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:17.047044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-38bc85f6-0200-44fb-9ab2-9c9077283a35 None None] MFA Rules not processed for user `119465233440460aba79a1ff63865c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:55:17.048222 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-38bc85f6-0200-44fb-9ab2-9c9077283a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:17.055026 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4272/8634] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:55:17 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:55:18.946344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:55:18.947827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:19.020009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87300c0-4aed-4004-bc89-8142ebebc7ab service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:55:19.025140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da3aa1-e4c5-49a4-8111-96b47ea766bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:55:19.025786 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da3aa1-e4c5-49a4-8111-96b47ea766bb service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:55:19.026073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da3aa1-e4c5-49a4-8111-96b47ea766bb service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:55:19.026349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da3aa1-e4c5-49a4-8111-96b47ea766bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:55:19.028650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-43da3aa1-e4c5-49a4-8111-96b47ea766bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:55:19.042281 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da3aa1-e4c5-49a4-8111-96b47ea766bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:55:19.043884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da3aa1-e4c5-49a4-8111-96b47ea766bb service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:55:19.056243 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4363/8635] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:55:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:56:29.453557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc85f6-0200-44fb-9ab2-9c9077283a35 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:56:29.468064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc85f6-0200-44fb-9ab2-9c9077283a35 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:56:29.473416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596c017-cbec-4ca8-9761-64fee437107f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:56:29.474044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596c017-cbec-4ca8-9761-64fee437107f service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:56:29.474323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596c017-cbec-4ca8-9761-64fee437107f service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:56:29.474593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596c017-cbec-4ca8-9761-64fee437107f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:56:29.476306 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e596c017-cbec-4ca8-9761-64fee437107f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:56:29.490523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596c017-cbec-4ca8-9761-64fee437107f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:56:29.492080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596c017-cbec-4ca8-9761-64fee437107f service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:56:29.504315 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4273/8636] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:56:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:57:08.121000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b2bb-9dd4-406e-97ef-fe826adc3590 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:08.121603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b2bb-9dd4-406e-97ef-fe826adc3590 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:08.121603 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b2bb-9dd4-406e-97ef-fe826adc3590 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:08.123405 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4364/8637] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:57:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:57:08.129661 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6f07-34fc-4ba1-8dde-73f05adbec6f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:08.130178 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6f07-34fc-4ba1-8dde-73f05adbec6f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:08.130283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6f07-34fc-4ba1-8dde-73f05adbec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:08.148445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-a2ec6f07-34fc-4ba1-8dde-73f05adbec6f None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:57:08.149618 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a2ec6f07-34fc-4ba1-8dde-73f05adbec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:08.158382 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4274/8638] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:57:08 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:57:08.180783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b2bb-9dd4-406e-97ef-fe826adc3590 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:57:08.197332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b2bb-9dd4-406e-97ef-fe826adc3590 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:57:08.206722 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:57:08.207396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:08.207674 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:08.207946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:08.217481 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:57:08.219070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:57:08.230515 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4365/8639] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:57:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:57:08.529309 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:08.529604 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:08.529880 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:08.552450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:57:08.554007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:08.562749 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4275/8640] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:57:08 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:57:08.574646 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:57:08.587548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae91b9-397f-4562-9f33-20de0db572b8 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:57:08.592614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe649f-3aee-407a-a370-8ddd633aa528 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:57:08.593317 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe649f-3aee-407a-a370-8ddd633aa528 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:08.593599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe649f-3aee-407a-a370-8ddd633aa528 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:08.593873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe649f-3aee-407a-a370-8ddd633aa528 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:08.602552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe649f-3aee-407a-a370-8ddd633aa528 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:57:08.604181 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe649f-3aee-407a-a370-8ddd633aa528 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:57:08.614276 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4366/8641] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:57:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:57:30.132699 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:57:30.134288 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:30.220867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c932e99-79db-4708-b726-c876b174bd61 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:57:30.228289 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:57:30.229366 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:30.229654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:30.229925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:30.231737 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:30.249097 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:57:30.251087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:57:30.265723 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4276/8642] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:57:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:57:35.663540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d057d-c283-45f5-b4b3-59fdab751fb1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:35.664033 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d057d-c283-45f5-b4b3-59fdab751fb1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:35.664140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d057d-c283-45f5-b4b3-59fdab751fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:35.681451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fa4d057d-c283-45f5-b4b3-59fdab751fb1 None None] MFA Rules not processed for user `119465233440460aba79a1ff63865c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:57:35.682630 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fa4d057d-c283-45f5-b4b3-59fdab751fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:35.690023 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4367/8643] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:57:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:57:35.994461 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:57:35.995857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:36.010148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5918918-671a-4ed9-b458-8743e4f8988e service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:57:36.021514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:57:36.021514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:36.021514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:36.021514 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:36.021949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:36.028155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:57:36.029599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:57:36.039733 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4277/8644] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:57:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:57:36.461316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e393fb-f765-4d10-b7ad-89c22af06052 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:36.461606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e393fb-f765-4d10-b7ad-89c22af06052 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:36.461891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e393fb-f765-4d10-b7ad-89c22af06052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:36.482041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-63e393fb-f765-4d10-b7ad-89c22af06052 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:57:36.483328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-63e393fb-f765-4d10-b7ad-89c22af06052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:57:36.492228 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4368/8645] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:57:36 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 21:57:36.507437 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:57:36.522624 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70ea48-0d7f-4d22-995b-a6388f819e97 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:57:36.527581 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:57:36.528220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:57:36.528499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:57:36.528807 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:57:36.537775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:57:36.539324 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:57:36.549106 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4278/8646] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:57:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:58:13.489027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e393fb-f765-4d10-b7ad-89c22af06052 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:58:13.501002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e393fb-f765-4d10-b7ad-89c22af06052 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:58:13.504554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:58:13.505278 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:58:13.505556 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:58:13.505824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:58:13.507579 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:58:13.531526 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:58:13.533592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:58:13.544061 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4369/8647] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:58:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:59:25.251480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:59:25.263833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24368bb-25c1-4ab2-9b4f-3c0c784b5f8c service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:59:25.267440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:59:25.268072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:25.268353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:25.268626 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:25.270441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:59:25.308071 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:59:25.311686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:59:25.323592 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4279/8648] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:59:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:59:26.518558 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:59:26.529515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e88b8-46a7-4030-8883-ec4ffa3e737c service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:59:26.533894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efa4e6-095b-4b65-8951-5a14caed4e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:59:26.534529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efa4e6-095b-4b65-8951-5a14caed4e16 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:26.534815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efa4e6-095b-4b65-8951-5a14caed4e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:26.535093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efa4e6-095b-4b65-8951-5a14caed4e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:26.536949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b1efa4e6-095b-4b65-8951-5a14caed4e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:59:26.553628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efa4e6-095b-4b65-8951-5a14caed4e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:59:26.555049 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efa4e6-095b-4b65-8951-5a14caed4e16 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:59:26.568216 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4370/8649] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:59:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:59:36.429528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:59:36.440654 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c488ea-b68b-4567-8639-d7984654523b service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:59:36.444383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac372f-258b-4579-907d-75a8c87d79a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:59:36.445061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac372f-258b-4579-907d-75a8c87d79a6 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:36.445349 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac372f-258b-4579-907d-75a8c87d79a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:36.445629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac372f-258b-4579-907d-75a8c87d79a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:36.447408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-86ac372f-258b-4579-907d-75a8c87d79a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:59:36.459777 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac372f-258b-4579-907d-75a8c87d79a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:59:36.461241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac372f-258b-4579-907d-75a8c87d79a6 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:59:36.471394 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4280/8650] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:59:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 21:59:36.637407 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b8eaa-b671-40fc-8ddf-d21bc4f38b84 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:36.637970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b8eaa-b671-40fc-8ddf-d21bc4f38b84 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:36.638115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b8eaa-b671-40fc-8ddf-d21bc4f38b84 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:36.639984 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4371/8651] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 21:59:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 21:59:36.645601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dca420-7926-4fcc-ad35-fb54312ce286 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:36.645886 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dca420-7926-4fcc-ad35-fb54312ce286 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:36.646157 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dca420-7926-4fcc-ad35-fb54312ce286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:36.674315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b8dca420-7926-4fcc-ad35-fb54312ce286 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:59:36.675527 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b8dca420-7926-4fcc-ad35-fb54312ce286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:59:36.683942 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4281/8652] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 21:59:36 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 21:59:36.707575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b8eaa-b671-40fc-8ddf-d21bc4f38b84 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:59:36.709242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6e5b8eaa-b671-40fc-8ddf-d21bc4f38b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:59:36.727890 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b8eaa-b671-40fc-8ddf-d21bc4f38b84 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:59:36.733168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e544b9a-4b46-43a6-8383-4ff01d060ec7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:59:36.733794 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e544b9a-4b46-43a6-8383-4ff01d060ec7 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:36.734074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e544b9a-4b46-43a6-8383-4ff01d060ec7 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:36.734348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e544b9a-4b46-43a6-8383-4ff01d060ec7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:36.743004 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e544b9a-4b46-43a6-8383-4ff01d060ec7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:59:36.744553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e544b9a-4b46-43a6-8383-4ff01d060ec7 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:59:36.754831 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4372/8653] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:59:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:59:41.659561 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dca420-7926-4fcc-ad35-fb54312ce286 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 21:59:41.671213 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dca420-7926-4fcc-ad35-fb54312ce286 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 21:59:41.675328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 21:59:41.675988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:41.676275 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:41.676587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:41.678720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:59:41.693660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 21:59:41.695914 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 21:59:41.705488 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4282/8654] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 21:59:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 21:59:56.113824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcea599-765c-4cf9-b907-4df522c33902 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 21:59:56.114616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcea599-765c-4cf9-b907-4df522c33902 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 21:59:56.114616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcea599-765c-4cf9-b907-4df522c33902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 21:59:56.132952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fdcea599-765c-4cf9-b907-4df522c33902 None None] MFA Rules not processed for user `119465233440460aba79a1ff63865c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 21:59:56.134153 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fdcea599-765c-4cf9-b907-4df522c33902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 21:59:56.141133 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4373/8655] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 21:59:56 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:00:00.125158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:00:00.143158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c497b-9d69-492a-81a5-608f305b8c0f service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:00:00.149924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:00:00.150709 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:00:00.151053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:00:00.151337 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:00:00.153226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:00:00.170283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:00:00.173120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:00:00.195247 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4283/8656] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:00:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:00:13.390721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcea599-765c-4cf9-b907-4df522c33902 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:00:13.405974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcea599-765c-4cf9-b907-4df522c33902 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:00:13.412097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:00:13.412778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:00:13.418328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:00:13.418328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:00:13.421135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:00:13.422700 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:00:13.432239 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4374/8657] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:00:13 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:00:30.754831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:00:30.768421 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52f296-1f07-4333-857a-e37975f21d02 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:00:30.774248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d3fe1-4e60-4a45-a55e-b19f5f59d4d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:00:30.774885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d3fe1-4e60-4a45-a55e-b19f5f59d4d1 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:00:30.775166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d3fe1-4e60-4a45-a55e-b19f5f59d4d1 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:00:30.775439 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d3fe1-4e60-4a45-a55e-b19f5f59d4d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:00:30.786927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d3fe1-4e60-4a45-a55e-b19f5f59d4d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:00:30.788491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d3fe1-4e60-4a45-a55e-b19f5f59d4d1 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:00:30.800586 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4284/8658] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:00:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:01:36.469311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:01:36.487833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68635cfc-3bac-42d2-9fc6-85ece0b7c8e5 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:01:36.493065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523eab-93bc-4457-bc0e-3e4cff17b736 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:01:36.493717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523eab-93bc-4457-bc0e-3e4cff17b736 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:01:36.494001 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523eab-93bc-4457-bc0e-3e4cff17b736 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:01:36.494276 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523eab-93bc-4457-bc0e-3e4cff17b736 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:01:36.506160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523eab-93bc-4457-bc0e-3e4cff17b736 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:01:36.507732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523eab-93bc-4457-bc0e-3e4cff17b736 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:01:36.524140 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4375/8659] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:01:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:01:46.618600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980091-5616-438d-98d2-1fc66dbd4b1e None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:01:46.619171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980091-5616-438d-98d2-1fc66dbd4b1e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:01:46.619171 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01980091-5616-438d-98d2-1fc66dbd4b1e None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:01:46.620900 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4285/8660] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 22:01:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 22:01:46.626164 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a924e-5034-4576-bc7c-d1916a369eff None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:01:46.631242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a924e-5034-4576-bc7c-d1916a369eff None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:01:46.631242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a924e-5034-4576-bc7c-d1916a369eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:01:46.656528 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-bd8a924e-5034-4576-bc7c-d1916a369eff None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:01:46.657782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-bd8a924e-5034-4576-bc7c-d1916a369eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:01:46.667066 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4376/8661] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:01:46 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:01:46.687849 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980091-5616-438d-98d2-1fc66dbd4b1e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:01:46.703449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01980091-5616-438d-98d2-1fc66dbd4b1e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:01:46.708291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:01:46.709445 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:01:46.709722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:01:46.709994 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:01:46.718341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:01:46.719876 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:01:46.729770 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4286/8662] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:01:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:02:18.352827 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb054c1-16ed-40da-bfe6-a47da67fc8ab None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:02:18.353320 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb054c1-16ed-40da-bfe6-a47da67fc8ab None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:02:18.353554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb054c1-16ed-40da-bfe6-a47da67fc8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:02:18.371500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-dfb054c1-16ed-40da-bfe6-a47da67fc8ab None None] MFA Rules not processed for user `119465233440460aba79a1ff63865c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:02:18.372707 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-dfb054c1-16ed-40da-bfe6-a47da67fc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:02:18.379728 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4377/8663] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:02:18 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:02:18.682389 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:02:18.694021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7e01c-cfe8-4b50-b462-17ff080e7776 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:02:18.697613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:02:18.698242 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:02:18.698524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:02:18.698797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:02:18.700537 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:02:18.712152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:02:18.713610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:02:18.724251 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4287/8664] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:02:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:02:24.845355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb054c1-16ed-40da-bfe6-a47da67fc8ab None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:02:24.859519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb054c1-16ed-40da-bfe6-a47da67fc8ab None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:02:24.865408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51316391-470f-4260-92d3-c499badf13cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:02:24.866046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51316391-470f-4260-92d3-c499badf13cb service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:02:24.866332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51316391-470f-4260-92d3-c499badf13cb service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:02:24.866608 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51316391-470f-4260-92d3-c499badf13cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:02:24.868419 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-51316391-470f-4260-92d3-c499badf13cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:02:24.884171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51316391-470f-4260-92d3-c499badf13cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:02:24.885904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51316391-470f-4260-92d3-c499badf13cb service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:02:24.898476 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4378/8665] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:02:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:02:33.434129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:02:33.450319 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb0da4-95ab-47f2-8a28-58473566cc98 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:02:33.455895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:02:33.456533 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:02:33.456858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:02:33.462585 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:02:33.469719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:02:33.471282 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:02:33.484710 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4288/8666] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:02:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:02:38.434227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297fe42-156f-484b-9a4d-4320d8169042 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:02:38.434828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297fe42-156f-484b-9a4d-4320d8169042 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:02:38.435182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297fe42-156f-484b-9a4d-4320d8169042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:02:38.455988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5297fe42-156f-484b-9a4d-4320d8169042 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:02:38.457267 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5297fe42-156f-484b-9a4d-4320d8169042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:02:38.465977 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4379/8667] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 25 22:02:38 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:02:38.479817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:02:38.494140 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836824-e4ef-4f33-a219-943a7b239e4c service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:02:38.499024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd144743-3fde-463e-8b7f-ac85a0a176fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:02:38.499646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144743-3fde-463e-8b7f-ac85a0a176fa service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:02:38.499928 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144743-3fde-463e-8b7f-ac85a0a176fa service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:02:38.500205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd144743-3fde-463e-8b7f-ac85a0a176fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:02:38.509003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd144743-3fde-463e-8b7f-ac85a0a176fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:02:38.510542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd144743-3fde-463e-8b7f-ac85a0a176fa service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:02:38.519912 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4289/8668] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:02:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:03:34.559891 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2038-de57-41cb-8f16-21c51fd44c50 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:03:34.560500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2038-de57-41cb-8f16-21c51fd44c50 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:03:34.560500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2038-de57-41cb-8f16-21c51fd44c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:03:34.607326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-261e2038-de57-41cb-8f16-21c51fd44c50 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:03:34.609107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-261e2038-de57-41cb-8f16-21c51fd44c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:03:34.617609 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4380/8669] 10.222.0.37 () {58 vars in 1015 bytes} [Sat Dec 25 22:03:34 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:03:34.631034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97c2aa-ee8c-4b31-af2d-4e3e13d45530 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:03:34.631464 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97c2aa-ee8c-4b31-af2d-4e3e13d45530 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:03:34.631577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97c2aa-ee8c-4b31-af2d-4e3e13d45530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:03:34.649794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cd97c2aa-ee8c-4b31-af2d-4e3e13d45530 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:03:34.650969 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cd97c2aa-ee8c-4b31-af2d-4e3e13d45530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:03:34.659540 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4290/8670] 10.222.0.32 () {58 vars in 1057 bytes} [Sat Dec 25 22:03:34 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:03:34.666370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2038-de57-41cb-8f16-21c51fd44c50 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:03:34.676563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2038-de57-41cb-8f16-21c51fd44c50 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:03:34.681815 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:03:34.682457 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:03:34.682738 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:03:34.683013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:03:34.691387 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:03:34.693429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:03:34.702954 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4381/8671] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:03:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:04:17.429864 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5e6-d6f7-407f-b43e-0312a0581317 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:17.430466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5e6-d6f7-407f-b43e-0312a0581317 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:17.430466 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb5e6-d6f7-407f-b43e-0312a0581317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:17.465749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f9dcb5e6-d6f7-407f-b43e-0312a0581317 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:04:17.466942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9dcb5e6-d6f7-407f-b43e-0312a0581317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:04:17.483220 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4291/8672] 10.222.0.32 () {58 vars in 1061 bytes} [Sat Dec 25 22:04:17 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:04:17.489431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:04:17.498393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159aca6-4695-4058-881f-6e0ea0cf5cd8 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:04:17.502012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6be1bf-a60c-426f-adcc-9b09c694f811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:04:17.507854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be1bf-a60c-426f-adcc-9b09c694f811 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:17.507854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be1bf-a60c-426f-adcc-9b09c694f811 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:17.507854 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6be1bf-a60c-426f-adcc-9b09c694f811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:17.512809 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6be1bf-a60c-426f-adcc-9b09c694f811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:04:17.514438 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6be1bf-a60c-426f-adcc-9b09c694f811 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:04:17.525651 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4382/8673] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:04:17 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:04:18.094655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449057-dbd5-42aa-a727-968f89036c80 None None] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:18.094877 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449057-dbd5-42aa-a727-968f89036c80 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:18.095132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449057-dbd5-42aa-a727-968f89036c80 None None] PATH_INFO: `/` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:18.096955 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4292/8674] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 22:04:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 22:04:18.102054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de048ba4-e4f7-4792-a3ad-abb3b1d84667 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:18.105300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de048ba4-e4f7-4792-a3ad-abb3b1d84667 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:18.105300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de048ba4-e4f7-4792-a3ad-abb3b1d84667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:18.121307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-de048ba4-e4f7-4792-a3ad-abb3b1d84667 None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:04:18.122490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-de048ba4-e4f7-4792-a3ad-abb3b1d84667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:04:18.141091 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4383/8675] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:04:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:04:18.161188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453f8cd-59e1-4eb3-9be5-db922e8394eb None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:18.161479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453f8cd-59e1-4eb3-9be5-db922e8394eb None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:18.161784 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453f8cd-59e1-4eb3-9be5-db922e8394eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:18.181109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-d453f8cd-59e1-4eb3-9be5-db922e8394eb None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:04:18.182502 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d453f8cd-59e1-4eb3-9be5-db922e8394eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:04:18.192497 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4293/8676] 10.222.0.32 () {58 vars in 1057 bytes} [Sat Dec 25 22:04:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:04:18.199479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de048ba4-e4f7-4792-a3ad-abb3b1d84667 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:04:18.209946 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de048ba4-e4f7-4792-a3ad-abb3b1d84667 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:04:18.215101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:04:18.215732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:18.216013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:18.216287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:18.224550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:04:18.226146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:04:18.235870 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4384/8677] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:04:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:04:18.513584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453f8cd-59e1-4eb3-9be5-db922e8394eb None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:04:18.523693 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453f8cd-59e1-4eb3-9be5-db922e8394eb None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:04:18.528743 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:04:18.529509 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:18.529792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:18.530069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:18.538924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:04:18.540492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:04:18.550196 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4294/8678] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:04:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:04:27.227250 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:04:27.236623 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c52cd-d518-428d-abc4-2cc8e345814f service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:04:27.240762 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:04:27.241425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:27.241710 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:27.241988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:27.254621 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:04:27.256727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:04:27.279179 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4385/8679] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:04:27 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:04:28.454430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:04:28.463912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801fe62-ef12-4f46-af10-b3e42d148266 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:04:28.467519 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:04:28.468214 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:28.468496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:28.468770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:28.481977 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:04:28.483425 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:04:28.497464 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4295/8680] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:04:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:04:44.290083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:04:44.298908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a9d2-276d-4f85-a18a-a15e5acfc5b6 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:04:44.302503 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:04:44.303131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:04:44.303412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:04:44.303685 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:04:44.314083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:04:44.315578 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:04:44.325960 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4386/8681] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:04:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:00.697867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:00.706266 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90798b-cfa8-4507-95b4-65668afe64d6 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:00.709908 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:00.710541 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:00.710823 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:00.711100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:00.719913 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:00.721352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:00.748734 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4296/8682] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:04.530408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:04.548010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75390ca-f01e-4581-ab41-93e4f869bc18 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:04.553072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:04.554273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:04.554273 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:04.554559 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] PATH_INFO: `/v3/users/119465233440460aba79a1ff63865c6c` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:04.555789 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119465233440460aba79a1ff63865c6c)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:04.557787 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:04.744270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119465233440460aba79a1ff63865c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:04.751323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119465233440460aba79a1ff63865c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:04.763631 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119465233440460aba79a1ff63865c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:04.764348 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119465233440460aba79a1ff63865c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:04.827704 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-cc1c933d-8722-43c2-9e06-b375f3c8d119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119465233440460aba79a1ff63865c6c'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:04.834022 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4387/8683] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:05:04 2021] DELETE /identity/v3/users/119465233440460aba79a1ff63865c6c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:05:05.069262 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:05.079194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf2dfd-93bf-452d-8762-08dc6e5712a8 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:05.135221 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:05.136067 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.136345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.136612 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] PATH_INFO: `/v3/projects/1e594b8d48e948b8ae34d96bebfc2a36` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.137820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e594b8d48e948b8ae34d96bebfc2a36)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:05.143372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:05.230846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e594b8d48e948b8ae34d96bebfc2a36', 'request_id': 'req-3781f439-38c0-4765-9426-e620a83eb4ca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:05.236815 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e594b8d48e948b8ae34d96bebfc2a36', 'request_id': 'req-3781f439-38c0-4765-9426-e620a83eb4ca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:05.316797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e594b8d48e948b8ae34d96bebfc2a36', 'request_id': 'req-3781f439-38c0-4765-9426-e620a83eb4ca'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:05.339009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] The token cache is being invalidate because project 1e594b8d48e948b8ae34d96bebfc2a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:05:05.339297 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:05.339918 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-3781f439-38c0-4765-9426-e620a83eb4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:05.341502 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4297/8684] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:05:05 2021] DELETE /identity/v3/projects/1e594b8d48e948b8ae34d96bebfc2a36 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:05:05.347304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab93c-029d-462a-83d6-5ae79b7cb87f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.347596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab93c-029d-462a-83d6-5ae79b7cb87f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.347879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab93c-029d-462a-83d6-5ae79b7cb87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.397455 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b6dab93c-029d-462a-83d6-5ae79b7cb87f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:05.398956 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b6dab93c-029d-462a-83d6-5ae79b7cb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:05.456733 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4388/8685] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:05.465463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc6613-5aaf-4695-9607-e0510def0fae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.465757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc6613-5aaf-4695-9607-e0510def0fae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.466040 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc6613-5aaf-4695-9607-e0510def0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.484567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-15fc6613-5aaf-4695-9607-e0510def0fae None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:05.485819 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-15fc6613-5aaf-4695-9607-e0510def0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:05.493846 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4298/8686] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:05.498209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab93c-029d-462a-83d6-5ae79b7cb87f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:05.508483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab93c-029d-462a-83d6-5ae79b7cb87f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:05.513108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:05.513760 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.514043 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.514319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.515066 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96733) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 22:05:05.515376 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:05.517026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:05.529205 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4389/8687] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 22:05:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 22:05:05.534254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc6613-5aaf-4695-9607-e0510def0fae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:05.543778 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc6613-5aaf-4695-9607-e0510def0fae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:05.548475 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:05.549155 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.549474 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.549700 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.550413 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:05.552287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:05.646181 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4299/8688] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:05:05 2021] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:05:05.650837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:05.660811 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fd264-0a9e-40b9-a580-0e004abca7a9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:05.714570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:05.715225 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.715505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.715777 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] PATH_INFO: `/v3/users` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.716467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:05.718395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:05.814002 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4390/8689] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:05:05 2021] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:05:05.818055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:05.828752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0af7-e8e1-492c-acba-351446eeb3b2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:05.833577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:05.834224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.835256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.835406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.836118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:05.837746 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:05.847403 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4300/8690] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:05:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:05:05.851316 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:05.861736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a804d0-3798-4755-a9cb-f90bf35c2f0e admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:05.866948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351fb26-a983-4432-aaa8-d83fed654a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:05.867601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351fb26-a983-4432-aaa8-d83fed654a1b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.867892 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351fb26-a983-4432-aaa8-d83fed654a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.868167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351fb26-a983-4432-aaa8-d83fed654a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.868915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351fb26-a983-4432-aaa8-d83fed654a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:05.870511 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351fb26-a983-4432-aaa8-d83fed654a1b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:05.880387 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4391/8691] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:05:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:05:05.885109 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:05.894857 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3d38d-99c7-46c3-9fac-359c6f49aa1e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:05.900816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:05.900816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:05.900816 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:05.901191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] PATH_INFO: `/v3/projects/8dc9c763cc31441a9b4a70ec405bbc23/users/faa994a3fd5b460883d775a94a52783a/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:05.916251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc9c763cc31441a9b4a70ec405bbc23, user_id=faa994a3fd5b460883d775a94a52783a, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:05.918959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:06.012865 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4301/8692] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:05:05 2021] PUT /identity/v3/projects/8dc9c763cc31441a9b4a70ec405bbc23/users/faa994a3fd5b460883d775a94a52783a/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:05:06.018079 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586acc9-bde2-4380-9b66-839290523f85 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:06.018374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586acc9-bde2-4380-9b66-839290523f85 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:06.018654 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586acc9-bde2-4380-9b66-839290523f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:06.037068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6586acc9-bde2-4380-9b66-839290523f85 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:06.038270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6586acc9-bde2-4380-9b66-839290523f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:06.097152 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4392/8693] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:06.107300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:06.109017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:06.164628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d061f-7959-487d-b353-10212b495142 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:06.168247 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02288329-6b72-4ee3-b71d-ac57fc6cf675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:06.168893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288329-6b72-4ee3-b71d-ac57fc6cf675 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:06.169193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288329-6b72-4ee3-b71d-ac57fc6cf675 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:06.169468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288329-6b72-4ee3-b71d-ac57fc6cf675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:06.178794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02288329-6b72-4ee3-b71d-ac57fc6cf675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:06.180195 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02288329-6b72-4ee3-b71d-ac57fc6cf675 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:06.189739 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4302/8694] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:07.411634 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016108-1e94-4b39-b697-c169e50d967d None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:07.412193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016108-1e94-4b39-b697-c169e50d967d None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:07.413124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016108-1e94-4b39-b697-c169e50d967d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:07.442379 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-74016108-1e94-4b39-b697-c169e50d967d None None] MFA Rules not processed for user `faa994a3fd5b460883d775a94a52783a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:07.443591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-74016108-1e94-4b39-b697-c169e50d967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:07.508093 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4393/8695] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:07 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:07.517966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd1af-84d4-4657-94c1-9e20afa7dd63 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:07.518443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd1af-84d4-4657-94c1-9e20afa7dd63 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:07.518548 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd1af-84d4-4657-94c1-9e20afa7dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:07.535074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f44cd1af-84d4-4657-94c1-9e20afa7dd63 None None] MFA Rules not processed for user `faa994a3fd5b460883d775a94a52783a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:07.536317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f44cd1af-84d4-4657-94c1-9e20afa7dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:07.543209 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4303/8696] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:07 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:07.559141 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ca4e7-6960-48c4-8600-4917c537a16c None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:07.559726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ca4e7-6960-48c4-8600-4917c537a16c None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:07.559726 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ca4e7-6960-48c4-8600-4917c537a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:07.596403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-104ca4e7-6960-48c4-8600-4917c537a16c None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:07.597638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-104ca4e7-6960-48c4-8600-4917c537a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:07.661952 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4394/8697] 10.222.0.32 () {58 vars in 1058 bytes} [Sat Dec 25 22:05:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:07.669610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd1af-84d4-4657-94c1-9e20afa7dd63 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:07.682941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd1af-84d4-4657-94c1-9e20afa7dd63 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:07.688347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825232e5-4713-440b-aed9-6f7771fd1175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:07.689042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825232e5-4713-440b-aed9-6f7771fd1175 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:07.689272 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825232e5-4713-440b-aed9-6f7771fd1175 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:07.689544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825232e5-4713-440b-aed9-6f7771fd1175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:07.697761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825232e5-4713-440b-aed9-6f7771fd1175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:07.699315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825232e5-4713-440b-aed9-6f7771fd1175 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:07.707899 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4304/8698] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:07 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:07.733331 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc21d09-fad2-483e-a2c0-b4c0651f411e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:07.733622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc21d09-fad2-483e-a2c0-b4c0651f411e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:07.733902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc21d09-fad2-483e-a2c0-b4c0651f411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:07.752356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-4dc21d09-fad2-483e-a2c0-b4c0651f411e None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:07.753566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-4dc21d09-fad2-483e-a2c0-b4c0651f411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:07.763506 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4395/8699] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:05:07 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:07.775673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3c29-ad37-466f-a8a9-0a693c37a86d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:07.775964 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3c29-ad37-466f-a8a9-0a693c37a86d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:07.776263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a3c29-ad37-466f-a8a9-0a693c37a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:07.827898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ef5a3c29-ad37-466f-a8a9-0a693c37a86d None None] MFA Rules not processed for user `94e4b61a62d24f6c9274c0f46d514656`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:07.829136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ef5a3c29-ad37-466f-a8a9-0a693c37a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:07.887160 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4305/8700] 10.222.0.32 () {58 vars in 1059 bytes} [Sat Dec 25 22:05:07 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:07.893601 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc21d09-fad2-483e-a2c0-b4c0651f411e None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:07.902553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc21d09-fad2-483e-a2c0-b4c0651f411e None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:07.906247 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087ba61-e02a-4d16-86a4-cb61ab65b104 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:07.906878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087ba61-e02a-4d16-86a4-cb61ab65b104 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:07.907158 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087ba61-e02a-4d16-86a4-cb61ab65b104 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:07.907432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087ba61-e02a-4d16-86a4-cb61ab65b104 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:07.917877 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087ba61-e02a-4d16-86a4-cb61ab65b104 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:07.919310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087ba61-e02a-4d16-86a4-cb61ab65b104 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:07.930439 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4396/8701] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:09.535665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d603-4dd9-4868-8952-bb0f9f6a3e4a None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:09.536184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d603-4dd9-4868-8952-bb0f9f6a3e4a None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:09.536184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131d603-4dd9-4868-8952-bb0f9f6a3e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:09.554022 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1131d603-4dd9-4868-8952-bb0f9f6a3e4a None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:09.555220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1131d603-4dd9-4868-8952-bb0f9f6a3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:09.564768 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4306/8702] 10.222.0.32 () {58 vars in 1058 bytes} [Sat Dec 25 22:05:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:09.571429 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:09.571928 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:09.572050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:09.590606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:09.591796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:09.601681 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4397/8703] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:05:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:09.613182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131d603-4dd9-4868-8952-bb0f9f6a3e4a None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:09.622921 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131d603-4dd9-4868-8952-bb0f9f6a3e4a None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:09.626500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:09.627128 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:09.627404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:09.627675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:09.641752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:09.643203 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:09.653975 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4307/8704] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:10.540662 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:10.542114 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:10.609313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9891-c824-45ae-808f-011898a7fb42 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:10.614366 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3a4a-641a-4c03-891f-a1b76fa61615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:10.615008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3a4a-641a-4c03-891f-a1b76fa61615 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:10.615293 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3a4a-641a-4c03-891f-a1b76fa61615 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:10.615569 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3a4a-641a-4c03-891f-a1b76fa61615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:10.617340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0a4a3a4a-641a-4c03-891f-a1b76fa61615 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:10.628342 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a3a4a-641a-4c03-891f-a1b76fa61615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:10.629937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a3a4a-641a-4c03-891f-a1b76fa61615 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:10.639495 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4398/8705] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:17.373480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:17.385163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f6cbd-a685-448c-9a88-b06762ab959a service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:17.391710 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:17.392542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:17.393134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:17.396348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:17.396348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:17.413277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:17.416094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:17.432924 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4308/8706] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:24.223358 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8c91-f64c-4b57-87eb-a83cfc56aa4b None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:24.223920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8c91-f64c-4b57-87eb-a83cfc56aa4b None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:24.223920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8c91-f64c-4b57-87eb-a83cfc56aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:24.244562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0b2d8c91-f64c-4b57-87eb-a83cfc56aa4b None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:24.245805 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b2d8c91-f64c-4b57-87eb-a83cfc56aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:24.252548 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4399/8707] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Dec 25 22:05:24 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:24.266821 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:24.276310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bf8a3-84b1-4ec9-81b7-64389afd66f6 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:24.280007 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319134d6-a693-43b4-9c0c-8164f4cb52dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:24.280641 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319134d6-a693-43b4-9c0c-8164f4cb52dd service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:24.280952 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319134d6-a693-43b4-9c0c-8164f4cb52dd service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:24.281360 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319134d6-a693-43b4-9c0c-8164f4cb52dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:24.289087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319134d6-a693-43b4-9c0c-8164f4cb52dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:24.290500 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319134d6-a693-43b4-9c0c-8164f4cb52dd service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:24.298131 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4309/8708] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:26.838101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686b2d-7aea-49be-a69d-a680f4ba4362 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:26.840006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686b2d-7aea-49be-a69d-a680f4ba4362 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:26.840006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1686b2d-7aea-49be-a69d-a680f4ba4362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:26.856764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-e1686b2d-7aea-49be-a69d-a680f4ba4362 None None] MFA Rules not processed for user `faa994a3fd5b460883d775a94a52783a`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:26.858018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e1686b2d-7aea-49be-a69d-a680f4ba4362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:26.864852 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4400/8709] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:26 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:38.355844 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15acfa4-f000-488a-a74d-6a846e753f4f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:38.356393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15acfa4-f000-488a-a74d-6a846e753f4f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:38.356393 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15acfa4-f000-488a-a74d-6a846e753f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:38.374291 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-b15acfa4-f000-488a-a74d-6a846e753f4f None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:38.375480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b15acfa4-f000-488a-a74d-6a846e753f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:38.385168 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4310/8710] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:05:38 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:38.398202 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686b2d-7aea-49be-a69d-a680f4ba4362 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:38.411422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1686b2d-7aea-49be-a69d-a680f4ba4362 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:38.418616 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:38.419252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:38.419536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:38.419812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:38.432736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:38.435411 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:38.445675 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4401/8711] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:42.724590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430282d-2d16-4358-b18c-4ae042226e41 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:42.725175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430282d-2d16-4358-b18c-4ae042226e41 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:42.725175 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430282d-2d16-4358-b18c-4ae042226e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:42.744758 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-7430282d-2d16-4358-b18c-4ae042226e41 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:42.746143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7430282d-2d16-4358-b18c-4ae042226e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:42.755720 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4311/8712] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:05:42 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:42.768062 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:42.780340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b085116-528d-486a-abc3-5cde8f7e3c19 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:42.785937 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:42.786688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:42.787013 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:42.787290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:42.798912 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:42.802392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:42.812388 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4402/8713] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:05:49.621374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430282d-2d16-4358-b18c-4ae042226e41 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:49.633625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430282d-2d16-4358-b18c-4ae042226e41 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:49.639926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:49.639926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:49.640847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:49.640847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] PATH_INFO: `/v3/users/faa994a3fd5b460883d775a94a52783a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:49.642255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa994a3fd5b460883d775a94a52783a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:49.644740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:49.849211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa994a3fd5b460883d775a94a52783a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:49.856101 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa994a3fd5b460883d775a94a52783a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:49.867335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa994a3fd5b460883d775a94a52783a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:49.868006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa994a3fd5b460883d775a94a52783a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:49.868608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5acee994-ee46-45a1-b0d4-64c73ac3b03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa994a3fd5b460883d775a94a52783a'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:49.945514 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4312/8714] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:05:49 2021] DELETE /identity/v3/users/faa994a3fd5b460883d775a94a52783a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:05:50.188050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:50.205530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717054d-ad62-4a50-a496-5edb69f04dd9 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:50.263145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:50.264027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.264301 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.264568 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] PATH_INFO: `/v3/projects/8dc9c763cc31441a9b4a70ec405bbc23` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.265784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc9c763cc31441a9b4a70ec405bbc23)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:50.267667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:50.401497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc9c763cc31441a9b4a70ec405bbc23', 'request_id': 'req-b8c75e04-c3b0-4f78-a509-d2088ce42266'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:50.465027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc9c763cc31441a9b4a70ec405bbc23', 'request_id': 'req-b8c75e04-c3b0-4f78-a509-d2088ce42266'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:50.471740 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc9c763cc31441a9b4a70ec405bbc23', 'request_id': 'req-b8c75e04-c3b0-4f78-a509-d2088ce42266'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:50.482729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] The token cache is being invalidate because project 8dc9c763cc31441a9b4a70ec405bbc23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:05:50.483034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:50.483661 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b8c75e04-c3b0-4f78-a509-d2088ce42266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:05:50.485244 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4403/8715] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:05:50 2021] DELETE /identity/v3/projects/8dc9c763cc31441a9b4a70ec405bbc23 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:05:50.491678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458082b-64a9-4596-b34d-3c48f6774944 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.491971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458082b-64a9-4596-b34d-3c48f6774944 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.492253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458082b-64a9-4596-b34d-3c48f6774944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.510243 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-6458082b-64a9-4596-b34d-3c48f6774944 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:50.511450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6458082b-64a9-4596-b34d-3c48f6774944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:50.569282 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4313/8716] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:50.577375 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d78d-a341-4e66-9ad8-a0ef779cb9d3 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.577658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d78d-a341-4e66-9ad8-a0ef779cb9d3 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.577929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d78d-a341-4e66-9ad8-a0ef779cb9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.596096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-10b1d78d-a341-4e66-9ad8-a0ef779cb9d3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:50.597383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-10b1d78d-a341-4e66-9ad8-a0ef779cb9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:50.606417 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4404/8717] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:50.610568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458082b-64a9-4596-b34d-3c48f6774944 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:50.620820 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458082b-64a9-4596-b34d-3c48f6774944 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:50.625479 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:50.626126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.626407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.626678 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.627404 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 22:05:50.627712 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:50.629335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:50.640522 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4314/8718] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 22:05:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 22:05:50.644720 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1d78d-a341-4e66-9ad8-a0ef779cb9d3 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:50.654021 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1d78d-a341-4e66-9ad8-a0ef779cb9d3 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:50.659046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:50.659699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.660008 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.660284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.661014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:50.662963 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:50.747112 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4405/8719] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:05:50 2021] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 22:05:50.751935 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:50.761316 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4209b2-6365-4fb4-a800-3f65d48935aa admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:50.815166 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:50.815832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.816120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.816429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.817190 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:50.819138 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:50.900363 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4315/8720] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:05:50 2021] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:05:50.904947 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:50.915454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3610-2efd-4a7c-9e14-c11a45d4d49b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:50.920984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:50.921642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.921925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.922207 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.922972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:50.924588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:50.935031 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4406/8721] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:05:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:05:50.939050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:50.949126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe86c-2966-453f-a560-788d54a642b1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:50.953800 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25504481-ceb4-4b33-8f64-60e3469702ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:50.954455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25504481-ceb4-4b33-8f64-60e3469702ad admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.954741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25504481-ceb4-4b33-8f64-60e3469702ad admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.955017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25504481-ceb4-4b33-8f64-60e3469702ad admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:50.955744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25504481-ceb4-4b33-8f64-60e3469702ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:50.960920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25504481-ceb4-4b33-8f64-60e3469702ad admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:50.967860 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4316/8722] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:05:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:05:50.971925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:50.982817 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7181e4-4210-44f3-a6db-e7f38fd69813 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:50.987381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:50.988244 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:50.988519 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:50.988790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] PATH_INFO: `/v3/projects/713c72669335418fac39775d2bc8bc3d/users/55d0711693b54bdb87fb3dc7c54a452e/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:51.002843 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] RBAC: Authorizing `identity:create_grant(project_id=713c72669335418fac39775d2bc8bc3d, user_id=55d0711693b54bdb87fb3dc7c54a452e, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:51.005446 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:51.094849 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4407/8723] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:05:50 2021] PUT /identity/v3/projects/713c72669335418fac39775d2bc8bc3d/users/55d0711693b54bdb87fb3dc7c54a452e/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:05:51.106372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7a610-0a56-4616-8a2a-4bebed909110 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:51.106666 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7a610-0a56-4616-8a2a-4bebed909110 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:51.106950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7a610-0a56-4616-8a2a-4bebed909110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:51.132546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-0ff7a610-0a56-4616-8a2a-4bebed909110 None None] MFA Rules not processed for user `55d0711693b54bdb87fb3dc7c54a452e`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:05:51.133775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0ff7a610-0a56-4616-8a2a-4bebed909110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:51.195347 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4317/8724] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:05:51 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:05:51.206104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:05:51.207792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:05:51.262818 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dc3cd-d2d2-42f7-9dbc-95096550365c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:05:51.266383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cacf-3d0f-46f7-a009-5088e9c6bdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:05:51.267018 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cacf-3d0f-46f7-a009-5088e9c6bdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:05:51.267299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cacf-3d0f-46f7-a009-5088e9c6bdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:05:51.267573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cacf-3d0f-46f7-a009-5088e9c6bdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:05:51.275691 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cacf-3d0f-46f7-a009-5088e9c6bdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:05:51.277725 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cacf-3d0f-46f7-a009-5088e9c6bdb2 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:05:51.286335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4408/8725] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:05:51 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:06:08.226118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7a610-0a56-4616-8a2a-4bebed909110 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:08.286896 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7a610-0a56-4616-8a2a-4bebed909110 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:08.291419 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:08.292286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:08.292572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:08.292850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] PATH_INFO: `/v3/users/55d0711693b54bdb87fb3dc7c54a452e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:08.294076 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d0711693b54bdb87fb3dc7c54a452e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:08.295978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:08.496945 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d0711693b54bdb87fb3dc7c54a452e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:08.504053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d0711693b54bdb87fb3dc7c54a452e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:08.515545 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d0711693b54bdb87fb3dc7c54a452e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:08.516614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d0711693b54bdb87fb3dc7c54a452e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:08.519496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d0711693b54bdb87fb3dc7c54a452e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:08.602850 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4318/8726] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:06:08 2021] DELETE /identity/v3/users/55d0711693b54bdb87fb3dc7c54a452e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:06:08.607986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:08.608466 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:08.608591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:08.627364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:08.628670 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:08.686335 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4409/8727] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:08.696840 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:08.698398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:08.754665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba8602-9832-4ef8-afe3-2c802d28f5af admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:08.758426 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fde156-9ec8-4d9c-8318-7e9637373d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:08.759207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fde156-9ec8-4d9c-8318-7e9637373d40 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:08.759491 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fde156-9ec8-4d9c-8318-7e9637373d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:08.759765 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fde156-9ec8-4d9c-8318-7e9637373d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:08.768805 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fde156-9ec8-4d9c-8318-7e9637373d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:08.770284 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fde156-9ec8-4d9c-8318-7e9637373d40 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:08.780056 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4319/8728] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:06:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:06:09.033420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:09.034847 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:09.047799 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453a822-3d45-4b03-93bb-3db95cecf262 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:09.052575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:09.053470 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.053749 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.057900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] PATH_INFO: `/v3/projects/713c72669335418fac39775d2bc8bc3d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.057900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713c72669335418fac39775d2bc8bc3d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:09.057900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:09.183136 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713c72669335418fac39775d2bc8bc3d', 'request_id': 'req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:09.264107 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713c72669335418fac39775d2bc8bc3d', 'request_id': 'req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:09.270369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713c72669335418fac39775d2bc8bc3d', 'request_id': 'req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:09.280856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] The token cache is being invalidate because project 713c72669335418fac39775d2bc8bc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:06:09.281170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:09.281784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-904dc4fb-dbc0-42b2-bea6-09a0e8507bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:09.283338 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4410/8729] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:06:09 2021] DELETE /identity/v3/projects/713c72669335418fac39775d2bc8bc3d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:06:09.289429 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f78e07-1451-4c95-b18f-efe5d9fc3d2e None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.289926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f78e07-1451-4c95-b18f-efe5d9fc3d2e None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.290059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f78e07-1451-4c95-b18f-efe5d9fc3d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.307505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-68f78e07-1451-4c95-b18f-efe5d9fc3d2e None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:09.308702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-68f78e07-1451-4c95-b18f-efe5d9fc3d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:09.365890 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4320/8730] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:09.373861 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2d4c-b1f7-4117-9bc3-6d925fdf7aa0 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.374148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2d4c-b1f7-4117-9bc3-6d925fdf7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.374422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2d4c-b1f7-4117-9bc3-6d925fdf7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.392804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f79d2d4c-b1f7-4117-9bc3-6d925fdf7aa0 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:09.394019 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f79d2d4c-b1f7-4117-9bc3-6d925fdf7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:09.402557 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4411/8731] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:09.406802 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f78e07-1451-4c95-b18f-efe5d9fc3d2e None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:09.416482 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f78e07-1451-4c95-b18f-efe5d9fc3d2e None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:09.421019 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:09.421688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.421966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.422280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.422997 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 22:06:09.423298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:09.424867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:09.436083 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4321/8732] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 22:06:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 22:06:09.440242 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d2d4c-b1f7-4117-9bc3-6d925fdf7aa0 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:09.450259 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d2d4c-b1f7-4117-9bc3-6d925fdf7aa0 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:09.455183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:09.455830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.456108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.456381 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.457137 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:09.459146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:09.574897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4412/8733] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:06:09 2021] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:06:09.578822 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:09.588762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c63a3-3b0f-4699-81c8-0b0ca4a6f161 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:09.644346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:09.645113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.645322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.645595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.646286 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:09.648253 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:09.740019 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4322/8734] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:06:09 2021] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:06:09.744134 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:09.755744 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e48bb-5302-420b-8562-f723ab0bc562 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:09.760454 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:09.761147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.762059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.762340 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.763070 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:09.764658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:09.775918 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4413/8735] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:06:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:06:09.779988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:09.790005 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c9015-5d6b-4bc7-8d06-3243515154a1 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:09.794834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965face-d623-4121-a2ce-8d8c14a3b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:09.795476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965face-d623-4121-a2ce-8d8c14a3b0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.795755 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965face-d623-4121-a2ce-8d8c14a3b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.796029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965face-d623-4121-a2ce-8d8c14a3b0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.796749 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965face-d623-4121-a2ce-8d8c14a3b0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:09.798342 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965face-d623-4121-a2ce-8d8c14a3b0e9 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:09.807909 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4323/8736] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:06:09 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:06:09.812255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:09.822017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac8295-27d1-497b-ab2f-9506b916aee9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:09.827180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:09.828037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.828312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.828581 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] PATH_INFO: `/v3/projects/b6d372ce30e444d3b11ed384c53e71f9/users/150952cada594c79bf9a06e5c08c4255/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.842504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d372ce30e444d3b11ed384c53e71f9, user_id=150952cada594c79bf9a06e5c08c4255, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:09.845162 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:09.909593 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4414/8737] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:06:09 2021] PUT /identity/v3/projects/b6d372ce30e444d3b11ed384c53e71f9/users/150952cada594c79bf9a06e5c08c4255/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:06:09.919736 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975aa95-4e64-4e0d-bad8-c75c0bbdbfae None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:09.920050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975aa95-4e64-4e0d-bad8-c75c0bbdbfae None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:09.920329 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975aa95-4e64-4e0d-bad8-c75c0bbdbfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:09.946766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8975aa95-4e64-4e0d-bad8-c75c0bbdbfae None None] MFA Rules not processed for user `150952cada594c79bf9a06e5c08c4255`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:09.947959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8975aa95-4e64-4e0d-bad8-c75c0bbdbfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:10.009518 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4324/8738] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:09 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:10.019765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:10.021549 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:10.076602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b6d3-96c5-4a8d-80d8-83e5246a6567 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:10.080287 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900384-07ce-460f-a178-c636451d7a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:10.082599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900384-07ce-460f-a178-c636451d7a58 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:10.082599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900384-07ce-460f-a178-c636451d7a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:10.082599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900384-07ce-460f-a178-c636451d7a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:10.090399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1900384-07ce-460f-a178-c636451d7a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:10.091822 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1900384-07ce-460f-a178-c636451d7a58 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:10.100540 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4415/8739] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:06:10 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:06:16.129006 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975aa95-4e64-4e0d-bad8-c75c0bbdbfae None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:16.188859 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975aa95-4e64-4e0d-bad8-c75c0bbdbfae None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:16.193353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:16.194212 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:16.194485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:16.194750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] PATH_INFO: `/v3/users/150952cada594c79bf9a06e5c08c4255` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:16.195916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=150952cada594c79bf9a06e5c08c4255)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:16.197837 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:16.346377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150952cada594c79bf9a06e5c08c4255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:16.353415 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150952cada594c79bf9a06e5c08c4255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:16.364988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150952cada594c79bf9a06e5c08c4255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:16.365660 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150952cada594c79bf9a06e5c08c4255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:16.366252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150952cada594c79bf9a06e5c08c4255'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:16.435774 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4325/8740] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:06:16 2021] DELETE /identity/v3/users/150952cada594c79bf9a06e5c08c4255 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:06:16.440252 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:16.440728 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:16.440941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:16.459048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:16.460239 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:16.521858 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4416/8741] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:16.532039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:16.533770 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:16.598434 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e4f7-4c27-48fc-b525-baa70e3bf87d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:16.602829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651b1ac-3b39-459d-80be-26d31902f253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:16.603510 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651b1ac-3b39-459d-80be-26d31902f253 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:16.603793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651b1ac-3b39-459d-80be-26d31902f253 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:16.604103 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651b1ac-3b39-459d-80be-26d31902f253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:16.614638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651b1ac-3b39-459d-80be-26d31902f253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:16.616129 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651b1ac-3b39-459d-80be-26d31902f253 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:16.626784 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4326/8742] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:06:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:06:16.889271 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:16.890790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:16.903367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28774b70-66fc-4d5b-9649-a4237c8b23bb None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:16.908248 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:16.909213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:16.909497 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:16.910147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] PATH_INFO: `/v3/projects/b6d372ce30e444d3b11ed384c53e71f9` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:16.911036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d372ce30e444d3b11ed384c53e71f9)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:16.913005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.023962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d372ce30e444d3b11ed384c53e71f9', 'request_id': 'req-453fcab8-6b51-4bf5-9a78-8700403ab4b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:17.104002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d372ce30e444d3b11ed384c53e71f9', 'request_id': 'req-453fcab8-6b51-4bf5-9a78-8700403ab4b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:17.111589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d372ce30e444d3b11ed384c53e71f9', 'request_id': 'req-453fcab8-6b51-4bf5-9a78-8700403ab4b4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:17.121444 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] The token cache is being invalidate because project b6d372ce30e444d3b11ed384c53e71f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:06:17.121723 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:17.122367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-453fcab8-6b51-4bf5-9a78-8700403ab4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:06:17.123935 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4417/8743] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:06:16 2021] DELETE /identity/v3/projects/b6d372ce30e444d3b11ed384c53e71f9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:06:17.131074 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4eff-158c-4db8-a25a-b9fa4470b702 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.131568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4eff-158c-4db8-a25a-b9fa4470b702 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.131688 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4eff-158c-4db8-a25a-b9fa4470b702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.148927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9c3e4eff-158c-4db8-a25a-b9fa4470b702 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:17.150146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9c3e4eff-158c-4db8-a25a-b9fa4470b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:17.207083 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4327/8744] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:17.215139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f524-2f82-423b-98a0-588873ba5c95 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.215422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f524-2f82-423b-98a0-588873ba5c95 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.215695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896f524-2f82-423b-98a0-588873ba5c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.234899 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-d896f524-2f82-423b-98a0-588873ba5c95 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:17.236093 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d896f524-2f82-423b-98a0-588873ba5c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:17.243981 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4418/8745] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:17.248516 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4eff-158c-4db8-a25a-b9fa4470b702 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:17.258164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4eff-158c-4db8-a25a-b9fa4470b702 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:17.262689 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:17.263355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.263677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.263955 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.264675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 22:06:17.265017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:17.266620 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.278150 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4328/8746] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 22:06:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 22:06:17.282195 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896f524-2f82-423b-98a0-588873ba5c95 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:17.291403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896f524-2f82-423b-98a0-588873ba5c95 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:17.296763 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:17.297435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.297719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.297995 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.298688 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:17.300562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.382785 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4419/8747] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:06:17 2021] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:06:17.387160 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:17.396927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308ed8-8a2e-47a5-ab69-3f4f55dc37ae admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:17.452374 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:17.453124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.453409 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.453682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.454375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:17.456263 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.550831 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4329/8748] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:06:17 2021] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 22:06:17.554747 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:17.565311 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd45dff-359f-4782-9698-325841f85c04 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:17.569939 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:17.570588 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.570871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.571148 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.571876 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:17.574005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.584161 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4420/8749] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:06:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:06:17.592264 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:17.602619 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261f5f6-e3e1-43f9-a560-d40aa0bedc30 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:17.607314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e753e-0b8c-48c0-a200-79ad09067732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:17.607984 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e753e-0b8c-48c0-a200-79ad09067732 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.608293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e753e-0b8c-48c0-a200-79ad09067732 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.608568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e753e-0b8c-48c0-a200-79ad09067732 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.609338 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e753e-0b8c-48c0-a200-79ad09067732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:17.610898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e753e-0b8c-48c0-a200-79ad09067732 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.620542 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4330/8750] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:06:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:06:17.624546 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:17.634318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d6d3c-a0de-404a-9a31-565071adeecb admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:17.639425 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:17.640290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.640595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.640849 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] PATH_INFO: `/v3/projects/29cc4c1ab18949cf9fcd5658c1535162/users/102a4e79336a4125ab08f043bfb262c7/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.655532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cc4c1ab18949cf9fcd5658c1535162, user_id=102a4e79336a4125ab08f043bfb262c7, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:17.660005 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.777118 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4421/8751] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:06:17 2021] PUT /identity/v3/projects/29cc4c1ab18949cf9fcd5658c1535162/users/102a4e79336a4125ab08f043bfb262c7/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:06:17.781123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0180-a1b3-481e-aac7-076205b5859f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.781451 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0180-a1b3-481e-aac7-076205b5859f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.781685 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0180-a1b3-481e-aac7-076205b5859f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.799663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-559b0180-a1b3-481e-aac7-076205b5859f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:17.801020 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-559b0180-a1b3-481e-aac7-076205b5859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:17.858474 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4331/8752] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 22:06:17.868436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:17.870881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:17.929198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda9ca6-1ff1-45aa-bb68-766793912331 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:17.933462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:17.934098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:17.934378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:17.934653 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:17.944071 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:17.945547 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:17.957413 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4422/8753] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:06:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:06:22.712148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144ea17-9848-45c2-9b20-8ca9b3908934 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:22.713056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144ea17-9848-45c2-9b20-8ca9b3908934 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:22.713336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144ea17-9848-45c2-9b20-8ca9b3908934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:22.743708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9144ea17-9848-45c2-9b20-8ca9b3908934 None None] MFA Rules not processed for user `102a4e79336a4125ab08f043bfb262c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:22.745186 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9144ea17-9848-45c2-9b20-8ca9b3908934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:22.839945 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4332/8754] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:22 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:22.844518 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:22.855077 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d348e-c75d-412d-bbc8-7d80b5187ebb service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:22.859825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:22.860482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:22.860792 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:22.861108 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:22.861800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:22.863706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:22.959883 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4423/8755] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:06:22 2021] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:06:22.963753 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144ea17-9848-45c2-9b20-8ca9b3908934 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:22.975622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144ea17-9848-45c2-9b20-8ca9b3908934 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:23.033790 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:23.034472 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:23.034752 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:23.035021 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:23.035713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:23.037663 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:23.131518 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4333/8756] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:06:22 2021] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 22:06:23.132833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:23.144724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec09e08-f5bc-4c90-b2a3-97ea18bb2983 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:23.151280 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:23.152100 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:23.152482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:23.152863 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:23.153768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:23.155475 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:23.167504 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4424/8757] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:06:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:06:23.170824 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:23.181408 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233d4b3-9709-435b-b540-64d7da660d3c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:23.187290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:23.188193 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:23.188481 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:23.188757 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] PATH_INFO: `/v3/projects/b8f09c6ccf6845fcb71851b99a23ebcf/users/b9a2ae81c7ec4bdcb181033b5509b92b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:23.214879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f09c6ccf6845fcb71851b99a23ebcf, user_id=b9a2ae81c7ec4bdcb181033b5509b92b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:23.222158 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:23.288590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4334/8758] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:06:23 2021] PUT /identity/v3/projects/b8f09c6ccf6845fcb71851b99a23ebcf/users/b9a2ae81c7ec4bdcb181033b5509b92b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 22:06:23.292566 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:23.303307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ccf2b-564f-4279-9704-d5f55a92e9a9 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:23.364595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c8e00-2609-4595-a7a1-463665989d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:23.365302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c8e00-2609-4595-a7a1-463665989d02 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:23.365586 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c8e00-2609-4595-a7a1-463665989d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:23.365866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c8e00-2609-4595-a7a1-463665989d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:23.366596 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c8e00-2609-4595-a7a1-463665989d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:23.368288 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c8e00-2609-4595-a7a1-463665989d02 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:23.379375 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4425/8759] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:06:23 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:06:23.383450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:23.394090 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a97693-132a-49e1-b18c-22501ca236b6 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:23.398764 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:23.399986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:23.400134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:23.400355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] PATH_INFO: `/v3/projects/b8f09c6ccf6845fcb71851b99a23ebcf/users/b9a2ae81c7ec4bdcb181033b5509b92b/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:23.402456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f09c6ccf6845fcb71851b99a23ebcf, user_id=b9a2ae81c7ec4bdcb181033b5509b92b, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:23.405116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:23.415654 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4335/8760] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:06:23 2021] PUT /identity/v3/projects/b8f09c6ccf6845fcb71851b99a23ebcf/users/b9a2ae81c7ec4bdcb181033b5509b92b/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:06:29.071889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684df6e-6542-4610-8947-1afa62401c47 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:29.072374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684df6e-6542-4610-8947-1afa62401c47 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:29.072643 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684df6e-6542-4610-8947-1afa62401c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:29.100436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-b684df6e-6542-4610-8947-1afa62401c47 None None] MFA Rules not processed for user `b9a2ae81c7ec4bdcb181033b5509b92b`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:29.101767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-b684df6e-6542-4610-8947-1afa62401c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:29.180244 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4426/8761] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:29 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:29.202332 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:29.204062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:29.262851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c623b5-c096-4772-9b1b-9c698ffd3b21 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:29.266610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78217cba-63ac-4291-a0d4-246eeae1d299 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:29.267258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217cba-63ac-4291-a0d4-246eeae1d299 service glance] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:29.267542 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217cba-63ac-4291-a0d4-246eeae1d299 service glance] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:29.267817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78217cba-63ac-4291-a0d4-246eeae1d299 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:29.332442 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78217cba-63ac-4291-a0d4-246eeae1d299 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:29.333941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78217cba-63ac-4291-a0d4-246eeae1d299 service glance] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:29.348735 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4336/8762] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:06:29 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:06:29.651117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63c27-8580-4968-b501-8439e96e96b1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:29.651117 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63c27-8580-4968-b501-8439e96e96b1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:29.651408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63c27-8580-4968-b501-8439e96e96b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:29.714211 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-45b63c27-8580-4968-b501-8439e96e96b1 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:29.715483 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-45b63c27-8580-4968-b501-8439e96e96b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:29.803983 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4427/8763] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:06:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:29.948646 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e324-26e8-4351-a454-716bb736ed16 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:29.949037 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e324-26e8-4351-a454-716bb736ed16 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:29.949383 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e324-26e8-4351-a454-716bb736ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:30.004968 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4d05e324-26e8-4351-a454-716bb736ed16 None None] MFA Rules not processed for user `eea4089e93f04fc5893b3e86954ead79`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:30.006187 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4d05e324-26e8-4351-a454-716bb736ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:30.079740 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4337/8764] 10.222.0.32 () {58 vars in 1039 bytes} [Sat Dec 25 22:06:29 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:30.086490 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63c27-8580-4968-b501-8439e96e96b1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:30.099534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63c27-8580-4968-b501-8439e96e96b1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:30.105180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70f33c-8ad1-4e82-8be2-9b5cb8f6f25b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:30.105768 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f33c-8ad1-4e82-8be2-9b5cb8f6f25b service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:30.110353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f33c-8ad1-4e82-8be2-9b5cb8f6f25b service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:30.110353 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70f33c-8ad1-4e82-8be2-9b5cb8f6f25b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:30.115378 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70f33c-8ad1-4e82-8be2-9b5cb8f6f25b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:30.117067 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70f33c-8ad1-4e82-8be2-9b5cb8f6f25b service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:30.126469 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4428/8765] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:06:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:06:41.456967 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d614f-e921-4958-abf4-1a153aacd7ea None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:41.461809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d614f-e921-4958-abf4-1a153aacd7ea None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:41.461809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d614f-e921-4958-abf4-1a153aacd7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:41.475850 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f31d614f-e921-4958-abf4-1a153aacd7ea None None] MFA Rules not processed for user `102a4e79336a4125ab08f043bfb262c7`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:41.477377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f31d614f-e921-4958-abf4-1a153aacd7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:41.484724 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4338/8766] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:06:41 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:41.741073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9f20-7ae3-480b-894e-646e6b29f0b5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:41.741673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9f20-7ae3-480b-894e-646e6b29f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:41.741673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af9f20-7ae3-480b-894e-646e6b29f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:41.759482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-38af9f20-7ae3-480b-894e-646e6b29f0b5 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:41.760730 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-38af9f20-7ae3-480b-894e-646e6b29f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:41.811470 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4429/8767] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:06:41 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:41.823771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d614f-e921-4958-abf4-1a153aacd7ea None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:41.833121 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d614f-e921-4958-abf4-1a153aacd7ea None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:41.836839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:41.837506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:41.837789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:41.838064 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:41.846870 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:41.848333 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:41.857324 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4339/8768] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:06:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:06:44.948054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dbc44-a5ed-4f53-bb19-194d65d7f867 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:44.949383 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dbc44-a5ed-4f53-bb19-194d65d7f867 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:44.949894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dbc44-a5ed-4f53-bb19-194d65d7f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:44.978374 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-261dbc44-a5ed-4f53-bb19-194d65d7f867 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:06:44.979592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-261dbc44-a5ed-4f53-bb19-194d65d7f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:06:44.987778 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4430/8769] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:06:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:06:45.001547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:06:45.014110 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8e8a3-dce4-4dd4-bfb4-8cb005cd8f39 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:06:45.019124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:06:45.019761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:06:45.020044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:06:45.020320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:06:45.028719 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:06:45.030966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:06:45.039232 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4340/8770] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:06:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:07:11.260632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dbc44-a5ed-4f53-bb19-194d65d7f867 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:07:11.269894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dbc44-a5ed-4f53-bb19-194d65d7f867 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:07:11.273462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6193599-40b7-4e64-a776-f39f8a33ed1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:07:11.274115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193599-40b7-4e64-a776-f39f8a33ed1a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:07:11.274395 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193599-40b7-4e64-a776-f39f8a33ed1a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:07:11.274694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6193599-40b7-4e64-a776-f39f8a33ed1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:07:11.283773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6193599-40b7-4e64-a776-f39f8a33ed1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:07:11.285299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6193599-40b7-4e64-a776-f39f8a33ed1a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:07:11.294695 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4431/8771] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:07:11 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:07:43.433511 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:07:43.434980 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:07:43.546323 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e0677-90ea-4002-a44a-9ee4e85b7e7a service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:07:43.552118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:07:43.552788 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:07:43.553120 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:07:43.553397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:07:43.555184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:07:43.566851 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:07:43.568407 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:07:43.577949 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4341/8772] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:07:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:08:39.511482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9062f-bd75-4bbe-9546-f8ee17b45ca5 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:39.512003 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9062f-bd75-4bbe-9546-f8ee17b45ca5 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:39.512115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9062f-bd75-4bbe-9546-f8ee17b45ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:39.530367 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-42e9062f-bd75-4bbe-9546-f8ee17b45ca5 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:08:39.531552 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-42e9062f-bd75-4bbe-9546-f8ee17b45ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:39.538806 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4432/8773] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 22:08:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:08:39.579396 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:39.594023 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bc4d8-46b1-4b03-94c0-7b3d77d061fc service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:39.595457 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:39.596087 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:39.596369 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:39.596644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:39.604897 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:39.606480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:39.615590 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4342/8774] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:08:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:08:43.710554 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9062f-bd75-4bbe-9546-f8ee17b45ca5 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:43.725274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9062f-bd75-4bbe-9546-f8ee17b45ca5 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:43.730369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:43.731168 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:43.731458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:43.731745 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:43.733788 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:43.747230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:43.749146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:43.765620 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4433/8775] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:08:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:08:48.501609 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:48.563002 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a71a27-95e9-4ca9-8111-1c2da8743ec2 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:48.570239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:48.570239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:48.570239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:48.570239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] PATH_INFO: `/v3/users/102a4e79336a4125ab08f043bfb262c7` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:48.570673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=102a4e79336a4125ab08f043bfb262c7)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:48.572412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:48.805440 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102a4e79336a4125ab08f043bfb262c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:48.812126 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102a4e79336a4125ab08f043bfb262c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:48.825173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102a4e79336a4125ab08f043bfb262c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:48.825173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102a4e79336a4125ab08f043bfb262c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:48.825173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102a4e79336a4125ab08f043bfb262c7'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:48.908953 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4343/8776] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:08:48 2021] DELETE /identity/v3/users/102a4e79336a4125ab08f043bfb262c7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:08:49.140599 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:49.151834 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b8d9e-3434-4d3b-ad27-c3a5e578ff0d service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:49.209140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:49.210015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:49.210297 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:49.210574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] PATH_INFO: `/v3/projects/29cc4c1ab18949cf9fcd5658c1535162` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:49.211796 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cc4c1ab18949cf9fcd5658c1535162)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:49.213839 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:49.327246 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cc4c1ab18949cf9fcd5658c1535162', 'request_id': 'req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.395960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cc4c1ab18949cf9fcd5658c1535162', 'request_id': 'req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.402028 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cc4c1ab18949cf9fcd5658c1535162', 'request_id': 'req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.411866 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] The token cache is being invalidate because project 29cc4c1ab18949cf9fcd5658c1535162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:08:49.418619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.418619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.418619 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4434/8777] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:08:49 2021] DELETE /identity/v3/projects/29cc4c1ab18949cf9fcd5658c1535162 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:08:49.418948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:49.419885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:49.433394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834bdbf-2e43-4fde-9146-eb5c3d11a1eb admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:49.487767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:49.488623 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:49.488924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:49.489200 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] PATH_INFO: `/v3/users/b9a2ae81c7ec4bdcb181033b5509b92b` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:49.490400 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a2ae81c7ec4bdcb181033b5509b92b)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:49.492300 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:49.696988 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a2ae81c7ec4bdcb181033b5509b92b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.703694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a2ae81c7ec4bdcb181033b5509b92b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.715614 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a2ae81c7ec4bdcb181033b5509b92b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.719134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a2ae81c7ec4bdcb181033b5509b92b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.719134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-bf37d16b-8682-4a73-9f6d-27516651a579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a2ae81c7ec4bdcb181033b5509b92b'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:49.815530 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4344/8778] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:08:49 2021] DELETE /identity/v3/users/b9a2ae81c7ec4bdcb181033b5509b92b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:08:50.028539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:50.030046 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:50.046775 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c7e4d-8b33-4349-a16c-49fcbe9cc54f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:50.104445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:50.105410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.105696 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.105974 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] PATH_INFO: `/v3/projects/b8f09c6ccf6845fcb71851b99a23ebcf` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.107213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f09c6ccf6845fcb71851b99a23ebcf)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:50.109238 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:50.195333 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f09c6ccf6845fcb71851b99a23ebcf', 'request_id': 'req-b9965015-e6d0-4587-a4ff-4130beab48e4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:50.272514 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f09c6ccf6845fcb71851b99a23ebcf', 'request_id': 'req-b9965015-e6d0-4587-a4ff-4130beab48e4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:50.279035 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f09c6ccf6845fcb71851b99a23ebcf', 'request_id': 'req-b9965015-e6d0-4587-a4ff-4130beab48e4'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:50.289042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] The token cache is being invalidate because project b8f09c6ccf6845fcb71851b99a23ebcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:08:50.289330 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:50.289958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-b9965015-e6d0-4587-a4ff-4130beab48e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:08:50.291526 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4435/8779] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:08:50 2021] DELETE /identity/v3/projects/b8f09c6ccf6845fcb71851b99a23ebcf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:08:50.297529 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185c42e-0102-476c-a609-06ca845014b1 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.299267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185c42e-0102-476c-a609-06ca845014b1 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.299267 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185c42e-0102-476c-a609-06ca845014b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.315775 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1185c42e-0102-476c-a609-06ca845014b1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:08:50.317645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1185c42e-0102-476c-a609-06ca845014b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:50.374571 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4345/8780] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:08:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:08:50.382338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76690401-3e1f-41c3-bd01-e4bde3758db9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.382627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76690401-3e1f-41c3-bd01-e4bde3758db9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.382906 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76690401-3e1f-41c3-bd01-e4bde3758db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.400766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-76690401-3e1f-41c3-bd01-e4bde3758db9 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:08:50.402052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-76690401-3e1f-41c3-bd01-e4bde3758db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:50.410398 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4436/8781] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:08:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:08:50.414388 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185c42e-0102-476c-a609-06ca845014b1 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:50.423779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185c42e-0102-476c-a609-06ca845014b1 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:50.428989 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:50.429629 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.429905 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.430177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.430903 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 22:08:50.431207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:50.432774 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:50.444628 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4346/8782] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 22:08:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 22:08:50.448472 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76690401-3e1f-41c3-bd01-e4bde3758db9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:50.457563 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76690401-3e1f-41c3-bd01-e4bde3758db9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:50.462170 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:50.462800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.463081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.463356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.464037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:50.465968 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:50.587803 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4437/8783] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:08:50 2021] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:08:50.591884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:50.602825 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e0547-e881-438a-9121-ec3631e13264 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:50.657252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:50.657916 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.658194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.658467 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.659142 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:50.661622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:50.745138 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4347/8784] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:08:50 2021] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:08:50.749336 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:50.759819 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85e1b-aa43-4ba5-b14a-44973f1ecdbd admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:50.764538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:50.765222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.765500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.765771 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.766529 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:50.768091 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:50.778770 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4438/8785] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:08:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 22:08:50.782622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:50.793283 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5d1e2-1af5-43b5-b1c3-41d9b72e979c admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:50.797976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b848c36-359f-4097-a668-357efac5deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:50.798625 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848c36-359f-4097-a668-357efac5deee admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.798909 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848c36-359f-4097-a668-357efac5deee admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.799191 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848c36-359f-4097-a668-357efac5deee admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.799920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b848c36-359f-4097-a668-357efac5deee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:50.801534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b848c36-359f-4097-a668-357efac5deee admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:50.811253 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4348/8786] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:08:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:08:50.815204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:50.825037 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecfb31-2ead-483b-a367-21e5ed65de14 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:50.829613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:50.830471 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.830753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.831027 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] PATH_INFO: `/v3/projects/252f592e72984919a30b8248c35228f7/users/cbd356d161184383bdcc6fb37232ca64/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.845397 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252f592e72984919a30b8248c35228f7, user_id=cbd356d161184383bdcc6fb37232ca64, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:50.848833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:50.921322 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4439/8787] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:08:50 2021] PUT /identity/v3/projects/252f592e72984919a30b8248c35228f7/users/cbd356d161184383bdcc6fb37232ca64/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:08:50.932188 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a73c-6913-49fb-a3fc-010cc71a517c None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:50.932513 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a73c-6913-49fb-a3fc-010cc71a517c None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:50.932792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a73c-6913-49fb-a3fc-010cc71a517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:50.961027 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-8de7a73c-6913-49fb-a3fc-010cc71a517c None None] MFA Rules not processed for user `cbd356d161184383bdcc6fb37232ca64`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:08:50.962239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8de7a73c-6913-49fb-a3fc-010cc71a517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:51.025410 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4349/8788] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:08:50 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 22:08:51.029816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:51.091991 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99adb0-d1c0-4fe9-a0c9-b86d6fce5fd5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:51.096600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:51.098089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.098369 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.098641 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.099341 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:51.101255 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:51.179523 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4440/8789] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:08:51 2021] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:08:51.183595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a73c-6913-49fb-a3fc-010cc71a517c None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:51.195069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a73c-6913-49fb-a3fc-010cc71a517c None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:51.248420 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:51.249112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.249397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.249674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.250378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:51.252296 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:51.346825 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4350/8790] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:08:51 2021] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:08:51.350983 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:51.361920 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b056da8-a4b3-4ff7-b99b-88974b1bc095 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:51.366893 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:51.371803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.371803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.371803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.371803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:51.371803 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:51.381642 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4441/8791] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:08:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:08:51.385773 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:51.396233 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859fc7-9108-4d05-8a19-a1898cf3b665 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:51.400832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:51.401731 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.402010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.402285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] PATH_INFO: `/v3/projects/ccfad4ec989e4df58239c73ab142be53/users/cf8960d6aa6a4614b6db2c24d34516fb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.418100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfad4ec989e4df58239c73ab142be53, user_id=cf8960d6aa6a4614b6db2c24d34516fb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:51.420887 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:51.487009 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4351/8792] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:08:51 2021] PUT /identity/v3/projects/ccfad4ec989e4df58239c73ab142be53/users/cf8960d6aa6a4614b6db2c24d34516fb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:08:51.497467 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:51.507921 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c55627-a157-4cfd-82fb-ffec9b9e504f admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:51.560296 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4296c-0b25-4ad7-9c95-7a881c775775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:51.560970 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4296c-0b25-4ad7-9c95-7a881c775775 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.561251 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4296c-0b25-4ad7-9c95-7a881c775775 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.561521 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4296c-0b25-4ad7-9c95-7a881c775775 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.562228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4296c-0b25-4ad7-9c95-7a881c775775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:51.563806 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4296c-0b25-4ad7-9c95-7a881c775775 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:51.573653 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4442/8793] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:08:51 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:08:51.577809 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:51.588320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63ef8-0e67-4106-a98b-e0aa1e3d70d2 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:51.593011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:51.593879 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.594169 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.594443 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] PATH_INFO: `/v3/projects/ccfad4ec989e4df58239c73ab142be53/users/cf8960d6aa6a4614b6db2c24d34516fb/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.596416 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfad4ec989e4df58239c73ab142be53, user_id=cf8960d6aa6a4614b6db2c24d34516fb, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:51.599930 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:51.609760 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4352/8794] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:08:51 2021] PUT /identity/v3/projects/ccfad4ec989e4df58239c73ab142be53/users/cf8960d6aa6a4614b6db2c24d34516fb/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 22:08:51.619192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.619479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.619754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.646193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] MFA Rules not processed for user `cf8960d6aa6a4614b6db2c24d34516fb`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:08:51.647393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:51.712566 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4443/8795] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:08:51 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:08:51.725055 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:51.726750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:51.797334 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81514089-a946-4836-a6fe-954d38bae523 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:51.803028 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90c785-57a1-4d74-a787-e5d9830c2493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:51.803664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90c785-57a1-4d74-a787-e5d9830c2493 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:51.803948 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90c785-57a1-4d74-a787-e5d9830c2493 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:51.804220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90c785-57a1-4d74-a787-e5d9830c2493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:51.857922 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90c785-57a1-4d74-a787-e5d9830c2493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:51.859418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90c785-57a1-4d74-a787-e5d9830c2493 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:51.868194 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4353/8796] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:08:51 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:08:57.268675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:08:57.270900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:08:57.337988 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b429-1a22-4bcd-9753-11473c175202 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:08:57.341609 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb141ca0-a539-485c-bf93-7de5578eb14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:08:57.342230 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb141ca0-a539-485c-bf93-7de5578eb14f service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:08:57.342508 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb141ca0-a539-485c-bf93-7de5578eb14f service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:08:57.342781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb141ca0-a539-485c-bf93-7de5578eb14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:08:57.352041 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb141ca0-a539-485c-bf93-7de5578eb14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:08:57.353506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb141ca0-a539-485c-bf93-7de5578eb14f service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:08:57.363186 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4444/8797] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:08:57 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:09:00.694546 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:09:00.694979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:09:00.695122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:09:00.712592 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] MFA Rules not processed for user `cbd356d161184383bdcc6fb37232ca64`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:09:00.713884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:09:00.726690 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4354/8798] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:09:00 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:09:58.579932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10586d-6c87-4887-be60-8729eaad1252 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:09:58.580480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10586d-6c87-4887-be60-8729eaad1252 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:09:58.580480 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10586d-6c87-4887-be60-8729eaad1252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:09:58.627913 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2b10586d-6c87-4887-be60-8729eaad1252 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:09:58.632422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2b10586d-6c87-4887-be60-8729eaad1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:09:58.647331 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4445/8799] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:09:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:09:58.660962 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:09:58.666702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:09:58.679034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05984d28-0b03-4739-b0aa-1fb77bec3af2 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:09:58.685483 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f3c70-74c0-4bff-ab3a-ca6a41875926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:09:58.686073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3c70-74c0-4bff-ab3a-ca6a41875926 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:09:58.686358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3c70-74c0-4bff-ab3a-ca6a41875926 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:09:58.687255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f3c70-74c0-4bff-ab3a-ca6a41875926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:09:58.705123 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3c70-74c0-4bff-ab3a-ca6a41875926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:09:58.707741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f3c70-74c0-4bff-ab3a-ca6a41875926 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:09:58.725402 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4355/8800] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:09:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:10:14.572109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b230ab-d9c9-4c9c-ab40-3f92967fb997 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:14.573210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b230ab-d9c9-4c9c-ab40-3f92967fb997 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:14.573351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b230ab-d9c9-4c9c-ab40-3f92967fb997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:14.595401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-f1b230ab-d9c9-4c9c-ab40-3f92967fb997 None None] MFA Rules not processed for user `cbd356d161184383bdcc6fb37232ca64`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:10:14.597210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f1b230ab-d9c9-4c9c-ab40-3f92967fb997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:14.611608 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4446/8801] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:10:14 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:10:14.657682 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53258c-0d68-4997-bc7c-8bbea3a23fa5 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:14.658227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53258c-0d68-4997-bc7c-8bbea3a23fa5 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:14.658227 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53258c-0d68-4997-bc7c-8bbea3a23fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:14.689738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-fd53258c-0d68-4997-bc7c-8bbea3a23fa5 None None] MFA Rules not processed for user `94e4b61a62d24f6c9274c0f46d514656`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:10:14.691251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fd53258c-0d68-4997-bc7c-8bbea3a23fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:14.773233 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4356/8802] 10.222.0.32 () {58 vars in 1059 bytes} [Sat Dec 25 22:10:14 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:10:14.777285 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b230ab-d9c9-4c9c-ab40-3f92967fb997 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:10:14.792101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b230ab-d9c9-4c9c-ab40-3f92967fb997 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:10:14.796304 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:10:14.797186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:14.797451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:14.797795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:14.800076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:14.821676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:10:14.824774 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:10:14.837153 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4447/8803] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:10:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:10:15.171449 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:15.171738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:15.172044 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:15.192401 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:10:15.193686 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:15.200736 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4357/8804] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:10:15 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 22:10:15.214000 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:10:15.216083 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:15.228307 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371507-b36e-4ba6-be24-285375e19949 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:10:15.233227 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:10:15.234059 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:15.234465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:15.234838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:15.243463 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:10:15.245065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:10:15.257394 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4448/8805] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:10:15 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:10:16.688277 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:10:16.689727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:16.709147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:10:16.719002 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91601c09-c6a8-4352-a72e-bbc20855922d service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:10:16.724234 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:10:16.724897 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:16.725183 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:16.725642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:16.727502 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:16.741400 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:10:16.742825 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:10:16.754517 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4449/8806] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:10:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:10:16.775787 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac565b-e278-40bc-b9a7-a97e274f8dc4 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:10:16.781327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:10:16.782180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:16.782463 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:16.782740 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:16.784675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:16.801011 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:10:16.802763 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:10:16.819094 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4358/8807] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:10:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:10:27.909597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:10:27.918335 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dfb67-1b53-4a2d-96d0-37458106c04e service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:10:27.922155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701d697-ab67-4ccd-a688-13737d992f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:10:27.922795 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701d697-ab67-4ccd-a688-13737d992f76 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:10:27.923074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701d697-ab67-4ccd-a688-13737d992f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:10:27.923343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701d697-ab67-4ccd-a688-13737d992f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:10:27.925155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6701d697-ab67-4ccd-a688-13737d992f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:10:27.934865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701d697-ab67-4ccd-a688-13737d992f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:10:27.940689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701d697-ab67-4ccd-a688-13737d992f76 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:10:27.947490 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4450/8808] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:10:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:11:52.164694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:11:52.177839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e12ee-6dc5-4395-9778-4ccd5a8c203f service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:11:52.184204 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:11:52.184965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:11:52.185321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:11:52.185665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:11:52.189299 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:11:52.202901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:11:52.204471 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:11:52.215798 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4359/8809] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:11:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:12:08.610453 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b53b1-34ac-4670-9347-c0022fb73381 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:08.611319 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b53b1-34ac-4670-9347-c0022fb73381 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:08.611602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b53b1-34ac-4670-9347-c0022fb73381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:08.632724 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5b3b53b1-34ac-4670-9347-c0022fb73381 None None] MFA Rules not processed for user `cbd356d161184383bdcc6fb37232ca64`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:12:08.633871 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5b3b53b1-34ac-4670-9347-c0022fb73381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:12:08.641837 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4451/8810] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:12:08 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:12:09.470375 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:12:09.472480 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:12:09.501065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e273d6c-fa61-49f5-b123-87c83a1bc227 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:12:09.507508 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:12:09.508180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:09.508465 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:09.508742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:09.510610 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:12:09.523248 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:12:09.524830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:12:09.534798 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4360/8811] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:12:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:12:20.474098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b53b1-34ac-4670-9347-c0022fb73381 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:12:20.486860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b53b1-34ac-4670-9347-c0022fb73381 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:12:20.493235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42a78c-49af-48ce-82be-b18801196157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:12:20.493874 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a78c-49af-48ce-82be-b18801196157 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:20.494151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a78c-49af-48ce-82be-b18801196157 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:20.494423 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42a78c-49af-48ce-82be-b18801196157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:20.496133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-7c42a78c-49af-48ce-82be-b18801196157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:12:20.509036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42a78c-49af-48ce-82be-b18801196157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:12:20.510639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42a78c-49af-48ce-82be-b18801196157 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:12:20.521952 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4452/8812] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:12:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:12:47.449240 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:12:47.459986 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e4b09-b18a-45fc-9d9e-07b639bcf72b service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:12:47.465073 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:12:47.465701 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:47.465983 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:47.466254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:47.468231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:12:47.480238 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:12:47.481839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:12:47.491362 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4361/8813] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:12:47 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:12:53.102452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83918-6c0b-460e-9fa4-6bf2adb85c75 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:53.102975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83918-6c0b-460e-9fa4-6bf2adb85c75 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:53.103290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac83918-6c0b-460e-9fa4-6bf2adb85c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:53.121300 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-0ac83918-6c0b-460e-9fa4-6bf2adb85c75 None None] MFA Rules not processed for user `043f47597a6b4368afbad7be8a7f40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:12:53.122574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-0ac83918-6c0b-460e-9fa4-6bf2adb85c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:12:53.129904 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4453/8814] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:12:53 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:12:53.142224 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:12:53.151911 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc00e7-6206-40bc-93c7-39ef161787ff service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:12:53.155476 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c77876-5dbd-4f3d-ad22-5a65cfdb1061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:12:53.156102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c77876-5dbd-4f3d-ad22-5a65cfdb1061 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:53.156379 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c77876-5dbd-4f3d-ad22-5a65cfdb1061 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:53.156653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c77876-5dbd-4f3d-ad22-5a65cfdb1061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:53.163559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c77876-5dbd-4f3d-ad22-5a65cfdb1061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:12:53.164999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c77876-5dbd-4f3d-ad22-5a65cfdb1061 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:12:53.172661 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4362/8815] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:12:53 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:12:53.344790 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd97e-ae01-4dd3-bef8-763400e8e3f7 None None] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:53.350298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd97e-ae01-4dd3-bef8-763400e8e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:53.350298 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffd97e-ae01-4dd3-bef8-763400e8e3f7 None None] PATH_INFO: `/` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:53.350298 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4454/8816] 10.222.0.32 () {54 vars in 921 bytes} [Sat Dec 25 22:12:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 25 22:12:53.352317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53becc-e1ec-4253-a043-1ab3d7e54c0f None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:53.352611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53becc-e1ec-4253-a043-1ab3d7e54c0f None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:53.352924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53becc-e1ec-4253-a043-1ab3d7e54c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:53.371578 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-ac53becc-e1ec-4253-a043-1ab3d7e54c0f None None] MFA Rules not processed for user `79c9077ed07144bdb0149dd6be7d134a`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:12:53.372762 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac53becc-e1ec-4253-a043-1ab3d7e54c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:12:53.382105 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4363/8817] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:12:53 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:12:53.402232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffd97e-ae01-4dd3-bef8-763400e8e3f7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:12:53.415505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffd97e-ae01-4dd3-bef8-763400e8e3f7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:12:53.420398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:12:53.421068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:12:53.421349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:12:53.421632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:12:53.430257 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:12:53.431816 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:12:53.441348 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4455/8818] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:12:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:13:46.716012 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53becc-e1ec-4253-a043-1ab3d7e54c0f None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:13:46.726838 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53becc-e1ec-4253-a043-1ab3d7e54c0f None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:13:46.732054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965e1a9-1d57-4503-9573-ee25cba855f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:13:46.732697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965e1a9-1d57-4503-9573-ee25cba855f5 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:13:46.733124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965e1a9-1d57-4503-9573-ee25cba855f5 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:13:46.733403 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965e1a9-1d57-4503-9573-ee25cba855f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:13:46.735153 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9965e1a9-1d57-4503-9573-ee25cba855f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:13:46.747506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965e1a9-1d57-4503-9573-ee25cba855f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:13:46.749255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965e1a9-1d57-4503-9573-ee25cba855f5 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:13:46.760136 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4364/8819] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:13:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:13:51.617144 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:13:51.626364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdd5ad-cbb3-4794-a4fa-b6920cce1053 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:13:51.630582 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:13:51.631299 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:13:51.631648 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:13:51.631929 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:13:51.640627 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:13:51.642591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:13:51.651630 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4456/8820] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:13:51 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:13:59.061444 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def084a-1a13-4f14-83fd-4722bc101bf0 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:13:59.061938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def084a-1a13-4f14-83fd-4722bc101bf0 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:13:59.062148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def084a-1a13-4f14-83fd-4722bc101bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:13:59.081889 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5def084a-1a13-4f14-83fd-4722bc101bf0 None None] MFA Rules not processed for user `cbd356d161184383bdcc6fb37232ca64`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:13:59.083182 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5def084a-1a13-4f14-83fd-4722bc101bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:13:59.090574 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4365/8821] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:13:59 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:13:59.442614 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:13:59.452384 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ade9e-458b-435a-b49d-bd7a35269482 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:13:59.456629 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:13:59.457322 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:13:59.457605 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:13:59.457878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:13:59.460216 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:13:59.471560 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:13:59.473126 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:13:59.482810 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4457/8822] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:13:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:14:10.683269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def084a-1a13-4f14-83fd-4722bc101bf0 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:14:10.693645 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def084a-1a13-4f14-83fd-4722bc101bf0 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:14:10.697290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:14:10.697936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:14:10.698218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:14:10.698492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:14:10.707560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:14:10.709003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:14:10.718645 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4366/8823] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:14:10 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:15:25.576090 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:15:25.596150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bcb99-1ae9-43c1-acaa-123676a47ff7 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:15:25.600036 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cd6a0-87f8-42a2-976a-ad2839344986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:15:25.600695 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cd6a0-87f8-42a2-976a-ad2839344986 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:15:25.601025 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cd6a0-87f8-42a2-976a-ad2839344986 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:15:25.601303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cd6a0-87f8-42a2-976a-ad2839344986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:15:25.611902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cd6a0-87f8-42a2-976a-ad2839344986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:15:25.613416 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cd6a0-87f8-42a2-976a-ad2839344986 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:15:25.635192 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4458/8824] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:15:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:15:26.866979 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:15:26.884580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41186f0e-5201-4db1-ab10-f7942c713000 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:15:26.888108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:15:26.888732 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:15:26.889043 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:15:26.889315 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:15:26.899806 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:15:26.901265 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:15:26.912720 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4367/8825] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:15:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:15:41.325198 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26782fbb-c11e-4953-8da3-a85f8921d6cc None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:15:41.325702 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26782fbb-c11e-4953-8da3-a85f8921d6cc None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:15:41.325952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26782fbb-c11e-4953-8da3-a85f8921d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:15:41.344160 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-26782fbb-c11e-4953-8da3-a85f8921d6cc None None] MFA Rules not processed for user `cbd356d161184383bdcc6fb37232ca64`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:15:41.345732 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-26782fbb-c11e-4953-8da3-a85f8921d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:15:41.354056 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4459/8826] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:15:41 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:15:41.688843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:15:41.701201 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9312fe9-6a66-4156-8220-acc2847a381d service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:15:41.705280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:15:41.705938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:15:41.706217 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:15:41.706524 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:15:41.715845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:15:41.717354 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:15:41.733095 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4368/8827] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:15:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:15:42.140118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26782fbb-c11e-4953-8da3-a85f8921d6cc None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:15:42.166836 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26782fbb-c11e-4953-8da3-a85f8921d6cc None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:15:42.173778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:15:42.174881 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:15:42.175392 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:15:42.175860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:15:42.186719 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:15:42.188773 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:15:42.226450 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4460/8828] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:15:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:15:45.120116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:15:45.129004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663140-7e53-46d6-b939-c6375f1345fc service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:15:45.135181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:15:45.135839 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:15:45.136122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:15:45.136398 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:15:45.147298 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:15:45.148748 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:15:45.157796 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4369/8829] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:15:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:15:56.224139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:15:56.237150 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d18507-3e81-4298-8547-e700207ac346 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:15:56.242959 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff60061-fc04-4036-bcfe-056a73d10155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:15:56.243600 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60061-fc04-4036-bcfe-056a73d10155 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:15:56.243878 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60061-fc04-4036-bcfe-056a73d10155 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:15:56.244147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff60061-fc04-4036-bcfe-056a73d10155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:15:56.254174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff60061-fc04-4036-bcfe-056a73d10155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:15:56.255733 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff60061-fc04-4036-bcfe-056a73d10155 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:15:56.266916 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4461/8830] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:15:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:16:39.070936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:39.149901 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd02b-5a5a-4642-8a5e-7e819f931f27 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:39.154499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:39.155359 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:39.155638 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:39.155906 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] PATH_INFO: `/v3/users/cbd356d161184383bdcc6fb37232ca64` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:39.157133 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd356d161184383bdcc6fb37232ca64)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:39.159094 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:39.299829 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd356d161184383bdcc6fb37232ca64'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:39.306653 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd356d161184383bdcc6fb37232ca64'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:39.317917 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd356d161184383bdcc6fb37232ca64'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:39.318599 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd356d161184383bdcc6fb37232ca64'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:39.319220 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd356d161184383bdcc6fb37232ca64'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:39.399986 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4370/8831] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:16:39 2021] DELETE /identity/v3/users/cbd356d161184383bdcc6fb37232ca64 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:16:39.408302 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:39.408769 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:39.408904 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:39.446505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:16:39.447689 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:39.502884 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4462/8832] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:16:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:16:39.512595 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:39.514050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:39.568976 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6592bb-e594-49cb-ae1c-9a111a0e49dc admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:39.572572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:39.573251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:39.573534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:39.573810 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:39.583180 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:39.584601 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:39.594190 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4371/8833] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:16:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:16:39.813146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:39.814658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:39.826727 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d94ff-569c-45e3-b55a-669251713c45 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:39.831405 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:39.832315 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:39.832593 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:39.832867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] PATH_INFO: `/v3/projects/252f592e72984919a30b8248c35228f7` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:39.834115 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252f592e72984919a30b8248c35228f7)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:39.836009 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:39.942754 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252f592e72984919a30b8248c35228f7', 'request_id': 'req-9340b1de-300c-498c-ab53-0b6a83d40778'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.017347 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252f592e72984919a30b8248c35228f7', 'request_id': 'req-9340b1de-300c-498c-ab53-0b6a83d40778'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.024399 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252f592e72984919a30b8248c35228f7', 'request_id': 'req-9340b1de-300c-498c-ab53-0b6a83d40778'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.034318 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] The token cache is being invalidate because project 252f592e72984919a30b8248c35228f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:16:40.034597 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.035778 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.037419 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4463/8834] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:16:39 2021] DELETE /identity/v3/projects/252f592e72984919a30b8248c35228f7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:16:40.041460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:40.051083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b024d6-e392-47ae-a172-95eab9df24a7 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:40.107435 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:40.108223 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:40.108501 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:40.108767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] PATH_INFO: `/v3/users/cf8960d6aa6a4614b6db2c24d34516fb` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:40.110039 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8960d6aa6a4614b6db2c24d34516fb)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:40.111933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:40.293898 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8960d6aa6a4614b6db2c24d34516fb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.300723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8960d6aa6a4614b6db2c24d34516fb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.312029 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8960d6aa6a4614b6db2c24d34516fb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.312703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8960d6aa6a4614b6db2c24d34516fb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.313341 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-5093d62d-5098-43f7-a919-15121fe39158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8960d6aa6a4614b6db2c24d34516fb'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:40.400278 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4372/8835] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:16:40 2021] DELETE /identity/v3/users/cf8960d6aa6a4614b6db2c24d34516fb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:16:40.808113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:40.809589 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:40.824948 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b1de-300c-498c-ab53-0b6a83d40778 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:40.881972 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:40.882860 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:40.883139 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:40.883436 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] PATH_INFO: `/v3/projects/ccfad4ec989e4df58239c73ab142be53` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:40.888750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfad4ec989e4df58239c73ab142be53)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:40.890708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.001099 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfad4ec989e4df58239c73ab142be53', 'request_id': 'req-9617088d-1f5d-49e0-873a-fa78912f80c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:41.068226 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfad4ec989e4df58239c73ab142be53', 'request_id': 'req-9617088d-1f5d-49e0-873a-fa78912f80c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:41.074619 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfad4ec989e4df58239c73ab142be53', 'request_id': 'req-9617088d-1f5d-49e0-873a-fa78912f80c9'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:41.085034 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] The token cache is being invalidate because project ccfad4ec989e4df58239c73ab142be53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:16:41.085326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:41.085952 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-9617088d-1f5d-49e0-873a-fa78912f80c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:16:41.087503 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4464/8836] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:16:40 2021] DELETE /identity/v3/projects/ccfad4ec989e4df58239c73ab142be53 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:16:41.094269 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f9d4c-74f8-452f-9224-a4872fbfd406 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.094558 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f9d4c-74f8-452f-9224-a4872fbfd406 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.094834 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f9d4c-74f8-452f-9224-a4872fbfd406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.132096 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e82f9d4c-74f8-452f-9224-a4872fbfd406 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:16:41.133322 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e82f9d4c-74f8-452f-9224-a4872fbfd406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:41.190463 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4373/8837] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:16:41.199209 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d91d-efc2-478b-9eb3-2fab42f5a7a1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.199491 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d91d-efc2-478b-9eb3-2fab42f5a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.199767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3d91d-efc2-478b-9eb3-2fab42f5a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.217889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-9dd3d91d-efc2-478b-9eb3-2fab42f5a7a1 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:16:41.219015 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-9dd3d91d-efc2-478b-9eb3-2fab42f5a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:41.227674 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4465/8838] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:16:41.231779 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f9d4c-74f8-452f-9224-a4872fbfd406 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:41.242117 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f9d4c-74f8-452f-9224-a4872fbfd406 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:41.246858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:41.247534 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.247812 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.248086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.248832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 22:16:41.249270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:41.250884 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.262231 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4374/8839] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 22:16:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 22:16:41.270676 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d91d-efc2-478b-9eb3-2fab42f5a7a1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:41.279925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3d91d-efc2-478b-9eb3-2fab42f5a7a1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:41.284666 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:41.285880 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.286161 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.286435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.287152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:41.289082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.401836 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4466/8840] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:16:41 2021] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:16:41.406034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:41.416582 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ffa7d-a30f-40a0-91ac-8eb53e03e0db admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:41.469794 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:41.470459 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.470745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.471024 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.471723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:41.474164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.548206 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4375/8841] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:16:41 2021] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:16:41.552515 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:41.562969 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc3df6-72b8-4cb9-85dc-9087ad9f0904 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:41.567879 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:41.568527 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.568814 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.569133 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.569886 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:41.571476 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.581251 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4467/8842] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:16:41.585608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:41.595560 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c16f88-fec8-4b82-a211-94c78aba236a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:41.600863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4701b8-aaad-4576-addd-227cf86c2827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:41.601573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4701b8-aaad-4576-addd-227cf86c2827 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.601858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4701b8-aaad-4576-addd-227cf86c2827 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.602136 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4701b8-aaad-4576-addd-227cf86c2827 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.602861 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4701b8-aaad-4576-addd-227cf86c2827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:41.604428 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4701b8-aaad-4576-addd-227cf86c2827 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.614069 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4376/8843] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 25 22:16:41.618109 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:41.628097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7845baf-4eb7-4044-a6d2-edf1f0cef126 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:41.632797 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:41.633701 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.633984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.634262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] PATH_INFO: `/v3/projects/8aefbad38c734203b2719ed40e315a78/users/21adac3627a24f24b10c1c0023d80a69/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.650012 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aefbad38c734203b2719ed40e315a78, user_id=21adac3627a24f24b10c1c0023d80a69, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:41.652639 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.737145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4468/8844] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:16:41 2021] PUT /identity/v3/projects/8aefbad38c734203b2719ed40e315a78/users/21adac3627a24f24b10c1c0023d80a69/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 22:16:41.742771 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5423-23b2-438e-9a3b-70ef4380832d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.743065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5423-23b2-438e-9a3b-70ef4380832d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.743345 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5423-23b2-438e-9a3b-70ef4380832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.760828 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-5e5d5423-23b2-438e-9a3b-70ef4380832d None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:16:41.762050 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-5e5d5423-23b2-438e-9a3b-70ef4380832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:41.818960 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4377/8845] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:16:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:16:41.828810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:41.830525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:41.886544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346d5f5-f65b-40ac-a492-b7b6e0d61564 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:41.890204 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:41.890990 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:41.891272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:41.891542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:41.901073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:41.902562 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:41.911925 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4469/8846] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:16:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:16:47.322959 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa3b2-ef6f-47c3-9c58-c3b44a56447b None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:47.323949 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa3b2-ef6f-47c3-9c58-c3b44a56447b None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:47.324498 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa3b2-ef6f-47c3-9c58-c3b44a56447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:47.355347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-e92aa3b2-ef6f-47c3-9c58-c3b44a56447b None None] MFA Rules not processed for user `21adac3627a24f24b10c1c0023d80a69`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:16:47.356733 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-e92aa3b2-ef6f-47c3-9c58-c3b44a56447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:47.429304 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4378/8847] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:16:47 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 25 22:16:47.433638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:47.443712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed15d3-226f-4832-9533-9b16d9567d31 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:47.448303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:47.448975 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:47.449262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:47.449535 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:47.450223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:47.452101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:47.537938 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4470/8848] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:16:47 2021] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 22:16:47.541933 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aa3b2-ef6f-47c3-9c58-c3b44a56447b None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:47.553072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aa3b2-ef6f-47c3-9c58-c3b44a56447b None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:47.608211 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:47.608963 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:47.609252 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:47.609531 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:47.610593 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:47.612568 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:47.732615 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4379/8849] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:16:47 2021] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:16:47.736683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:47.746684 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15f0b-45b4-4dcc-8e5f-a7b26e9ba8e5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:47.751309 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:47.751960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:47.752243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:47.752542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:47.753979 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:47.755590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:47.766062 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4471/8850] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:16:47.770179 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:47.780049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d288125-ce2b-44b1-950b-59fa8656f6d4 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:47.784602 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:47.785540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:47.785818 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:47.786091 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] PATH_INFO: `/v3/projects/c27b6c0ab9fc476b89cce6d1d5e9d32d/users/032515af50044ab1ad8d3605073c612e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:47.801644 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27b6c0ab9fc476b89cce6d1d5e9d32d, user_id=032515af50044ab1ad8d3605073c612e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:47.804292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:47.869476 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4380/8851] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:16:47 2021] PUT /identity/v3/projects/c27b6c0ab9fc476b89cce6d1d5e9d32d/users/032515af50044ab1ad8d3605073c612e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:16:47.873458 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:47.884188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48d60-5520-4a23-812b-4ab407dbdbe5 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:47.940068 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607278b-66db-4d95-9916-317a889f5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:47.940729 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607278b-66db-4d95-9916-317a889f5f1b admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:47.941082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607278b-66db-4d95-9916-317a889f5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:47.941349 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607278b-66db-4d95-9916-317a889f5f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:47.942080 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607278b-66db-4d95-9916-317a889f5f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:47.943683 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607278b-66db-4d95-9916-317a889f5f1b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:47.953811 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4472/8852] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:16:47.957993 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:47.975786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1c2f0-4fc8-49c5-925c-78240c1de980 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:47.980523 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:47.981485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:47.981766 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:47.982042 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] PATH_INFO: `/v3/projects/c27b6c0ab9fc476b89cce6d1d5e9d32d/users/032515af50044ab1ad8d3605073c612e/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:47.984125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27b6c0ab9fc476b89cce6d1d5e9d32d, user_id=032515af50044ab1ad8d3605073c612e, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:47.986798 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:47.997688 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4381/8853] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:16:47 2021] PUT /identity/v3/projects/c27b6c0ab9fc476b89cce6d1d5e9d32d/users/032515af50044ab1ad8d3605073c612e/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:16:53.313923 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677104f-74e7-47c6-af5e-30f1f1062729 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:53.314445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677104f-74e7-47c6-af5e-30f1f1062729 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:53.314445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677104f-74e7-47c6-af5e-30f1f1062729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:53.353465 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6677104f-74e7-47c6-af5e-30f1f1062729 None None] MFA Rules not processed for user `032515af50044ab1ad8d3605073c612e`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:16:53.354699 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6677104f-74e7-47c6-af5e-30f1f1062729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:53.438925 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4473/8854] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:16:53 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:16:53.448735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:16:53.450532 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:53.527270 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480db3c-3c22-4fd3-ac8c-c63da64b5144 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:16:53.532817 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:16:53.533506 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:53.533795 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:53.534069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:53.593054 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:16:53.594713 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:16:53.604803 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4382/8855] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:16:53 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:16:56.697694 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:16:56.698145 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:16:56.698264 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:16:56.716613 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] MFA Rules not processed for user `21adac3627a24f24b10c1c0023d80a69`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:16:56.717829 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:16:56.725754 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4474/8856] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:16:56 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:17:01.179843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:17:01.194196 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a347ad-1912-412d-9a42-a50500b334fe service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:17:01.206493 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:17:01.207781 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:17:01.208124 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:17:01.208462 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:17:01.210348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:17:01.224567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:17:01.226218 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:17:01.237297 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4383/8857] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:17:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:17:09.440210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:17:09.441632 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:17:09.497193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a60a5-8db6-4d1c-bb05-9a0e895149f1 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:17:09.500766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:17:09.501427 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:17:09.501706 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:17:09.501980 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:17:09.511355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:17:09.512791 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:17:09.522657 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4475/8858] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:17:09 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:17:50.456650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:17:50.458056 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:17:50.567310 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d113-4782-43a5-ab8c-17302d33255c service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:17:50.573060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf899eb-1f95-424b-ae17-c5d314102994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:17:50.573697 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf899eb-1f95-424b-ae17-c5d314102994 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:17:50.573973 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf899eb-1f95-424b-ae17-c5d314102994 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:17:50.574241 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf899eb-1f95-424b-ae17-c5d314102994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:17:50.575970 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-bcf899eb-1f95-424b-ae17-c5d314102994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:17:50.587189 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf899eb-1f95-424b-ae17-c5d314102994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:17:50.588735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf899eb-1f95-424b-ae17-c5d314102994 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:17:50.598199 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4384/8859] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:17:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:18:50.687901 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:18:50.729856 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d4a5-2498-4204-91f5-40ae423e9019 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:18:50.735094 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:18:50.735766 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:18:50.736048 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:18:50.736323 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:18:50.738081 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:18:50.750087 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:18:50.751687 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:18:50.761534 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4476/8860] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:18:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:19:20.090084 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:20.090570 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:20.090657 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:20.150250 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:19:20.151485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:20.219344 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4385/8861] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:19:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:19:20.371930 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:19:20.373420 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:20.472842 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa23c-1e4c-4d9c-b71c-adf0982b05e3 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:19:20.478736 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:19:20.479052 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:20.479337 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:20.479604 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:20.489188 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:19:20.491182 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:19:20.500592 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4477/8862] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:19:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:19:22.272780 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:19:22.274314 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:22.297321 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e9606-082d-4c46-a79d-7175482fdd8d None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:19:22.304184 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee98b9-20af-41f0-a798-ccdbdb53d7ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:19:22.304854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee98b9-20af-41f0-a798-ccdbdb53d7ba service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:22.305173 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee98b9-20af-41f0-a798-ccdbdb53d7ba service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:22.305455 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee98b9-20af-41f0-a798-ccdbdb53d7ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:22.307418 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8cee98b9-20af-41f0-a798-ccdbdb53d7ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:22.323092 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee98b9-20af-41f0-a798-ccdbdb53d7ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:19:22.325373 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee98b9-20af-41f0-a798-ccdbdb53d7ba service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:19:22.342653 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4386/8863] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:19:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:19:34.883595 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:19:34.892679 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06585f-39f4-483e-a0d5-32fbe7c8151d service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:19:34.896192 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:19:34.896812 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:34.897124 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:34.897396 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:34.899120 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:34.921668 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:19:34.923006 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:19:34.930675 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4478/8864] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:19:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:19:35.220292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba911da-7354-467f-98fe-a2216e516da8 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:35.220845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba911da-7354-467f-98fe-a2216e516da8 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:35.220845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba911da-7354-467f-98fe-a2216e516da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:35.258049 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-dba911da-7354-467f-98fe-a2216e516da8 None None] MFA Rules not processed for user `79e05d879a534c6c890d4aea42c89975`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:19:35.259258 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-dba911da-7354-467f-98fe-a2216e516da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:35.268811 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4387/8865] 10.222.0.32 () {58 vars in 1018 bytes} [Sat Dec 25 22:19:35 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:19:35.282606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:19:35.284014 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:35.366303 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0d4d-41db-4337-b2fa-f8c1dd5c4d9a service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:19:35.369889 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a291-8796-428d-99d4-32559fd159be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:19:35.370553 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a291-8796-428d-99d4-32559fd159be service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:35.370813 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a291-8796-428d-99d4-32559fd159be service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:35.371084 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a291-8796-428d-99d4-32559fd159be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:35.381510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a291-8796-428d-99d4-32559fd159be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:19:35.382915 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a291-8796-428d-99d4-32559fd159be service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:19:35.393485 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4479/8866] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:19:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:19:35.578926 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba911da-7354-467f-98fe-a2216e516da8 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:19:35.588255 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba911da-7354-467f-98fe-a2216e516da8 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:19:35.592382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:19:35.593065 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:35.593347 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:35.593622 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:35.595367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:35.609499 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:19:35.611009 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:19:35.619377 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4388/8867] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:19:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:19:37.634128 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7cfd-73b9-49fd-8638-16713682553f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:37.635555 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7cfd-73b9-49fd-8638-16713682553f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:37.636097 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7cfd-73b9-49fd-8638-16713682553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:37.655308 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-1dbc7cfd-73b9-49fd-8638-16713682553f None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:19:37.656479 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1dbc7cfd-73b9-49fd-8638-16713682553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:37.663755 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4480/8868] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:19:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:19:37.676260 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:19:37.688382 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c837d9-8f70-4ab0-9f75-f8669871d3e5 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:19:37.693346 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:19:37.699287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:37.699287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:37.699287 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:37.703181 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:19:37.704783 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:19:37.713372 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4389/8869] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:19:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:19:53.730310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb56674-e87d-4313-8a41-1c4ba14c05f2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:53.730869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb56674-e87d-4313-8a41-1c4ba14c05f2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:53.730869 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb56674-e87d-4313-8a41-1c4ba14c05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:53.748356 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6eb56674-e87d-4313-8a41-1c4ba14c05f2 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:19:53.749574 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6eb56674-e87d-4313-8a41-1c4ba14c05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:19:53.757166 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4481/8870] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 22:19:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:19:53.771456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:19:53.782176 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b077f-98ff-413d-a365-60569ea13575 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:19:53.787307 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:19:53.791414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:19:53.791414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:19:53.791414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:19:53.796690 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:19:53.798858 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:19:53.806917 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4390/8871] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:19:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:20:58.165190 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb56674-e87d-4313-8a41-1c4ba14c05f2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:20:58.175220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb56674-e87d-4313-8a41-1c4ba14c05f2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:20:58.178960 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:20:58.179590 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:20:58.179865 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:20:58.180131 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:20:58.181895 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:20:58.190925 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:20:58.192332 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:20:58.199897 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4482/8872] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:20:58 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:21:07.145835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:21:07.168971 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e1597-ee21-4d90-bd85-6aae0c0204ab service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:21:07.176563 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:21:07.177521 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:21:07.178004 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:21:07.178485 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:21:07.180698 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:21:07.209831 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:21:07.211920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:21:07.223714 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4391/8873] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:21:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:21:07.526452 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:21:07.535544 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd38a4-29ac-46b5-952d-c6132242a198 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:21:07.539550 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f2da-48eb-4ca0-bcfe-fc40c3257ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:21:07.540203 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f2da-48eb-4ca0-bcfe-fc40c3257ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:21:07.540673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f2da-48eb-4ca0-bcfe-fc40c3257ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:21:07.540993 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f2da-48eb-4ca0-bcfe-fc40c3257ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:21:07.542830 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5102f2da-48eb-4ca0-bcfe-fc40c3257ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:21:07.558973 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f2da-48eb-4ca0-bcfe-fc40c3257ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:21:07.560431 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f2da-48eb-4ca0-bcfe-fc40c3257ea0 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:21:07.575038 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4483/8874] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:21:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:21:08.824003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:21:08.834194 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518271f-a4ad-4072-94af-ca8354da8081 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:21:08.838108 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:21:08.838756 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:21:08.839034 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:21:08.839492 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:21:08.841290 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:21:08.856577 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:21:08.858088 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:21:08.869130 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4392/8875] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:21:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:21:15.448243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:21:15.448731 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:21:15.448820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:21:15.469957 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] MFA Rules not processed for user `21adac3627a24f24b10c1c0023d80a69`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:21:15.471140 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:21:15.477992 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4484/8876] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:21:15 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:21:21.488017 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:21:21.501703 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e713-c8ea-4c44-b7e5-d80aef2118c8 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:21:21.507113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:21:21.507769 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:21:21.508047 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:21:21.508320 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:21:21.510317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:21:21.523938 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:21:21.525694 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:21:21.537441 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4393/8877] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:21:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:22:56.434213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:22:56.435622 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:22:56.464118 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0171cb-976e-4159-b97f-8c4abd60e7c7 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:22:56.469505 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:22:56.470147 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:22:56.470445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:22:56.470717 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:22:56.479210 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:22:56.480765 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:22:56.490254 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4485/8878] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:22:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:23:55.696352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:23:55.706966 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60cd56-83f5-4cb4-b912-82e498f24599 service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:23:55.712162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:23:55.712797 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:23:55.713125 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:23:55.713397 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:23:55.722522 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:23:55.724060 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:23:55.733798 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4394/8879] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:23:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:11.420900 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:11.433657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb48375-bec4-4032-b6c7-3903c659e073 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:11.439152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:11.439804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:11.440085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:11.440363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:11.448155 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:11.449999 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:11.458929 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4486/8880] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:11 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:15.894052 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:15.906095 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322795c0-bb79-4898-8dee-41879e0dbc2a service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:15.911674 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:15.912301 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:15.912580 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:15.912854 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:15.922317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:15.923863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:15.935640 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4395/8881] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:18.128270 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:18.138241 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87130025-c7f6-43c4-92d5-165c54dbcba7 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:18.141908 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:18.142539 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:18.142821 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:18.143101 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:18.205089 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:18.206523 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:18.215996 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4487/8882] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:25.572328 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:25.586708 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861b10-4bab-44e6-a5f0-d149a8fcff12 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:25.591244 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:25.592135 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:25.592412 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:25.592723 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] PATH_INFO: `/v3/users/21adac3627a24f24b10c1c0023d80a69` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:25.593920 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] RBAC: Authorizing `identity:delete_user(user_id=21adac3627a24f24b10c1c0023d80a69)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:25.595786 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:25.772999 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21adac3627a24f24b10c1c0023d80a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:25.779628 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21adac3627a24f24b10c1c0023d80a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:25.791729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21adac3627a24f24b10c1c0023d80a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:25.792406 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21adac3627a24f24b10c1c0023d80a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:25.793102 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21adac3627a24f24b10c1c0023d80a69'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:25.862935 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4396/8883] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:25:25 2021] DELETE /identity/v3/users/21adac3627a24f24b10c1c0023d80a69 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:25:26.107223 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:26.117909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0807b-38ac-427b-9d59-12a5ff03d4ed service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:26.173804 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:26.174659 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:26.174938 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:26.175213 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] PATH_INFO: `/v3/projects/8aefbad38c734203b2719ed40e315a78` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:26.176382 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aefbad38c734203b2719ed40e315a78)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:26.178310 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:26.299073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aefbad38c734203b2719ed40e315a78', 'request_id': 'req-8cb0e19d-e355-43b5-8c54-394baab51542'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.356793 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aefbad38c734203b2719ed40e315a78', 'request_id': 'req-8cb0e19d-e355-43b5-8c54-394baab51542'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.363152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aefbad38c734203b2719ed40e315a78', 'request_id': 'req-8cb0e19d-e355-43b5-8c54-394baab51542'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.373166 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] The token cache is being invalidate because project 8aefbad38c734203b2719ed40e315a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:25:26.373394 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.374030 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.375572 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4488/8884] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:25:26 2021] DELETE /identity/v3/projects/8aefbad38c734203b2719ed40e315a78 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:25:26.379538 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:26.380942 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:26.394670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74210d-3a59-4d45-b48d-3607eba2105d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:26.450083 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:26.450950 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:26.451232 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:26.451505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] PATH_INFO: `/v3/users/032515af50044ab1ad8d3605073c612e` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:26.452702 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032515af50044ab1ad8d3605073c612e)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:26.454684 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:26.632540 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032515af50044ab1ad8d3605073c612e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.639793 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032515af50044ab1ad8d3605073c612e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.651572 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032515af50044ab1ad8d3605073c612e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.652249 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032515af50044ab1ad8d3605073c612e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.652863 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-77f46877-6214-4fa7-858a-a03121b82c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032515af50044ab1ad8d3605073c612e'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:26.789485 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4397/8885] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:25:26 2021] DELETE /identity/v3/users/032515af50044ab1ad8d3605073c612e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:25:27.028243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:27.029764 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:27.044592 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0e19d-e355-43b5-8c54-394baab51542 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:27.101482 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:27.102504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.102784 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.103056 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] PATH_INFO: `/v3/projects/c27b6c0ab9fc476b89cce6d1d5e9d32d` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.104232 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27b6c0ab9fc476b89cce6d1d5e9d32d)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:27.106262 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:27.213984 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27b6c0ab9fc476b89cce6d1d5e9d32d', 'request_id': 'req-0b06e2ce-0670-4f43-9785-a77d9a2d757d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:27.323277 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27b6c0ab9fc476b89cce6d1d5e9d32d', 'request_id': 'req-0b06e2ce-0670-4f43-9785-a77d9a2d757d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:27.330258 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27b6c0ab9fc476b89cce6d1d5e9d32d', 'request_id': 'req-0b06e2ce-0670-4f43-9785-a77d9a2d757d'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:27.340243 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] The token cache is being invalidate because project c27b6c0ab9fc476b89cce6d1d5e9d32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96733) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:25:27.340534 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:27.341193 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-0b06e2ce-0670-4f43-9785-a77d9a2d757d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:25:27.342722 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4489/8886] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:25:27 2021] DELETE /identity/v3/projects/c27b6c0ab9fc476b89cce6d1d5e9d32d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:25:27.348747 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376b51-be6c-47d2-af60-6f53ad05e018 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.349068 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376b51-be6c-47d2-af60-6f53ad05e018 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.349348 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376b51-be6c-47d2-af60-6f53ad05e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.376924 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-4a376b51-be6c-47d2-af60-6f53ad05e018 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:25:27.378118 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-4a376b51-be6c-47d2-af60-6f53ad05e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:27.435964 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4398/8887] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:25:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:25:27.452061 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5646-abd6-4469-850d-62cfb08f167f None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.452355 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5646-abd6-4469-850d-62cfb08f167f None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.452658 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c5646-abd6-4469-850d-62cfb08f167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.470783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-fc1c5646-abd6-4469-850d-62cfb08f167f None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:25:27.472010 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-fc1c5646-abd6-4469-850d-62cfb08f167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:27.480231 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4490/8888] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:25:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:25:27.484378 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a376b51-be6c-47d2-af60-6f53ad05e018 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:27.494528 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a376b51-be6c-47d2-af60-6f53ad05e018 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:27.499086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:27.499727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.500010 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.500285 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.501069 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=96732) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 25 22:25:27.501391 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:27.502941 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:27.514764 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4399/8889] 10.222.0.32 () {58 vars in 1152 bytes} [Sat Dec 25 22:25:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 25 22:25:27.518753 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c5646-abd6-4469-850d-62cfb08f167f None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:27.527800 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c5646-abd6-4469-850d-62cfb08f167f None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:27.532422 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:27.533085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.533364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.533635 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.534326 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:27.536201 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:27.645035 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4491/8890] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:25:27 2021] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 22:25:27.649236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:27.660940 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9f51-a812-40fa-b0ef-0e19db2b4c2d admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:27.719154 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:27.719826 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.720231 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.720505 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.721390 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:27.723303 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:27.788185 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4400/8891] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:25:27 2021] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:25:27.793174 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:27.803363 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98299b-1832-4528-888d-e4566d656a3c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:27.808540 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:27.809231 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.809510 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.809782 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.810504 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:27.812113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:27.822774 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4492/8892] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:25:27.827226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:27.837311 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc513e0-d710-4b45-8234-adb040cff61a admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:27.842318 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ac9b5-8b1e-43b5-a71f-4207f68e8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:27.842992 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ac9b5-8b1e-43b5-a71f-4207f68e8fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.843325 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ac9b5-8b1e-43b5-a71f-4207f68e8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.843607 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ac9b5-8b1e-43b5-a71f-4207f68e8fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.844335 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ac9b5-8b1e-43b5-a71f-4207f68e8fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:27.846114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ac9b5-8b1e-43b5-a71f-4207f68e8fc0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:27.857790 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4401/8893] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:25:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:25:27.861852 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:27.872642 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8d0cb-2d28-44a7-9a89-50d87956e097 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:27.878050 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:27.878932 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:27.879212 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:27.879524 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] PATH_INFO: `/v3/projects/58660263f53e4173b07360be1b863c34/users/47a300ee498f4ef9974ed430de68c526/roles/cb697f13703f4bc19072e3c59c644481` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:27.894824 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58660263f53e4173b07360be1b863c34, user_id=47a300ee498f4ef9974ed430de68c526, role_id=cb697f13703f4bc19072e3c59c644481)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:27.897520 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:28.000118 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4493/8894] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:25:27 2021] PUT /identity/v3/projects/58660263f53e4173b07360be1b863c34/users/47a300ee498f4ef9974ed430de68c526/roles/cb697f13703f4bc19072e3c59c644481 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:25:28.005236 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e414-dc03-41b0-8ebb-32b1aad63ad3 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:28.005530 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e414-dc03-41b0-8ebb-32b1aad63ad3 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:28.005811 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189e414-dc03-41b0-8ebb-32b1aad63ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:28.023936 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-9189e414-dc03-41b0-8ebb-32b1aad63ad3 None None] MFA Rules not processed for user `85e4a70773484059927d734314165968`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:25:28.030082 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9189e414-dc03-41b0-8ebb-32b1aad63ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:28.084638 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4402/8895] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:25:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:25:28.097445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:28.099189 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:28.171351 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70bfeb-a463-4546-9f0b-c1b851a47e1b admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:28.175054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:28.175705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:28.175987 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:28.176261 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:28.186172 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:28.187602 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:28.197145 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4494/8896] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:33.545326 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec35e4-1643-441b-8da0-52ebc3b0f6bc None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:33.545832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec35e4-1643-441b-8da0-52ebc3b0f6bc None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:33.545832 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec35e4-1643-441b-8da0-52ebc3b0f6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:33.571726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-96ec35e4-1643-441b-8da0-52ebc3b0f6bc None None] MFA Rules not processed for user `47a300ee498f4ef9974ed430de68c526`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:25:33.572931 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-96ec35e4-1643-441b-8da0-52ebc3b0f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:33.636289 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4403/8897] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:25:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:25:33.640820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:33.652098 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c60b21-4c5b-4b73-8df4-cd17bd27bea9 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:33.656698 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:33.657373 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:33.657675 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:33.657949 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] PATH_INFO: `/v3/projects` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:33.658750 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:33.660650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:33.781853 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4495/8898] 10.222.0.32 () {60 vars in 1152 bytes} [Sat Dec 25 22:25:33 2021] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 25 22:25:33.785875 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec35e4-1643-441b-8da0-52ebc3b0f6bc None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:33.797414 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec35e4-1643-441b-8da0-52ebc3b0f6bc None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:33.856673 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:33.857456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:33.857734 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:33.858003 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] PATH_INFO: `/v3/users` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:33.858677 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:33.860567 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:34.005748 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4404/8899] 10.222.0.32 () {60 vars in 1143 bytes} [Sat Dec 25 22:25:33 2021] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 25 22:25:34.010681 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:34.021254 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7cfcf-4683-48d8-bda9-753294f79933 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:34.026918 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:34.027615 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:34.027898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:34.028178 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:34.028962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:34.030525 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:34.041560 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4496/8900] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:25:34 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:25:34.045885 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:34.056355 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d455088-52b0-449b-99f1-49bcc4ebdc43 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:34.061575 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:34.062554 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:34.062835 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:34.063100 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] PATH_INFO: `/v3/projects/8e66dcff1afc4b849b6a9f8dd7f3caaf/users/4fc189f9e1184279a526dbc485bcddaa/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:34.080132 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e66dcff1afc4b849b6a9f8dd7f3caaf, user_id=4fc189f9e1184279a526dbc485bcddaa, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:34.082894 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:34.177214 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4405/8901] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:25:34 2021] PUT /identity/v3/projects/8e66dcff1afc4b849b6a9f8dd7f3caaf/users/4fc189f9e1184279a526dbc485bcddaa/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:25:34.181398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:34.192412 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca35b55-a804-4e6e-8119-2fcab1aa7f63 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:34.253584 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d706259-5be6-457b-a255-c577ae0c367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:34.254268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706259-5be6-457b-a255-c577ae0c367f admin admin] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:34.254541 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706259-5be6-457b-a255-c577ae0c367f admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:34.254810 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706259-5be6-457b-a255-c577ae0c367f admin admin] PATH_INFO: `/v3/roles` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:34.255532 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706259-5be6-457b-a255-c577ae0c367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:34.257708 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d706259-5be6-457b-a255-c577ae0c367f admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:34.267587 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4497/8902] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 22:25:34 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 25 22:25:34.271803 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:34.283148 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182fe08-21a1-45c9-a383-b19c067ff14e admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:34.288145 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:34.289070 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:34.289358 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:34.289636 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] PATH_INFO: `/v3/projects/8e66dcff1afc4b849b6a9f8dd7f3caaf/users/4fc189f9e1184279a526dbc485bcddaa/roles/ea5f089fb3e14674bf5b72ebed6e787a` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:34.291695 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e66dcff1afc4b849b6a9f8dd7f3caaf, user_id=4fc189f9e1184279a526dbc485bcddaa, role_id=ea5f089fb3e14674bf5b72ebed6e787a)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:34.294293 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:34.305302 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4406/8903] 10.222.0.32 () {60 vars in 1482 bytes} [Sat Dec 25 22:25:34 2021] PUT /identity/v3/projects/8e66dcff1afc4b849b6a9f8dd7f3caaf/users/4fc189f9e1184279a526dbc485bcddaa/roles/ea5f089fb3e14674bf5b72ebed6e787a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 25 22:25:39.754268 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa22d4-1cf1-4497-9855-672dcc013a1e None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:39.754894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa22d4-1cf1-4497-9855-672dcc013a1e None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:39.754894 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa22d4-1cf1-4497-9855-672dcc013a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:39.786196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-a9aa22d4-1cf1-4497-9855-672dcc013a1e None None] MFA Rules not processed for user `4fc189f9e1184279a526dbc485bcddaa`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:25:39.787500 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-a9aa22d4-1cf1-4497-9855-672dcc013a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:39.863061 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4498/8904] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:25:39 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:25:39.875544 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:39.877377 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:39.964676 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972b5b-e0a6-4331-9f95-280d7c76bfc0 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:39.970503 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:39.971162 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:39.971446 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:39.971735 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:40.029261 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:40.031099 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:40.041120 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4407/8905] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:39 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:42.556462 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:42.557073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:42.557073 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:42.579873 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] MFA Rules not processed for user `47a300ee498f4ef9974ed430de68c526`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:25:42.581180 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:42.601290 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4499/8906] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:25:42 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:25:42.940845 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:42.942367 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:43.002405 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409c5a-5a4e-4418-a4f4-b1732e6ed8d8 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:43.006207 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:43.006929 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:43.007216 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:43.007496 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:43.009381 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:43.020256 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:43.021729 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:43.031042 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4408/8907] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:43.467506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:43.469835 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:43.560328 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825fc5c-2d33-4c51-a285-fb51a4bb46a9 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:43.565445 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:43.566085 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:43.566371 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:43.566650 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:43.568486 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:43.581017 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:43.582607 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:43.593264 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4500/8908] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:52.289164 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:52.291114 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:52.306742 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1813655-a7c5-4bba-8c69-cc4402dff26e service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:52.312134 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:52.312760 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:52.313072 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:52.320251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:52.320251 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:25:52.327460 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:52.329041 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:52.339634 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4409/8909] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:25:54.121290 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:25:54.130344 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3fc80-68fc-4f5e-ad8a-4130e2baebe2 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:25:54.134884 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:25:54.135506 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:25:54.135783 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:25:54.136054 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:25:54.144838 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:25:54.146313 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:25:54.155674 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4501/8910] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:25:54 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:26:04.168978 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:26:04.178399 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39acfc-f7e8-4004-8231-eee1bc01f5c6 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:26:04.182600 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac30e-9e29-4a39-9f39-71f7a7c9b84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:26:04.183229 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac30e-9e29-4a39-9f39-71f7a7c9b84f service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:26:04.183557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac30e-9e29-4a39-9f39-71f7a7c9b84f service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:26:04.183833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac30e-9e29-4a39-9f39-71f7a7c9b84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:26:04.185606 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-9c2ac30e-9e29-4a39-9f39-71f7a7c9b84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:26:04.194722 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac30e-9e29-4a39-9f39-71f7a7c9b84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:26:04.196122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac30e-9e29-4a39-9f39-71f7a7c9b84f service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:26:04.204087 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4410/8911] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:26:04 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:27:51.570368 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:27:51.571759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:27:51.644759 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd0a7-3622-4a23-a1e9-852a725d7cb3 service neutron] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:27:51.648489 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e4b61a62d24f6c9274c0f46d514656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:27:51.649167 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:27:51.649447 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:27:51.649721 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:27:51.651464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:27:51.664864 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:27:51.666312 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:27:51.677617 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4502/8912] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:27:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:27:56.116122 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:27:56.116603 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:27:56.116696 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:27:56.134423 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:27:56.135613 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:27:56.189504 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4411/8913] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:27:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:27:56.364542 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:27:56.365976 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:27:56.434065 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e62945-7d7d-4026-9824-4fa46d5d1fe9 service glance] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:27:56.439086 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1e401-71b8-4a53-a662-ae1df3ddc091 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:27:56.443665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e401-71b8-4a53-a662-ae1df3ddc091 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:27:56.443665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e401-71b8-4a53-a662-ae1df3ddc091 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:27:56.443665 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e401-71b8-4a53-a662-ae1df3ddc091 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:27:56.448536 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1e401-71b8-4a53-a662-ae1df3ddc091 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:27:56.450163 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1e401-71b8-4a53-a662-ae1df3ddc091 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:27:56.458358 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4503/8914] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:27:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:28:03.463385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:28:03.463385 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:03.480143 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144e91-b8cf-43ec-be07-003237a4f4cd None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:28:03.486163 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:28:03.486833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:03.487116 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:03.487487 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:03.489675 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:03.502080 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:28:03.503738 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:28:03.526729 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4412/8915] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:28:03 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:28:07.835837 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676875d-8d66-4fd6-988d-8dd164e74c99 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:07.836338 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676875d-8d66-4fd6-988d-8dd164e74c99 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:07.836432 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676875d-8d66-4fd6-988d-8dd164e74c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:07.854962 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-c676875d-8d66-4fd6-988d-8dd164e74c99 None None] MFA Rules not processed for user `47a300ee498f4ef9974ed430de68c526`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:28:07.856228 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-c676875d-8d66-4fd6-988d-8dd164e74c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:07.863107 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4504/8916] 10.222.0.32 () {58 vars in 957 bytes} [Sat Dec 25 22:28:07 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:28:08.173579 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:28:08.182683 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1141-d8f9-435a-aaf2-5acb1c8f08ac service placement] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:28:08.186954 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:28:08.187584 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:08.187869 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:08.188146 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:08.189965 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:08.199239 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:28:08.200647 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:28:08.208253 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4413/8917] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:28:08 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:28:08.666072 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676875d-8d66-4fd6-988d-8dd164e74c99 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:28:08.679403 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676875d-8d66-4fd6-988d-8dd164e74c99 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:28:08.684663 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ef0b2-55a5-4faa-858e-e80f88039979 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:28:08.685343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ef0b2-55a5-4faa-858e-e80f88039979 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:08.685624 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ef0b2-55a5-4faa-858e-e80f88039979 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:08.685902 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ef0b2-55a5-4faa-858e-e80f88039979 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:08.686000 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:28:08.687649 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-628ef0b2-55a5-4faa-858e-e80f88039979 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:08.694789 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b76fc-eb23-4a42-85cb-a1d25ee11a53 service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:28:08.698450 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:28:08.699152 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:08.699441 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:08.699720 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:08.700152 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ef0b2-55a5-4faa-858e-e80f88039979 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:28:08.701526 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:08.701767 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ef0b2-55a5-4faa-858e-e80f88039979 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:28:08.711776 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4505/8918] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:28:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:28:08.723025 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:28:08.724547 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:28:08.740074 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4414/8919] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:28:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:28:10.626110 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d146-b37e-41ed-b15f-b80bccb02362 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:10.626575 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d146-b37e-41ed-b15f-b80bccb02362 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:10.626781 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d146-b37e-41ed-b15f-b80bccb02362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:10.645451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-2553d146-b37e-41ed-b15f-b80bccb02362 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:28:10.646667 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2553d146-b37e-41ed-b15f-b80bccb02362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:10.654671 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4506/8920] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:28:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:28:10.668650 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:28:10.679716 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083b5ff-52d8-48e5-8aa8-8d7ce1d4e1ca service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:28:10.684635 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bd138-ee18-47ec-8b0a-ca2c5c65d514 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:28:10.685292 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd138-ee18-47ec-8b0a-ca2c5c65d514 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:10.685573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd138-ee18-47ec-8b0a-ca2c5c65d514 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:10.685846 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd138-ee18-47ec-8b0a-ca2c5c65d514 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:10.694317 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bd138-ee18-47ec-8b0a-ca2c5c65d514 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:28:10.695867 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bd138-ee18-47ec-8b0a-ca2c5c65d514 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:28:10.704372 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4415/8921] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:28:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:28:58.686501 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d146-b37e-41ed-b15f-b80bccb02362 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:28:58.728828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d146-b37e-41ed-b15f-b80bccb02362 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:28:58.733958 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:28:58.734591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:28:58.734898 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:28:58.735820 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:28:58.737628 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:28:58.748657 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:28:58.750274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:28:58.759920 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4507/8922] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:28:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:30:02.634761 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1648cb-1051-40c0-9d6a-eba99226f517 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:02.635304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1648cb-1051-40c0-9d6a-eba99226f517 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:02.635304 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1648cb-1051-40c0-9d6a-eba99226f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:02.694468 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-cd1648cb-1051-40c0-9d6a-eba99226f517 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:30:02.695670 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-cd1648cb-1051-40c0-9d6a-eba99226f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:30:02.711976 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4416/8923] 10.222.0.32 () {58 vars in 1009 bytes} [Sat Dec 25 22:30:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:30:02.752570 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:02.773186 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbc9a-b2a0-4d51-b7c1-2744d050d93b service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:02.778082 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:02.778714 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:02.778997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:02.779274 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:02.787703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:02.789306 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:02.797977 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4508/8924] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:30:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:30:13.600664 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf036c8-9146-4e29-9607-c21c7f65d773 None None] REQUEST_METHOD: `POST` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:13.601208 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf036c8-9146-4e29-9607-c21c7f65d773 None None] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:13.601352 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf036c8-9146-4e29-9607-c21c7f65d773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:13.619394 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.auth.core [None req-1bf036c8-9146-4e29-9607-c21c7f65d773 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96732) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:30:13.620587 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-1bf036c8-9146-4e29-9607-c21c7f65d773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:30:13.627713 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4417/8925] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 22:30:13 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:30:13.641448 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:13.652092 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c11d9b-b623-4aa7-8814-28b26fe76932 service swift] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:13.657802 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734f8fe-7c31-472a-b24f-0e66d9767412 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:13.658426 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734f8fe-7c31-472a-b24f-0e66d9767412 service swift] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:13.658705 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734f8fe-7c31-472a-b24f-0e66d9767412 service swift] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:13.658978 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734f8fe-7c31-472a-b24f-0e66d9767412 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:13.666848 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734f8fe-7c31-472a-b24f-0e66d9767412 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:13.668408 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734f8fe-7c31-472a-b24f-0e66d9767412 service swift] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:13.676274 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4509/8926] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:30:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:30:15.539353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf036c8-9146-4e29-9607-c21c7f65d773 None None] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:15.552556 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf036c8-9146-4e29-9607-c21c7f65d773 None None] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:15.559205 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:15.560372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:15.560372 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:15.560557 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:15.562327 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:30:15.576741 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:15.579053 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:15.590100 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4418/8927] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:30:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:30:19.628828 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b724b-a811-4093-9a00-961359c642c2 None None] REQUEST_METHOD: `POST` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:19.629291 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b724b-a811-4093-9a00-961359c642c2 None None] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:19.629418 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b724b-a811-4093-9a00-961359c642c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:19.647113 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.auth.core [None req-075b724b-a811-4093-9a00-961359c642c2 None None] MFA Rules not processed for user `23c0a773f0c542baaa1bd937a8412456`. Rule list: `[]` (Enabled: `True`). {{(pid=96733) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 25 22:30:19.648284 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-075b724b-a811-4093-9a00-961359c642c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:30:19.655504 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4510/8928] 10.222.0.32 () {58 vars in 967 bytes} [Sat Dec 25 22:30:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 25 22:30:19.668830 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:19.680172 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9d9d3-3926-468b-8b75-b97f2147a196 service nova] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:19.685062 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea4089e93f04fc5893b3e86954ead79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:19.685681 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:19.685958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:19.686226 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:19.694518 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:19.696086 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:19.705772 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4419/8929] 10.222.0.32 () {60 vars in 1384 bytes} [Sat Dec 25 22:30:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 25 22:30:21.790464 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b724b-a811-4093-9a00-961359c642c2 None None] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:21.804401 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b724b-a811-4093-9a00-961359c642c2 None None] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:21.811196 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e05d879a534c6c890d4aea42c89975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:21.813042 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:21.813393 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:21.813734 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:21.816135 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:30:21.829986 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:21.831606 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:21.845978 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4511/8930] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:30:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:30:27.755655 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:27.767059 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f00cd-468a-4db1-87e4-e90f8b87e536 service swift] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:27.771254 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '043f47597a6b4368afbad7be8a7f40b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:27.774353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:27.774353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:27.774353 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:27.846745 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:27.848183 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:27.868829 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4420/8931] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:30:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:30:33.565435 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:33.577104 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060c4fc-4270-472b-88e5-9644de49ef98 service nova] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:33.583451 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:33.584364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:33.584638 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:33.584941 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] PATH_INFO: `/v3/users/47a300ee498f4ef9974ed430de68c526` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:33.586151 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a300ee498f4ef9974ed430de68c526)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:33.588060 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:33.750591 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a300ee498f4ef9974ed430de68c526'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:33.759557 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a300ee498f4ef9974ed430de68c526'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:33.771343 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a300ee498f4ef9974ed430de68c526'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:33.772096 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a300ee498f4ef9974ed430de68c526'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:33.849235 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a300ee498f4ef9974ed430de68c526'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:33.855409 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4512/8932] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:30:33 2021] DELETE /identity/v3/users/47a300ee498f4ef9974ed430de68c526 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:30:34.097336 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:34.108608 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91d77d-80e8-4ac3-a511-cf807fd7213a service neutron] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:34.166061 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:34.166925 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:34.167209 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:34.167484 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] PATH_INFO: `/v3/projects/58660263f53e4173b07360be1b863c34` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:34.168785 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58660263f53e4173b07360be1b863c34)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:34.170727 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:34.285767 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58660263f53e4173b07360be1b863c34', 'request_id': 'req-979f6f2d-daf4-4964-98a9-b6004e52294f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.291744 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58660263f53e4173b07360be1b863c34', 'request_id': 'req-979f6f2d-daf4-4964-98a9-b6004e52294f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.353726 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58660263f53e4173b07360be1b863c34', 'request_id': 'req-979f6f2d-daf4-4964-98a9-b6004e52294f'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.376586 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] The token cache is being invalidate because project 58660263f53e4173b07360be1b863c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:30:34.376958 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.377590 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.379123 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4421/8933] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:30:34 2021] DELETE /identity/v3/projects/58660263f53e4173b07360be1b863c34 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:30:34.383171 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:34.384548 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:30:34.397538 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d76d7-6161-480a-813a-658d7672fe83 admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:34.452398 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:34.453364 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:34.453637 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:34.453905 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] PATH_INFO: `/v3/users/4fc189f9e1184279a526dbc485bcddaa` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:34.455103 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc189f9e1184279a526dbc485bcddaa)` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:34.457026 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:34.607314 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc189f9e1184279a526dbc485bcddaa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.614703 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc189f9e1184279a526dbc485bcddaa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.625867 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc189f9e1184279a526dbc485bcddaa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.626530 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc189f9e1184279a526dbc485bcddaa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.694272 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.notifications [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc189f9e1184279a526dbc485bcddaa'} {{(pid=96733) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:34.700384 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4513/8934] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 22:30:34 2021] DELETE /identity/v3/users/4fc189f9e1184279a526dbc485bcddaa => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:30:34.942895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:30:34.945927 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:30:34.957559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f6f2d-daf4-4964-98a9-b6004e52294f admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:30:35.014611 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e4a70773484059927d734314165968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b3685f056e42a38cb9ec18c9d20fa2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:30:35.015912 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:30:35.016280 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:30:35.016573 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] PATH_INFO: `/v3/projects/8e66dcff1afc4b849b6a9f8dd7f3caaf` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:30:35.017895 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e66dcff1afc4b849b6a9f8dd7f3caaf)` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:30:35.019833 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:30:35.151113 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e66dcff1afc4b849b6a9f8dd7f3caaf', 'request_id': 'req-a3d7df63-e714-4c5d-b605-cac310075321'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:35.157648 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e66dcff1afc4b849b6a9f8dd7f3caaf', 'request_id': 'req-a3d7df63-e714-4c5d-b605-cac310075321'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:35.222847 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e66dcff1afc4b849b6a9f8dd7f3caaf', 'request_id': 'req-a3d7df63-e714-4c5d-b605-cac310075321'} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:35.233177 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] The token cache is being invalidate because project 8e66dcff1afc4b849b6a9f8dd7f3caaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=96732) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 25 22:30:35.233456 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:35.234665 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.notifications [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=96732) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 25 22:30:35.236199 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4422/8935] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 22:30:34 2021] DELETE /identity/v3/projects/8e66dcff1afc4b849b6a9f8dd7f3caaf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 25 22:33:10.415074 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:33:10.416488 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:33:10.502909 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f53d-4477-4dae-8710-dce51147da5c admin admin] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:33:10.561997 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:33:10.562673 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:33:10.562951 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:33:10.563222 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:33:10.565146 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:33:10.576611 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:33:10.578220 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:33:10.587883 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4514/8936] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:33:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 25 22:34:03.651112 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Authenticating user token {{(pid=96732) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:34:03.652893 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:34:03.669843 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7df63-e714-4c5d-b605-cac310075321 admin admin] Validating token access rules against request {{(pid=96732) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:34:03.674792 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db0f29-1eb8-406a-9e3f-a6457dba0f6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96732) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:34:03.675430 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db0f29-1eb8-406a-9e3f-a6457dba0f6e service placement] REQUEST_METHOD: `GET` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:34:03.675714 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db0f29-1eb8-406a-9e3f-a6457dba0f6e service placement] SCRIPT_NAME: `/identity` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:34:03.675990 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db0f29-1eb8-406a-9e3f-a6457dba0f6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96732) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:34:03.677750 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.fernet_utils [None req-96db0f29-1eb8-406a-9e3f-a6457dba0f6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96732) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:34:03.689991 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db0f29-1eb8-406a-9e3f-a6457dba0f6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:34:03.691559 ncdv-master-1 devstack@keystone.service[96732]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db0f29-1eb8-406a-9e3f-a6457dba0f6e service placement] RBAC: Authorization granted {{(pid=96732) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:34:03.701322 ncdv-master-1 devstack@keystone.service[96732]: [pid: 96732|app: 0|req: 4423/8937] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:34:03 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 25 22:38:15.413410 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] Authenticating user token {{(pid=96733) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 25 22:38:15.414370 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.fernet_utils [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=96733) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 25 22:38:15.456833 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f46a5e-9108-4a0e-88fb-9ad121234b70 service placement] Validating token access rules against request {{(pid=96733) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 25 22:38:15.461931 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746a46e-3efe-49bd-ac74-3212a1739be4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79c9077ed07144bdb0149dd6be7d134a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8de2c022c7e473abd53e78670253e88', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96733) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 25 22:38:15.462573 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746a46e-3efe-49bd-ac74-3212a1739be4 service placement] REQUEST_METHOD: `GET` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 25 22:38:15.462855 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746a46e-3efe-49bd-ac74-3212a1739be4 service placement] SCRIPT_NAME: `/identity` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 25 22:38:15.463129 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746a46e-3efe-49bd-ac74-3212a1739be4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=96733) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 25 22:38:15.472076 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746a46e-3efe-49bd-ac74-3212a1739be4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 25 22:38:15.473712 ncdv-master-1 devstack@keystone.service[96733]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746a46e-3efe-49bd-ac74-3212a1739be4 service placement] RBAC: Authorization granted {{(pid=96733) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 25 22:38:15.483551 ncdv-master-1 devstack@keystone.service[96733]: [pid: 96733|app: 0|req: 4515/8938] 10.222.0.32 () {60 vars in 1365 bytes} [Sat Dec 25 22:38:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)